Hello, I have technical systems knowledge but I am very new to TrueNAS.
tl;dr Ran "sg_format -v -F /dev/sdX" on two HGST 8TB drives, neither drive is usable. Did I brick them?
Sequence of events are as follows
tl;dr Ran "sg_format -v -F /dev/sdX" on two HGST 8TB drives, neither drive is usable. Did I brick them?
Sequence of events are as follows
- I purchased some stupid cheap SAS HGST 8TB drives from ebay and loaded 10 into my R730xd
- Installed TrueNAS Core, and created a 2x5 mirrored vdev pool. Storage looks great so far.
- Discovered I really wanted TrueNAS scale and migrated to TrueNAS-SCALE-23.10.0.1
- Pool was still there but saw alerts like "Disk(s): sdc are formatted with Data Integrity Feature (DIF) which is unsupported." To whit
Code:root@truenas[~]# sg_format -v /dev/sdc HGST H7280A520SUN8.0T PD51 peripheral_type: disk [0x0] PROTECT=1 << supports protection information>> Unit serial number: 001528PKZ61V 2EGKZ61V LU name: 5000cca23b20aea0 mode sense(10) cdb: [5a 00 01 00 00 00 00 00 fc 00] Mode Sense (block descriptor) data, prior to changes: block count maxed out, set <<longlba>> mode sense(10) cdb: [5a 10 01 00 00 00 00 00 fc 00] <<< longlba flag set (64 bit lba) >>> Number of blocks=15362376264 [0x393ab4248] Block size=512 [0x200] read capacity(16) cdb: [9e 10 00 00 00 00 00 00 00 00 00 00 00 20 00 00] Read Capacity (16) results: Protection: prot_en=1, p_type=0, p_i_exponent=0 Logical block provisioning: lbpme=0, lbprz=0 Logical blocks per physical block exponent=3 Lowest aligned logical block address=0 Number of logical blocks=15362376264 Logical block size=512 bytes No changes made. To format use '--format'. To resize use '--resize'
- Didn't have any data in the pool yet so I deleted it and tried to re-created it... which didn't work. Menu refused to add any DIF enabled drives into a pool.
- Following a thread on this forum, I tried "sg_format -v -F /dev/sdX". The command is increadibly slow and probably got 0.5% in before the shell closed from auto-logout after 5min (that's on me)
- Now the disk is not reachable
- Tried the command again on a second disk, this time in tmux. Ran for several hours until crashing out at 17%. This drive is no longer reachable either.
- kernel log hot-inserting a normal drive
Code:[14438.715505] scsi 0:0:9:0: Direct-Access HGST H7280A520SUN8.0T PD51 PQ: 0 ANSI: 6 [14438.736341] sd 0:0:9:0: Attached scsi generic sg4 type 0 [14438.736794] sd 0:0:9:0: [sda] 15362376264 512-byte logical blocks: (7.87 TB/7.15 TiB) [14438.737306] sd 0:0:9:0: [sda] 4096-byte physical blocks [14438.738601] sd 0:0:9:0: [sda] Write Protect is off [14438.739247] sd 0:0:9:0: [sda] Mode Sense: f1 00 10 08 [14438.740596] sd 0:0:9:0: [sda] Write cache: disabled, read cache: enabled, supports DPO and FUA [14438.744946] sd 0:0:9:0: [sda] Disabling DIF Type 1 protection [14438.745526] sd 0:0:9:0: [sda] Enabling DIF Type 0 protection [14438.787668] sd 0:0:9:0: [sda] Attached SCSI disk
^ interesting that the kernel logs mention disabling DIF before attaching SCSI... - Hot either of the "bricked" drives
Code:[13724.585257] megaraid_sas 0000:03:00.0: 7117 (755665066s/0x0004/CRIT) - Enclosure PD 20(c None/p1) phy bad for slot 9 [13782.630654] megaraid_sas 0000:03:00.0: 7121 (755665124s/0x0002/FATAL) - Unable to access device PD 09(e0x20/s9)
- And right now zfs is only showing the boot pool (as I would expect)
- Code:
# zpool list NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT boot-pool 448G 4.69G 443G - 16G 0% 1% 1.00x ONLINE -