pc storage

I mainly use the harddisks in the PCs I run for storage of Hidef movies and TV series.

Current storage situation

Machine	Bruto*	Redundancy	Netto*	Disks
livingroom PC	3.5TB	single disk	3.5TB	500GB Crucial MX500 SSD, 1TB Crucial MX500, 1.05TB MX300 Crucial, 1TB Samsung EVO970 nvme
livingroom HTPC	256GB	single disk	256GB	256GB Crucial M4 SSD
NasPC	112TB	60GB Boot 14x4T RAIDZ2 14x4T RAIDZ2	96TB	60GB Intel 330 series, 14x4TB Seagate, 14x4TB Seagate
NasPC2	96TB	120GB Boot 12x8T RAIDZ2	80TB	120GB Intel 330, 12x8TB Seagate Constellation
LinuxPC	36TB	SSD 30G for boot SSD 60G share 12x3TB RAIDZ2 ZFS	30TB	128GB Crucial C300 SSD, 12x3TB Seagate
ServerPC	5TB	SSD 120G for boot SSD 5x 1TB RAIDZ1 ZFS	4TB	120GB Crucial M500 SSD, 5x1.05TB Crucial SSD
Atom Low power PC (11W)	256GB	1x30GB boot 226G	226GB	500GB Crucial BX100 SSD (220G unformatted)
old pc win7	2.7TB	single disk	2.5TB	256GB Crucial M4 SSD, 480GB Crucial M500, 1x 2TB Seagate
Total:	255TB	.	215TB	.

I store all data to ZFS on Linux since version 0.6.2. Recently ZFS on Linux (0.8.6) was integrated in OpenZFS 2.0 sharing sourcecode with FreeBSD and Illumos the opensource version of Solaris where ZFS was first developed under Sun Microsystems. The previous LVM raid 0 volumes have been moved to ZFS pools with RAIDZ1 or RAIDZ2.
RAIDZ1 is like RAID5 and can withstand 1 disk breaking. RAIDZ2 can withstand 2 disks breaking. But after disk failure recovery is only needed for the data, not the entire disk so it is much quicker than plain RAID5 or RAID6.
ZFS keeps checksums on all data to ensure data integrity at all times. For RAIDZ1 there is the space of 1 spare disk, for RAIDZ2 (like RAID6) the space of 2 spare disks is needed and used for CRC data and other ZFS overhead data. Besides that ZFS/RAIDZ takes about 5% of the volume size for additional overhead.
Currently the 10x2T are retired and the healthy ones were sold.
I have 12x3T in raidz2, integrated in my linux desktop PC.
In Nas1 there are 14x4T in RAIDZ2 plus another 14x4T in RAIDZ2. So 2 pools with 1 vdev each.
In Nas2 I have 12x8T in RAIDZ2.
The always on XeonD server has 5x 1TB SSD in RAIDZ1.
I keep separate pools in order to be able to swap them out to different PC's. I have removed the 10x2T because 2 disks were failing and 3 more were pending failure. No data was lost.
The main NAS PC has 8 onboard sata interfaces and 24 extra sata interfaces through a sas card, there are 24 regular bays (2x10 + one 4in3 bay) and I have stacked 1 seperate 4 drive bay inside the case. Currently 28 bays are in use. The free PCI-E 4x slot is now used for a 10Gbe Intel X520-DA1 network card with SFP+.
The second NAS PC has 14 onboard sata interfaces, 1x for boot 12x in use for the data disks, 1x free sata. It has a 10Gbe Intel X520-DA2 network card with SFP+. It is managed via IPMI (Supermicro).
The XeonD has 6 sata interfaces. 1x boot plus 5x data. It has onboard 10Gbe RJ45. It also has IPMI (Supermicro) for management.

Disk inventory ::
12x Seagate 8.0TB : ST8000NM0055 (7200 rpm) (sata3, 256MB)
27x Seagate 4.0TB : ST4000DM000 (5900 rpm) (sata3, 64MB)
1x Seagate 4.0TB : ST4000DM005 (5900 rpm) (sata3, 64MB)
12x Seagate 3.0TB : ST3000DM001 (7200 rpm) (sata3, 64MB) (1x broken)
1x Seagate 3.0TB : ST3000DM007 (5900 rpm) (20mm thin disk,SMR,256MB)
9x Seagate 2.0TB : ST2000DL003 (5900 rpm) (sata3, 64MB) (2x broken)
1x Seagate 2.0TB : ST2000DM001 (7200 rpm)
2x Seagate 2.0TB : ST32000542AS (5900 rpm)
2x WesternDigital 2.0TB : WD20EARS Caviar Green 2TB, 64MB (1x broken)
4x Samsung 1.5TB : HD154UI Green (5400 rpm)
4x Seagate 1.5TB : ST31500341AS
6x Samsung 1TB : HD103UJ
5x Samsung 750G : HD753LJ
4x Samsung 500G : HD501LJ
7x SSD : 60GB + 120GB Intel 330 , 128GB Crucial C300, 2x 256GB Crucial M4, 120GB + 480GB Crucial M500
9x SSD : 6x 1TB Crucial MX300, 500GB Crucial BX100, 1x 1TB Crucial MX500, 1x 1TB Samsung EVO970 nvme
3x SSD external : 2x Samung T5 500GB usb-c and 1x Samsung T5 1TB usb-c

This table shows Linux kernel versions and ZFS/SPL versions used currently :

ZFS version (git zfs)	kernel	SPL	ZFS	OS version
atom64	5.15.38	none	none	Slackware 15.0
riwilinux	5.15.38	2.1.14-1	2.1.14-1	Slackware 15.0
riwinas	5.15.19	2.1.15-1	2.1.15-1	Slackware 15.0
riwinas2	5.15.19	2.1.15-1	2.1.15-1	Slackware 15.0
riwixeon	5.15.63	2.1.14-1	2.1.14-1	Slackware 15.0

This table shows the storage usage per pool:

drive

total

used

free

graph bar

riwilinux:/pool3

26639G

21021G

5618G

79%

riwinas:/pool4

43973G

38133G

5841G

87%

riwinas:/pool5

43973G

26437G

17536G

60%

riwinas2:/pool8

70680G

33630G

37051G

48%

riwixeon:/pool0

3948G

2220G

1728G

56%

total

189213G

121441G

67774G

64%

This table shows the health of each individual disk as well as some statistics.

device	volume	diskmodel	serial	temp	hours	power on count	reported_uncorrect	current_pending_sector	offline_uncorrectable	reallocated_sector_count
riwilinux:/dev/sda	-none	C300-CTFDDAC128MAG	00000000104602FF3866	none	6697	1024	0	0	0	2048
riwilinux:/dev/sdb	zfs-pool3	ST3000DM001-1CH166	Z1F1PTZ7	35 C	6385	1318	0	0	0	0
riwilinux:/dev/sdc	zfs-pool3	ST3000DM001-1CH166	Z1F31RN5	35 C	5502	1118	0	0	0	0
riwilinux:/dev/sdd	zfs-pool3	ST3000DM007-1WY10G	ZFN35WNB	37 C	265	81	0	0	0	0
riwilinux:/dev/sde	zfs-pool3	ST3000DM001-1CH166	Z1F1P72Z	35 C	6395	1326	0	0	0	0
riwilinux:/dev/sdf	zfs-pool3	ST3000DM001-1CH166	Z1F1PR6B	35 C	6395	1319	0	0	0	0
riwilinux:/dev/sdg	zfs-pool3	ST3000DM001-1CH166	Z1F1NLX9	36 C	6386	1320	0	0	0	0
riwilinux:/dev/sdh	zfs-pool3	ST3000DM001-1CH166	Z1F1QAT8	36 C	6391	1321	0	0	0	0
riwilinux:/dev/sdi	zfs-pool3	ST3000DM001-1CH166	Z1F1MLHG	36 C	6393	1318	0	0	0	0
riwilinux:/dev/sdj	zfs-pool3	ST3000DM001-1CH166	W1F39TEE	34 C	4595	955	0	0	0	0
riwilinux:/dev/sdk	zfs-pool3	ST3000DM001-1CH166	W1F39TEB	36 C	4586	953	0	0	0	0
riwilinux:/dev/sdl	zfs-pool3	ST3000DM001-1ER166	Z501H1Q7	35 C	1458	369	1	0	0	8
riwilinux:/dev/sdm	zfs-pool3	ST3000DM001-1ER166	Z501KWLN	35 C	1467	365	0	0	0	0
device	volume	diskmodel	serial	temp	hours	power on count	reported_uncorrect	current_pending_sector	offline_uncorrectable	reallocated_sector_count
riwinas:/dev/sda	-none	INTEL SSDSC2CT060A3	CVMP215605Q1060AGN	none	12605	1807	0	0	0	0
riwinas:/dev/sdaa	zfs-pool5	ST4000DM000-1F2168	Z300V3KX	31 C	4491	812	0	0	0	0
riwinas:/dev/sdab	zfs-pool5	ST4000DM000-1F2168	Z3013WLW	31 C	4573	812	0	0	0	0
riwinas:/dev/sdac	zfs-pool4	ST4000DM000-1F2168	Z300K11N	32 C	7938	1548	0	0	0	0
riwinas:/dev/sdb	zfs-pool4	ST4000DM000-1F2168	Z301GP5Q	29 C	3955	807	0	0	0	0
riwinas:/dev/sdc	zfs-pool4	ST4000DM000-1F2168	Z301GE5S	29 C	3956	807	0	0	0	0
riwinas:/dev/sdd	zfs-pool4	ST4000DM000-1F2168	Z304WYTA	29 C	44	793	0	0	0	0
riwinas:/dev/sde	zfs-pool4	ST4000DM000-1F2168	Z303Y4ZP	29 C	44	790	0	0	0	0
riwinas:/dev/sdf	zfs-pool4	ST4000DM000-1F2168	Z300K08K	32 C	7953	1548	0	0	0	0
riwinas:/dev/sdg	zfs-pool5	ST4000DM000-1F2168	Z3013VNL	31 C	4544	810	0	0	0	0
riwinas:/dev/sdh	zfs-pool5	ST4000DM000-1F2168	Z300V3G1	30 C	4583	811	0	0	0	0
riwinas:/dev/sdi	zfs-pool5	ST4000DM000-1F2168	Z30146PF	31 C	4539	814	0	0	0	0
riwinas:/dev/sdj	zfs-pool4	ST4000DM000-1F2168	Z300MC1Z	32 C	7945	1548	0	0	0	0
riwinas:/dev/sdk	zfs-pool4	ST4000DM000-1F2168	Z300MB1C	32 C	7942	1548	0	0	0	0
riwinas:/dev/sdl	zfs-pool4	ST4000DM000-1F2168	Z300MB1L	32 C	7947	1548	0	0	0	0
riwinas:/dev/sdm	zfs-pool4	ST4000DM000-1F2168	Z300K0PQ	32 C	7947	1548	0	0	0	0
riwinas:/dev/sdn	zfs-pool5	ST4000DM000-1F2168	Z301GNNK	30 C	4092	742	0	0	0	0
riwinas:/dev/sdo	zfs-pool5	ST4000DM000-1F2168	Z301GDD3	30 C	4092	742	0	0	0	0
riwinas:/dev/sdp	zfs-pool5	ST4000DM000-1F2168	Z301GRFN	30 C	4093	742	0	0	0	0
riwinas:/dev/sdq	zfs-pool5	ST4000DM005-2DP166	ZDH1BGYF	29 C	2724	522	0	0	0	0
riwinas:/dev/sdr	zfs-pool4	ST4000DM000-1F2168	Z30156CH	32 C	6799	1344	0	0	0	0
riwinas:/dev/sds	zfs-pool4	ST4000DM000-1F2168	Z30147QZ	33 C	6801	1344	0	0	0	0
riwinas:/dev/sdt	zfs-pool4	ST4000DM000-1F2168	W300BMH0	32 C	7646	1484	0	0	0	0
riwinas:/dev/sdu	zfs-pool4	ST4000DM000-1F2168	W300G8KQ	31 C	7647	1484	0	0	0	0
riwinas:/dev/sdv	zfs-pool5	ST4000DM000-1F2168	Z3013VLC	31 C	4546	811	0	0	0	0
riwinas:/dev/sdw	zfs-pool5	ST4000DM000-1F2168	Z3013W9T	31 C	4545	812	0	0	0	0
riwinas:/dev/sdx	zfs-pool5	ST4000DM000-1F2168	Z3013YJL	31 C	4542	812	0	0	0	0
riwinas:/dev/sdy	zfs-pool5	ST4000DM000-1F2168	Z3013XE4	32 C	4497	812	0	0	0	0
riwinas:/dev/sdz	zfs-pool5	ST4000DM000-1F2168	Z300V342	31 C	4580	812	0	0	0	0
device	volume	diskmodel	serial	temp	hours	power on count	reported_uncorrect	current_pending_sector	offline_uncorrectable	reallocated_sector_count
riwinas2:/dev/sda	-none	INTEL SSDSC2CT120A3	CVMP2152038G120BGN	none	20017	486	0	0	0	0
riwinas2:/dev/sdb	zfs-pool8	ST8000NM0055-1RM112	ZA174S1D	38 C	810	219	0	0	0	0
riwinas2:/dev/sdc	zfs-pool8	ST8000NM0055-1RM112	ZA16ZH1W	35 C	840	219	0	0	0	0
riwinas2:/dev/sdd	zfs-pool8	ST8000NM0055-1RM112	ZA174RC1	36 C	853	219	0	0	0	0
riwinas2:/dev/sde	zfs-pool8	ST8000NM0055-1RM112	ZA16ZE7L	37 C	839	219	0	0	0	0
riwinas2:/dev/sdf	zfs-pool8	ST8000NM0055-1RM112	ZA174RLC	37 C	839	219	0	0	0	0
riwinas2:/dev/sdg	zfs-pool8	ST8000NM0055-1RM112	ZA174RMR	38 C	692	269	0	0	0	0
riwinas2:/dev/sdh	zfs-pool8	ST8000NM0055-1RM112	ZA174RV2	38 C	697	219	0	0	0	0
riwinas2:/dev/sdi	zfs-pool8	ST8000NM0055-1RM112	ZA16ZRXH	37 C	682	265	0	0	0	0
riwinas2:/dev/sdj	zfs-pool8	ST8000NM0055-1RM112	ZA174RDB	43 C	695	275	0	0	0	0
riwinas2:/dev/sdk	zfs-pool8	ST8000NM0055-1RM112	ZA15H4W8	37 C	696	219	0	0	0	0
riwinas2:/dev/sdl	zfs-pool8	ST8000NM0055-1RM112	ZA174RE6	38 C	687	268	0	0	0	0
riwinas2:/dev/sdm	zfs-pool8	ST8000NM0055-1RM112	ZA174SDG	37 C	688	219	0	0	0	0
device	volume	diskmodel	serial	temp	hours	power on count	reported_uncorrect	current_pending_sector	offline_uncorrectable	reallocated_sector_count
riwixeon:/dev/sda	-none	Crucial_CT120M500SSD1	1308092BD91E	39 C	74606	75	0	0	0	0
riwixeon:/dev/sdb	zfs-pool0	Crucial_CT1050MX300SSD1	163813FCCF24	41 C	67161	27	0	0	0	1
riwixeon:/dev/sdc	zfs-pool0	Crucial_CT1050MX300SSD1	163813FCD7FE	40 C	67162	27	0	0	0	0
riwixeon:/dev/sdd	zfs-pool0	Crucial_CT1050MX300SSD1	1631137A4205	38 C	65709	28	0	0	0	0
riwixeon:/dev/sde	zfs-pool0	Crucial_CT1050MX300SSD1	1631137A1D38	38 C	65750	27	0	0	0	1
riwixeon:/dev/sdf	zfs-pool0	Crucial_CT1050MX300SSD1	163813FCCD4D	39 C	66446	28	0	0	0	0
device	volume	diskmodel	serial	temp	hours	power on count	reported_uncorrect	current_pending_sector	offline_uncorrectable	reallocated_sector_count
atom64:/dev/sda	-none	CT500BX100SSD1	1449F000999E	34 C	1748	26	0	0	0	0