pc storage

I mainly use the harddisks in the PCs I run for storage of Hidef movies and TV series.

Current storage situation

Machine	Bruto*	Redundancy	Netto*	Disks
livingroom PC	3.5TB	single disk	3.5TB	500GB Crucial MX500 SSD, 1TB Crucial MX500, 1.05TB MX300 Crucial, 1TB Samsung EVO970 nvme
livingroom HTPC	256GB	single disk	256GB	256GB Crucial M4 SSD
NasPC	112TB	60GB Boot 14x4T RAIDZ2 14x4T RAIDZ2	96TB	60GB Intel 330 series, 14x4TB Seagate, 14x4TB Seagate
NasPC2	96TB	120GB Boot 12x8T RAIDZ2	80TB	120GB Intel 330, 12x8TB Seagate Constellation
LinuxPC	36TB	SSD 30G for boot SSD 60G share 12x3TB RAIDZ2 ZFS	30TB	128GB Crucial C300 SSD, 12x3TB Seagate
ServerPC	5TB	SSD 120G for boot SSD 5x 1TB RAIDZ1 ZFS	4TB	120GB Crucial M500 SSD, 5x1.05TB Crucial SSD
Atom Low power PC (11W)	256GB	1x30GB boot 226G	226GB	500GB Crucial BX100 SSD (220G unformatted)
old pc win7	2.7TB	single disk	2.5TB	256GB Crucial M4 SSD, 480GB Crucial M500, 1x 2TB Seagate
Total:	255TB	.	215TB	.

I store all data to ZFS on Linux since version 0.6.2. Recently ZFS on Linux (0.8.6) was integrated in OpenZFS 2.0 sharing sourcecode with FreeBSD and Illumos the opensource version of Solaris where ZFS was first developed under Sun Microsystems. The previous LVM raid 0 volumes have been moved to ZFS pools with RAIDZ1 or RAIDZ2.
RAIDZ1 is like RAID5 and can withstand 1 disk breaking. RAIDZ2 can withstand 2 disks breaking. But after disk failure recovery is only needed for the data, not the entire disk so it is much quicker than plain RAID5 or RAID6.
ZFS keeps checksums on all data to ensure data integrity at all times. For RAIDZ1 there is the space of 1 spare disk, for RAIDZ2 (like RAID6) the space of 2 spare disks is needed and used for CRC data and other ZFS overhead data. Besides that ZFS/RAIDZ takes about 5% of the volume size for additional overhead.
Currently the 10x2T are retired and the healthy ones were sold.
I have 12x3T in raidz2, integrated in my linux desktop PC.
In Nas1 there are 14x4T in RAIDZ2 plus another 14x4T in RAIDZ2. So 2 pools with 1 vdev each.
In Nas2 I have 12x8T in RAIDZ2.
The always on XeonD server has 5x 1TB SSD in RAIDZ1.
I keep separate pools in order to be able to swap them out to different PC's. I have removed the 10x2T because 2 disks were failing and 3 more were pending failure. No data was lost.
The main NAS PC has 8 onboard sata interfaces and 24 extra sata interfaces through a sas card, there are 24 regular bays (2x10 + one 4in3 bay) and I have stacked 1 seperate 4 drive bay inside the case. Currently 28 bays are in use. The free PCI-E 4x slot is now used for a 10Gbe Intel X520-DA1 network card with SFP+.
The second NAS PC has 14 onboard sata interfaces, 1x for boot 12x in use for the data disks, 1x free sata. It has a 10Gbe Intel X520-DA2 network card with SFP+. It is managed via IPMI (Supermicro).
The XeonD has 6 sata interfaces. 1x boot plus 5x data. It has onboard 10Gbe RJ45. It also has IPMI (Supermicro) for management.

Disk inventory ::
12x Seagate 8.0TB : ST8000NM0055 (7200 rpm) (sata3, 256MB)
27x Seagate 4.0TB : ST4000DM000 (5900 rpm) (sata3, 64MB)
1x Seagate 4.0TB : ST4000DM005 (5900 rpm) (sata3, 64MB)
12x Seagate 3.0TB : ST3000DM001 (7200 rpm) (sata3, 64MB) (1x broken)
1x Seagate 3.0TB : ST3000DM007 (5900 rpm) (20mm thin disk,SMR,256MB)
9x Seagate 2.0TB : ST2000DL003 (5900 rpm) (sata3, 64MB) (2x broken)
1x Seagate 2.0TB : ST2000DM001 (7200 rpm)
2x Seagate 2.0TB : ST32000542AS (5900 rpm)
2x WesternDigital 2.0TB : WD20EARS Caviar Green 2TB, 64MB (1x broken)
4x Samsung 1.5TB : HD154UI Green (5400 rpm)
4x Seagate 1.5TB : ST31500341AS
6x Samsung 1TB : HD103UJ
5x Samsung 750G : HD753LJ
4x Samsung 500G : HD501LJ
7x SSD : 60GB + 120GB Intel 330 , 128GB Crucial C300, 2x 256GB Crucial M4, 120GB + 480GB Crucial M500
9x SSD : 6x 1TB Crucial MX300, 500GB Crucial BX100, 1x 1TB Crucial MX500, 1x 1TB Samsung EVO970 nvme
3x SSD external : 2x Samung T5 500GB usb-c and 1x Samsung T5 1TB usb-c

This table shows Linux kernel versions and ZFS/SPL versions used currently :

ZFS version (git zfs)	kernel	SPL	ZFS	OS version
atom64	5.15.38	none	none	Slackware 15.0
riwilinux	5.15.38	2.1.14-1	2.1.14-1	Slackware 15.0
riwinas	5.15.19	2.1.15-1	2.1.15-1	Slackware 15.0
riwinas2	5.15.19	2.1.15-1	2.1.15-1	Slackware 15.0
riwixeon	5.15.63	2.1.14-1	2.1.14-1	Slackware 15.0

This table shows the storage usage per pool:

drive

total

used

free

graph bar

riwilinux:/pool3

26639G

21021G

5618G

79%

riwinas:/pool4

43973G

37683G

6290G

86%

riwinas:/pool5

43973G

25638G

18335G

58%

riwinas2:/pool8

70680G

33249G

37431G

47%

riwixeon:/pool0

3948G

2961G

987G

75%

total

189213G

120552G

68661G

64%

This table shows the health of each individual disk as well as some statistics.

device	volume	diskmodel	serial	temp	hours	power on count	reported_uncorrect	current_pending_sector	offline_uncorrectable	reallocated_sector_count
riwilinux:/dev/sda	-none	C300-CTFDDAC128MAG	00000000104602FF3866	none	6697	1024	0	0	0	2048
riwilinux:/dev/sdb	zfs-pool3	ST3000DM001-1CH166	Z1F1PTZ7	35 C	6385	1318	0	0	0	0
riwilinux:/dev/sdc	zfs-pool3	ST3000DM001-1CH166	Z1F31RN5	35 C	5502	1118	0	0	0	0
riwilinux:/dev/sdd	zfs-pool3	ST3000DM007-1WY10G	ZFN35WNB	37 C	265	81	0	0	0	0
riwilinux:/dev/sde	zfs-pool3	ST3000DM001-1CH166	Z1F1P72Z	35 C	6395	1326	0	0	0	0
riwilinux:/dev/sdf	zfs-pool3	ST3000DM001-1CH166	Z1F1PR6B	35 C	6395	1319	0	0	0	0
riwilinux:/dev/sdg	zfs-pool3	ST3000DM001-1CH166	Z1F1NLX9	36 C	6386	1320	0	0	0	0
riwilinux:/dev/sdh	zfs-pool3	ST3000DM001-1CH166	Z1F1QAT8	36 C	6391	1321	0	0	0	0
riwilinux:/dev/sdi	zfs-pool3	ST3000DM001-1CH166	Z1F1MLHG	36 C	6393	1318	0	0	0	0
riwilinux:/dev/sdj	zfs-pool3	ST3000DM001-1CH166	W1F39TEE	34 C	4595	955	0	0	0	0
riwilinux:/dev/sdk	zfs-pool3	ST3000DM001-1CH166	W1F39TEB	36 C	4586	953	0	0	0	0
riwilinux:/dev/sdl	zfs-pool3	ST3000DM001-1ER166	Z501H1Q7	35 C	1458	369	1	0	0	8
riwilinux:/dev/sdm	zfs-pool3	ST3000DM001-1ER166	Z501KWLN	35 C	1467	365	0	0	0	0
device	volume	diskmodel	serial	temp	hours	power on count	reported_uncorrect	current_pending_sector	offline_uncorrectable	reallocated_sector_count
riwinas:/dev/sda	-none	INTEL SSDSC2CT060A3	CVMP215605Q1060AGN	none	12587	1804	0	0	0	0
riwinas:/dev/sdaa	zfs-pool5	ST4000DM000-1F2168	Z300V3KX	24 C	4473	809	0	0	0	0
riwinas:/dev/sdab	zfs-pool5	ST4000DM000-1F2168	Z3013WLW	25 C	4555	809	0	0	0	0
riwinas:/dev/sdac	zfs-pool4	ST4000DM000-1F2168	Z300K11N	26 C	7920	1545	0	0	0	0
riwinas:/dev/sdb	zfs-pool4	ST4000DM000-1F2168	Z301GP5Q	24 C	3937	804	0	0	0	0
riwinas:/dev/sdc	zfs-pool4	ST4000DM000-1F2168	Z301GE5S	23 C	3938	804	0	0	0	0
riwinas:/dev/sdd	zfs-pool4	ST4000DM000-1F2168	Z304WYTA	23 C	26	790	0	0	0	0
riwinas:/dev/sde	zfs-pool4	ST4000DM000-1F2168	Z303Y4ZP	23 C	26	787	0	0	0	0
riwinas:/dev/sdf	zfs-pool4	ST4000DM000-1F2168	Z300K08K	26 C	7935	1545	0	0	0	0
riwinas:/dev/sdg	zfs-pool5	ST4000DM000-1F2168	Z3013VNL	25 C	4525	807	0	0	0	0
riwinas:/dev/sdh	zfs-pool5	ST4000DM000-1F2168	Z300V3G1	24 C	4565	808	0	0	0	0
riwinas:/dev/sdi	zfs-pool5	ST4000DM000-1F2168	Z30146PF	24 C	4521	811	0	0	0	0
riwinas:/dev/sdj	zfs-pool4	ST4000DM000-1F2168	Z300MC1Z	26 C	7926	1545	0	0	0	0
riwinas:/dev/sdk	zfs-pool4	ST4000DM000-1F2168	Z300MB1C	26 C	7924	1545	0	0	0	0
riwinas:/dev/sdl	zfs-pool4	ST4000DM000-1F2168	Z300MB1L	25 C	7929	1545	0	0	0	0
riwinas:/dev/sdm	zfs-pool4	ST4000DM000-1F2168	Z300K0PQ	25 C	7929	1545	0	0	0	0
riwinas:/dev/sdn	zfs-pool5	ST4000DM000-1F2168	Z301GNNK	24 C	4073	739	0	0	0	0
riwinas:/dev/sdo	zfs-pool5	ST4000DM000-1F2168	Z301GDD3	24 C	4073	739	0	0	0	0
riwinas:/dev/sdp	zfs-pool5	ST4000DM000-1F2168	Z301GRFN	24 C	4075	739	0	0	0	0
riwinas:/dev/sdq	zfs-pool5	ST4000DM005-2DP166	ZDH1BGYF	23 C	2706	519	0	0	0	0
riwinas:/dev/sdr	zfs-pool4	ST4000DM000-1F2168	Z30156CH	25 C	6781	1341	0	0	0	0
riwinas:/dev/sds	zfs-pool4	ST4000DM000-1F2168	Z30147QZ	26 C	6782	1341	0	0	0	0
riwinas:/dev/sdt	zfs-pool4	ST4000DM000-1F2168	W300BMH0	26 C	7627	1481	0	0	0	0
riwinas:/dev/sdu	zfs-pool4	ST4000DM000-1F2168	W300G8KQ	25 C	7629	1481	0	0	0	0
riwinas:/dev/sdv	zfs-pool5	ST4000DM000-1F2168	Z3013VLC	25 C	4527	808	0	0	0	0
riwinas:/dev/sdw	zfs-pool5	ST4000DM000-1F2168	Z3013W9T	25 C	4527	809	0	0	0	0
riwinas:/dev/sdx	zfs-pool5	ST4000DM000-1F2168	Z3013YJL	25 C	4524	809	0	0	0	0
riwinas:/dev/sdy	zfs-pool5	ST4000DM000-1F2168	Z3013XE4	25 C	4479	809	0	0	0	0
riwinas:/dev/sdz	zfs-pool5	ST4000DM000-1F2168	Z300V342	24 C	4562	809	0	0	0	0
device	volume	diskmodel	serial	temp	hours	power on count	reported_uncorrect	current_pending_sector	offline_uncorrectable	reallocated_sector_count
riwinas2:/dev/sda	-none	INTEL SSDSC2CT120A3	CVMP2152038G120BGN	none	20008	483	0	0	0	0
riwinas2:/dev/sdb	zfs-pool8	ST8000NM0055-1RM112	ZA174S1D	32 C	804	216	0	0	0	0
riwinas2:/dev/sdc	zfs-pool8	ST8000NM0055-1RM112	ZA16ZH1W	33 C	834	216	0	0	0	0
riwinas2:/dev/sdd	zfs-pool8	ST8000NM0055-1RM112	ZA174RC1	33 C	847	216	0	0	0	0
riwinas2:/dev/sde	zfs-pool8	ST8000NM0055-1RM112	ZA16ZE7L	34 C	833	216	0	0	0	0
riwinas2:/dev/sdf	zfs-pool8	ST8000NM0055-1RM112	ZA174RLC	35 C	833	216	0	0	0	0
riwinas2:/dev/sdg	zfs-pool8	ST8000NM0055-1RM112	ZA174RMR	35 C	687	266	0	0	0	0
riwinas2:/dev/sdh	zfs-pool8	ST8000NM0055-1RM112	ZA174RV2	35 C	691	216	0	0	0	0
riwinas2:/dev/sdi	zfs-pool8	ST8000NM0055-1RM112	ZA16ZRXH	34 C	677	262	0	0	0	0
riwinas2:/dev/sdj	zfs-pool8	ST8000NM0055-1RM112	ZA174RDB	33 C	689	272	0	0	0	0
riwinas2:/dev/sdk	zfs-pool8	ST8000NM0055-1RM112	ZA15H4W8	35 C	691	216	0	0	0	0
riwinas2:/dev/sdl	zfs-pool8	ST8000NM0055-1RM112	ZA174RE6	34 C	681	265	0	0	0	0
riwinas2:/dev/sdm	zfs-pool8	ST8000NM0055-1RM112	ZA174SDG	34 C	683	216	0	0	0	0
device	volume	diskmodel	serial	temp	hours	power on count	reported_uncorrect	current_pending_sector	offline_uncorrectable	reallocated_sector_count
riwixeon:/dev/sda	-none	Crucial_CT120M500SSD1	1308092BD91E	31 C	71535	73	0	0	0	0
riwixeon:/dev/sdb	zfs-pool0	Crucial_CT1050MX300SSD1	163813FCCF24	35 C	64189	25	0	0	0	1
riwixeon:/dev/sdc	zfs-pool0	Crucial_CT1050MX300SSD1	163813FCD7FE	34 C	64190	25	0	0	0	0
riwixeon:/dev/sdd	zfs-pool0	Crucial_CT1050MX300SSD1	1631137A4205	33 C	62634	26	0	0	0	0
riwixeon:/dev/sde	zfs-pool0	Crucial_CT1050MX300SSD1	1631137A1D38	32 C	63474	24	0	0	0	1
riwixeon:/dev/sdf	zfs-pool0	Crucial_CT1050MX300SSD1	163813FCCD4D	34 C	63474	26	0	0	0	0
device	volume	diskmodel	serial	temp	hours	power on count	reported_uncorrect	current_pending_sector	offline_uncorrectable	reallocated_sector_count
atom64:/dev/sda	-none	CT500BX100SSD1	1449F000999E	34 C	1748	26	0	0	0	0