pc storage

I mainly use the harddisks in the PCs I run for storage of Hidef movies and TV series.

Current storage situation

Machine	Bruto*	Redundancy	Netto*	Disks
livingroom PC	3.5TB	single disk	3.5TB	500GB Crucial MX500 SSD, 1TB Crucial MX500, 1.05TB MX300 Crucial, 1TB Samsung EVO970 nvme
livingroom HTPC	256GB	single disk	256GB	256GB Crucial M4 SSD
NasPC	112TB	60GB Boot 14x4T RAIDZ2 14x4T RAIDZ2	96TB	60GB Intel 330 series, 14x4TB Seagate, 14x4TB Seagate
NasPC2	96TB	120GB Boot 12x8T RAIDZ2	80TB	120GB Intel 330, 12x8TB Seagate Constellation
LinuxPC	36TB	SSD 30G for boot SSD 60G share 12x3TB RAIDZ2 ZFS	30TB	128GB Crucial C300 SSD, 12x3TB Seagate
ServerPC	5TB	SSD 120G for boot SSD 5x 1TB RAIDZ1 ZFS	4TB	120GB Crucial M500 SSD, 5x1.05TB Crucial SSD
Atom Low power PC (11W)	256GB	1x30GB boot 226G	226GB	500GB Crucial BX100 SSD (220G unformatted)
old pc win7	2.7TB	single disk	2.5TB	256GB Crucial M4 SSD, 480GB Crucial M500, 1x 2TB Seagate
Total:	255TB	.	215TB	.

I store all data to ZFS on Linux since version 0.6.2. Recently ZFS on Linux (0.8.6) was integrated in OpenZFS 2.0 sharing sourcecode with FreeBSD and Illumos the opensource version of Solaris where ZFS was first developed under Sun Microsystems. The previous LVM raid 0 volumes have been moved to ZFS pools with RAIDZ1 or RAIDZ2.
RAIDZ1 is like RAID5 and can withstand 1 disk breaking. RAIDZ2 can withstand 2 disks breaking. But after disk failure recovery is only needed for the data, not the entire disk so it is much quicker than plain RAID5 or RAID6.
ZFS keeps checksums on all data to ensure data integrity at all times. For RAIDZ1 there is the space of 1 spare disk, for RAIDZ2 (like RAID6) the space of 2 spare disks is needed and used for CRC data and other ZFS overhead data. Besides that ZFS/RAIDZ takes about 5% of the volume size for additional overhead.
Currently the 10x2T are retired and the healthy ones were sold.
I have 12x3T in raidz2, integrated in my linux desktop PC.
In Nas1 there are 14x4T in RAIDZ2 plus another 14x4T in RAIDZ2. So 2 pools with 1 vdev each.
In Nas2 I have 12x8T in RAIDZ2.
The always on XeonD server has 5x 1TB SSD in RAIDZ1.
I keep separate pools in order to be able to swap them out to different PC's. I have removed the 10x2T because 2 disks were failing and 3 more were pending failure. No data was lost.
The main NAS PC has 8 onboard sata interfaces and 24 extra sata interfaces through a sas card, there are 24 regular bays (2x10 + one 4in3 bay) and I have stacked 1 seperate 4 drive bay inside the case. Currently 28 bays are in use. The free PCI-E 4x slot is now used for a 10Gbe Intel X520-DA1 network card with SFP+.
The second NAS PC has 14 onboard sata interfaces, 1x for boot 12x in use for the data disks, 1x free sata. It has a 10Gbe Intel X520-DA2 network card with SFP+. It is managed via IPMI (Supermicro).
The XeonD has 6 sata interfaces. 1x boot plus 5x data. It has onboard 10Gbe RJ45. It also has IPMI (Supermicro) for management.

Disk inventory ::
12x Seagate 8.0TB : ST8000NM0055 (7200 rpm) (sata3, 256MB)
27x Seagate 4.0TB : ST4000DM000 (5900 rpm) (sata3, 64MB)
1x Seagate 4.0TB : ST4000DM005 (5900 rpm) (sata3, 64MB)
12x Seagate 3.0TB : ST3000DM001 (7200 rpm) (sata3, 64MB) (1x broken)
1x Seagate 3.0TB : ST3000DM007 (5900 rpm) (20mm thin disk,SMR,256MB)
9x Seagate 2.0TB : ST2000DL003 (5900 rpm) (sata3, 64MB) (2x broken)
1x Seagate 2.0TB : ST2000DM001 (7200 rpm)
2x Seagate 2.0TB : ST32000542AS (5900 rpm)
2x WesternDigital 2.0TB : WD20EARS Caviar Green 2TB, 64MB (1x broken)
4x Samsung 1.5TB : HD154UI Green (5400 rpm)
4x Seagate 1.5TB : ST31500341AS
6x Samsung 1TB : HD103UJ
5x Samsung 750G : HD753LJ
4x Samsung 500G : HD501LJ
7x SSD : 60GB + 120GB Intel 330 , 128GB Crucial C300, 2x 256GB Crucial M4, 120GB + 480GB Crucial M500
9x SSD : 6x 1TB Crucial MX300, 500GB Crucial BX100, 1x 1TB Crucial MX500, 1x 1TB Samsung EVO970 nvme
3x SSD external : 2x Samung T5 500GB usb-c and 1x Samsung T5 1TB usb-c

This table shows Linux kernel versions and ZFS/SPL versions used currently :

ZFS version (git zfs)	kernel	SPL	ZFS	OS version
atom64	5.15.38	none	none	Slackware 15.0
riwilinux	5.15.161	2.2.6-1	2.2.6-1	Slackware 15.0
riwinas	5.15.19	2.2.6-1	2.2.6-1	Slackware 15.0
riwinas2	5.15.19	2.2.6-1	2.2.6-1	Slackware 15.0
riwixeon	5.15.161	2.2.6-1	2.2.6-1	Slackware 15.0

This table shows the storage usage per pool:

drive

total

used

free

graph bar

riwilinux:/pool3

26639G

21021G

5618G

79%

riwinas:/pool4

43973G

38746G

5227G

88%

riwinas:/pool5

43973G

27543G

16430G

63%

riwinas2:/pool8

70680G

34726G

35954G

49%

riwixeon:/pool0

3948G

2334G

1614G

59%

total

189213G

124370G

64843G

66%

This table shows the health of each individual disk as well as some statistics.

device	volume	diskmodel	serial	temp	hours	power on count	reported_uncorrect	current_pending_sector	offline_uncorrectable	reallocated_sector_count
riwilinux:/dev/sda	-none	C300-CTFDDAC128MAG	00000000104602FF3866	none	6731	1040	0	0	0	2048
riwilinux:/dev/sdb	zfs-pool3	ST3000DM001-1CH166	Z1F1PTZ7	34 C	6419	1334	0	0	0	0
riwilinux:/dev/sdc	zfs-pool3	ST3000DM001-1CH166	Z1F31RN5	34 C	5536	1134	0	0	0	0
riwilinux:/dev/sdd	zfs-pool3	ST3000DM007-1WY10G	ZFN35WNB	36 C	299	97	0	0	0	0
riwilinux:/dev/sde	zfs-pool3	ST3000DM001-1CH166	Z1F1P72Z	34 C	6429	1342	0	0	0	0
riwilinux:/dev/sdf	zfs-pool3	ST3000DM001-1CH166	Z1F1PR6B	34 C	6429	1335	0	0	0	0
riwilinux:/dev/sdg	zfs-pool3	ST3000DM001-1CH166	Z1F1NLX9	35 C	6420	1336	0	0	0	0
riwilinux:/dev/sdh	zfs-pool3	ST3000DM001-1CH166	Z1F1QAT8	35 C	6425	1337	0	0	0	0
riwilinux:/dev/sdi	zfs-pool3	ST3000DM001-1CH166	Z1F1MLHG	34 C	6427	1334	0	0	0	0
riwilinux:/dev/sdj	zfs-pool3	ST3000DM001-1CH166	W1F39TEE	33 C	4629	971	0	0	0	0
riwilinux:/dev/sdk	zfs-pool3	ST3000DM001-1CH166	W1F39TEB	35 C	4620	969	0	0	0	0
riwilinux:/dev/sdl	zfs-pool3	ST3000DM001-1ER166	Z501H1Q7	34 C	1493	385	1	0	0	8
riwilinux:/dev/sdm	zfs-pool3	ST3000DM001-1ER166	Z501KWLN	34 C	1502	381	0	0	0	0
device	volume	diskmodel	serial	temp	hours	power on count	reported_uncorrect	current_pending_sector	offline_uncorrectable	reallocated_sector_count
riwinas:/dev/sda	-none	INTEL SSDSC2CT060A3	CVMP215605Q1060AGN	none	12667	1821	0	0	0	0
riwinas:/dev/sdaa	zfs-pool5	ST4000DM000-1F2168	Z300V3KX	25 C	4552	826	0	0	0	0
riwinas:/dev/sdab	zfs-pool5	ST4000DM000-1F2168	Z3013WLW	25 C	4635	826	0	0	0	0
riwinas:/dev/sdac	zfs-pool4	ST4000DM000-1F2168	Z300K11N	27 C	8000	1562	0	0	0	0
riwinas:/dev/sdb	zfs-pool4	ST4000DM000-1F2168	Z301GP5Q	24 C	4016	821	0	0	0	0
riwinas:/dev/sdc	zfs-pool4	ST4000DM000-1F2168	Z301GE5S	23 C	4017	821	0	0	0	0
riwinas:/dev/sdd	zfs-pool4	ST4000DM000-1F2168	Z304WYTA	23 C	16	807	0	0	0	0
riwinas:/dev/sde	zfs-pool4	ST4000DM000-1F2168	Z303Y4ZP	23 C	16	804	0	0	0	0
riwinas:/dev/sdf	zfs-pool4	ST4000DM000-1F2168	Z300K08K	27 C	8015	1562	0	0	0	0
riwinas:/dev/sdg	zfs-pool5	ST4000DM000-1F2168	Z3013VNL	26 C	4605	824	0	0	0	0
riwinas:/dev/sdh	zfs-pool5	ST4000DM000-1F2168	Z300V3G1	25 C	4644	825	0	0	0	0
riwinas:/dev/sdi	zfs-pool5	ST4000DM000-1F2168	Z30146PF	25 C	4601	828	0	0	0	0
riwinas:/dev/sdj	zfs-pool4	ST4000DM000-1F2168	Z300MC1Z	27 C	8006	1562	0	0	0	0
riwinas:/dev/sdk	zfs-pool4	ST4000DM000-1F2168	Z300MB1C	27 C	8004	1562	0	0	0	0
riwinas:/dev/sdl	zfs-pool4	ST4000DM000-1F2168	Z300MB1L	26 C	8009	1562	0	0	0	0
riwinas:/dev/sdm	zfs-pool4	ST4000DM000-1F2168	Z300K0PQ	26 C	8008	1562	0	0	0	0
riwinas:/dev/sdn	zfs-pool5	ST4000DM000-1F2168	Z301GNNK	24 C	4153	756	0	0	0	0
riwinas:/dev/sdo	zfs-pool5	ST4000DM000-1F2168	Z301GDD3	24 C	4153	756	0	0	0	0
riwinas:/dev/sdp	zfs-pool5	ST4000DM000-1F2168	Z301GRFN	24 C	4154	756	0	0	0	0
riwinas:/dev/sdq	zfs-pool5	ST4000DM005-2DP166	ZDH1BGYF	23 C	2786	536	0	0	0	0
riwinas:/dev/sdr	zfs-pool4	ST4000DM000-1F2168	Z30156CH	26 C	6861	1358	0	0	0	0
riwinas:/dev/sds	zfs-pool4	ST4000DM000-1F2168	Z30147QZ	27 C	6862	1358	0	0	0	0
riwinas:/dev/sdt	zfs-pool4	ST4000DM000-1F2168	W300BMH0	27 C	7707	1498	0	0	0	0
riwinas:/dev/sdu	zfs-pool4	ST4000DM000-1F2168	W300G8KQ	26 C	7708	1498	0	0	0	0
riwinas:/dev/sdv	zfs-pool5	ST4000DM000-1F2168	Z3013VLC	25 C	4607	825	0	0	0	0
riwinas:/dev/sdw	zfs-pool5	ST4000DM000-1F2168	Z3013W9T	26 C	4607	826	0	0	0	0
riwinas:/dev/sdx	zfs-pool5	ST4000DM000-1F2168	Z3013YJL	26 C	4603	826	0	0	0	0
riwinas:/dev/sdy	zfs-pool5	ST4000DM000-1F2168	Z3013XE4	26 C	4555	826	0	0	0	0
riwinas:/dev/sdz	zfs-pool5	ST4000DM000-1F2168	Z300V342	25 C	4641	826	0	0	0	0
device	volume	diskmodel	serial	temp	hours	power on count	reported_uncorrect	current_pending_sector	offline_uncorrectable	reallocated_sector_count
riwinas2:/dev/sda	-none	INTEL SSDSC2CT120A3	CVMP2152038G120BGN	none	20073	499	0	0	0	0
riwinas2:/dev/sdb	zfs-pool8	ST8000NM0055-1RM112	ZA174S1D	29 C	855	232	0	0	0	0
riwinas2:/dev/sdc	zfs-pool8	ST8000NM0055-1RM112	ZA16ZH1W	30 C	883	232	0	0	0	0
riwinas2:/dev/sdd	zfs-pool8	ST8000NM0055-1RM112	ZA174RC1	30 C	897	232	0	0	0	0
riwinas2:/dev/sde	zfs-pool8	ST8000NM0055-1RM112	ZA16ZE7L	32 C	882	232	0	0	0	0
riwinas2:/dev/sdf	zfs-pool8	ST8000NM0055-1RM112	ZA174RLC	33 C	882	232	0	0	0	0
riwinas2:/dev/sdg	zfs-pool8	ST8000NM0055-1RM112	ZA174RMR	33 C	727	282	0	0	0	0
riwinas2:/dev/sdh	zfs-pool8	ST8000NM0055-1RM112	ZA174RV2	33 C	732	232	0	0	0	0
riwinas2:/dev/sdi	zfs-pool8	ST8000NM0055-1RM112	ZA16ZRXH	33 C	718	278	0	0	0	0
riwinas2:/dev/sdj	zfs-pool8	ST8000NM0055-1RM112	ZA174RDB	32 C	730	288	0	0	0	0
riwinas2:/dev/sdk	zfs-pool8	ST8000NM0055-1RM112	ZA15H4W8	33 C	734	232	0	0	0	0
riwinas2:/dev/sdl	zfs-pool8	ST8000NM0055-1RM112	ZA174RE6	33 C	718	281	0	0	0	0
riwinas2:/dev/sdm	zfs-pool8	ST8000NM0055-1RM112	ZA174SDG	32 C	723	232	0	0	0	0
device	volume	diskmodel	serial	temp	hours	power on count	reported_uncorrect	current_pending_sector	offline_uncorrectable	reallocated_sector_count
riwixeon:/dev/sda	-none	Crucial_CT120M500SSD1	1308092BD91E	26 C	80019	76	0	0	0	0
riwixeon:/dev/sdb	zfs-pool0	Crucial_CT1050MX300SSD1	163813FCCF24	29 C	72248	28	0	0	0	1
riwixeon:/dev/sdc	zfs-pool0	Crucial_CT1050MX300SSD1	163813FCD7FE	28 C	72249	28	0	0	0	0
riwixeon:/dev/sdd	zfs-pool0	Crucial_CT1050MX300SSD1	1631137A4205	27 C	70796	29	0	0	0	0
riwixeon:/dev/sde	zfs-pool0	Crucial_CT1050MX300SSD1	1631137A1D38	28 C	70836	28	0	0	0	1
riwixeon:/dev/sdf	zfs-pool0	Crucial_CT1050MX300SSD1	163813FCCD4D	27 C	71533	29	0	0	0	0
device	volume	diskmodel	serial	temp	hours	power on count	reported_uncorrect	current_pending_sector	offline_uncorrectable	reallocated_sector_count
atom64:/dev/sda	-none	CT500BX100SSD1	1449F000999E	34 C	1748	26	0	0	0	0