Edwrai
Member
Before anyone reads on - it looks daunting to me and I wrote it!
So have a look at this which is a great and more fun summary.
Apologies didn't see this message come through sir. Massively off topic now, but bear with me whilst I explain...
USB C is not what I need here, I need to cover off some other requirements, which will help explain my rationale. If I go the USB C route I will be limited to single drives and if I use large density cheap-ish spinning platters then I'll simply not get the speed out of them to perform editing. I would also have to be within arms reach of the drives - which will mess with my Zen like office (not really) but I don't want devices all over the place. If I use SSD's for the speed then it will cost a small fortune to get the amount of data storage I need. I've also invested in NAS since 2011 so it would seem silly to lose all the resiliency and have to use stand alone drives, bit of a retrograde step. The 250Gb's were a trial and were based on Sata so I didn't want to go all out, I've now switched to 2 x 500Gb NVME which is much better (speeds of between 1800-2700MB/s vs around 550MB/s on Sata), and as you say definitely the sweet spot at 500Gb
With 10GbE, or 5GbE as I'm sitting on now (more on that below), then I can have the storage up to 100m away from the computer as I'm running Cat7 cabling, and the data is accessible from anywhere I want it to be, or any device for that matter, even simultaneously.
I will be trying out multiple raid setups to get this running the best for me. Raid 1 over Raid 0 for speed and basic resilience, then Raid 5, 6 and 10 etc. All with and without caching and over 5GbE and 10GbE.
Even on basic Raid 5 with no NVME acceleration (and now over 5GbE - as I have moved onto a larger NAS with a better blend of capabilities but lower interface speed) I'm getting the speeds below - which is just about enough to get me to 4K editing. The 5GbE interface will tap out at roughly 500MB/s which is more than ample for editing anything in the 4k range that I can produce.
I also have the option on the switch to run LAPC port aggregation which I have tried on my old NAS with 4 x 1GbE and that worked ok, but it was time for a performance upgrade so I hit the reset button and went for some new kit.
To give an idea of the file sizes I'm looking at. I have imported the video that I took originally for the tow bar work (I'll do the work over again to get the detail right - I'm just learning - but the data size is useful if nothing else). Once imported and made into proxy media we are looking at the thick end of 500Gb of data. I can remove the proxy media when I archive it but that's a significant amount for 1 video and not all of that was at 4k either. I have been known to over-egg the pudding so to speak but I prefer to buy the right things and use them for a long time than to cut corners at the start and either not achieve my goals or be delayed re-visiting things every 5 minutes. Wether I decide to do lots of video's here (I started last year on basic door removal etc but not yet published) or just go for home video editing then
Here is a link to the new NAS I'm running from QNAP. So far a great device - https://amzn.to/338x7qu
Love the feedback and happy to take offline or to the green room as waaaaaaaay off topic now.
View attachment 57234
You are not limited to single drives with usb c you can use a range of enclosures don’t use raid one if you are performance focus as you will get a little less than the performance of a single drive you want to us raid 10, don’t use raid 5 it always ends in tears, Raid 6 is ok but for speed raid 10 really is the only option if you want redundancy.
Simply the cost of the 10Gbit networking is a big factor. If you can avoid it I would.
I work in data centre computing as well as consumer computing for businesses.
As you have discovered your NVME isn’t limited by SATA bus however with a 6 or 8 disk array and the cost of the SATA drives you will max out your connectivity before the storage.
The other option is to use a clever SAN that uses platters and SSDs that will give you a lot of density without much of a hit in performance.
The Intel 660p NVME are interesting drives coming in at 1Tb for £100 but it cheats by using slow solid state with fast solid state so for your usage speed will drop off during sustained copying.
The QNAP san and nas are good. The other option. Is to keep your storage and processing local. And access the processing remotely.
Sent from my iPhone using Tapatalk