I haven't had time to write up the details yet, but I wanted to share a project that's been many months in the making: The Petabyte Pi Project on YouTube.
I'm still doing follow-up testing based on feedback from Broadcom storage engineers, and will put out a much more in-depth blog post later, but the gist is:
Can a single Raspberry Pi cosplay as an 'enterprise' storage server, directly addressing 1 PB of storage?
Now... caveats abound here. What does 'enterprise' mean? And what does 'directly addressing' mean? Those things are all answered in the video linked above.
But to give a tl;dr: The Pi does not perform swimmingly. But... I did get a single array of 60 hard drives—20TB Exos HDDs to be exact—working in a 45Drives Storinator XL60 chassis, controlled only through a single Raspberry Pi Compute Module 4. Of course I had to rip out the Xeon guts and replace them with said Pi:
Some snarky commenters will say "oh of course the Pi couldn't cope that well! It's a tiny SBC that's not built for it!"
But you're talking to the guy who's spent two years getting a GPU to work (barely) on a Raspberry Pi. And the guy who built a $5,000 all-SSD Pi storage server. If there was even a tiny chance I could get my hands on a raw petabyte of storage, I was going to run this thing to its logical conclusion.
Watch the video linked above for the whole story (for now), and I have to say an incredibly huge thank you to 45Drives, who sponsored this project and helped in so many ways (and to some Broadcom engineers who have been immensely helpful along the way).
45Drives even shipped a custom faceplate enshrining Red Shirt Jeff's favorite weapon of destruction on the front of the thing:
What did it cost? (The whole thing)
If you put all the specs together on 45Drives' site, the server hardware they sent is somewhere around $15-20,000, and the hard drives are around $30,000. The parts I put in (the PCIe switch board, the Pi, the CM4 IO board, power supplies, cabling, etc.) totals around $200 (using some HBAs that cost at least $500 or so each).
Did you get to keep the server hardware and hard drives?
Yes; I'll be replacing the insides with the original Xeon hardware soon, and deploying it into my homelab!