I've had a number of people ask about my backup strategy—how I ensure the 6 TB of video project files and a few TB of other files stays intact over time.
Over the past year, since I got more serious about my growing YouTube channel's success, I decided to document and automate as much of my backups as possible, following a 3-2-1 backup plan:
- 3 Copies of all my data
- 2 Copies on different storage media
- 1 Offsite copy
The culmination of that work is this GitHub repository: my-backup-plan.
The first thing I needed to do was take a data inventory—all the files important enough for me to worry about fell into six main categories:
For each category, I have at least three copies, on different storage media (locally on my main Mac and NAS, or on my primary and secondary NAS in the case of video files), and one copy in the cloud (some data uses cloud storage, other data is
rcloned to AWS Glacier (using an S3 Glacier-backed bucket).
rclone and automated
gickup runs for Git backups) on my 'backup Pi', which is managed via Ansible and has a few simple scripts and cron jobs to upload to AWS direct from my NAS.
This allows me to have full disaster recovery quickly if just my main computer or primary NAS dies, and a little slower if my house burns down or someone nukes St. Louis (hopefully neither of those things happens...).
Many people have asked about Glacier pricing, also about how expensive retrieval is. Well, for storage, it costs about $4/month for more than 6 TB of data. Retrieval is more expensive, and there was one instance where I needed to spend about $5 to pull down 30 GB of data as quickly as possible... but that's not the main annoyance with Glacier.
The main problem is it took over 12 hours—since I'm using Deep Archive—to even start that data transfer, since the data had to be brought back from cold storage.
But it's a price I'm willing to pay, to save a ton on the monthly costs, and to have a dead-simple remote storage solution (
rclone is seriously awesome, and simple).
Anyways, for even more detail about my backups, check out my latest video on YouTube:
And be sure to check out my GitHub repository, which goes into a LOT more detail: my-backup-plan.