To review the last post of backing up to dreamhost and s3 with duplicity, here is clearer summary of what is necessary to get duplicity working with s3, as I figured it out on the fly and I'm sure my notes are confusing.
Howto get Duplicity with S3 working on Debian
- Install rdiff-backup
apt-get install rdiff-backup
- Install bitbucket
cd /usr/src/
wget http://cheeseshop.python.org/packages/source/B/BitBucket/BitBucket-0.4a.tar.gz
tar -xzvf BitBucket-0.4a.tar.gz
cd BitBucket-0.4a
python setup.py install
- Get CVS checkout of duplicity
cd /usr/src/
cvs -z3 -d:pserver:anonymous@cvs.savannah.nongnu.org:/sources/duplicity co duplicity
cd duplicity
- Copy _librsync.so to duplicity folder (or if you can compile it with what is provided in the CVS source, I couldn't get it to compile)
cp /var/lib/python-support/python2.4/rdiff_backup/_librsync.so /usr/src/duplicity/duplicity/
- Then create a bash script to put it all together. I used the script provided by Labora:
#!/bin/sh
export S3KEY=[key]
export S3SECRET=[secret]/usr/local/share/duplicity/duplicity-bin --include-filelist="backuplist.txt" / s3+http://my-bucket
Thanks again labora - your post got this all started!
Author's notes:
- It is assumed you have an S3 account, if not go to Amazon's Web Services Page and sign up.
- It is assumed you are comfortable with linux and debian.
- I download and install new software into /usr/src/ and so the code above uses those path prefixes, you can install to a different location if your environment requirements dictate it.
- I have uploaded the packages referenced in this article just in case the others are for some reason unavailable to you. Unfortunately, I don't know how to sign the files (yet) with an MD5 hash so you'll either have to trust me, be able to check their integrity on your own, or not use them.
Duplicity Files:
bitbucket-0.4a.tar.gzduplicity.zip (includes _librysnc.so for x86, 32-bit platforms)
UPDATE November 2007: Files removed, I never used them again.