Setting up Duplicity for use with Amazon s S3 on Debian GNU Linux to backup on Dreamhost

January 29th, 2007

To review the last post of backing up to dreamhost and s3 with duplicity, here is clearer summary of what is necessary to get duplicity working with s3, as I figured it out on the fly and I'm sure my notes are confusing.

Howto get Duplicity with S3 working on Debian

  1. Install rdiff-backup
  2. apt-get install rdiff-backup
  3. Install bitbucket
  4. cd /usr/src/
    tar -xzvf BitBucket-0.4a.tar.gz
    cd BitBucket-0.4a
    python install
  5. Get CVS checkout of duplicity
  6. cd /usr/src/
    cvs -z3 co duplicity
    cd duplicity
  7. Copy to duplicity folder (or if you can compile it with what is provided in the CVS source, I couldn't get it to compile)
  8. cp /var/lib/python-support/python2.4/rdiff_backup/ /usr/src/duplicity/duplicity/
  9. Then create a bash script to put it all together. I used the script provided by Labora:

export S3KEY=[key]

export S3SECRET=[secret]/usr/local/share/duplicity/duplicity-bin --include-filelist="backuplist.txt" / s3+http://my-bucket

Thanks again labora - your post got this all started!

Author's notes:

  • It is assumed you have an S3 account, if not go to Amazon's Web Services Page and sign up.
  • It is assumed you are comfortable with linux and debian.
  • I download and install new software into /usr/src/ and so the code above uses those path prefixes, you can install to a different location if your environment requirements dictate it.
  • I have uploaded the packages referenced in this article just in case the others are for some reason unavailable to you. Unfortunately, I don't know how to sign the files (yet) with an MD5 hash so you'll either have to trust me, be able to check their integrity on your own, or not use them.

Duplicity Files: (includes for x86, 32-bit platforms)

UPDATE November 2007: Files removed, I never used them again.

Yearly Indexes: 2003 2004 2006 2007 2008 2009 2010 2011 2012 2013 2015 2019 2020 2022