Debian Package a Day ([info]debaday) wrote,
@ 2004-08-24 08:00:00
Previous Entry  Add to memories!  Tell a Friend!  Next Entry
rdiff-backup - Backup program to use deltas for history
rdiff-backup is a script that backs up one directory to another. The target directory ends up a copy of the source directory, but extra reverse diffs are stored in a special subdirectory of that target directory, so you can still recover files lost some time ago. The idea is to combine the best features of a mirror and an incremental backup. rdiff-backup also preserves subdirectories, symlinks, special files, permissions, uid/gid ownership (if it is running as root), and modification times. Finally, rdiff-backup can operate in a bandwidth efficient manner over a pipe, like rsync. Thus you can use rdiff-backup and ssh to securely back a hard drive up to a remote location, and only the differences will be transmitted.

Anonymous suggestion:
hi, I looked at dirvish, when searching a backup solution for myself, but chose rdiff-backup instead. It also uses rsync for copying AFAIK and rdiff for the incremental backups. One can restore any snapshot and easily tell, for how long they should be kept (deleting an old increment means that the diffs are applied). Of course, it can use ssh to do it remotely, but rdiff-backup must be installed on both sides with not too different versions.


More information on this package can be found on the Debian web site.
(If there is a package you would like to see featured here, go to the userinfo page and follow the directions there to submit your entry.)

Now available in RSS and ATOM flavors too.



(Post a new comment)


(Anonymous)
2004-08-24 01:03 pm UTC (link)
Anybody know of something like this that will store
the backup in a single encrypted file without requiring
loop device or encrypted filesystem support?

(It would be good to store my backup on the work machines which I can access with SSH, but I don't
want to leave data unencrypted and if possible
not in a whole tree, but rather in a single file.)

(Reply to this) (Thread)

duplicity
(Anonymous)
2004-08-24 04:12 pm UTC (link)
duplicity? (http://www.nongnu.org/duplicity)

there's even a debian package (http://packages.debian.org/duplicity).

duplicity (http://rdiff-backup.stanford.edu/duplicity.html) is more than just conceptually similar to rdiff-backup (http://www.nongnu.org/duplicity/rdiff-backup.html), i just haven't looked into the history of the two projects to find the connection.

a little bit off-topic (though having to do with "a backup contained in a single file" and duplicity), but i'll echo the criticism (http://www.nongnu.org/duplicity/new_format.html) about tar the duplicity author makes. i perform automated weekly full & daily incremental backups and manually restore a file or two from these backups at least once a month, so i know first hand that tar does not include an index within archives nor support all filesystem features (acl & ea). that's why i'm looking towards dar (http://dar.linux.free.fr/) (again, with debian package (http://packages.debian.org/dar)). the only thing currently stopping me from adopting dar is my familiarity with tar and the lack of dar adoption (large user-base => long project lifetime => continued support/development => unarchivable data in the future).

so far i've only had to restore a file here and there, so dealing with manually restoring acls isn't that difficult, and i don't have acls on very many files. what'll probably convince me to use dar is having to do a full restore and not remember what files had what acls, little alone manually restoring all the acls even if i knew.

(Reply to this) (Parent)(Thread)

Re: duplicity
[info]toykeeper
2004-08-24 06:49 pm UTC (link)
At some point, we're going to need to either modify tar, or create a similar derivative, to support subfiles. What I mean is archiving things in the style of reiserfs4, where there is no practical difference between a file and a directory, or a file and an attribute. This approach is simple, powerful, and flexible, and I expect it to be a major influence in the next decade. The namesys papers on it explain quite a bit, but to summarize, it could solve all manner of current problems with permission granularity, embedded metadata (id3 tags, etc), ACLs, etc. But we'll need support for this in a backup and encapsulation tool like tar in order to keep data safe or share it with others.

A small example... Say you have files called song1.mp3 and song2.mp3. You could store their ownership as subfiles, song1.mp3/..uid and song2.mp3/..uid. To change ownership, a "chown" tool is not needed. Simply "cp song1.mp3/..uid song2.mp3/..uid". ID3 tags would be unnecessary also, as you could store that data as song1.mp3/.title or song2.mp3/.artist. Instead of requiring a special tagger to edit the metadata, you could "vi song2.mp3/.album". Or instead of using the "file" utility to guess its type, simply "cat .song1.mp3/.mimetype". This greatly extends the "everything is a file" unix philosophy and adds further expressive power to simple tools and basic operations. And this is barely touching on the possibilities.

(Reply to this) (Parent)

Re: duplicity
(Anonymous)
2004-08-31 05:37 am UTC (link)
I was rather puzzled by the difference as well, but reading your post made me want to figure out what the difference truly was, and voilá: http://rdiff-backup.stanford.edu/duplicity.html

I think I might even have read that page before, but failed to understand it, as I was very new to rdiff-backup at that time ;-)

(Reply to this) (Parent)

Daily backups with rdiff-backup
(Anonymous)
2004-08-25 07:47 am UTC (link)
Some years ago, I searched for an easy but powerful tool to make differential backups. After a long search, I choose rdiff-backup. Until today, for private use, I haven't found a better tool yet!

I have made a backup partition of 9GB and each day a backup is made thanks a cron job. I haven't nothing to do, just to turn on my machine.

When I accidentally delete a file (and this can happen to anyone, believe me!!!), doesn't matter if I realize some months later, I can easily restore it from a previous backup.

I have loved this tool so much that I have made a Debian package to automate the daily backup process: emirdiff-backup (http://planamente.ch/emidio/pages/linux_download_demo.php?package=emirdiff-backup). You can easily install it via apt-get, just follow the instructions (http://planamente.ch/emidio/pages/linux_installation_aptget.php).

(Reply to this)


Create an Account
Forgot your login or password?
Login w/ OpenID
English • Español • Deutsch • Русский…