Langue: en

Version: 24 Dec 2005 (ubuntu - 07/07/09)

Section: 1 (Commandes utilisateur)


rdup - generate a file list suitable for making backups


rdup [-N timestamp] [OPTION...] [FILELIST] [DIR/FILE...]


rdup is a utility inspired by rsync and the plan9 way of doing backups. rdup itself does not backup anything. It only prints a list of files that are changed, or all files in case of a null dump. It also handles files that are removed, allowing for correct incremental backups. All paths printed are absolute.

The FILELIST is a internal list rdup writes to, to keep track of which files are in a backup. If you don't want this (i.e. make a full backup), use /dev/null here. The file /dev/null is handled specially by rdup: if detected no new file list is written. This is useful when doing full backups and you want all files to be printed.

FILELIST itself is needed to calculate which files are to removed from a backup.

The DIRS/FILES can be specified multiple times. These are the directories and files you want to backup.

If the -N timestamp option is not given, all paths found are printed. Only when a -N timestamp file is given, times can be compared and an incremental output can be generated.

rdup prints a filelist to standard output. Subsequent programs in a pipe line can be used to actually implement to backup scheme. If FILELIST is empty or non existent all files in DIR are dumped. This is the same as a null dump. After a run a new FILELIST is written. No warning is given when FILELIST is an existing file, it just gets overwritten by rdup. New runs will print out only those files that have actually changed or are removed since the last run, thereby making incremental backups possible.

Files are checked for changes by comparing the c-time (change time), if this time is NEWER than the c-time of FILELIST the pathname is printed to standard output. When files are removed they are also printed to standard output, but they are prefixed with a '-'. See FORMAT below. The default format rdup uses is: "%p%T %b %m %u %g %l %s %n\n"

Note, that rdup also supports hashing of files, this makes it possible to check the local hash with the hash of the backed up file.

All errors are written to standard error. If the directory or file does not exist, they are skipped and a warning is emitted.

The general idea is to be very UNIX like and create a bunch of simple programs which each do a their specific thing very well. With rdup and a small shell script (50 lines) one can implement encrypted and compressed backups.


As rdup doesn't backup anything, the backup policy; what you backup, how you backup, how often and how you restore; is all left to the scripts.


-F format
Specify a printf-style format to use. See FORMAT below.
-N timestamp
use the m_time of file timestamp as the timestamp to decide what to include in the incremental backup list. If timestamp does not exist of full dump is performed. rdup will create/touch timestamp after it has printed the file list. This means if something goes wrong, you still have the original timestamp.
Reverse the output of rdup. Tools accepting this ouput must create leading directory as they see them. This option allows a script -- running as a normal user -- to put files in a directory which could have 0600 as its permission.
-E file
The file named 'file' contains a list of Perl-compatible regular expressions (PCRE) , one per line, that rdup will use to exclude names. A '#' at the start of the line can be used to signal a comment. Empty lines are discarded. The -0 option also affects the format of this file.

If a directory is excluded, rdup won't descend in that directory, so all files in that directory are also excluded.

The directories leading up to the directory to be backed up can not be excluded. If you use a command line like:

        rdup /dev/null /home/miekg/bin

The directories '/home', '/home/miekg', '/home/miekg/bin' are always printed.
If you want to exclude the file '/home/miekg/blaat' you need to add the following regular expression: '/home/miekg/blaat'.
If you want to exclude all .mozilla/cache directories of all users you can use '/home/.*/.mozilla/cache/.*'. This doesn't exclude the directory itself and I'm assuming that the users' home directories are found under '/home'.
Also note that rdup does not print directories with a trailing slash.
Print rdup's version.
Give an overview of the options.
Don't honor .nobackup files. Normally if such a file is found the directory and all files containing it, are not printed to standard output, now they are.
Print the files' contents to standard output. This sets the FORMAT string to: "%p%T %b %u %g %l %s\n%n%C"

Note this creates a race condition: if a file changes in size after rdup has crawled it and before it has been sent to the remote server, the backup will fail. rdup will check for file size changes, but this doesn't remove the race condition.

This option is used when streaming your backup to a remote machine. Note that the remote machine must have rdup installed.

Only print removed files; entries that start with a `-'. This option unsets -m.
Only print modified/new files; entries that start with a `+'. This option unsets -r.
Local backups, do not check for file size changes.
Be more verbose. When used once, processed .nobackup files will be printed to standard error. When used twice each path will also be printed to standard error. This is usefull in case of a remote backup (-c) where the normal output is not seen.
-s size
Only output files smaller then size bytes. This can be used to limit the amount of data to be transferred when doing a remote backup. This option only applies to files and symbolic links, not to directories.
Delimit filelist with NULL's instead of a newline. Use '\0' in the format string to change rdup's output.
Stay on the local filesystem.



        rm -f timestamp && rdup -N timestamp LIST DIR

All full-dump filelist is printed to standard output. And with:

        rdup -N timestamp LIST DIR

An incremental dump filelist is printed. The file timestamp is used to save the exact time of rdup's run. The file LIST is used to calculate the correct incremental dump list, this is needed for files that are removed, or have a different type.


The default format rdup uses is: "%p%T %b %u %g %l %s %n\n"

The following escape sequences are understood by rdup:

        'p': '+' if file is new/modified, '-' if removed
        'b': permission bits from lstat(2), octal in four digits
        'm': the file mode bits, st_mode from lstat(2), decimal digits
        'u': uid
        'g': gid
        'l': path name length
        's': file size (zero if directory)
        'n': path
        't': time of modification (seconds from epoch)
        'H': the SHA1 hash of the regular file, all zeros ("0") for all other types
        'T': file type: -: normal file, l: symlink, h: hardlink, d:         directory, c: character device, b: block device, p: named pipe
        and s: socket.

        'C': the content of the file (none for all other types)

To delimit the output of rdup with NULLs you can use '\0' in the format string.


rdup writes the FILELIST in the following format:

Where MODE is the st_mode from stat(2), PATH_SIZE is the length of PATH. Where PATH is the path of the file. DEV is the dev id as returned by the stat call and INODE is the inode number - rdup needs this info to decide if a directory is renamed.

A typical example is:

33216 2310 444739411 8 bin/rdup


The default output generated by rdup is formatted like:


o +|-
plus or minus, indicating whether PATH should added or removed.
the type of the see %T in FORMAT.
the permission of the file, this is a subset of the st_mode from lstat(2). These are four octal digits.
the numerical user id of PATH. Note that if the first character of the line is '-' (i.e. remove) the UID will be zero.
the numerical group id of PATH. Note that if the first character of the line is '-' (i.e. remove) the GID will be zero.
the size of PATH.
the size of file pointed to by PATH. Note that if the first character of the line is '-' (i.e. remove) the SIZE will be zero. For directories this size will always be zero. Symbolic and hard links are handled differently, see CAVEATS.
the pathname

A typical example might look like this:
        +- 0755 1000 1000 8 11288 bin/rdup

This example show that the file should be backed up, has a user and group id of 1000, the length of the path is 8 bytes, the size of the file it 11288 and it has "bin/rdup" as a path.

Directories are always printed by rdup.


The output generated by rdup -c is formatted like:


This makes it possible possible for a remote shell script to receive the actual file and make a backup.

All field are identical as described in OUTPUT FORMAT, but there is one extra field and the following cavaets.

The entire file is concatenated to standard output.


o symbolic and hard links
the PATH name is generated from the link's name and its target. A symlink like

    /home/bin/blaat -> /home/bin/bliep

is printed as '/home/bin/blaat -> /home/bin/bliep'. The PATH_SIZE is modified accordingly. The FILE_SIZE is not needed, so it is set the size of the link's name, in this case the length of '/home/bin/blaat'.

If rdup encounters a hardlink it is handled in the same way, but the output type is set to 'h' instead of 'l'. A hardlink is only detected if rdup find a file with the same inode and device number as a previous one.

o character/block devices
The size field (%s) is changed to hold the major,minor number of the device. So if a major number is 8 and the minor number is 0 (under Linux this is /dev/sda), its size will be 8,0. The numbers are only separated with a comma (,).

The output when using the -c is changed as follows, for:

o directories:
the FILE_SIZE is zero and no content is printed. Thus:

        +d 0755 1000 1000 11 0\n
o regular files:
the FILE_SIZE is used as-is and the entire file contents is printed to standard output. Thus:

        +- 0644 1000 1000 32 6\n
Where aaa/a is a regular file containing the word 'hello\n'


rdup return a zero exit code on success, otherwise one is returned.


Written by Miek Gieben.


Report bugs to <miek@miek.nl>.


See the -c flag for explanation about a small race condition when doing remote dumps.

Extended attributes are not detected.


http:/www.miek.nl/projects/rdup is the main site of rdup. Copyright (C) 2005-2008 Miek Gieben. This is free software. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.

Licensed under the GPL version 3. See the file LICENSE in the source distribution of rdup.