Rsnapshot: Difference between revisions

From Alpine Linux
(→‎Automation: add a script to write the contents of each file)
(use https)
 
(5 intermediate revisions by 2 users not shown)
Line 1: Line 1:
[http://rsnapshot.org/ <samp>rsnapshot</samp>] is a filesystem backup utility based on [[rsync|<samp>rsync</samp>]]. Using <samp>rsnapshot</samp>, it is possible to take snapshots of your filesystems at different points in time. Using hard links, rsnapshot creates the illusion of multiple full backups, while only taking up the space of one full backup plus differences. When coupled with <samp>ssh</samp>, it is possible to take snapshots of remote filesystems as well. This document is a tutorial on the installation and configuration of rsnapshot.
[https://rsnapshot.org/ <samp>rsnapshot</samp>] is a filesystem backup utility based on [[rsync|<samp>rsync</samp>]]. Using <samp>rsnapshot</samp>, it is possible to take snapshots of your filesystems at different points in time. Using hard links, rsnapshot creates the illusion of multiple full backups, while only taking up the space of one full backup plus differences. When coupled with <samp>ssh</samp>, it is possible to take snapshots of remote filesystems as well. This document is a tutorial on the installation and configuration of rsnapshot.


== Installation ==
== Installation ==
Line 8: Line 8:


== Configuration ==
== Configuration ==
To configure <samp>rsnapshot</samp>, copy the example configuration <samp>/etc/rsnapshot.conf.default</samp> to <samp>/etc/rsnapshot.conf</samp>, and edit it to your needs based on the comments and the [http://rsnapshot.org/rsnapshot/docs/docbook/rest.html official documentation]. Note that <samp>rsnapshot</samp> requires tabs between options and values in <samp>rsnapshot.conf</samp>. This is done so spaces can be included in filenames without requiring any extra escaping or quoting.
To configure <samp>rsnapshot</samp>, copy the example configuration <samp>/etc/rsnapshot.conf.default</samp> to <samp>/etc/rsnapshot.conf</samp>, and edit it to your needs based on the comments and the [https://rsnapshot.org/rsnapshot/docs/docbook/rest.html official documentation]. Note that <samp>rsnapshot</samp> requires tabs between options and values in <samp>rsnapshot.conf</samp>. This is done so spaces can be included in filenames without requiring any extra escaping or quoting.


The most important parts to modify are where to store the backups:
The most important parts to modify are where to store the backups:
Line 15: Line 15:
</pre>
</pre>
How many backups to retain:
How many backups to retain:
These settings used to be called "hourly, daily, weekly, monthly" in older releases of rsnapshot, but were changed to "alpha, beta, gamma, delta" because the time interval between backups is arbitrary.
Setting this means I end up with 6 backups which were done most recently, then one of those gets hived off to become the beta backup, which it keeps 7 of, one of which gets hived off as gamma, and so on. This means you have multiple alpha backups fairly recently, multiple older beta backups representing days then gamma representing weeks and delta backups going back months. Set this according to how many backups you want to have.
<pre>
<pre>
retain daily 7
retain alpha 6
retain weekly 4
retain beta 7
retain monthly 12
retain gamma 4
retain delta 3
</pre>
</pre>
And what to backup:
And what to backup:
Line 39: Line 44:
To check what the system would do when running a backup without executing the commands, i.e. a dry run:
To check what the system would do when running a backup without executing the commands, i.e. a dry run:
<pre>
<pre>
rsnapshot -t daily
rsnapshot -t alpha
rsnapshot -t weekly
rsnapshot -t beta
rsnapshot -t monthly
rsnapshot -t gamma
rsnapshot -t delta
</pre>
</pre>
Finally, perform the first backup:
Finally, perform the first backup:
<pre>
<pre>
rsnapshot daily
rsnapshot alpha
</pre>
</pre>
The last part might take a while. Subsequent backups should be much faster, as it will then only have to copy files that have changed since the last backup.
The last part might take a while. Subsequent backups should be much faster, as it will then only have to copy files that have changed since the last backup.


== Automation ==
== Automation ==
After setting up and testing <samp>rsnapshot</samp> as described above, the next step is to make [[cron|<samp>cron</samp>]] automatically run <samp>rsnapshot</samp> at fixed intervals. The easiest way to achieve this is to create a few scripts in the folders <samp>/etc/periodic/*</samp> that <samp>crond</samp> monitors. The script below will write the appropriate contents to those files and make them executable:
After setting up and testing <samp>rsnapshot</samp> as described above, the next step is to make [[cron|<samp>cron</samp>]] automatically run <samp>rsnapshot</samp> at fixed intervals. The easiest way to achieve this is to create a few scripts in the folders <samp>/etc/periodic/*</samp> that <samp>crond</samp> monitors:
<pre>
#!/bin/sh
cd /etc/periodic
dirs=("daily" "weekly" "monthly")


for dir in "${dirs[@]}"; do
{{Cat|/etc/periodic/hourly/rsnapshot|#!/bin/sh
    echo -e "#!/bin/sh\nexec /usr/bin/rsnapshot $dir" > "$dir/rsnapshot"
    chmod +x "$dir/rsnapshot"
done


</pre>
exec /usr/bin/rsnapshot alpha
}}




{{Cat|/etc/periodic/daily/rsnapshot|#!/bin/sh
{{Cat|/etc/periodic/daily/rsnapshot|#!/bin/sh


exec /usr/bin/rsnapshot daily
exec /usr/bin/rsnapshot beta
}}
}}


Line 72: Line 72:
{{Cat|/etc/periodic/weekly/rsnapshot|#!/bin/sh
{{Cat|/etc/periodic/weekly/rsnapshot|#!/bin/sh


exec /usr/bin/rsnapshot weekly
exec /usr/bin/rsnapshot gamma
}}
}}


Line 78: Line 78:
{{Cat|/etc/periodic/monthly/rsnapshot|#!/bin/sh
{{Cat|/etc/periodic/monthly/rsnapshot|#!/bin/sh


exec /usr/bin/rsnapshot monthly
exec /usr/bin/rsnapshot delta
}}
}}


Line 88: Line 88:
After that, test that the scripts work as expected:
After that, test that the scripts work as expected:
<pre>
<pre>
run-parts /etc/periodic/hourly
run-parts /etc/periodic/daily
run-parts /etc/periodic/daily
run-parts /etc/periodic/weekly
run-parts /etc/periodic/weekly

Latest revision as of 21:18, 25 August 2023

rsnapshot is a filesystem backup utility based on rsync. Using rsnapshot, it is possible to take snapshots of your filesystems at different points in time. Using hard links, rsnapshot creates the illusion of multiple full backups, while only taking up the space of one full backup plus differences. When coupled with ssh, it is possible to take snapshots of remote filesystems as well. This document is a tutorial on the installation and configuration of rsnapshot.

Installation

To install rsnapshot:

apk add rsnapshot

Configuration

To configure rsnapshot, copy the example configuration /etc/rsnapshot.conf.default to /etc/rsnapshot.conf, and edit it to your needs based on the comments and the official documentation. Note that rsnapshot requires tabs between options and values in rsnapshot.conf. This is done so spaces can be included in filenames without requiring any extra escaping or quoting.

The most important parts to modify are where to store the backups:

snapshot_root	/mnt/backup

How many backups to retain:

These settings used to be called "hourly, daily, weekly, monthly" in older releases of rsnapshot, but were changed to "alpha, beta, gamma, delta" because the time interval between backups is arbitrary.

Setting this means I end up with 6 backups which were done most recently, then one of those gets hived off to become the beta backup, which it keeps 7 of, one of which gets hived off as gamma, and so on. This means you have multiple alpha backups fairly recently, multiple older beta backups representing days then gamma representing weeks and delta backups going back months. Set this according to how many backups you want to have.

retain	alpha	6
retain	beta	7
retain	gamma	4
retain	delta	3

And what to backup:

# Local
backup	/home/			local/
backup	/etc/			local/

# Remote
backup	user@remote:/home/user/	remote/		exclude=/home/user/Downloads

In this case, every 7th daily backup is saved as a weekly backup, every 4th weekly backup is retained as a monthly backup, and every 12th monthly backup is deleted. The folders /home and /etc from the local machine are backed up to /mnt/backup/local/, while it uses ssh to back up the folder /home/user on the machine remote to /mnt/backup/remote/. Make sure root has passwordless ssh access to the machines you want to backup over the internet (i.e. run ssh-keygen and ssh-copy-id as root).
The last line also shows an example of how you can exclude parts of the location from backups.

Testing

To test that your config file has the correct syntax:

rsnapshot configtest

To check what the system would do when running a backup without executing the commands, i.e. a dry run:

rsnapshot -t alpha
rsnapshot -t beta
rsnapshot -t gamma
rsnapshot -t delta

Finally, perform the first backup:

rsnapshot alpha

The last part might take a while. Subsequent backups should be much faster, as it will then only have to copy files that have changed since the last backup.

Automation

After setting up and testing rsnapshot as described above, the next step is to make cron automatically run rsnapshot at fixed intervals. The easiest way to achieve this is to create a few scripts in the folders /etc/periodic/* that crond monitors:

Contents of /etc/periodic/hourly/rsnapshot

#!/bin/sh exec /usr/bin/rsnapshot alpha


Contents of /etc/periodic/daily/rsnapshot

#!/bin/sh exec /usr/bin/rsnapshot beta


Contents of /etc/periodic/weekly/rsnapshot

#!/bin/sh exec /usr/bin/rsnapshot gamma


Contents of /etc/periodic/monthly/rsnapshot

#!/bin/sh exec /usr/bin/rsnapshot delta


Remember to make the scripts executable:

chmod +x /etc/periodic/*/rsnapshot

After that, test that the scripts work as expected:

run-parts /etc/periodic/hourly
run-parts /etc/periodic/daily
run-parts /etc/periodic/weekly
run-parts /etc/periodic/monthly

Assuming crond is set to start at boot (the default), your system should now make backups automatically.