Diskless Mode: Difference between revisions
Prabuanand (talk | contribs) (removed redundant info about installation. cleaned up sentences to make understanding easier. fixed grammar issues) |
Prabuanand (talk | contribs) (added Upgrading a Running System for Diskless mode from Alpine_Package_Keeper page) |
||
Line 65: | Line 65: | ||
It's possible to load an APKOVL file from a webserver, by supplying a custom url with the <code>APKOVL</code> kernel boot parameter. If you don't have a web server you can run busybox's httpd temporarily to serve an .apkovl - <code>busybox httpd -p 127.0.0.1:80</code>. | It's possible to load an APKOVL file from a webserver, by supplying a custom url with the <code>APKOVL</code> kernel boot parameter. If you don't have a web server you can run busybox's httpd temporarily to serve an .apkovl - <code>busybox httpd -p 127.0.0.1:80</code>. | ||
== Upgrading a Running System == | |||
When Alping Linux runs in "diskless" or "data" disk mode, Upgrading a running system requires few extra steps. | |||
If booting a "diskless" system from a read-only device, or as an iso image on writable media, it's not possible to update the boot files (kernel, modules, firmware, ...) that reside on that device. | |||
For [[Create_a_Bootable_Device|customizable boot device]], It is possible to update the boot files. However, even then, the kernel, with its modules and firmware files, can still not be updated directly through regular packages updates. Instead, there is the <code>update-kernel</code> script that can generate initfs images and install them together with upgraded kernels. | |||
Upgrading can be done as follows. | |||
{{cmd|apk add mkinitfs | |||
}} | |||
This package is required for the generation of the initial filesystem used during boot. | |||
* Additional initfs features that are missing in the default configuration, like the [[Btrfs|btrfs]] filesystem support (at the time of writing, to allow loading .apkovl configs and package cache during boot), may be enabled in <code>/etc/mkinitfs/mkinitfs.conf</code>. | |||
* Available initfs features may be listed with <code>ls /etc/mkinitfs/features.d</code> | |||
{{cmd|ls /etc/mkinitfs/features.d | |||
apk add nano | |||
nano /etc/mkinitfs/mkinitfs.conf | |||
lbu commit | |||
}} | |||
Finally update the kernel and its boot environment. | |||
{{cmd|update-kernel /media/sdXY/boot/ | |||
}} | |||
* An <code>update-kernel</code> run needs at least 8 GB free ram memory to avoid a broken modloop-image. | |||
* See <code>update-kernel --help</code> for options to manually add additional module or firmware packages. | |||
== See Also == | == See Also == | ||
Line 71: | Line 96: | ||
* [[Manually editing a existing apkovl]] | * [[Manually editing a existing apkovl]] | ||
* [[Back Up a Flash Memory Installation]] | * [[Back Up a Flash Memory Installation]] | ||
* [[Upgrading_Alpine#Upgrading_Alpine_Linux_on_other_removable_media_(such_as_CF/USB)|Upgrading Diskless to New Alpine Linux Release]] | * [[Upgrading_Alpine#Upgrading_Alpine_Linux_on_other_removable_media_(such_as_CF/USB)|Upgrading Diskless to New Alpine Linux Release]] | ||
* [[PXE boot#Specifying an apkovl|Diskless PXE Boot]] | * [[PXE boot#Specifying an apkovl|Diskless PXE Boot]] |
Revision as of 10:26, 2 November 2024
In Diskless mode the entire operating system with all applications are first loaded into RAM and then only run from there. This is also the method used to boot the Alpine Linux iso
installation media. Alpine Linux can be installed and configured so that the system continue to boot like this if "disk=none" is specified while running the setup-alpine
script.
The mode is extremely fast and can save on unnecessary disk spin-ups, power, and wear. It is similar to what other linux distributions may call a "frugal" install or boot using a "toram" option.
Custom configurations may be preserved or "persist" across reboots by using the Alpine Linux tool named Local Backup Utility(lbu)
. The initial and possibly read-only installation media can remain the only boot device for the "diskless" system by saving the running state to an .apkovl
file, and have these automatically loaded when booting from the the boot device.
In addition to the installation media, it is also possible to boot the "diskless" Alpine Linux from a customizable boot device.
Apkovl
Apkovl is a file used for storing local configuration state when running Alpine Linux in Diskless Mode. It stores all configuration files that have changed from the default ones. The filename is <hostname>.apkovl.tar.gz
and is stored in a location whose path is defined in /etc/lbu/lbu.conf. The contents from the Apkovl file are overlaid on top of the contents of the apks that are loaded on boot.
The backup tool lbu
enables committing and reverting local configuration system state by using .apkovl files that are saved to a backup location and loaded when booting. In Diskless mode, for every change made to the running system to persist across reboot, the command lbu commit
must be issued before rebooting the system to update the .apkovl file.
Local Package Cache
When Alpine Linux boots in Diskless Mode, the remote repositories will not be available until after networking has started. That means packages newer than on your local boot media would not be available after a reboot, unless they were made to persistent, by having a local package cache available on a local, writable, storage device.
If additional or updated packages have been added to the system, these may also be made available for automatic (re)installation and copied into RAM during the boot phase without any (re)downloading, by enabling a local package cache on a writable storage. The local package cache can be stored on the same partition as the .apkovl file.
Installation
During Installation, Alpine Linux Setup script Setup-alpine
uses setup-lbu
script to configure a "local backup" location to save the initial local configuration state as an .apkovl file using lbu
tool. If subsequent changes are made to the running system, the command lbu commit
must be used to update the .apkovl file.
Boot the diskless system from the installation media. Due to Bug: #10473 storing local configs and package cache on internal disks requires manual steps listed below before running setup-alpine
script.
Apkovl on internal disk
To save customized running states to an .apkovl file on a writable partition on internal disks, the following steps are needed to be manually done i.e. create a filesystem, making an entry in /etc/fstab, create mountpoint, and mount , as follows:
- If necessary partition(s) are unavailable, manually create a partition. In the below steps, we will use /dev/sdXY as partition number. Adjust the partition identifier as per blkid
- Due to Bug: #11589. The APKOVL loading of diskless setups doesn't work on btrfs and xfs filesystems, or nvme-based devices. So use only ext4 filesystem partitions on classic drives to store diskless mode states.
- mkfs.ext4 creates ext4 filesystem with 64bit feature enabled by default, but extlinux may not be able to boot with that due to Issue #14895. You may need to add "-O ^64bit" to mkfs.ext4 to circumvent this. The below command creates an ext4 partition with disabled journaling, to reduce write operations and allow the disk to spin down after the .apkovl and the packages have been read from the partition during the boot.
mkfs.ext4 -O ^has_journal,^64bit /dev/sdXY
- Due to a bug, the partition can not be mounted to /boot. Configure the /etc/fstab to mount the writable partition to /media/sdXY instead of /boot i.e. conforming to the hot/cold-plug mountpoints.
mkdir /media/sdXY
echo "/dev/sdXY /media/sdXY ext4 noatime,ro 0 0" >> /etc/fstab
- Mount the partitions listed in /etc/fstab.
Look at the output to verify that the changes have been applied correctly.mount -a
- If
Setup-alpine
has not run before, follow the Installation steps to complete the base configuration. The above changes should now enable you to choose the partition for saving the local configs and package cache. If asked, there is no need to first unmount the partition, that would only be needed to allow installing on its parent disk. - If
Setup-alpine
has already been used to configure the diskless system, the storage settings may be modified directly withsetup-lbu sdXY
- Local package cache can be enabled as follows:
mkdir /media/sdXY/cache
setup-apkcache /media/sdXY/cache
- If the partition is large enough, it can be useful to edit lbu.conf to uncomment and set BACKUP_LIMIT=3. For example, to allow reverting to a previous, working state if needed.
apk add nano
nano /etc/lbu/lbu.conf
- Finally, generate the first .apkovl file containing all the previous changes by executing
lbu commit
, so the customizations that were just made will persist a reboot.lbu commit
- From now on, whenever packages are installed or newly configured, and the changes should be kept, execute
lbu commit
.
Customizable boot device
Alpine Linux running Diskless mode can also boot from a partition with a writable filesystem on USB-Stick/CompactFlash/SDCard or SSD/NVMe harddisk. This boot device is known as customizable boot device to differentiate against iso9660 filesystem based read only Installation Media based boot device. Local customizations like apkovl files and cached packages can be stored in this customizable boot device, which also allows to also upgrade the kernel with its modules and firmware with the update-kernel
script.
For the newly configured local "diskless" system, it is possible to copy the boot system from a read-only installation media to a writable vfat partition (e.g. /dev/sdXY) with setup-bootable
script or manually to any writable partition and create a customizable boot device.
Loading apkovl from webserver
Alpine's "diskless mode" ISO boot images support boot parameters to load customizations files i.e apkovl from a webserver.
It's possible to load an APKOVL file from a webserver, by supplying a custom url with the APKOVL
kernel boot parameter. If you don't have a web server you can run busybox's httpd temporarily to serve an .apkovl - busybox httpd -p 127.0.0.1:80
.
Upgrading a Running System
When Alping Linux runs in "diskless" or "data" disk mode, Upgrading a running system requires few extra steps.
If booting a "diskless" system from a read-only device, or as an iso image on writable media, it's not possible to update the boot files (kernel, modules, firmware, ...) that reside on that device.
For customizable boot device, It is possible to update the boot files. However, even then, the kernel, with its modules and firmware files, can still not be updated directly through regular packages updates. Instead, there is the update-kernel
script that can generate initfs images and install them together with upgraded kernels.
Upgrading can be done as follows.
apk add mkinitfs
This package is required for the generation of the initial filesystem used during boot.
- Additional initfs features that are missing in the default configuration, like the btrfs filesystem support (at the time of writing, to allow loading .apkovl configs and package cache during boot), may be enabled in
/etc/mkinitfs/mkinitfs.conf
. - Available initfs features may be listed with
ls /etc/mkinitfs/features.d
ls /etc/mkinitfs/features.d apk add nano nano /etc/mkinitfs/mkinitfs.conf lbu commit
Finally update the kernel and its boot environment.
update-kernel /media/sdXY/boot/
- An
update-kernel
run needs at least 8 GB free ram memory to avoid a broken modloop-image. - See
update-kernel --help
for options to manually add additional module or firmware packages.
See Also
- Alpine Local backup Utility - lbu'
- Local package cache
- Manually editing a existing apkovl
- Back Up a Flash Memory Installation
- Upgrading Diskless to New Alpine Linux Release
- Diskless PXE Boot
- How to make a custom ISO image with mkimage
- QEMU Diskless example
- Include special files section - To include custom files outside of
/etc
in .apkovl file.