Local APK cache: Difference between revisions

From Alpine Linux
(Created page with "Alpine Linux needs to be able to pull packages from local media on boot. (You can't download packages from the net before you have a network connection.) Using remote repositori...")
 
m (Fixed typo and added filesystem specification for mount command)
(15 intermediate revisions by 7 users not shown)
Line 3: Line 3:
The solution is a local cache of updated packages.  This cache can be stored on any r/w media, typically the same location as the apkovl.
The solution is a local cache of updated packages.  This cache can be stored on any r/w media, typically the same location as the apkovl.


The cache is enbaled by creating a symlink named ''/etc/apk/cache'' that points to the cache directory.
= Enabling Local Cache =
The cache is enabled by creating a symlink named ''/etc/apk/cache'' that points to the cache directory. Note that ''apk'' will ignore any cache residing on a ''tmpfs'' volume. If you want this for some reason, see section below on tmpfs caches.


To enable local cache run: {{Cmd|setup-apkcache}}
To enable local cache run: {{Cmd|setup-apkcache}}


=== To enable Local Cache on releases prior v2.3 ===
== To enable Local Cache on releases prior v2.3 ==
Alpine Linux version prior to v2.3 does not have the ''setup-apkcache'' tool so the symlink needs to be set up manually.
Alpine Linux version prior to v2.3 does not have the ''setup-apkcache'' tool so the symlink needs to be set up manually.


==== To Manually Enable Local Cache on HDD install ====
== To manually enable Local Cache on HDD install ==
If you've installed Alpine to your hard drive (as 'sys'), then create a cache dir and then an ''/etc/apk/cache'' symlink pointing to that dir:
If you've installed Alpine to your hard drive (as 'sys'), then create a cache dir and then an ''/etc/apk/cache'' symlink pointing to that dir:
{{Cmd|mkdir -p /var/cache/apk
{{Cmd|mkdir -p /var/cache/apk
Line 17: Line 18:
You normally don't need apk cache on HDD 'sys' installs but it might be handy if you re-install from net to have the packages cached.
You normally don't need apk cache on HDD 'sys' installs but it might be handy if you re-install from net to have the packages cached.


==== To Manually Enable Local Cache on run-from-RAM installs ====
== To manually enable Local Cache on run-from-RAM installs ==
 
# Create a '''cache''' directory on the device you store your lbu backups (typically, <code>/dev/sda1</code>.)  {{Cmd| mkdir /media/sda1/cache }}
# Create a '''cache''' directory on the device you store your lbu backups (typically, <code>/dev/sda1</code>.)  {{Cmd| mkdir /media/sda1/cache }}
{{Tip|If you get an error that says "mkdir: can't create directory '/media/usbdisk/cache': Read-only file system", then you probably need to remount your disk read-write temporarily.  Try {{Cmd|mount -o remount,rw /media/sda1}} and then don't forget to run {{Cmd|mount -o remount,ro /media/sda1}} when you are done with the following commands}}
{{Tip|If you get an error that says "mkdir: can't create directory '/media/usbdisk/cache': Read-only file system", then you probably need to remount your disk read-write temporarily.  Try {{Cmd|mount -o remount,rw /media/sda1}} and then don't forget to run {{Cmd|mount -o remount,ro /media/sda1}} when you are done with the following commands}}
# Create a symlink to this directory from <code>/etc/apk/cache</code>.  {{Cmd|ln -s /media/sda1/cache /etc/apk/cache}}
# Create a symlink to this directory from <code>/etc/apk/cache</code>.  {{Cmd|ln -s /media/sda1/cache /etc/apk/cache}}
# Run an lbu commit to save the change (<code>/etc/apk/cache</code> is in <code>/etc</code> and is automatically backed up.) {{Cmd|lbu commit}}
# Run an lbu commit to save the change (<code>/etc/apk/cache</code> is in <code>/etc</code> and is automatically backed up.) {{Cmd|lbu commit}}
# Done.  Now whenever you run an apk command that pulls a new package from a remote repository, The package is stored on your local media.  On startup, Alpine Linux will check the local cache for new packages, and will install them in preference.
# Done.  Now whenever you run an apk command that pulls a new package from a remote repository, the package is stored on your local media.  On startup, Alpine Linux will check the local cache for new packages, and will install them if available.
 
So you now have a run-from-RAM distro that can do a '''yum upgrade''' or '''apt-get dist-upgrade'''
 
 
=== Cache Maintenance ===


= Cache maintenance =
Over time, newer packages will replace older ones; the cache directory will contain all older versions of packages.   
Over time, newer packages will replace older ones; the cache directory will contain all older versions of packages.   


==== Delete Old Packages ====
== Delete old packages ==
To clean out older versions of packages, run the '''clean''' command.  {{cmd|apk cache clean}} or to see what is deleted {{cmd|apk -v cache clean}}
To clean out older versions of packages, run the '''clean''' command.  {{cmd|apk cache clean}} or to see what is deleted {{cmd|apk -v cache clean}}


==== Download Missing Packages ====
== Download missing packages ==
If you accidentally delete packages from the cache directory, you can make sure they are there with the '''download''' command, {{cmd|apk cache download}}
If you accidentally delete packages from the cache directory, you can make sure they are there with the '''download''' command, {{cmd|apk cache download}}


==== Delete and Download In One Step ====
== Delete and download in one step ==
You can combine the two steps into one with the '''sync''' command - this cleans out old packages and downloads missing packages. {{cmd|apk cache -v sync}}
You can combine the two steps into one with the '''sync''' command - this cleans out old packages and downloads missing packages. {{cmd|apk cache -v sync}}


==== Automatically Cleaning Cache on Reboot ====
== Automatically Cleaning Cache on Reboot ==
To automatically attempt to validate your cache on reboot, you can add the above command to the <code>/etc/conf.d/local</code> script, in the <code>stop</code> stanza:
To automatically attempt to validate your cache on reboot, you can add the above command to a {{Path|/etc/local.d/*.stop}} file:


local_stop() {  
{{Cat|/etc/local.d/cache.stop|#!/bin/sh
        # This is a good place to unload any misc.
 
        # programs you started above.
 
# verify the local cache on shutdown
        # verify the local cache on shutdown
apk cache -v sync
        apk cache -v sync
 
 
# We should always return 0
        # We should always return 0
return 0
        return 0
}}
}


{{Tip|Usually the only time you need to reboot is when things have gone horribly wrong; so this is a "best effort" to cover forgetting to sync the cache; It is much better to run '''sync''' immediately after adding or upgrading packages.}}
{{Tip|Usually the only time you need to reboot is when things have gone horribly wrong; so this is a "best effort" to cover forgetting to sync the cache; It is much better to run '''sync''' immediately after adding or upgrading packages.}}
{{Note|Custom shutdown commands were formerly added to a {{Path|/etc/conf.d/local}}; but that method is now deprecated.}}
= Using the Local Cache with tmpfs volumes =
In some circumstances it might be useful to have the cache reside on tmpfs, for example if you only wish for it to last as long as the system is up.
NOTE: ''apk'' is coded to ignore tmpfs caches, and this is correct behaviour in most instances. Using tmpfs as a package cache can consume large amounts of system memory if you install a lot of packages, possibly resulting in a crashed system. You can limit this by restricting the size of your cache to a small number (128M in the example below).
To do it, you need to create an image inside which your cache can live. We do this by creating an image file, formatting it with ext2, and mounting it at ''/etc/apk/cache''.
* apk add e2fsprogs
* dd if=/dev/zero of=/apkcache.img bs=1M count=128
* mkfs.ext2 -F /apkcache.img
* mkdir -p /etc/apk/cache
* mount -t ext2 /apkcache.img /etc/apk/cache
* apk update
As per usual, if you want to download currently installed packages into the cache, use ''apk cache sync''.
[[Category:Package Manager]]
<!--
== Enabling Package Caching (Older) ==
{{Note|This document applies to Alpine 1.9 and later versions only}}
Package caching is useful when the need arises to upgrade packages on read-only media. Package caching allows you to store newer packages in a location on writable media, which Alpine checks for when loading packages on start-up.
This can be enabled either from the console or through the ACF.
{{Tip|For package upgrades, it is useful to point Alpine Package Manager to repositories on the internet, to easily obtain package upgrades when they become available.}}
{{:Include:Using_Internet_Repositories_for_apk-tools}}
== Enable caching from either console or ACF ==
Choose one of the two methods below to enable, either from the console or from the ACF web interface.
=== Option 1: Enable caching from the console ===
''Substitute 'sda1' in the example below for the actual device you will use to store the caching directory.''
First upgrade apk-tools:
{{Cmd|apk add –u apk-tools}}
Now enable package caching:
{{Cmd|mkdir –p /media/sda1/cache
ln –s /media/sda1/cache /etc/apk/cache}}
=== Option 2: From the ACF ===
Browse to '''System > Packages > Cache'''
''Edit Cache Settings:''
Tick '''Enable Cache'''
Specify the '''Cache Directory''', for example:
/media/sda1/cache
Click '''Save'''
-->

Revision as of 16:08, 5 April 2018

Alpine Linux needs to be able to pull packages from local media on boot. (You can't download packages from the net before you have a network connection.) Using remote repositories presents a problem. If the config files have been modified for a newer version of a package, and the older package is on local media, all sorts of fun can result.

The solution is a local cache of updated packages. This cache can be stored on any r/w media, typically the same location as the apkovl.

Enabling Local Cache

The cache is enabled by creating a symlink named /etc/apk/cache that points to the cache directory. Note that apk will ignore any cache residing on a tmpfs volume. If you want this for some reason, see section below on tmpfs caches.

To enable local cache run:

setup-apkcache

To enable Local Cache on releases prior v2.3

Alpine Linux version prior to v2.3 does not have the setup-apkcache tool so the symlink needs to be set up manually.

To manually enable Local Cache on HDD install

If you've installed Alpine to your hard drive (as 'sys'), then create a cache dir and then an /etc/apk/cache symlink pointing to that dir:

mkdir -p /var/cache/apk ln -s /var/cache/apk /etc/apk/cache

You normally don't need apk cache on HDD 'sys' installs but it might be handy if you re-install from net to have the packages cached.

To manually enable Local Cache on run-from-RAM installs

  1. Create a cache directory on the device you store your lbu backups (typically, /dev/sda1.)

    mkdir /media/sda1/cache

Tip: If you get an error that says "mkdir: can't create directory '/media/usbdisk/cache': Read-only file system", then you probably need to remount your disk read-write temporarily. Try

mount -o remount,rw /media/sda1

and then don't forget to run

mount -o remount,ro /media/sda1

when you are done with the following commands
  1. Create a symlink to this directory from /etc/apk/cache.

    ln -s /media/sda1/cache /etc/apk/cache

  2. Run an lbu commit to save the change (/etc/apk/cache is in /etc and is automatically backed up.)

    lbu commit

  3. Done. Now whenever you run an apk command that pulls a new package from a remote repository, the package is stored on your local media. On startup, Alpine Linux will check the local cache for new packages, and will install them if available.

Cache maintenance

Over time, newer packages will replace older ones; the cache directory will contain all older versions of packages.

Delete old packages

To clean out older versions of packages, run the clean command.

apk cache clean

or to see what is deleted

apk -v cache clean

Download missing packages

If you accidentally delete packages from the cache directory, you can make sure they are there with the download command,

apk cache download

Delete and download in one step

You can combine the two steps into one with the sync command - this cleans out old packages and downloads missing packages.

apk cache -v sync

Automatically Cleaning Cache on Reboot

To automatically attempt to validate your cache on reboot, you can add the above command to a /etc/local.d/*.stop file:

Contents of /etc/local.d/cache.stop

#!/bin/sh # verify the local cache on shutdown apk cache -v sync # We should always return 0 return 0
Tip: Usually the only time you need to reboot is when things have gone horribly wrong; so this is a "best effort" to cover forgetting to sync the cache; It is much better to run sync immediately after adding or upgrading packages.
Note: Custom shutdown commands were formerly added to a /etc/conf.d/local; but that method is now deprecated.


Using the Local Cache with tmpfs volumes

In some circumstances it might be useful to have the cache reside on tmpfs, for example if you only wish for it to last as long as the system is up.

NOTE: apk is coded to ignore tmpfs caches, and this is correct behaviour in most instances. Using tmpfs as a package cache can consume large amounts of system memory if you install a lot of packages, possibly resulting in a crashed system. You can limit this by restricting the size of your cache to a small number (128M in the example below).

To do it, you need to create an image inside which your cache can live. We do this by creating an image file, formatting it with ext2, and mounting it at /etc/apk/cache.

  • apk add e2fsprogs
  • dd if=/dev/zero of=/apkcache.img bs=1M count=128
  • mkfs.ext2 -F /apkcache.img
  • mkdir -p /etc/apk/cache
  • mount -t ext2 /apkcache.img /etc/apk/cache
  • apk update

As per usual, if you want to download currently installed packages into the cache, use apk cache sync.