2007-04-26 15:57:43 -07:00
|
|
|
====================
|
2005-04-16 15:20:36 -07:00
|
|
|
kAFS: AFS FILESYSTEM
|
|
|
|
====================
|
|
|
|
|
2007-04-26 15:57:43 -07:00
|
|
|
Contents:
|
|
|
|
|
|
|
|
- Overview.
|
|
|
|
- Usage.
|
|
|
|
- Mountpoints.
|
|
|
|
- Proc filesystem.
|
|
|
|
- The cell database.
|
|
|
|
- Security.
|
|
|
|
- Examples.
|
|
|
|
|
|
|
|
|
|
|
|
========
|
|
|
|
OVERVIEW
|
|
|
|
========
|
2005-04-16 15:20:36 -07:00
|
|
|
|
2007-04-26 15:57:43 -07:00
|
|
|
This filesystem provides a fairly simple secure AFS filesystem driver. It is
|
|
|
|
under development and does not yet provide the full feature set. The features
|
|
|
|
it does support include:
|
2005-04-16 15:20:36 -07:00
|
|
|
|
2007-04-26 15:57:43 -07:00
|
|
|
(*) Security (currently only AFS kaserver and KerberosIV tickets).
|
2005-04-16 15:20:36 -07:00
|
|
|
|
2009-08-19 08:10:16 -07:00
|
|
|
(*) File reading and writing.
|
2005-04-16 15:20:36 -07:00
|
|
|
|
2007-04-26 15:57:43 -07:00
|
|
|
(*) Automounting.
|
|
|
|
|
2009-08-19 08:10:16 -07:00
|
|
|
(*) Local caching (via fscache).
|
2007-04-26 15:57:43 -07:00
|
|
|
|
2009-08-19 08:10:16 -07:00
|
|
|
It does not yet support the following AFS features:
|
2007-04-26 15:57:43 -07:00
|
|
|
|
|
|
|
(*) pioctl() system call.
|
|
|
|
|
|
|
|
|
|
|
|
===========
|
|
|
|
COMPILATION
|
|
|
|
===========
|
|
|
|
|
|
|
|
The filesystem should be enabled by turning on the kernel configuration
|
|
|
|
options:
|
|
|
|
|
|
|
|
CONFIG_AF_RXRPC - The RxRPC protocol transport
|
|
|
|
CONFIG_RXKAD - The RxRPC Kerberos security handler
|
|
|
|
CONFIG_AFS - The AFS filesystem
|
|
|
|
|
|
|
|
Additionally, the following can be turned on to aid debugging:
|
|
|
|
|
|
|
|
CONFIG_AF_RXRPC_DEBUG - Permit AF_RXRPC debugging to be enabled
|
|
|
|
CONFIG_AFS_DEBUG - Permit AFS debugging to be enabled
|
|
|
|
|
|
|
|
They permit the debugging messages to be turned on dynamically by manipulating
|
|
|
|
the masks in the following files:
|
|
|
|
|
|
|
|
/sys/module/af_rxrpc/parameters/debug
|
2009-08-19 08:10:16 -07:00
|
|
|
/sys/module/kafs/parameters/debug
|
2007-04-26 15:57:43 -07:00
|
|
|
|
|
|
|
|
|
|
|
=====
|
2005-04-16 15:20:36 -07:00
|
|
|
USAGE
|
|
|
|
=====
|
|
|
|
|
|
|
|
When inserting the driver modules the root cell must be specified along with a
|
|
|
|
list of volume location server IP addresses:
|
|
|
|
|
2009-08-19 08:10:16 -07:00
|
|
|
modprobe af_rxrpc
|
|
|
|
modprobe rxkad
|
|
|
|
modprobe kafs rootcell=cambridge.redhat.com:172.16.18.73:172.16.18.91
|
2005-04-16 15:20:36 -07:00
|
|
|
|
2007-04-26 15:57:43 -07:00
|
|
|
The first module is the AF_RXRPC network protocol driver. This provides the
|
|
|
|
RxRPC remote operation protocol and may also be accessed from userspace. See:
|
|
|
|
|
|
|
|
Documentation/networking/rxrpc.txt
|
|
|
|
|
|
|
|
The second module is the kerberos RxRPC security driver, and the third module
|
|
|
|
is the actual filesystem driver for the AFS filesystem.
|
2005-04-16 15:20:36 -07:00
|
|
|
|
|
|
|
Once the module has been loaded, more modules can be added by the following
|
|
|
|
procedure:
|
|
|
|
|
2009-08-19 08:10:16 -07:00
|
|
|
echo add grand.central.org 18.9.48.14:128.2.203.61:130.237.48.87 >/proc/fs/afs/cells
|
2005-04-16 15:20:36 -07:00
|
|
|
|
|
|
|
Where the parameters to the "add" command are the name of a cell and a list of
|
2007-04-26 15:57:43 -07:00
|
|
|
volume location servers within that cell, with the latter separated by colons.
|
2005-04-16 15:20:36 -07:00
|
|
|
|
|
|
|
Filesystems can be mounted anywhere by commands similar to the following:
|
|
|
|
|
|
|
|
mount -t afs "%cambridge.redhat.com:root.afs." /afs
|
|
|
|
mount -t afs "#cambridge.redhat.com:root.cell." /afs/cambridge
|
|
|
|
mount -t afs "#root.afs." /afs
|
|
|
|
mount -t afs "#root.cell." /afs/cambridge
|
|
|
|
|
|
|
|
Where the initial character is either a hash or a percent symbol depending on
|
|
|
|
whether you definitely want a R/W volume (hash) or whether you'd prefer a R/O
|
|
|
|
volume, but are willing to use a R/W volume instead (percent).
|
|
|
|
|
|
|
|
The name of the volume can be suffixes with ".backup" or ".readonly" to
|
|
|
|
specify connection to only volumes of those types.
|
|
|
|
|
|
|
|
The name of the cell is optional, and if not given during a mount, then the
|
2009-08-19 08:10:16 -07:00
|
|
|
named volume will be looked up in the cell specified during modprobe.
|
2005-04-16 15:20:36 -07:00
|
|
|
|
|
|
|
Additional cells can be added through /proc (see later section).
|
|
|
|
|
|
|
|
|
2007-04-26 15:57:43 -07:00
|
|
|
===========
|
2005-04-16 15:20:36 -07:00
|
|
|
MOUNTPOINTS
|
|
|
|
===========
|
|
|
|
|
2007-04-26 15:57:43 -07:00
|
|
|
AFS has a concept of mountpoints. In AFS terms, these are specially formatted
|
|
|
|
symbolic links (of the same form as the "device name" passed to mount). kAFS
|
|
|
|
presents these to the user as directories that have a follow-link capability
|
|
|
|
(ie: symbolic link semantics). If anyone attempts to access them, they will
|
|
|
|
automatically cause the target volume to be mounted (if possible) on that site.
|
2005-04-16 15:20:36 -07:00
|
|
|
|
2007-04-26 15:57:43 -07:00
|
|
|
Automatically mounted filesystems will be automatically unmounted approximately
|
|
|
|
twenty minutes after they were last used. Alternatively they can be unmounted
|
|
|
|
directly with the umount() system call.
|
2005-04-16 15:20:36 -07:00
|
|
|
|
2007-04-26 15:57:43 -07:00
|
|
|
Manually unmounting an AFS volume will cause any idle submounts upon it to be
|
|
|
|
culled first. If all are culled, then the requested volume will also be
|
|
|
|
unmounted, otherwise error EBUSY will be returned.
|
2005-04-16 15:20:36 -07:00
|
|
|
|
2007-04-26 15:57:43 -07:00
|
|
|
This can be used by the administrator to attempt to unmount the whole AFS tree
|
|
|
|
mounted on /afs in one go by doing:
|
2005-04-16 15:20:36 -07:00
|
|
|
|
2007-04-26 15:57:43 -07:00
|
|
|
umount /afs
|
2005-04-16 15:20:36 -07:00
|
|
|
|
|
|
|
|
2007-04-26 15:57:43 -07:00
|
|
|
===============
|
2005-04-16 15:20:36 -07:00
|
|
|
PROC FILESYSTEM
|
|
|
|
===============
|
|
|
|
|
|
|
|
The AFS modules creates a "/proc/fs/afs/" directory and populates it:
|
|
|
|
|
2007-04-26 15:57:43 -07:00
|
|
|
(*) A "cells" file that lists cells currently known to the afs module and
|
|
|
|
their usage counts:
|
|
|
|
|
|
|
|
[root@andromeda ~]# cat /proc/fs/afs/cells
|
|
|
|
USE NAME
|
|
|
|
3 cambridge.redhat.com
|
2005-04-16 15:20:36 -07:00
|
|
|
|
|
|
|
(*) A directory per cell that contains files that list volume location
|
|
|
|
servers, volumes, and active servers known within that cell.
|
|
|
|
|
2007-04-26 15:57:43 -07:00
|
|
|
[root@andromeda ~]# cat /proc/fs/afs/cambridge.redhat.com/servers
|
|
|
|
USE ADDR STATE
|
|
|
|
4 172.16.18.91 0
|
|
|
|
[root@andromeda ~]# cat /proc/fs/afs/cambridge.redhat.com/vlservers
|
|
|
|
ADDRESS
|
|
|
|
172.16.18.91
|
|
|
|
[root@andromeda ~]# cat /proc/fs/afs/cambridge.redhat.com/volumes
|
|
|
|
USE STT VLID[0] VLID[1] VLID[2] NAME
|
|
|
|
1 Val 20000000 20000001 20000002 root.afs
|
2005-04-16 15:20:36 -07:00
|
|
|
|
2007-04-26 15:57:43 -07:00
|
|
|
|
|
|
|
=================
|
2005-04-16 15:20:36 -07:00
|
|
|
THE CELL DATABASE
|
|
|
|
=================
|
|
|
|
|
2007-04-26 15:57:43 -07:00
|
|
|
The filesystem maintains an internal database of all the cells it knows and the
|
|
|
|
IP addresses of the volume location servers for those cells. The cell to which
|
2009-08-19 08:10:16 -07:00
|
|
|
the system belongs is added to the database when modprobe is performed by the
|
2007-04-26 15:57:43 -07:00
|
|
|
"rootcell=" argument or, if compiled in, using a "kafs.rootcell=" argument on
|
|
|
|
the kernel command line.
|
2005-04-16 15:20:36 -07:00
|
|
|
|
|
|
|
Further cells can be added by commands similar to the following:
|
|
|
|
|
|
|
|
echo add CELLNAME VLADDR[:VLADDR][:VLADDR]... >/proc/fs/afs/cells
|
2009-08-19 08:10:16 -07:00
|
|
|
echo add grand.central.org 18.9.48.14:128.2.203.61:130.237.48.87 >/proc/fs/afs/cells
|
2005-04-16 15:20:36 -07:00
|
|
|
|
|
|
|
No other cell database operations are available at this time.
|
|
|
|
|
|
|
|
|
2007-04-26 15:57:43 -07:00
|
|
|
========
|
|
|
|
SECURITY
|
|
|
|
========
|
|
|
|
|
|
|
|
Secure operations are initiated by acquiring a key using the klog program. A
|
|
|
|
very primitive klog program is available at:
|
|
|
|
|
|
|
|
http://people.redhat.com/~dhowells/rxrpc/klog.c
|
|
|
|
|
|
|
|
This should be compiled by:
|
|
|
|
|
|
|
|
make klog LDLIBS="-lcrypto -lcrypt -lkrb4 -lkeyutils"
|
|
|
|
|
|
|
|
And then run as:
|
|
|
|
|
|
|
|
./klog
|
|
|
|
|
|
|
|
Assuming it's successful, this adds a key of type RxRPC, named for the service
|
|
|
|
and cell, eg: "afs@<cellname>". This can be viewed with the keyctl program or
|
|
|
|
by cat'ing /proc/keys:
|
|
|
|
|
|
|
|
[root@andromeda ~]# keyctl show
|
|
|
|
Session Keyring
|
|
|
|
-3 --alswrv 0 0 keyring: _ses.3268
|
|
|
|
2 --alswrv 0 0 \_ keyring: _uid.0
|
|
|
|
111416553 --als--v 0 0 \_ rxrpc: afs@CAMBRIDGE.REDHAT.COM
|
|
|
|
|
|
|
|
Currently the username, realm, password and proposed ticket lifetime are
|
|
|
|
compiled in to the program.
|
|
|
|
|
|
|
|
It is not required to acquire a key before using AFS facilities, but if one is
|
|
|
|
not acquired then all operations will be governed by the anonymous user parts
|
|
|
|
of the ACLs.
|
|
|
|
|
|
|
|
If a key is acquired, then all AFS operations, including mounts and automounts,
|
|
|
|
made by a possessor of that key will be secured with that key.
|
|
|
|
|
|
|
|
If a file is opened with a particular key and then the file descriptor is
|
|
|
|
passed to a process that doesn't have that key (perhaps over an AF_UNIX
|
|
|
|
socket), then the operations on the file will be made with key that was used to
|
|
|
|
open the file.
|
|
|
|
|
|
|
|
|
|
|
|
========
|
2005-04-16 15:20:36 -07:00
|
|
|
EXAMPLES
|
|
|
|
========
|
|
|
|
|
2007-04-26 15:57:43 -07:00
|
|
|
Here's what I use to test this. Some of the names and IP addresses are local
|
|
|
|
to my internal DNS. My "root.afs" partition has a mount point within it for
|
2005-04-16 15:20:36 -07:00
|
|
|
some public volumes volumes.
|
|
|
|
|
2007-04-26 15:57:43 -07:00
|
|
|
insmod /tmp/rxrpc.o
|
|
|
|
insmod /tmp/rxkad.o
|
|
|
|
insmod /tmp/kafs.o rootcell=cambridge.redhat.com:172.16.18.91
|
2005-04-16 15:20:36 -07:00
|
|
|
|
|
|
|
mount -t afs \%root.afs. /afs
|
|
|
|
mount -t afs \%cambridge.redhat.com:root.cell. /afs/cambridge.redhat.com/
|
|
|
|
|
2009-08-19 08:10:16 -07:00
|
|
|
echo add grand.central.org 18.9.48.14:128.2.203.61:130.237.48.87 > /proc/fs/afs/cells
|
2005-04-16 15:20:36 -07:00
|
|
|
mount -t afs "#grand.central.org:root.cell." /afs/grand.central.org/
|
|
|
|
mount -t afs "#grand.central.org:root.archive." /afs/grand.central.org/archive
|
|
|
|
mount -t afs "#grand.central.org:root.contrib." /afs/grand.central.org/contrib
|
|
|
|
mount -t afs "#grand.central.org:root.doc." /afs/grand.central.org/doc
|
|
|
|
mount -t afs "#grand.central.org:root.project." /afs/grand.central.org/project
|
|
|
|
mount -t afs "#grand.central.org:root.service." /afs/grand.central.org/service
|
|
|
|
mount -t afs "#grand.central.org:root.software." /afs/grand.central.org/software
|
|
|
|
mount -t afs "#grand.central.org:root.user." /afs/grand.central.org/user
|
|
|
|
|
|
|
|
umount /afs
|
|
|
|
rmmod kafs
|
2007-04-26 15:57:43 -07:00
|
|
|
rmmod rxkad
|
2005-04-16 15:20:36 -07:00
|
|
|
rmmod rxrpc
|