2.1. Customizing the Configuration¶
Each Bareos component (Director, Client, Storage, Console) has its own configuration containing a set of resource definitions. These resources are very similar from one service to another, but may contain different directives (records) depending on the component. For example, in the Director configuration, the Director Resource defines the name of the Director, a number of global Director parameters and his password. In the File daemon configuration, the Director Resource specifies which Directors are permitted to use the File daemon.
If you install all Bareos daemons (Director, Storage and File Daemon) onto one system, the Bareos package tries its best to generate a working configuration as a basis for your individual configuration.
The details of each resource and the directives permitted therein are described in the following chapters.
The following configuration files must be present:
- Director Configuration – to define the resources necessary for the Director. You define all the Clients and Storage daemons that you use in this configuration file.
- Storage Daemon Configuration – to define the resources to be used by each Storage daemon. Normally, you will have a single Storage daemon that controls your disk storage or tape drives. However, if you have tape drives on several machines, you will have at least one Storage daemon per machine.
- Client/File Daemon Configuration – to define the resources for each client to be backed up. That is, you will have a separate Client resource file on each machine that runs a File daemon.
- Console Configuration – to define the resources for the Console program (user interface to the Director). It defines which Directors are available so that you may interact with them.
2.1.1. Configuration Path Layout¶
When a Bareos component starts, it reads its configuration. In Bareos 16.2.2 only configuration files (which optionally can include other files) are supported. Since Bareos 16.2.2 also configuration subdirectories are supported.
2.1.1.1. Naming¶
In this section, the following naming is used:
CONFIGDIR
refers to the base configuration directory. Bareos Linux packages use/etc/bareos/
.- A component is one of the following Bareos programs:
- bareos-dir
- bareos-sd
- bareos-fd
- bareos-traymonitor
- bconsole
- bat (only legacy config file: bat.conf)
- Bareos tools, like section-VolumeUtilityCommands and others.
COMPONENT
refers to one of the listed components.
2.1.1.1.1. What configuration will be used?¶
When starting a Bareos component, it will look for its configuration. Bareos components allow the configuration file/directory to be specified as a command line parameter -c PATH
.
- configuration path parameter is not given (default)
CONFIGDIR/COMPONENT.conf
is a file- the configuration is read from the file
CONFIGDIR/COMPONENT.conf
- the configuration is read from the file
CONFIGDIR/COMPONENT.d/
is a directory- the configuration is read from
CONFIGDIR/COMPONENT.d/*/*.conf
(subdirectory configuration)
- the configuration is read from
- configuration path parameter is given (
-c PATH
)PATH
is a file- the configuration is read from the file specified in
PATH
- the configuration is read from the file specified in
PATH
is a directory- the configuration is read from
PATH/COMPONENT.d/*/*.conf
(subdirectory configuration)
- the configuration is read from
As the CONFIGDIR`
differs between platforms or is overwritten by the path parameter, the documentation will often refer to the configuration without the leading path (e.g. path:COMPONENT.d/*/*.conf
instead of ``path:CONFIGDIR/COMPONENT.d//.conf`).
When subdirectory configuration is used, all files matching PATH/COMPONENT.d/*/*.conf
will be read, see section-ConfigurationSubdirectories.
2.1.1.1.1.1. Relation between Bareos components and configuration¶
2.1.1.1.2. Subdirectory Configuration Scheme¶
If the subdirectory configuration is used, instead of a single configuration file, all files matching COMPONENT.d/*/*.conf
are read as a configuration, see What configuration will be used?.
2.1.1.2. Reason for the Subdirectory Configuration Scheme¶
In Bareos 16.2.2, Bareos uses one configuration file per component.
Most larger Bareos environments split their configuration into separate files, making it easier to manage the configuration.
Also some extra packages (bareos-webui, plugins, …) require a configuration, which must be included into the Bareos Director Daemon or Bareos Storage Daemon configuration. The subdirectory approach makes it easier to add or modify the configuration resources of different Bareos packages.
The Bareos configure command requires a configuration directory structure, as provided by the subdirectory approach.
From Bareos 16.2.4 on, new installations will use configuration subdirectories by default.
2.1.1.3. Resource file conventions¶
- Each configuration resource has to use its own configuration file.
- The path of a resource file is
COMPONENT.d/RESOURCETYPE/RESOURCENAME.conf
. - The name of the configuration file is identical with the resource name:
- e.g.
bareos-dir.d/director/bareos-dir.conf
bareos-dir.d/pool/Full.conf
- Exceptions:
- The resource file
bareos-fd.d/client/myself.conf`
always has the file name ``path:myself.conf`, while the name is normally set to the hostname of the system.
- The resource file
- e.g.
- Example resource files:
- Additional packages can contain configuration files that are automatically included. However, most additional configuration resources require configuration. When a resource file requires configuration, it has to be included as an example file:
CONFIGDIR/COMPONENT.d/RESOURCE/NAME.conf.example
- For example, the Bareos Webui entails one config resource and one config resource example for the Bareos Director Daemon:
CONFIGDIR/bareos-director.d/profile/webui-admin.conf
CONFIGDIR/bareos-director.d/console/admin.conf.example
- Additional packages can contain configuration files that are automatically included. However, most additional configuration resources require configuration. When a resource file requires configuration, it has to be included as an example file:
- extbfsection-deleteConfigurationResourceFilesDisable/remove configuration resource files:
- Normally you should not remove resources that are already in use (jobs, clients, …). Instead you should disable them by adding the directive Enable = no. Otherwise you take the risk that orphaned entries are kept in the Bareos catalog. However, if a resource has not been used or all references have been cleared from the database, they can also be removed from the configuration.
Warning
- If you want to remove a configuration resource that is part of a Bareos package,
- replace the resource configuration file by an empty file. This prevents the resource from reappearing in the course of a package update.
2.1.1.4. Using Subdirectories Configuration Scheme¶
- The Subdirectories Configuration Scheme is used by default from Bareos 16.2.4 onwards.
- They will be usable immediately after installing a Bareos component.
- If additional packages entail example configuration files (
NAME.conf.example`
), copy them to ``path:NAME.conf`, modify it as required and reload or restart the component.
- When updating to a Bareos version containing the Subdirectories Configuration, the existing configuration will not be touched and is still the default configuration.
Warning
- Problems can occur if you have implemented an own wildcard mechanism to load your configuration
- from the same subdirectories as used by the new packages (verb|path:CONFIGDIR/COMPONENT.d//.conf|). In this case, newly installed configuration resource files can alter your current configuration by adding resources.
Best create a copy of your configuration directory before updating Bareos and modify your existing configuration file to use that other directory.
- As long as the old configuration file (
CONFIGDIR/COMPONENT.conf
) exists, it will be used. - The correct way of migrating to the new configuration scheme would be to split the configuration file into resources, store them in the resource directories and then remove the original configuration file.
- For migrating the Bareos Director Daemon configuration, the script bareos-migrate-config.sh exists. Being called, it connects via bconsole to a running Bareos Director Daemon and creates subdirectories with the resource configuration files.
mkdir CONFIGDIR/COMPONENT.d/migrate && mv CONFIGDIR/COMPONENT.conf CONFIGDIR/COMPONENT.d/migrate
- Resources defined in both, the new configuration directory scheme and the old configuration file, must be removed from one of the places, best from the old configuration file, after verifying that the settings are identical with the new settings.
2.1.2. Configuration File Format¶
A configuration file consists of one or more resources (see Resource).
Bareos programs can work with
- all resources defined in one configuration file
- configuration files that include other configuration files (see Includes)
- section-ConfigurationSubdirectories, where each configuration file contains exactly one resource definition
Bareos assumes that all filenames are in UTF-8 format on Linux and Unix machines. On Win32 they are in Unicode (UTF-16) and will hence be automatically converted to UTF-8 format.
When reading a configuration, blank lines are ignored and everything after a hash sign (#) until the end of the line is taken to be a comment.
A semicolon (;) is a logical end of line and anything after the semicolon is considered as the next statement. If a statement appears on a line by itself, a semicolon is not necessary to terminate it, so generally in the examples in this manual, you will not see many semicolons.
If you wish to break your configuration file into smaller pieces, you can do so by including other files using the syntax @filename where filename
is the full path and filename of another file. The @filename specification can be given anywhere a primitive token would appear.
@/etc/bareos/extra/clients.conf
Since Bareos 16.2.1 wildcards in pathes are supported:
@/etc/bareos/extra/*.conf
By using @|command it is also possible to include the output of a script as a configuration:
@|"/etc/bareos/generate_configuration_to_stdout.sh"
or if a parameter should be used:
@|"sh -c '/etc/bareos/generate_client_configuration_to_stdout.sh clientname=client1.example.com'"
The scripts are called at the start of the daemon. You should use this with care.
2.1.3. Resource¶
A resource is defined as the resource type (see ResTypes), followed by an open brace ({`
), a number of section-ConfigurationResourceDirective`s, and ended by a closing brace (``path:})
Each resource definition MUST contain a Name directive. It can contain a Description directive. The Name directive is used to uniquely identify the resource. The Description directive can be used during the display of the Resource to provide easier human recognition. For example:
Director {
Name = "bareos-dir"
Description = "Main Bareos Director"
Query File = "/usr/lib/bareos/scripts/query.sql"
}
defines the Director resource with the name bareos-dir
and a query file /usr/lib/bareos/scripts/query.sql
.
When naming resources, for some resource types naming conventions should be applied:
- Client
- names should be postfixed with -fd
- Storage
- names should be postfixed with -sd
- Director
- names should be postfixed with -dir
These conventions helps a lot when reading log messages.
Each directive contained within the resource (within the curly braces {}
) is composed of a section-ConfigurationResourceDirectiveKeyword followed by an equal sign (=) followed by a Resource Directive Value. The keywords must be one of the known Bareos resource record keywords.
A resource directive keyword is the part before the equal sign (=
) in a section-ConfigurationResourceDirective. The following sections will list all available directives by Bareos component resources.
2.1.3.1. Upper and Lower Case and Spaces¶
Case (upper/lower) and spaces are ignored in the resource directive keywords.
Within the keyword (i.e. before the equal sign), spaces are not significant. Thus the keywords: name, Name, and N a m e are all identical.
2.1.3.1.1. Resource Directive Value¶
A resource directive value is the part after the equal sign (=
) in a section-ConfigurationResourceDirective.
2.1.3.2. Spaces¶
Spaces after the equal sign and before the first character of the value are ignored. Other spaces within a value may be significant (not ignored) and may require quoting.
2.1.3.3. Quotes¶
In general, if you want spaces in a name to the right of the first equal sign (=), you must enclose that name within double quotes. Otherwise quotes are not generally necessary because once defined, quoted strings and unquoted strings are all equal.
Within a quoted string, any character following a backslash () is taken as itself (handy for inserting backslashes and double quotes (“)).
2.1.3.4. Numbers¶
Numbers are not to be quoted, see Quotes. Also do not prepend numbers by zeros (0), as these are not parsed in the expected manner (write 1 instead of 01).
2.1.3.5. Data Types¶
When parsing the resource directives, Bareos classifies the data according to the types listed below.
acl .. index:
pair: Data Type; acl
Depending on the type of the ACL, the regular expressions can be either resource names, paths or console commands.
Since Bareos 16.2.4 regular expression are handled more strictly. Before also substring matches has been accepted.
Command ACL = help
Command ACL = help, list
Command ACL = help, iDoNotExist
Command ACL = *all*
Command ACL = !sqlquery, !u.*, *all*
Same:
Command ACL = !sqlquery, !u.*
Command ACL = *all*
Command ACL = !sqlquery
Command ACL = !u.*
Comamnd ACL = !set(ip|debug)
Comamnd ACL = *all*
\warning{
ACL checking stops at the first match. So the following definition allows all commands, which might not be what you expected:
}
# WARNING: this configuration ignores !sqlquery, as *all* is matched before.
Command ACL = *all*, !sqlquery
auth-type .. index:
pair: Data Type; auth-type
The following values are allowed:
- None
- Use no password
- Clear
- Use clear text password
- MD5
- Use MD5 hashing
integer .. index:
pair: Data Type; integer
Don’t use quotes around the number, see Quotes.
long integer .. index:
pair: Data Type; long integer
Don’t use quotes around the number, see Quotes.
job protocol .. index:
pair: Data Type; job protocol
The protocol to run a the job. Following protocols are available:
- Native
- Native Bareos job protocol.
- NDMP
- Deprecated. Alias for NDMP_BAREOS.
- NDMP_BAREOS
- Since Bareos 17.2.3. See NDMP_BAREOS.
- NDMP_NATIVE
- Since Bareos 17.2.3. See NDMP_NATIVE.
name .. index:
pair: Data Type; name
Please note that Bareos resource names as well as certain other names (e.g. Volume names) must contain only letters (including ISO accented letters), numbers, and a few special characters (space, underscore, …). All other characters and punctuation are invalid.
password .. index:
pair: Data Type; password
path .. index:
pair: Data Type; path
positive integer .. index:
pair: Data Type; positive integer
Don’t use quotes around the number, see Quotes.
speed .. index:
pair: Data Type; speed
Don’t use quotes around the parameter, see Quotes.
string .. index:
pair: Data Type; string
string-list .. index:
pair: Data Type; string list
strname .. index:
pair: Data Type; strname
net-address .. index:
pair: Data Type; net-address
net-addresses .. index:
pair: Data Type; net-addresses
Addresses = {
ip = { addr = 1.2.3.4; port = 1205;}
ipv4 = {
addr = 1.2.3.4; port = http;}
ipv6 = {
addr = 1.2.3.4;
port = 1205;
}
ip = {
addr = 1.2.3.4
port = 1205
}
ip = { addr = 1.2.3.4 }
ip = { addr = 201:220:222::2 }
ip = {
addr = server.example.com
}
}
where ip, ip4, ip6, addr, and port are all keywords. Note, that the address can be specified as either a dotted quadruple, or in IPv6 colon notation, or as a symbolic name (only in the ip specification). Also, the port can be specified as a number or as the mnemonic value from the :file:`/etc/services` file. If a port is not specified, the default one will be used. If an ip section is specified, the resolution can be made either by IPv4 or IPv6. If ip4 is specified, then only
IPv4 resolutions will be permitted, and likewise with ip6.
net-port .. index:
pair: Data Type; net-port
Don’t use quotes around the parameter, see Quotes.
resource .. index:
pair: Data Type; resource
size .. index:
pair: Data Type; size
- k
- 1,024 (kilobytes)
- kb
- 1,000 (kilobytes)
- m
- 1,048,576 (megabytes)
- mb
- 1,000,000 (megabytes)
- g
- 1,073,741,824 (gigabytes)
- gb
- 1,000,000,000 (gigabytes)
Don’t use quotes around the parameter, see Quotes.
time .. index:
pair: Data Type; time
seconds
audit-command-list .. index:
pair: Data Type; audit command list
yes|no .. index:
pair: Data Type; \yesno
2.1.3.6. Variable Expansion¶
Depending on the directive, Bareos will expand to the following variables:
When labeling a new volume (see Label FormatDirPool ), following Bareos internal variables can be used:
Internal Variable | Description |
$Year | Year |
$Month | Month: 1-12 |
$Day | Day: 1-31 |
$Hour | Hour: 0-24 |
$Minute | Minute: 0-59 |
$Second | Second: 0-59 |
$WeekDay | Day of the week: 0-6, using 0 for Sunday |
$Job | Name of the Job |
$Dir | Name of the Director |
$Level | Job Level |
$Type | Job Type |
$JobId | JobId |
$JobName | unique name of a job |
$Storage | Name of the Storage Daemon |
$Client | Name of the Clients |
$NumVols | Numbers of volumes in the pool |
$Pool | Name of the Pool |
$Catalog | Name of the Catalog |
$MediaType | Type of the media |
Additional, normal environment variables can be used, e.g. $HOME oder $HOSTNAME.
With the exception of Job specific variables, you can trigger the variable expansion by using the var command.
At the configuration of autochanger commands the following variables can be used:
Variable | Description |
%a |
Archive Device Name |
%c |
Changer Device Name |
%d |
Changer Drive Index |
%f |
Client’s Name |
%j |
Job Name |
%o |
Command |
%s |
Slot Base 0 |
%S |
Slot Base 1 |
%v |
Volume Name |
At the configuration of mount commands the following variables can be used:
Variable | Description |
%a |
Archive Device Name |
%e |
Erase |
%n |
Part Number |
%m |
Mount Point |
%v |
Last Part Name |
Variable Expansion on RunScripts is described at Run ScriptDirJob .
At the configuration of mail and operator commands the following variables can be used:
Variable | Description |
%c |
Client’s Name |
%d |
Director’s Name |
%e |
Job Exit Code |
%i |
JobId |
%j |
Unique Job Id |
%l |
Job Level |
%n |
Unadorned Job Name |
%s |
Since Time |
%t |
Job Type (Backup, …) |
%r |
Recipients |
%v |
Read Volume Name |
%V |
Write Volume Name |
%b |
Job Bytes |
%B |
Job Bytes in human readable format |
%F |
Job Files |
2.1.3.6.1. Resource Types¶
The following table lists all current Bareos resource types. It shows what resources must be defined for each service (daemon). The default configuration files will already contain at least one example of each permitted resource.
:raw-latex:`\multicolumn{1}{|c|| }{\bf Resource }` | :raw-latex:`\multicolumn{1}{c| }{ \ilink{Director}{DirectorConfChapter} }` | :raw-latex:`\multicolumn{1}{c| }{ \ilink{Client}{FiledConfChapter} }` | :raw-latex:`\multicolumn{1}{c| }{ \ilink{Storage}{StoredConfChapter} }` | :raw-latex:`\multicolumn{1}{c| }{ \ilink{Console}{ConsoleConfChapter} }` |
---|---|---|---|---|
Autochanger | StorageResourceAutochanger | |||
Catalog | DirectorResourceCatalog | |||
Client | DirectorResourceClient | ClientResourceClient | ||
Console | DirectorResourceConsole | ConsoleResourceConsole | ||
Device | StorageResourceDevice | |||
Director | DirectorResourceDirector | ClientResourceDirector | StorageResourceDirector | ConsoleResourceDirector |
FileSet | DirectorResourceFileSet | |||
Job | DirectorResourceJob | |||
JobDefs | DirectorResourceJobDefs | |||
Message | ResourceMessages | ResourceMessages | ResourceMessages | |
NDMP | StorageResourceNDMP | |||
Pool | DirectorResourcePool | |||
Profile | DirectorResourceProfile | |||
Schedule | DirectorResourceSchedule | |||
Storage | DirectorResourceStorage | StorageResourceStorage |
2.1.4. Names, Passwords and Authorization¶
In order for one daemon to contact another daemon, it must authorize itself with a password. In most cases, the password corresponds to a particular name, so both the name and the password must match to be authorized. Passwords are plain text, any text. They are not generated by any special process; just use random text.
The default configuration files are automatically defined for correct authorization with random passwords. If you add to or modify these files, you will need to take care to keep them consistent.
In the left column, you can see the Director, Storage, and Client resources and their corresponding names and passwords – these are all in bareos-dir.conf
. In the right column the corresponding values in the Console, Storage daemon (SD), and File daemon (FD) configuration files are shown.
Please note that the address fw-sd, that appears in the Storage resource of the Director, is passed to the File daemon in symbolic form. The File daemon then resolves it to an IP address. For this reason you must use either an IP address or a resolvable fully qualified name. A name such as localhost, not being a fully qualified name, will resolve in the File daemon to the localhost of the File daemon, which is most likely not what is desired. The password used for the File daemon to authorize with the Storage daemon is a temporary password unique to each Job created by the daemons and is not specified in any .conf file.