3. Task and Concepts

• 3.1. Bareos Console
  • 3.1.1. Console Configuration
  • 3.1.2. Running the Console Program
    • 3.1.2.1. Exit the Console Program
    • 3.1.2.2. Running the Console from a Shell Script
  • 3.1.3. Console Keywords
  • 3.1.4. Console Commands
    • 3.1.4.1. Special dot (.) Commands
    • 3.1.4.2. Special At (@) Commands
  • 3.1.5. Adding Volumes to a Pool
• 3.2. The Restore Command
  • 3.2.1. General
  • 3.2.2. The Restore Command
  • 3.2.3. Selecting Files by Filename
  • 3.2.4. Replace Options
  • 3.2.5. Command Line Arguments
  • 3.2.6. Using File Relocation
    • 3.2.6.1. Introduction
    • 3.2.6.2. RegexWhere Format
      • 3.2.6.2.1. Examples
  • 3.2.7. Restoring Directory Attributes
  • 3.2.8. Restoring on Windows
  • 3.2.9. Restore Errors
  • 3.2.10. Example Restore Job Resource
  • 3.2.11. File Selection Commands
• 3.3. Volume Management
  • 3.3.1. Key Concepts and Resource Records
    • 3.3.1.1. Pool Options to Limit the Volume Usage
    • 3.3.1.2. Automatic Volume Labeling
    • 3.3.1.3. Restricting the Number of Volumes and Recycling
  • 3.3.2. Concurrent Disk Jobs
    • 3.3.2.1. Example for two clients, separate devices and recycling
    • 3.3.2.2. Using Multiple Storage Devices
      • 3.3.2.2.1. Example: use four storage devices pointing to the same directory
  • 3.3.3. Automatic Volume Recycling
    • 3.3.3.1. Automatic Pruning
    • 3.3.3.2. Pruning Directives
    • 3.3.3.3. Recycling Algorithm
    • 3.3.3.4. Recycle Status
    • 3.3.3.5. Daily, Weekly, Monthly Tape Usage Example
    • 3.3.3.6. Automatic Pruning and Recycling Example
    • 3.3.3.7. Manually Recycling Volumes
• 3.4. Automated Disk Backup
  • 3.4.1. Overall Design
    • 3.4.1.1. Full Pool
    • 3.4.1.2. Differential Pool
    • 3.4.1.3. Incremental Pool
  • 3.4.2. Configuration Files
• 3.5. Autochanger Support
  • 3.5.1. Knowing What SCSI Devices You Have
    • 3.5.1.1. Linux
    • 3.5.1.2. FreeBSD
    • 3.5.1.3. Solaris
  • 3.5.2. Slots
  • 3.5.3. Multiple Devices
  • 3.5.4. Device Configuration Records
  • 3.5.5. Specifying Slots When Labeling
  • 3.5.6. Changing Cartridges
  • 3.5.7. Dealing with Multiple Magazines
  • 3.5.8. Update Slots Command
  • 3.5.9. Using the Autochanger
  • 3.5.10. Barcode Support
  • 3.5.11. Use bconsole to display Autochanger content
  • 3.5.12. Bareos Autochanger Interface
  • 3.5.13. Tapespeed and blocksizes
    • 3.5.13.1. Possible Problems
    • 3.5.13.2. How can I find out which block size was used when the tape was written?
    • 3.5.13.3. Direct access to Volumes with with non-default block sizes
    • 3.5.13.4. How to configure the block sizes in your environment
  • 3.5.14. Tape Drive Cleaning
• 3.6. Using Tape Drives without Autochanger
  • 3.6.1. Simple One Tape Backup
    • 3.6.1.1. Advantages
    • 3.6.1.2. Disadvantages
    • 3.6.1.3. Practical Details
  • 3.6.2. Manually Changing Tapes
  • 3.6.3. Daily Tape Rotation
    • 3.6.3.1. Advantages
    • 3.6.3.2. Disadvantages
    • 3.6.3.3. Practical Details
• 3.7. Data Spooling
  • 3.7.1. Data Spooling Directives
    • 3.7.1.1. Additional Notes
• 3.8. Migration and Copy
  • 3.8.1. Important Migration Considerations
  • 3.8.2. Configure Copy or Migration Jobs
    • 3.8.2.1. Job Resource
    • 3.8.2.2. Pool Resource
      • 3.8.2.2.1. Example Migration Jobs
        • 3.8.2.2.1.1. Multiple Storage Daemons
• 3.9. Always Incremental Backup Scheme
  • 3.9.1. Conventional Backup Scheme Drawbacks
  • 3.9.2. Always Incremental Concept
  • 3.9.3. How to configure in Bareos
    • 3.9.3.1. Always Incremental Backup Job
    • 3.9.3.2. Consolidate Job
    • 3.9.3.3. Storages and Pools
  • 3.9.4. How it works
  • 3.9.5. Enhancements for the Always Incremental Backup Scheme
    • 3.9.5.1. The basic always incremental scheme
    • 3.9.5.2. Always Incremental Max Full Age
    • 3.9.5.3. Max Full Consolidations
  • 3.9.6. Long Term Storage of Always Incremental Jobs
    • 3.9.6.1. Copy Jobs
    • 3.9.6.2. Virtual Full Jobs
• 3.10. How to manually transfer data/volumes
  • 3.10.1. Import Data from a Remote Storage Daemon
  • 3.10.2. Import Data from a Independent Remote Full Bareos Installation
• 3.11. File Deduplication using Base Jobs
• 3.12. Plugins
  • 3.12.1. File Daemon Plugins
    • 3.12.1.1. bpipe Plugin
    • 3.12.1.2. PGSQL Plugin
    • 3.12.1.3. MySQL Plugin
    • 3.12.1.4. MSSQL Plugin
    • 3.12.1.5. LDAP Plugin
    • 3.12.1.6. Cephfs Plugin
    • 3.12.1.7. Rados Plugin
    • 3.12.1.8. GlusterFS Plugin
    • 3.12.1.9. python-fd Plugin
      • 3.12.1.9.1. Command Plugins
      • 3.12.1.9.2. Option Plugins
  • 3.12.2. Storage Daemon Plugins
    • 3.12.2.1. autoxflate-sd
    • 3.12.2.2. scsicrypto-sd
      • 3.12.2.2.1. General
        • 3.12.2.2.1.1. LTO Hardware Encryption
        • 3.12.2.2.1.2. The scsicrypto-sd plugin
        • 3.12.2.2.1.3. Changes in the director
      • 3.12.2.2.2. Configuration
        • 3.12.2.2.2.1. SCSI crypto setup
        • 3.12.2.2.2.2. Security Setup
        • 3.12.2.2.2.3. Changes in bareos-sd.conf
        • 3.12.2.2.2.4. Changes in bareos-dir.conf
      • 3.12.2.2.3. Testing
      • 3.12.2.2.4. Disaster Recovery
    • 3.12.2.3. scsitapealert-sd
    • 3.12.2.4. python-sd Plugin
  • 3.12.3. Director Plugins
    • 3.12.3.1. python-dir Plugin
      • 3.12.3.1.1. Loading plugins
      • 3.12.3.1.2. Write your own Python Plugin
• 3.13. The Windows Version of Bareos
  • 3.13.1. Windows Installation
    • 3.13.1.1. Graphical Installation
    • 3.13.1.2. Command Line (Silent) Installation
      • 3.13.1.2.1. Commandline Switches
  • 3.13.2. Dealing with Windows Problems
    • 3.13.2.1. Antivirus Program
    • 3.13.2.2. Enable Debuggging
  • 3.13.3. Windows Compatibility Considerations
    • 3.13.3.1. Exclusively Opened Files
    • 3.13.3.2. Backing up the Windows Registry
    • 3.13.3.3. Windows Reparse Points
    • 3.13.3.4. Hard Links
    • 3.13.3.5. FilesNotToBackup Registry Key
    • 3.13.3.6. Windows dedup support
    • 3.13.3.7. Store all file attributes
    • 3.13.3.8. Support for Windows EFS filesystems
  • 3.13.4. Volume Shadow Copy Service (VSS)
    • 3.13.4.1. VSS Problems
  • 3.13.5. Windows Firewalls
    • 3.13.5.1. Network TCP Port
  • 3.13.6. Windows Restore Problems
  • 3.13.7. Windows Backup Problems
  • 3.13.8. Windows Ownership and Permissions Problems
  • 3.13.9. Advanced Windows Configuration
    • 3.13.9.1. Windows Service
    • 3.13.9.2. Windows Specific Command Line Options
• 3.14. Network setup
  • 3.14.1. Client Initiated Connection
  • 3.14.2. Passive Clients
    • 3.14.2.1. Usage
  • 3.14.3. Using different IP Adresses for SD – FD Communication
• 3.15. Transport Encryption
  • 3.15.1. TLS Configuration Directives
  • 3.15.2. Getting TLS Certificates
  • 3.15.3. Example TLS Configuration Files
    • 3.15.3.1. Bareos Director
    • 3.15.3.2. Bareos Storage Daemon
    • 3.15.3.3. Bareos File Daemon
• 3.16. Data Encryption
  • 3.16.1. Encryption Technical Details
  • 3.16.2. Generating Private/Public Encryption Keys
  • 3.16.3. Example Data Encryption Configurations (bareos-fd.conf)
  • 3.16.4. Decrypting with a Master Key
• 3.17. NDMP Backups with Bareos
  • 3.17.1. NDMP Basics
    • 3.17.1.1. NDMP Topologies
      • 3.17.1.1.1. NDMP 3-way Backup: Data Agent and Tape Agent running on different systems
      • 3.17.1.1.2. NDMP 2-way Backup: Data Agent and Tape Agent running on the same system
      • 3.17.1.1.3. Properties of the different NDMP Backup topologies
  • 3.17.2. NDMP Backup in Bareos
  • 3.17.3. NDMP_BAREOS
    • 3.17.3.1. Example Setup for NDMP_BAREOS backup
      • 3.17.3.1.1. Enable NDMP on your storage appliance
      • 3.17.3.1.2. Bareos Director: Configure NDMP Client Resource
      • 3.17.3.1.3. Bareos Storage Daemon: Configure NDMP
      • 3.17.3.1.4. Bareos Director: Configure a Paired Storage
      • 3.17.3.1.5. Bareos Director: Configure NDMP Fileset
      • 3.17.3.1.6. Bareos Director: Configure NDMP Jobs
    • 3.17.3.2. Run NDMP Backup
    • 3.17.3.3. Run NDMP Restore
      • 3.17.3.3.1. Full Restore
      • 3.17.3.3.2. Restore files to original path
      • 3.17.3.3.3. Restore files to different path
    • 3.17.3.4. NDMP Copy Jobs
      • 3.17.3.4.1. Restore to NDMP Primary Storage System
    • 3.17.3.5. Limitations
      • 3.17.3.5.1. NDMP Job limitations when scanning in volumes
      • 3.17.3.5.2. Restore always transfers the full main backup file to the Primary Storage System
  • 3.17.4. NDMP_NATIVE
    • 3.17.4.1. Example Setup for NDMP_NATIVE backup
      • 3.17.4.1.1. Configure a NDMP Client
      • 3.17.4.1.2. Configure a NDMP Fileset
      • 3.17.4.1.3. Configure a NDMP Storage
      • 3.17.4.1.4. Configure a Pool for the NDMP Tapes
      • 3.17.4.1.5. Configure NDMP Jobs
    • 3.17.4.2. Label Tapes
    • 3.17.4.3. Run NDMP_NATIVE Backup
    • 3.17.4.4. Run NDMP_NATIVE Restore
    • 3.17.4.5. Limitations
  • 3.17.5. NDMP Common
    • 3.17.5.1. NDMP Backup Level
    • 3.17.5.2. NDMP Debugging
    • 3.17.5.3. Bareos NDMP Common Limitations
      • 3.17.5.3.1. NDMP Fileset limitations
      • 3.17.5.3.2. Single file restore on incremental backups
      • 3.17.5.3.3. Temporary memory mapped database
    • 3.17.5.4. Tested Environments
• 3.18. Catalog Maintenance
  • 3.18.1. Catalog Database
    • 3.18.1.1. dbconfig-common (Debian)
    • 3.18.1.2. Manual Configuration
      • 3.18.1.2.1. PostgreSQL
      • 3.18.1.2.2. Remote PostgreSQL Database
      • 3.18.1.2.3. MySQL
        • 3.18.1.2.3.1. Modify database credentials
      • 3.18.1.2.4. Sqlite
  • 3.18.2. Retention Periods
    • 3.18.2.1. Database Size
    • 3.18.2.2. Setting Retention Periods
      • 3.18.2.2.1. Job Statistics
  • 3.18.3. PostgreSQL
    • 3.18.3.1. Compacting Your PostgreSQL Database
      • 3.18.3.1.1. What To Do When The Database Keeps Growing
    • 3.18.3.2. Repairing Your PostgreSQL Database
  • 3.18.4. MySQL/MariaDB
    • 3.18.4.1. MySQL/MariaDB Support
    • 3.18.4.2. Compacting Your MySQL Database
    • 3.18.4.3. Repairing Your MySQL Database
    • 3.18.4.4. MySQL Table is Full
    • 3.18.4.5. MySQL Server Has Gone Away
    • 3.18.4.6. MySQL Temporary Tables
    • 3.18.4.7. MySQL: Lock Wait Timeout
  • 3.18.5. Backing Up Your Bareos Database
• 3.19. Bareos Security Issues
  • 3.19.1. Configuring and Testing TCP Wrappers
  • 3.19.2. Secure Erase Command