Bacula 3: bpipe to stream dumps & clones directly to backup

Name: Bacula 3: bpipe to stream dumps & clones directly to backup
Rating: 3.2 (14 reviews)

bpipe plugin to stream dumps, VM clones and another data to your hot backup (MySQL, PostgreSQL, Firebird, Xen etc.)

Created byHeitor Faria

Last updated 9/2020

English

What you'll learn

Backup several applications with plugin
Automate the restore of several applications
Use the plugin to backup other applications
Deploy backup routines that don't need to use disk space in the clients machines for application intermediate backup

Course content

4 sections • 18 lectures • 34m total length

Who am I?1:39
Me, again!

Fetch the written course complimentary material - my Bacula ebook from Amazon.com: https://www.amazon.com/Bacula-Open-Source-Backup-Software-ebook/dp/B01MG7U5M4/ref=sr_1_1?ie=UTF8&qid=1479841355&sr=8-1&keywords=bacula

My website: http://www.bacula.us

Bacula full Manual: http://www.bacula.us/?page_id=1880

Be my friend at Facebook: https://www.facebook.com/heitor.faria

Remark 1: If you need professional help with Bacula I'm looking for a permanent job in USA or Europe. Please recommend me. =)

Remark 2: If you need in-company Bacula training or implementation worldwide send a email to heitor@bacula.com.br
Overview4:39
Article: http://bacula.us/using-bpipe-to-stream-dumps-vm-clones-and-another-data-to-your-backup/

A simple echo FIFO backup4:14
Plugin = "bpipe:/mnt/fifo/test.txt:/bin/echo fifo_teste:/usr/bin/tee /tmp/test.txt"
tar files5:20
Plugin = "bpipe:/mnt/fifo/test.tar:/bin/tar -cf - /etc:/bin/tar -C /tmp -xvf -"
MySQL databases3:28
Plugin = "bpipe:/mnt/fifo/heitorfaria.sql:mysqldump -u root -p123456 --databases heitorfaria:mysql -u root -p123456"

# Plugin = "bpipe:/mnt/fifo/heitorfaria2.sql:mysqldump -u root -p123456 --databases heitorfaria:dd of=/tmp/heitorfaria2.sql"
PostgreSQL databases3:18
Plugin = "bpipe:/mnt/fifo/heitorpg.sql:sudo -u postgres pg_dump --format=c heitorpg:sudo -u postgres pg_restore -d template1 -C"

# Plugin = "bpipe:/mnt/fifo/heitorpg2.sql:sudo -u postgres pg_dump heitorpg:tee /tmp/heitorpg2.sql"
Firebird Databases1:26
Plugin = "bpipe:/mnt/fifo/heitorpg.sql:gbak -backup heitorfire stdout:gbak -replace stdin heitorfire_2"
DB2 Databases0:03
LDAP Bases2:42
Plugin = "bpipe:/mnt/fifo/ldap.ldif:slapcat -l /dev/stdout:/usr/sbin/slapadd -l /dev/stdin"

# Plugin = "bpipe:/mnt/fifo/ldap.ldif:slapcat -l /dev/stdout:dd of=/tmp/ldap_restore.ldif"

REMARK: always stop the LDAP daemon before restoring with the slapadd command.

Another example, specifying domain and configuration file for dump:

Plugin = "bpipe:/tmp/ldap_bkp.ldif:slapcat -f /etc/ldap/slapd.conf -b "dc=ifnmg,dc=edu,dc=br" -l /dev/stdout:tee /tmp/ldap_restore.ldif"
Xenserver Virtual Machines3:01
Safer method - restore to file:

Plugin = "bpipe:/tmp/vm_name.xva:snapshot=`xe vm-snapshot uuid=vm_uuid new-name-label=vm_name_snps` && xe template-param-set is-a-template=false uuid=$snapshot && xe vm-export vm=$snapshot filename=:dd of=/mnt/vm_name.xva"

Restore to Xen Server automatically - import:

Plugin = "bpipe:/tmp/vm_name.xva:snapshot=`xe vm-snapshot uuid=vm_uuid new-name-label=vm_name_snps` && xe template-param-set is-a-template=false uuid=$snapshot && xe vm-export vm=$snapshot filename=:xe vm-import filename=/dev/stdin sr-uuid=xen_storage_uuid"

Remark 1.: in order to fetch storage uuid use, in shell: xe pbd-list

It's advisible to remove generated snapshots during backups.
e.g.: xe vm-uninstall force=true vm=nome_vm_snps

ClientRunAfterJob script sample to delete all Xen snapshots since Bacula Job already backuped the VMs:

for i in `xe snapshot-list --minimal | sed -e 's/,/\ /g'` ; do xe snapshot-uninstall force=true uuid=$i ; done

A script to dinamically configure Bacula to backup all Xen host running VM:

http://bacula.us/citrix-xen-bpipe-configuration-script-to-backup-all-running-virtual-machines/
KVM Virtual Machines0:01
See it in my website:
http://bacula.us/kvm-hot-online-virtual-machines-backup-with-bacula-bpipe/
Proxmox Virtual Machines0:01
Zimbra Mailboxes Backup0:03
Hadoop HDFS0:03
CEPH Volumes

Requirements

Basic Bacula - Bacula 1 Training

Description

*This s the continuation of the course Bacula 1: Open Source Backup Software, available at Udemy"

Using bpipe is the fastest, easiest, most automated and economic way of doing hot backups of specific application such Postgresql, Mysql, Firebird, Oracle databases; Xen and Kvm Virtual Machines export / snapshots; tar packages with several files; and more!

The bpipe plugins automatically creates, writes and reads from a FIFO, and is able to restore information directly to your application. E.g.: restore a database directly from Bacula, without the need to do any further operation. And you can do that with Bacula Community or Enterprise.

Any information that I send though the echo it goes but is not really stored on the FIFO; it is read directly by the Bacula and written into backup volume. You don't use disk space for that.

Training example applications:

MySQL
PostgreSQL
Firebird
LDAP
XenServer
Tar
Echo
etc.

Who this course is for:

Bacula Users
DevOps
IT Managers

Bacula 3: bpipe to stream dumps & clones directly to backup

What you'll learn

Explore related topics

Course content

Introduction2 lectures • 6min

bpipe Deploy2 lectures • 4min

bpipe examples13 lectures • 24min

Conclusion1 lecture • 1min

Requirements

Description

Who this course is for: