一键备份脚本 backup.sh
做网站最重要的是什么?数据!数据,是网站之本,备份,是每一个站长都应该重视的事情。但同时,备份也是一件繁琐和重复的事情。所以,这些事情,肯定能做到自动化的。
下面来介绍一下这个一键备份脚本 backup.sh。
总结一下 backup.sh 特点:
1、支持 MySQL/MariaDB/Percona 的数据库全量备份或选择备份;
2、支持指定目录或文件的备份;
3、支持加密备份文件(需安装 openssl 命令,可选);
4、支持上传至 Google Drive(需先安装 gdrive 并配置,可选);
5、支持在删除指定天数本地旧的备份文件的同时,也删除 Google Drive 上的同名文件(可选)。
2016 年 8 月 21 日更新:
1、新增:指定 MySQL/MariaDB 的数据库名进行备份,可以同时指定多个;
2、新增:删除指定天数本地旧的备份文件。
2016 年 9 月 8 日更新:
1、新增:删除指定天数本地旧的备份文件的同时,可选删除 Google Drive 上的同名文件。
2016 年 11 月 29 日更新:
1、新增:上传备份文件到 FTP 选项;
2、新增:删除指定天数本地旧的备份文件的同时,可选删除 Google Drive 及 FTP 上的同名文件。
教程模式开启:
1、下载该脚本并赋予执行权限
wget --no-check-certificate https://github.com/teddysun/across/raw/master/backup.sh chmod +x backup.sh
2、修改并配置脚本
请使用 vim 或 nano 等工具来修改。
关于变量名的一些说明:
ENCRYPTFLG (加密FLG,true 为加密,false 为不加密,默认是加密)
BACKUPPASS (加密密码,重要,务必要修改)
LOCALDIR (备份目录,可自己指定)
TEMPDIR (备份目录的临时目录,可自己指定)
LOGFILE (脚本运行产生的日志文件路径)
MYSQL_ROOT_PASSWORD (MySQL/MariaDB/Percona 的 root 用户密码)
MYSQL_DATABASE_NAME (指定 MySQL/MariaDB/Percona 的数据库名,留空则是备份所有数据库)
※ MYSQL_DATABASE_NAME 是一个数组变量,可以指定多个。举例如下:
MYSQL_DATABASE_NAME[0]="phpmyadmin" MYSQL_DATABASE_NAME[1]="test"
BACKUP (需要备份的指定目录或文件列表,留空就是不备份目录或文件)
※ BACKUP 是一个数组变量,可以指定多个。举例如下:
BACKUP[0]="/data/www/default/test.tgz" BACKUP[1]="/data/www/default/test/" BACKUP[2]="/data/www/default/test2/"
LOCALAGEDAILIES (指定多少天之后删除本地旧的备份文件,默认为 7 天)
DELETE_REMOTE_FILE_FLG (删除 Google Drive 或 FTP 上的备份文件 FLG,true 为删除,false 为不删除)
FTP_FLG (上传文件至 FTP 的 FLG,true 为上传,false 为不上传)
FTP_HOST (连接的 FTP 域名或 IP 地址)
FTP_USER (连接的 FTP 的用户名)
FTP_PASS (连接的 FTP 的用户的密码)
FTP_DIR (连接的 FTP 的远程目录,比如: public_html)
一些注意事项的说明:
1)脚本需要用 root 用户来执行;
2)脚本需要用到 openssl 来加密,请事先安装好;
3)脚本默认备份所有的数据库(全量备份);
4)备份文件的解密命令如下:
openssl enc -aes256 -in [ENCRYPTED BACKUP] -out decrypted_backup.tgz -pass pass:[BACKUPPASS] -d -md sha1
5)备份文件解密后,解压命令如下:
tar -zxPf [DECRYPTION BACKUP FILE]
解释一下参数 -P:
tar 压缩文件默认都是相对路径的。加个 -P 是为了 tar 能以绝对路径压缩文件。因此,解压的时候也要带个 -P 参数。
3、配置 gdrive 命令
gdrive 是一个命令行工具,用于 Google Drive 的上传下载等操作。官网网站:
https://github.com/prasmussen/gdrive
当然,你可以用以下的命令来安装 gdrive。
x86_64(64位):
wget -O /usr/bin/gdrive http://dl.lamp.sh/files/gdrive-linux-x64 chmod +x /usr/bin/gdrive
i386(32位)
wget -O /usr/bin/gdrive http://dl.lamp.sh/files/gdrive-linux-386 chmod +x /usr/bin/gdrive
然后,运行以下命令开始获取授权:
gdrive about
根据提示用浏览器打开 gdrive 给出的 URL,点击接受(Accept),然后将浏览器上显示出来的字符串粘贴回命令行里,完成授权。
4、运行脚本开始备份
./backup.sh
脚本默认会显示备份进度,并在最后统计出所需时间。
如果你想将脚本加入到 cron 自动运行的话,就不需要前台显示备份进度,只写日志就可以了。
这个时候你需要稍微改一下脚本中的 log 函数。
log() {echo "$(date "+%Y-%m-%d %H:%M:%S")" "$1"echo -e "$(date "+%Y-%m-%d %H:%M:%S")" "$1" >> ${LOGFILE} }
改为:
log() {echo -e "$(date "+%Y-%m-%d %H:%M:%S")" "$1" >> ${LOGFILE} }
关于如何使用 cron 自动备份,这里就不再赘述了 以 CentOS 6 来举例说明。
修改文件 /etc/crontab,内容如下:
SHELL=/bin/bash PATH=/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin:~/bin MAILTO=root HOME=/root# For details see man 4 crontabs# Example of job definition: # .---------------- minute (0 - 59) # | .------------- hour (0 - 23) # | | .---------- day of month (1 - 31) # | | | .------- month (1 - 12) OR jan,feb,mar,apr ... # | | | | .---- day of week (0 - 6) (Sunday=0 or 7) OR sun,mon,tue,wed,thu,fri,sat # | | | | | # * * * * * user-name command to be executed 30 1 * * * root bash /root/backup.sh
以上表示,每天凌晨 1 点 30 分,root 用户执行一次 backup.sh 脚本。
注意:
一定要修改其中的 PATH 和 HOME 变量的值。
尤其是 HOME 变量,gdrive 命令能否正确执行,是要依赖于其配置文件的。默认用 root 配置的话,其配置文件夹应该是 /root/.gdrive/ ,所以要更改 HOME 的值。
backup.sh 代码如下所示:
#!/usr/bin/env bash # # Auto backup script # # Copyright (C) 2016 Teddysun <i@teddysun.com> # # URL: https://teddysun.com/469.html # # You must to modify the config before run it!!! # Backup MySQL/MariaDB/Percona datebases, files and directories # Backup file is encrypted with AES256-cbc with SHA1 message-digest (option) # Auto transfer backup file to Google Drive (need install gdrive command) (option) # Auto transfer backup file to FTP server (option) # Auto delete Google Drive's or FTP server's remote file (option) #[[ $EUID -ne 0 ]] && echo "Error: This script must be run as root!" && exit 1########## START OF CONFIG ########### Encrypt flag (true: encrypt, false: not encrypt) ENCRYPTFLG=true# WARNING: KEEP THE PASSWORD SAFE!!! # The password used to encrypt the backup # To decrypt backups made by this script, run the following command: # openssl enc -aes256 -in [encrypted backup] -out decrypted_backup.tgz -pass pass:[backup password] -d -md sha1 BACKUPPASS="mypassword"# Directory to store backups LOCALDIR="/root/backups/"# Temporary directory used during backup creation TEMPDIR="/root/backups/temp/"# File to log the outcome of backups LOGFILE="/root/backups/backup.log"# OPTIONAL: If you want backup MySQL database, enter the MySQL root password below MYSQL_ROOT_PASSWORD=""# Below is a list of MySQL database name that will be backed up # If you want backup ALL databases, leave it blank. MYSQL_DATABASE_NAME[0]=""# Below is a list of files and directories that will be backed up in the tar backup # For example: # File: /data/www/default/test.tgz # Directory: /data/www/default/test BACKUP[0]=""# Number of days to store daily local backups (default 7 days) LOCALAGEDAILIES="7"# Delete Googole Drive's & FTP server's remote file flag (true: delete, false: not delete) DELETE_REMOTE_FILE_FLG=false# Upload to FTP server flag (true: upload, false: not upload) FTP_FLG=false# FTP server # OPTIONAL: If you want upload to FTP server, enter the Hostname or IP address below FTP_HOST=""# FTP username # OPTIONAL: If you want upload to FTP server, enter the FTP username below FTP_USER=""# FTP password # OPTIONAL: If you want upload to FTP server, enter the username's password below FTP_PASS=""# FTP server remote folder # OPTIONAL: If you want upload to FTP server, enter the FTP remote folder below # For example: public_html FTP_DIR=""########## END OF CONFIG ########### Date & Time DAY=$(date +%d) MONTH=$(date +%m) YEAR=$(date +%C%y) BACKUPDATE=$(date +%Y%m%d%H%M%S) # Backup file name TARFILE="${LOCALDIR}""$(hostname)"_"${BACKUPDATE}".tgz # Encrypted backup file name ENC_TARFILE="${TARFILE}.enc" # Backup MySQL dump file name SQLFILE="${TEMPDIR}mysql_${BACKUPDATE}.sql"log() {echo "$(date "+%Y-%m-%d %H:%M:%S")" "$1"echo -e "$(date "+%Y-%m-%d %H:%M:%S")" "$1" >> ${LOGFILE} }# Check for list of mandatory binaries check_commands() {# This section checks for all of the binaries used in the backupBINARIES=( cat cd du date dirname echo openssl mysql mysqldump pwd rm tar )# Iterate over the list of binaries, and if one isn't found, abortfor BINARY in "${BINARIES[@]}"; doif [ ! "$(command -v "$BINARY")" ]; thenlog "$BINARY is not installed. Install it and try again"exit 1fidone# check gdrive commandGDRIVE_COMMAND=falseif [ "$(command -v "gdrive")" ]; thenGDRIVE_COMMAND=truefi# check ftp commandif ${FTP_FLG}; thenif [ ! "$(command -v "ftp")" ]; thenlog "ftp is not installed. Install it and try again"exit 1fifi }calculate_size() {local file_name=$1local file_size=$(du -h $file_name 2>/dev/null | awk '{print $1}')if [ "x${file_size}" = "x" ]; thenecho "unknown"elseecho "${file_size}"fi }# Backup MySQL databases mysql_backup() {if [ -z ${MYSQL_ROOT_PASSWORD} ]; thenlog "MySQL root password not set, MySQL backup skipped"elselog "MySQL dump start"mysql -u root -p"${MYSQL_ROOT_PASSWORD}" 2>/dev/null <<EOF exit EOFif [ $? -ne 0 ]; thenlog "MySQL root password is incorrect. Please check it and try again"exit 1fiif [ "${MYSQL_DATABASE_NAME[*]}" == "" ]; thenmysqldump -u root -p"${MYSQL_ROOT_PASSWORD}" --all-databases > "${SQLFILE}" 2>/dev/nullif [ $? -ne 0 ]; thenlog "MySQL all databases backup failed"exit 1filog "MySQL all databases dump file name: ${SQLFILE}"#Add MySQL backup dump file to BACKUP listBACKUP=(${BACKUP[*]} ${SQLFILE})elsefor db in ${MYSQL_DATABASE_NAME[*]}dounset DBFILEDBFILE="${TEMPDIR}${db}_${BACKUPDATE}.sql"mysqldump -u root -p"${MYSQL_ROOT_PASSWORD}" ${db} > "${DBFILE}" 2>/dev/nullif [ $? -ne 0 ]; thenlog "MySQL database name [${db}] backup failed, please check database name is correct and try again"exit 1filog "MySQL database name [${db}] dump file name: ${DBFILE}"#Add MySQL backup dump file to BACKUP listBACKUP=(${BACKUP[*]} ${DBFILE})donefilog "MySQL dump completed"fi }start_backup() {[ "${BACKUP[*]}" == "" ] && echo "Error: You must to modify the [$(basename $0)] config before run it!" && exit 1log "Tar backup file start"tar -zcPf ${TARFILE} ${BACKUP[*]}if [ $? -gt 1 ]; thenlog "Tar backup file failed"exit 1filog "Tar backup file completed"# Encrypt tar fileif ${ENCRYPTFLG}; thenlog "Encrypt backup file start"openssl enc -aes256 -in "${TARFILE}" -out "${ENC_TARFILE}" -pass pass:"${BACKUPPASS}" -md sha1log "Encrypt backup file completed"# Delete unencrypted tarlog "Delete unencrypted tar file: ${TARFILE}"rm -f ${TARFILE}fi# Delete MySQL temporary dump filefor sql in `ls ${TEMPDIR}*.sql`dolog "Delete MySQL temporary dump file: ${sql}"rm -f ${sql}doneif ${ENCRYPTFLG}; thenOUT_FILE="${ENC_TARFILE}"elseOUT_FILE="${TARFILE}"filog "File name: ${OUT_FILE}, File size: `calculate_size ${OUT_FILE}`" }# Transfer backup file to Google Drive # If you want to install gdrive command, please visit website: # https://github.com/prasmussen/gdrive # of cause, you can use below command to install it # For x86_64: wget -O /usr/bin/gdrive http://dl.lamp.sh/files/gdrive-linux-x64; chmod +x /usr/bin/gdrive # For i386: wget -O /usr/bin/gdrive http://dl.lamp.sh/files/gdrive-linux-386; chmod +x /usr/bin/gdrive gdrive_upload() {if ${GDRIVE_COMMAND}; thenlog "Tranferring backup file to Google Drive"gdrive upload --no-progress ${OUT_FILE} >> ${LOGFILE}if [ $? -ne 0 ]; thenlog "Error: Tranferring backup file to Google Drive failed"exit 1filog "Tranferring backup file to Google Drive completed"fi }# Tranferring backup file to FTP server ftp_upload() {if ${FTP_FLG}; then[ -z ${FTP_HOST} ] && log "Error: FTP_HOST can not be empty!" && exit 1[ -z ${FTP_USER} ] && log "Error: FTP_USER can not be empty!" && exit 1[ -z ${FTP_PASS} ] && log "Error: FTP_PASS can not be empty!" && exit 1[ -z ${FTP_DIR} ] && log "Error: FTP_DIR can not be empty!" && exit 1local FTP_OUT_FILE=$(basename ${OUT_FILE})log "Tranferring backup file to FTP server"ftp -in ${FTP_HOST} 2>&1 >> ${LOGFILE} <<EOF user $FTP_USER $FTP_PASS binary lcd $LOCALDIR cd $FTP_DIR put $FTP_OUT_FILE quit EOFlog "Tranferring backup file to FTP server completed"fi }# Get file date get_file_date() {#Approximate a 30-day month and 365-day yearDAYS=$(( $((10#${YEAR}*365)) + $((10#${MONTH}*30)) + $((10#${DAY})) ))unset FILEYEAR FILEMONTH FILEDAY FILEDAYS FILEAGEFILEYEAR=$(echo "$1" | cut -d_ -f2 | cut -c 1-4)FILEMONTH=$(echo "$1" | cut -d_ -f2 | cut -c 5-6)FILEDAY=$(echo "$1" | cut -d_ -f2 | cut -c 7-8)if [[ "${FILEYEAR}" && "${FILEMONTH}" && "${FILEDAY}" ]]; then#Approximate a 30-day month and 365-day yearFILEDAYS=$(( $((10#${FILEYEAR}*365)) + $((10#${FILEMONTH}*30)) + $((10#${FILEDAY})) ))FILEAGE=$(( 10#${DAYS} - 10#${FILEDAYS} ))return 0fireturn 1 }# Delete Google Drive's old backup file delete_gdrive_file() {local FILENAME=$1if ${DELETE_REMOTE_FILE_FLG} && ${GDRIVE_COMMAND}; thenlocal FILEID=$(gdrive list -q "name = '${FILENAME}'" --no-header | awk '{print $1}')if [ -n ${FILEID} ]; thengdrive delete ${FILEID} >> ${LOGFILE}log "Google Drive's old backup file name: ${FILENAME} has been deleted"fifi }# Delete FTP server's old backup file delete_ftp_file() {local FILENAME=$1if ${DELETE_REMOTE_FILE_FLG} && ${FTP_FLG}; thenftp -in ${FTP_HOST} 2>&1 >> ${LOGFILE} <<EOF user $FTP_USER $FTP_PASS cd $FTP_DIR del $FILENAME quit EOFlog "FTP server's old backup file name: ${FILENAME} has been deleted"fi }# Clean up old file clean_up_files() {cd ${LOCALDIR} || exitif ${ENCRYPTFLG}; thenLS=($(ls *.enc))elseLS=($(ls *.tgz))fifor f in ${LS[@]}doget_file_date ${f}if [ $? == 0 ]; thenif [[ ${FILEAGE} -gt ${LOCALAGEDAILIES} ]]; thenrm -f ${f}log "Old backup file name: ${f} has been deleted"delete_gdrive_file ${f}delete_ftp_file ${f}fifidone }# Main progress STARTTIME=$(date +%s)# Check if the backup folders exist and are writeable if [ ! -d "${LOCALDIR}" ]; thenmkdir -p ${LOCALDIR} fi if [ ! -d "${TEMPDIR}" ]; thenmkdir -p ${TEMPDIR} filog "Backup progress start" check_commands mysql_backup start_backup log "Backup progress complete"log "Upload progress start" gdrive_upload ftp_upload log "Upload progress complete"clean_up_filesENDTIME=$(date +%s) DURATION=$((ENDTIME - STARTTIME)) log "All done" log "Backup and transfer completed in ${DURATION} seconds"
最后,欢迎交流和提出意见。
转载请注明:秋水逸冰 » 一键备份脚本backup.sh
转载于:https://www.cnblogs.com/yihr/p/7515255.html
一键备份脚本 backup.sh相关推荐
- 一键备份脚本backup.sh
转载于 秋水逸冰的blog 转载自:秋水逸冰 » 一键备份脚本backup.sh 做网站最重要的是什么?数据!数据,是网站之本,备份,是每一个站长都应该重视的事情.但同时,备份也是一件繁琐和重复的事情 ...
- 一键测试脚本bench.sh
转载于 秋水逸冰的blog 转载自:秋水逸冰 » 一键测试脚本bench.sh 经过几个版本的演化,一键测试脚本 bench.sh 已经几乎全面适用于各种 Linux 发行版的网络(下行)和 IO 测 ...
- sqlite3-windows 备份脚本 backup.bat
sqlite3-windows 备份脚本 backup.bat 注:其中 sqlite3 .gzip 需要手动下载,放到db目录, 下载地址: sqlite3.exe https://www. ...
- 树莓派一键备份脚本 备份为img镜像 可用于量产 可选备份位置 适配Debian/Ubuntu
2019-02-24 by 崔斐然 2019-02-28补充: 鉴于备份过程可能花费大量时间,建议使用ssh操作的同学安装screen管理会话,避免因网络波动造成ssh掉线任务失败.参考我的另一篇博文 ...
- MySQL一键备份脚本(温备)
文章目录 1. 全库备份 2. 增量备份 3. 开启定时任务 1. 全库备份 vim all_db_bak.sh#!/bin/bash #MySQL 全库备份PATH="/usr/local ...
- oracle备份数据脚本,oracle数据库自动备份脚本
::通过exp命令导出远程机器(192.168.2.1)上指定服务(orcl)指定用户(pmis)及密码(pmis)的数据 ::运行该脚本的机器必须安装oracle @echo off @echo [ ...
- svn数据库自动备份脚本
创建一个存放备份数据的路径 mkdir /data/svnbak -p 采用shell脚本的方式实现自动备份 #vim backup.sh #!/bin/bash log="/data/sv ...
- 百度网盘自动备份php,服务器自动备份脚本上传至百度云存储
一直以为自己管理的服务器不会出问题,没想到昨天由于误操作把数据库整个目录给删了,罪过... 有些数据我一直没在意,等到失去的时候才发现他们有多重要... 赶紧补上备份脚本 #!/bin/sh BACK ...
- python部署脚本_vsftp一键部署脚本
vsftp一键创建脚本#!/bin/sh #OS: Centos7.2 #filename: auto_install_vsftp.sh users=/etc/vsftpd/vftpuser.txt ...
最新文章
- 最全的Centos6.10详细安装Oracle 11G R2图文教程
- CentOS 6.5 伪分布安装
- Oracle 多行合并一行 方法
- 常见的6种JavaScript设计模式
- WPF中设置了WindowStyle=None后,窗口仍然有边框的解决方法
- 未能加载包studio package_Python包开发者的必备清单
- python api测试框架_python api 测试框架
- Python使用线性回归简单预测数据
- 程序员谈如何掌握计算机专业英语
- NDK开发基础④增量更新之客户端合并差分包
- GIS电力平台功能需求
- tif软件Android版下载,TIF文件查看器
- 解决Windows10专业版无法安装语言包!!!
- Pytorch 基于ResNet-18的服饰识别(使用Fashion-MNIST数据集)
- printvertically Java_Print Words Vertically in JavaScript
- 漏电继电器LLJ-100FG/CT45mm/AC220V
- 利用MQTT协议与阿里云数据交互的python程序
- 傲气雄鹰android 3dm,傲气雄鹰 重载
- 数据库篇-mysql主备搭建
- Hall定理及其充要性证明
热门文章
- 2020牛客寒假算法基础集训营1 I nico和niconiconi
- Nico的刷题日记(一)
- 文件 组织 服务器 数据库,nc文件服务器 数据库文件
- “名师带教,共同成长“渭南市马红“名师+”研修共同体2022年工作计划
- 怎样度过研究生生活,如何度过研究生生活
- 对话机器人在瓜子的实践
- Flexbox 布局简明教程-姜威-专题视频课程
- 东风破 -词:方文山 曲:周杰伦
- 网间进程的标识和端口分配机制
- 安卓角色扮演游戏源码_角色扮演类安卓手游排行榜 热门手游推荐