├── LICENSE.md ├── README.md ├── proxmox_noreminder.sh ├── s3ql ├── s3ql_backup.sh ├── s3ql_restore.sh └── setup_network.sh /LICENSE.md: -------------------------------------------------------------------------------- 1 | GNU General Public License 2 | ========================== 3 | 4 | _Version 2, June 1991_ 5 | _Copyright © 1989, 1991 Free Software Foundation, Inc.,_ 6 | _51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA_ 7 | 8 | Everyone is permitted to copy and distribute verbatim copies 9 | of this license document, but changing it is not allowed. 10 | 11 | ### Preamble 12 | 13 | The licenses for most software are designed to take away your 14 | freedom to share and change it. By contrast, the GNU General Public 15 | License is intended to guarantee your freedom to share and change free 16 | software--to make sure the software is free for all its users. This 17 | General Public License applies to most of the Free Software 18 | Foundation's software and to any other program whose authors commit to 19 | using it. (Some other Free Software Foundation software is covered by 20 | the GNU Lesser General Public License instead.) You can apply it to 21 | your programs, too. 22 | 23 | When we speak of free software, we are referring to freedom, not 24 | price. Our General Public Licenses are designed to make sure that you 25 | have the freedom to distribute copies of free software (and charge for 26 | this service if you wish), that you receive source code or can get it 27 | if you want it, that you can change the software or use pieces of it 28 | in new free programs; and that you know you can do these things. 29 | 30 | To protect your rights, we need to make restrictions that forbid 31 | anyone to deny you these rights or to ask you to surrender the rights. 32 | These restrictions translate to certain responsibilities for you if you 33 | distribute copies of the software, or if you modify it. 34 | 35 | For example, if you distribute copies of such a program, whether 36 | gratis or for a fee, you must give the recipients all the rights that 37 | you have. You must make sure that they, too, receive or can get the 38 | source code. And you must show them these terms so they know their 39 | rights. 40 | 41 | We protect your rights with two steps: **(1)** copyright the software, and 42 | **(2)** offer you this license which gives you legal permission to copy, 43 | distribute and/or modify the software. 44 | 45 | Also, for each author's protection and ours, we want to make certain 46 | that everyone understands that there is no warranty for this free 47 | software. If the software is modified by someone else and passed on, we 48 | want its recipients to know that what they have is not the original, so 49 | that any problems introduced by others will not reflect on the original 50 | authors' reputations. 51 | 52 | Finally, any free program is threatened constantly by software 53 | patents. We wish to avoid the danger that redistributors of a free 54 | program will individually obtain patent licenses, in effect making the 55 | program proprietary. To prevent this, we have made it clear that any 56 | patent must be licensed for everyone's free use or not licensed at all. 57 | 58 | The precise terms and conditions for copying, distribution and 59 | modification follow. 60 | 61 | ### TERMS AND CONDITIONS FOR COPYING, DISTRIBUTION AND MODIFICATION 62 | 63 | **0.** This License applies to any program or other work which contains 64 | a notice placed by the copyright holder saying it may be distributed 65 | under the terms of this General Public License. The “Program”, below, 66 | refers to any such program or work, and a “work based on the Program” 67 | means either the Program or any derivative work under copyright law: 68 | that is to say, a work containing the Program or a portion of it, 69 | either verbatim or with modifications and/or translated into another 70 | language. (Hereinafter, translation is included without limitation in 71 | the term “modification”.) Each licensee is addressed as “you”. 72 | 73 | Activities other than copying, distribution and modification are not 74 | covered by this License; they are outside its scope. The act of 75 | running the Program is not restricted, and the output from the Program 76 | is covered only if its contents constitute a work based on the 77 | Program (independent of having been made by running the Program). 78 | Whether that is true depends on what the Program does. 79 | 80 | **1.** You may copy and distribute verbatim copies of the Program's 81 | source code as you receive it, in any medium, provided that you 82 | conspicuously and appropriately publish on each copy an appropriate 83 | copyright notice and disclaimer of warranty; keep intact all the 84 | notices that refer to this License and to the absence of any warranty; 85 | and give any other recipients of the Program a copy of this License 86 | along with the Program. 87 | 88 | You may charge a fee for the physical act of transferring a copy, and 89 | you may at your option offer warranty protection in exchange for a fee. 90 | 91 | **2.** You may modify your copy or copies of the Program or any portion 92 | of it, thus forming a work based on the Program, and copy and 93 | distribute such modifications or work under the terms of Section 1 94 | above, provided that you also meet all of these conditions: 95 | 96 | * **a)** You must cause the modified files to carry prominent notices 97 | stating that you changed the files and the date of any change. 98 | * **b)** You must cause any work that you distribute or publish, that in 99 | whole or in part contains or is derived from the Program or any 100 | part thereof, to be licensed as a whole at no charge to all third 101 | parties under the terms of this License. 102 | * **c)** If the modified program normally reads commands interactively 103 | when run, you must cause it, when started running for such 104 | interactive use in the most ordinary way, to print or display an 105 | announcement including an appropriate copyright notice and a 106 | notice that there is no warranty (or else, saying that you provide 107 | a warranty) and that users may redistribute the program under 108 | these conditions, and telling the user how to view a copy of this 109 | License. (Exception: if the Program itself is interactive but 110 | does not normally print such an announcement, your work based on 111 | the Program is not required to print an announcement.) 112 | 113 | These requirements apply to the modified work as a whole. If 114 | identifiable sections of that work are not derived from the Program, 115 | and can be reasonably considered independent and separate works in 116 | themselves, then this License, and its terms, do not apply to those 117 | sections when you distribute them as separate works. But when you 118 | distribute the same sections as part of a whole which is a work based 119 | on the Program, the distribution of the whole must be on the terms of 120 | this License, whose permissions for other licensees extend to the 121 | entire whole, and thus to each and every part regardless of who wrote it. 122 | 123 | Thus, it is not the intent of this section to claim rights or contest 124 | your rights to work written entirely by you; rather, the intent is to 125 | exercise the right to control the distribution of derivative or 126 | collective works based on the Program. 127 | 128 | In addition, mere aggregation of another work not based on the Program 129 | with the Program (or with a work based on the Program) on a volume of 130 | a storage or distribution medium does not bring the other work under 131 | the scope of this License. 132 | 133 | **3.** You may copy and distribute the Program (or a work based on it, 134 | under Section 2) in object code or executable form under the terms of 135 | Sections 1 and 2 above provided that you also do one of the following: 136 | 137 | * **a)** Accompany it with the complete corresponding machine-readable 138 | source code, which must be distributed under the terms of Sections 139 | 1 and 2 above on a medium customarily used for software interchange; or, 140 | * **b)** Accompany it with a written offer, valid for at least three 141 | years, to give any third party, for a charge no more than your 142 | cost of physically performing source distribution, a complete 143 | machine-readable copy of the corresponding source code, to be 144 | distributed under the terms of Sections 1 and 2 above on a medium 145 | customarily used for software interchange; or, 146 | * **c)** Accompany it with the information you received as to the offer 147 | to distribute corresponding source code. (This alternative is 148 | allowed only for noncommercial distribution and only if you 149 | received the program in object code or executable form with such 150 | an offer, in accord with Subsection b above.) 151 | 152 | The source code for a work means the preferred form of the work for 153 | making modifications to it. For an executable work, complete source 154 | code means all the source code for all modules it contains, plus any 155 | associated interface definition files, plus the scripts used to 156 | control compilation and installation of the executable. However, as a 157 | special exception, the source code distributed need not include 158 | anything that is normally distributed (in either source or binary 159 | form) with the major components (compiler, kernel, and so on) of the 160 | operating system on which the executable runs, unless that component 161 | itself accompanies the executable. 162 | 163 | If distribution of executable or object code is made by offering 164 | access to copy from a designated place, then offering equivalent 165 | access to copy the source code from the same place counts as 166 | distribution of the source code, even though third parties are not 167 | compelled to copy the source along with the object code. 168 | 169 | **4.** You may not copy, modify, sublicense, or distribute the Program 170 | except as expressly provided under this License. Any attempt 171 | otherwise to copy, modify, sublicense or distribute the Program is 172 | void, and will automatically terminate your rights under this License. 173 | However, parties who have received copies, or rights, from you under 174 | this License will not have their licenses terminated so long as such 175 | parties remain in full compliance. 176 | 177 | **5.** You are not required to accept this License, since you have not 178 | signed it. However, nothing else grants you permission to modify or 179 | distribute the Program or its derivative works. These actions are 180 | prohibited by law if you do not accept this License. Therefore, by 181 | modifying or distributing the Program (or any work based on the 182 | Program), you indicate your acceptance of this License to do so, and 183 | all its terms and conditions for copying, distributing or modifying 184 | the Program or works based on it. 185 | 186 | **6.** Each time you redistribute the Program (or any work based on the 187 | Program), the recipient automatically receives a license from the 188 | original licensor to copy, distribute or modify the Program subject to 189 | these terms and conditions. You may not impose any further 190 | restrictions on the recipients' exercise of the rights granted herein. 191 | You are not responsible for enforcing compliance by third parties to 192 | this License. 193 | 194 | **7.** If, as a consequence of a court judgment or allegation of patent 195 | infringement or for any other reason (not limited to patent issues), 196 | conditions are imposed on you (whether by court order, agreement or 197 | otherwise) that contradict the conditions of this License, they do not 198 | excuse you from the conditions of this License. If you cannot 199 | distribute so as to satisfy simultaneously your obligations under this 200 | License and any other pertinent obligations, then as a consequence you 201 | may not distribute the Program at all. For example, if a patent 202 | license would not permit royalty-free redistribution of the Program by 203 | all those who receive copies directly or indirectly through you, then 204 | the only way you could satisfy both it and this License would be to 205 | refrain entirely from distribution of the Program. 206 | 207 | If any portion of this section is held invalid or unenforceable under 208 | any particular circumstance, the balance of the section is intended to 209 | apply and the section as a whole is intended to apply in other 210 | circumstances. 211 | 212 | It is not the purpose of this section to induce you to infringe any 213 | patents or other property right claims or to contest validity of any 214 | such claims; this section has the sole purpose of protecting the 215 | integrity of the free software distribution system, which is 216 | implemented by public license practices. Many people have made 217 | generous contributions to the wide range of software distributed 218 | through that system in reliance on consistent application of that 219 | system; it is up to the author/donor to decide if he or she is willing 220 | to distribute software through any other system and a licensee cannot 221 | impose that choice. 222 | 223 | This section is intended to make thoroughly clear what is believed to 224 | be a consequence of the rest of this License. 225 | 226 | **8.** If the distribution and/or use of the Program is restricted in 227 | certain countries either by patents or by copyrighted interfaces, the 228 | original copyright holder who places the Program under this License 229 | may add an explicit geographical distribution limitation excluding 230 | those countries, so that distribution is permitted only in or among 231 | countries not thus excluded. In such case, this License incorporates 232 | the limitation as if written in the body of this License. 233 | 234 | **9.** The Free Software Foundation may publish revised and/or new versions 235 | of the General Public License from time to time. Such new versions will 236 | be similar in spirit to the present version, but may differ in detail to 237 | address new problems or concerns. 238 | 239 | Each version is given a distinguishing version number. If the Program 240 | specifies a version number of this License which applies to it and “any 241 | later version”, you have the option of following the terms and conditions 242 | either of that version or of any later version published by the Free 243 | Software Foundation. If the Program does not specify a version number of 244 | this License, you may choose any version ever published by the Free Software 245 | Foundation. 246 | 247 | **10.** If you wish to incorporate parts of the Program into other free 248 | programs whose distribution conditions are different, write to the author 249 | to ask for permission. For software which is copyrighted by the Free 250 | Software Foundation, write to the Free Software Foundation; we sometimes 251 | make exceptions for this. Our decision will be guided by the two goals 252 | of preserving the free status of all derivatives of our free software and 253 | of promoting the sharing and reuse of software generally. 254 | 255 | ### NO WARRANTY 256 | 257 | **11.** BECAUSE THE PROGRAM IS LICENSED FREE OF CHARGE, THERE IS NO WARRANTY 258 | FOR THE PROGRAM, TO THE EXTENT PERMITTED BY APPLICABLE LAW. EXCEPT WHEN 259 | OTHERWISE STATED IN WRITING THE COPYRIGHT HOLDERS AND/OR OTHER PARTIES 260 | PROVIDE THE PROGRAM “AS IS” WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESSED 261 | OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF 262 | MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE. THE ENTIRE RISK AS 263 | TO THE QUALITY AND PERFORMANCE OF THE PROGRAM IS WITH YOU. SHOULD THE 264 | PROGRAM PROVE DEFECTIVE, YOU ASSUME THE COST OF ALL NECESSARY SERVICING, 265 | REPAIR OR CORRECTION. 266 | 267 | **12.** IN NO EVENT UNLESS REQUIRED BY APPLICABLE LAW OR AGREED TO IN WRITING 268 | WILL ANY COPYRIGHT HOLDER, OR ANY OTHER PARTY WHO MAY MODIFY AND/OR 269 | REDISTRIBUTE THE PROGRAM AS PERMITTED ABOVE, BE LIABLE TO YOU FOR DAMAGES, 270 | INCLUDING ANY GENERAL, SPECIAL, INCIDENTAL OR CONSEQUENTIAL DAMAGES ARISING 271 | OUT OF THE USE OR INABILITY TO USE THE PROGRAM (INCLUDING BUT NOT LIMITED 272 | TO LOSS OF DATA OR DATA BEING RENDERED INACCURATE OR LOSSES SUSTAINED BY 273 | YOU OR THIRD PARTIES OR A FAILURE OF THE PROGRAM TO OPERATE WITH ANY OTHER 274 | PROGRAMS), EVEN IF SUCH HOLDER OR OTHER PARTY HAS BEEN ADVISED OF THE 275 | POSSIBILITY OF SUCH DAMAGES. 276 | 277 | END OF TERMS AND CONDITIONS 278 | 279 | ### How to Apply These Terms to Your New Programs 280 | 281 | If you develop a new program, and you want it to be of the greatest 282 | possible use to the public, the best way to achieve this is to make it 283 | free software which everyone can redistribute and change under these terms. 284 | 285 | To do so, attach the following notices to the program. It is safest 286 | to attach them to the start of each source file to most effectively 287 | convey the exclusion of warranty; and each file should have at least 288 | the “copyright” line and a pointer to where the full notice is found. 289 | 290 | 291 | Copyright (C) 292 | 293 | This program is free software; you can redistribute it and/or modify 294 | it under the terms of the GNU General Public License as published by 295 | the Free Software Foundation; either version 2 of the License, or 296 | (at your option) any later version. 297 | 298 | This program is distributed in the hope that it will be useful, 299 | but WITHOUT ANY WARRANTY; without even the implied warranty of 300 | MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the 301 | GNU General Public License for more details. 302 | 303 | You should have received a copy of the GNU General Public License along 304 | with this program; if not, write to the Free Software Foundation, Inc., 305 | 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA. 306 | 307 | Also add information on how to contact you by electronic and paper mail. 308 | 309 | If the program is interactive, make it output a short notice like this 310 | when it starts in an interactive mode: 311 | 312 | Gnomovision version 69, Copyright (C) year name of author 313 | Gnomovision comes with ABSOLUTELY NO WARRANTY; for details type `show w'. 314 | This is free software, and you are welcome to redistribute it 315 | under certain conditions; type `show c' for details. 316 | 317 | The hypothetical commands `show w` and `show c` should show the appropriate 318 | parts of the General Public License. Of course, the commands you use may 319 | be called something other than `show w' and `show c`; they could even be 320 | mouse-clicks or menu items--whatever suits your program. 321 | 322 | You should also get your employer (if you work as a programmer) or your 323 | school, if any, to sign a “copyright disclaimer” for the program, if 324 | necessary. Here is a sample; alter the names: 325 | 326 | Yoyodyne, Inc., hereby disclaims all copyright interest in the program 327 | `Gnomovision' (which makes passes at compilers) written by James Hacker. 328 | 329 | , 1 April 1989 330 | Ty Coon, President of Vice 331 | 332 | This General Public License does not permit incorporating your program into 333 | proprietary programs. If your program is a subroutine library, you may 334 | consider it more useful to permit linking proprietary applications with the 335 | library. If this is what you want to do, use the GNU Lesser General 336 | Public License instead of this License. 337 | -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- 1 | # proxmox-server-scripts 2 | Various scripts for configuring and administering a Proxmox (Debian) server and VMs 3 | 4 | #### Backup and Restore with S3QL 5 | 6 | - s3ql: an init script for mounting the s3ql encryped filesystem for use as a storage directory in Proxmox 7 | - s3ql_backup.sh: for backing up a whole Proxmox server with s3ql to Amazon S3 storage 8 | - s3ql_restore.sh: for restoring a whole Proxmox server with 3sql from Amazon S3 storage 9 | 10 | #### Networking in KVM Guests 11 | - setup_network.sh: for changing static network settings in Debian guest VM after cloning 12 | 13 | #### Automatically remove Proxmox “No Valid Subscription” message on upgrades 14 | 15 | The Proxmox “No Valid Subscription” message re-appears after each Proxmox software update, even if you initially patched the pve-manager file. Since Proxmox is free software under the GPL, I do not like the connotation of the message, which makes it sound like one is using unlicenced software. If you want to use the community repository for updates and do not need commercial support, it is completely legitimate to run Proxmox this way. If you want to use the 'enterprise repository', please look into the attractive [subscription options](https://www.proxmox.com/en/proxmox-ve/pricing). 16 | 17 | Check your /etc/apt/sources.list and make sure, that you are actually getting updates from the free [Proxmox repository](https://pve.proxmox.com/wiki/Package_repositories): 18 | 19 | ``` 20 | echo "deb http://download.proxmox.com/debian/pve buster pve-no-subscription" >> /etc/apt/sources.list 21 | ``` 22 | 23 | - proxmox_noreminder.sh: the script automatically removes the Proxmox 6 “No Valid Subscription” message on upgrades by watching the relevant directory with ```incron```. Incron is watching the directory, as it seems to trigger more reliably than watching only the file. A few files in this directory are replaced during each upgrade, but only one needs to be patched in this edition of Proxmox. The script also patches the Proxmox Support Tab with a more friendly message. 24 | 25 | Initially backup & patch the files manually and confirm with diff, that the changes are as expected: 26 | ``` 27 | cp /usr/share/javascript/proxmox-widget-toolkit/proxmoxlib.js /usr/share/javascript/proxmox-widget-toolkit/proxmoxlib.js.bak 28 | sed -i "s/data.status !== 'Active'/false/g" /usr/share/javascript/proxmox-widget-toolkit/proxmoxlib.js 29 | systemctl restart pveproxy.service 30 | 31 | # log the changes 32 | diff /usr/share/javascript/proxmox-widget-toolkit/proxmoxlib.js.bak /usr/share/javascript/proxmox-widget-toolkit/proxmoxlib.js 33 | ``` 34 | 35 | Install Incron and only allow the root user 36 | ``` 37 | apt-get install incron 38 | echo "root" >> /etc/incron.allow 39 | ``` 40 | 41 | and copy the script: 42 | ``` 43 | cp proxmox_noreminder.sh /usr/local/bin/proxmox_noreminder.sh 44 | chmod +x /usr/local/bin/proxmox_noreminder.sh 45 | ``` 46 | 47 | Add the following in incrontab 48 | ``` 49 | incrontab -e 50 | ... 51 | /usr/share/javascript/proxmox-widget-toolkit/ IN_CREATE /usr/local/bin/proxmox_noreminder.sh $# 52 | ``` 53 | 54 | Test with (in another terminal): 55 | ``` 56 | tail -f /var/log/syslog | grep incrond 57 | 58 | tail -n 30 -f /var/log/incron.log 59 | ``` 60 | Reinstalling pve-manager should trigger incron: 61 | ``` 62 | apt-get install --reinstall proxmox-widget-toolkit 63 | ``` 64 | 65 | ###### Disclaimer: 66 | *The above scripts & patches may have unforeseen consequences and automatic patching could harm your system. Always backup your Proxmox system before applying such changes! Proxmox may change the code at any time, making the patches useless or even counterproductive. Please make sure you understand the code before applying it to your system. Also, IANAL, and in my opinion the above Proxmox patches are permitted under the GPL, but if want to make sure, please consult a copyright lawyer in your jurisdiction. This disclaimer should not be interpreted as legal advice.* 67 | 68 | --- 69 | ###### License: 70 | This program is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation; either version 2 of the License, or (at your option) any later version. 71 | -------------------------------------------------------------------------------- /proxmox_noreminder.sh: -------------------------------------------------------------------------------- 1 | #!/bin/bash 2 | # automatic removal of Proxmox subscription reminder during upgrades 3 | # - tested with Proxmox 6 4 | # 5 | # exit on error 6 | set -e 7 | 8 | #echo "--- File changed: $1" >> /var/log/incron.log 9 | 10 | # Since we are watching the whole directory, we need to check for the correct file 11 | if [ "$1" == "proxmoxlib.js.dpkg-tmp" ]; then 12 | echo "$(date +%Y-%m-%d_%H:%M) proxmoxlib.js has been upgraded - patching file" >> /var/log/incron.log 13 | 14 | # wait a bit until the file has its permanent name 15 | sleep 15 16 | 17 | # patch the files 18 | cp /usr/share/javascript/proxmox-widget-toolkit/proxmoxlib.js /usr/share/javascript/proxmox-widget-toolkit/proxmoxlib.js.bak 19 | sed -i "s/data.status !== 'Active'/false/g" /usr/share/javascript/proxmox-widget-toolkit/proxmoxlib.js 20 | systemctl restart pveproxy.service 21 | 22 | # log the changes 23 | diff /usr/share/javascript/proxmox-widget-toolkit/proxmoxlib.js.bak /usr/share/javascript/proxmox-widget-toolkit/proxmoxlib.js >> /var/log/incron.log 24 | fi 25 | -------------------------------------------------------------------------------- /s3ql: -------------------------------------------------------------------------------- 1 | #!/bin/sh 2 | ### BEGIN INIT INFO 3 | # Provides: s3ql 4 | # Required-Start: $local_fs $network $syslog 5 | # Required-Stop: $local_fs $network $syslog 6 | # Default-Start: 2 3 4 5 7 | # Default-Stop: 0 1 6 8 | # Description: S3QL is a filesystem that stores all its data online 9 | # on Amazon s3 and other backends 10 | ### END INIT INFO 11 | # init script for Debian 7 12 | 13 | DESC="S3QL filesystem" 14 | AUTHFILE="/root/.s3ql/authinfo2" 15 | STORAGE_URL="s3://proxmoxchris" 16 | MOUNTPOINT="/mnt/s3ql" 17 | 18 | mkdir -p $MOUNTPOINT 19 | # put all s3ql logs here 20 | mkdir -p /var/log/s3ql 21 | 22 | case "$1" in 23 | start) 24 | # Redirect stdout and stderr into the system log 25 | DIR=$(mktemp -d) 26 | mkfifo "$DIR/LOG_FIFO" 27 | logger -t s3ql.mount -p local0.info < "$DIR/LOG_FIFO" & 28 | exec > "$DIR/LOG_FIFO" 29 | exec 2>&1 30 | rm -rf "$DIR" 31 | 32 | if mountpoint -q "$MOUNTPOINT"; then 33 | echo "ERROR: $DESC $STORAGE_URL is already mounted on $MOUNTPOINT" 34 | exit 1 35 | fi 36 | 37 | echo "Mounting $DESC" "$STORAGE_URL on $MOUNTPOINT" 38 | # Check and mount file system 39 | fsck.s3ql --batch --log /var/log/s3ql/fsck.log --authfile "$AUTHFILE" "$STORAGE_URL" 40 | STA=$? 41 | 42 | if [ $STA -eq 0 ]; then 43 | echo "successfully checked filesystem" 44 | else 45 | echo "ERROR: this is the error code: $STA" 46 | exit $STA 47 | fi 48 | mount.s3ql --log /var/log/s3ql/mount.log --authfile "$AUTHFILE" "$STORAGE_URL" "$MOUNTPOINT" 49 | if [ $STA -eq 0 ]; then 50 | echo "successfully mounted on $MOUNTPOINT" 51 | else 52 | echo "ERROR: this is the error code: $STA" 53 | exit $STA 54 | fi 55 | ;; 56 | 57 | stop) 58 | # Redirect stdout and stderr into the system log 59 | DIR=$(mktemp -d) 60 | mkfifo "$DIR/LOG_FIFO" 61 | logger -t s3ql.unmount -p local0.info < "$DIR/LOG_FIFO" & 62 | exec > "$DIR/LOG_FIFO" 63 | exec 2>&1 64 | rm -rf "$DIR" 65 | 66 | if ! mountpoint -q "$MOUNTPOINT"; then 67 | echo "ERROR: $DESC $STORAGE_URL is currently not mounted on $MOUNTPOINT" 68 | exit 1 69 | fi 70 | 71 | echo "Unmounting $DESC $STORAGE_URL from $MOUNTPOINT" 72 | s3qlctrl flushcache "$MOUNTPOINT" 73 | s3qlctrl upload-meta "$MOUNTPOINT" 74 | umount.s3ql "$MOUNTPOINT" 75 | 76 | if [ $? -eq 0 ]; then 77 | echo "successfully unmounted $MOUNTPOINT" 78 | else 79 | echo "ERROR: this is the error code: $STA" 80 | exit $STA 81 | fi 82 | ;; 83 | 84 | status) 85 | if ! mountpoint -q "$MOUNTPOINT"; then 86 | echo "$DESC $STORAGE_URL is currently not mounted on $MOUNTPOINT" 87 | exit 1 88 | fi 89 | 90 | echo "Status of $DESC $STORAGE_URL on $MOUNTPOINT" 91 | s3qlstat "$MOUNTPOINT" 92 | exit "$?" 93 | ;; 94 | 95 | *) 96 | echo "Usage: s3ql {start|stop|status}" >&2 97 | exit 3 98 | ;; 99 | esac 100 | -------------------------------------------------------------------------------- /s3ql_backup.sh: -------------------------------------------------------------------------------- 1 | #!/bin/bash 2 | 3 | # Used for backing up a complete Proxmox 3.4 server on Debian 7 4 | # the VM's (in lib/vz) are backed up separately by Proxmox 5 | 6 | # This backup script should be run daily via cron 7 | 8 | # Abort entire script if any command fails 9 | set -e 10 | 11 | # Exclude the following from being backed up, because: 12 | # - /udev/ files can cause eth0 to be renamed 13 | # - /cluster.fw - we disable firewall during restore 14 | # - interfaces, hosts & hostname may need to be modified 15 | # - resolv.conf can interrupt rsync 16 | # - /etc/issue has Proxmox server IP in it 17 | # - grub.cfg has hardware specific UUIDs for the disks 18 | # - fstab could have disk UUIDs, mtab is dynamic 19 | # - .s3ql data is handled by s3ql itself 20 | # - /mnt/ contains the /s3ql backup dir 21 | # - /dev /proc /sys /run are populated at boot 22 | # - /tmp /media /lost+found does not need to be backed up 23 | # - lib/vz holding VM's are backed up separately by Proxmox 24 | cat > /tmp/exclude.txt << "EOF" 25 | /etc/udev 26 | /etc/pve/firewall/cluster.fw 27 | /etc/network/interfaces 28 | /etc/hosts 29 | /etc/hostname 30 | /etc/resolv.conf 31 | /etc/issue 32 | /boot/grub/grub.cfg 33 | /etc/fstab 34 | /etc/mtab 35 | /root/.s3ql 36 | /mnt 37 | /dev 38 | /proc 39 | /sys 40 | /run 41 | /tmp 42 | /media 43 | /lost+found 44 | /var/lib/vz/images 45 | /var/lib/vz/private 46 | /var/lib/vz/root 47 | EOF 48 | 49 | # copy some excluded files for later reference 50 | cp /boot/grub/grub.cfg /boot/grub/grub.cfg.restore 51 | cp /etc/issue /etc/issue.restore 52 | cp /etc/resolv.conf /etc/resolv.conf.restore 53 | cp /etc/fstab /etc/fstab.restore 54 | cp -R /etc/udev/ /etc/udev.restore/ 55 | 56 | # copy network related files for optional restore 57 | cp /etc/network/interfaces /etc/network/interfaces.restore 58 | cp /etc/hosts /etc/hosts.restore 59 | cp /etc/hostname /etc/hostname.restore 60 | 61 | # Backup destination with s3ql filesystem 62 | # - authinfo2 needs to be provided and storage already active on S3 63 | mountpoint="/mnt/s3ql" 64 | backupdir="$mountpoint/proxmoxfs" 65 | AUTHFILE="/root/.s3ql/authinfo2" 66 | STORAGE_URL="s3://proxmoxchris" 67 | 68 | mkdir -p /var/log/s3ql 69 | 70 | # check, if backup filesystem is mounted 71 | if ! mountpoint -q "$mountpoint"; then 72 | # clean mountpoint 73 | rm -vfR $mountpoint/* 74 | # Check and mount file system 75 | fsck.s3ql --log /var/log/s3ql/fsck.log --batch --authfile "$AUTHFILE" "$STORAGE_URL" 76 | mount.s3ql --log /var/log/s3ql/mount.log --authfile "$AUTHFILE" "$STORAGE_URL" "$mountpoint" 77 | fi 78 | 79 | # exit, if not mounted 80 | mountpoint "$mountpoint" 81 | 82 | # Figure out the most recent backup 83 | mkdir -p "$backupdir" 84 | cd "$backupdir" 85 | last_backup=`python < ~/.s3ql/authinfo2 << "EOF" 27 | [s3] 28 | storage-url: s3://proxmoxchris 29 | backend-login: [AWS Access Key ID] 30 | backend-password: [AWS Secret Access Key] 31 | fs-passphrase: ******** 32 | EOF 33 | chmod -v 600 ~/.s3ql/authinfo2 34 | fi 35 | 36 | # Restore from source mounted with s3ql filesystem 37 | mountpoint="/mnt/s3ql" 38 | backupdir="$mountpoint/proxmoxfs" 39 | AUTHFILE="/root/.s3ql/authinfo2" 40 | STORAGE_URL="s3://proxmoxchris" 41 | 42 | mkdir -p $mountpoint 43 | # put all s3ql logs here 44 | mkdir -p /var/log/s3ql 45 | 46 | # check, if backup filesystem is mounted 47 | if ! mountpoint -q "$mountpoint"; then 48 | echo "mounting $mountpoint" 49 | # Check and mount file system 50 | fsck.s3ql --log /var/log/s3ql/fsck.log --authfile "$AUTHFILE" "$STORAGE_URL" 51 | mount.s3ql --log /var/log/s3ql/mount.log --authfile "$AUTHFILE" "$STORAGE_URL" "$mountpoint" 52 | fi 53 | 54 | # exit, if not mounted 55 | mountpoint "$mountpoint" 56 | 57 | # optional argument is a valid backup directory like 2015-07-30_21:53:13 58 | # if no directory is given, then use the most recent backup 59 | if [ $# -ge 1 ] 60 | then 61 | from_backup=$1 62 | else 63 | # Figure out the most recent backup 64 | cd "$backupdir" 65 | from_backup=`python < /etc/pve/firewall/cluster.fw << "EOF" 93 | [OPTIONS] 94 | enable: 0 95 | EOF 96 | 97 | # restore the system using 10 rsync processes 98 | # - file exclusions are already handled by the backup script 99 | # - thus this method should be faster 100 | /usr/lib/s3ql/pcp.py -a --debug $backupdir/$from_backup/ / 101 | 102 | ## restore the system using 1 rsync process with exclusion file list 103 | # - use this, if you need to exclude additional files 104 | # - if the s3ql_backup script was used, then exclusions were already applied during backup 105 | # cat > /tmp/exclude.txt << "EOF" 106 | # /etc/pve/firewall/cluster.fw 107 | # /etc/network/interfaces 108 | # /etc/hosts 109 | # /etc/hostname 110 | # EOF 111 | # 112 | # rsync --archive --hard-links --acls --xattrs --one-file-system \ 113 | # --partial-dir=.rsync-partial \ 114 | # --progress --human-readable --stats \ 115 | # --log-file="/var/log/s3ql/rsync-restore-$from_backup.log" \ 116 | # --exclude-from=/tmp/exclude.txt \ 117 | # "$backupdir/$from_backup/" "/" 118 | # rm /tmp/exclude.txt 119 | 120 | echo -e "\n*** Things TO DO after restore:" 121 | echo "* check and reenable Proxmox Firewall (as it has been disabled)" 122 | 123 | echo -e "\n*** The following files were not overwritten, but can be restored manually:" 124 | echo "- /boot/grub/grub.cfg.restore" 125 | echo "- /etc/resolv.conf.restore" 126 | echo "- /etc/issue.restore" 127 | echo "- /etc/fstab.restore" 128 | echo "- /etc/udev.restore" 129 | 130 | echo -e "\n*** If you restored Proxmox to a different system," 131 | echo "you may need to modify the following files before restarting:" 132 | echo "* /etc/network/interfaces - Main IP, additional IPs, NAT rules" 133 | echo " (also inside KVMs utilizing an additional IP)" 134 | echo "* /etc/hosts - Main IP (also inside KVMs utilizing an additional IP)" 135 | echo "* /etc/hostname - be sure to check hostname configuration" 136 | echo -e "\n* These are available for manual or automatic restore here:" 137 | echo -e "* /etc/network/interfaces.restore, /etc/hosts.restore, /etc/hostname.restore\n" 138 | 139 | while true ; do 140 | read -p 'Overwrite networking files & hostname now? (yes/no?): ' answer 141 | case "${answer}" in 142 | [yY]|[yY][eE][sS]) 143 | # restore these files 144 | cp -v /etc/network/interfaces.restore /etc/network/interfaces 145 | cp -v /etc/hosts.restore /etc/hosts 146 | cp -v /etc/hostname.restore /etc/hostname 147 | hostname -F /etc/hostname 148 | break 149 | ;; 150 | [nN]|[nN][oO]) 151 | break 152 | ;; 153 | esac 154 | done 155 | 156 | while true ; do 157 | read -p 'Do you want to run 'update-grub' now? (yes/no?): ' answer 158 | case "${answer}" in 159 | [yY]|[yY][eE][sS]) 160 | update-grub 161 | break 162 | ;; 163 | [nN]|[nN][oO]) 164 | break 165 | ;; 166 | esac 167 | done 168 | -------------------------------------------------------------------------------- /setup_network.sh: -------------------------------------------------------------------------------- 1 | #!/bin/bash 2 | # Script for static network setup in a Debian 7 or 8 KVM guest on a Proxmox host 3 | # for use after cloning a KVM 4 | # 5 | # The host server has one bridge for routing additional IPs 6 | # and another bridge for local IP's with NAT accessible via the main server IP 7 | mainserverip="217.79.181.100" 8 | 9 | getinfo() { 10 | read -e -p "Enter the IP address for your server: " -i "10.10.10.254" staticip 11 | read -e -p "Enter the netmask for your network: " -i "255.255.255.0" netmask 12 | read -e -p "Enter the IP of your Gateway: " -i "10.10.10.1" gatewayip 13 | read -e -p "Enter the Hostname: " -i "$HOSTNAME" newhostname 14 | } 15 | 16 | getinfoaddip() { 17 | read -e -p "Enter the IP address for your server (additional external IP): " -i "203.0.113.0" staticip 18 | read -e -p "Enter the netmask for your point-to-point network: " -i "255.255.255.255" netmask 19 | read -e -p "Enter the IP of your Gateway (main Proxmox IP): " -i "$mainserverip" gatewayip 20 | read -e -p "Enter the Hostname: " -i "$HOSTNAME" newhostname 21 | } 22 | 23 | writenetworkfile() { 24 | #> /etc/network/interfaces 25 | cat << EOF > /etc/network/interfaces 26 | # This file describes the network interfaces available on your system 27 | # and how to activate them. For more information, see interfaces(5). 28 | # The loopback network interface 29 | auto lo 30 | iface lo inet loopback 31 | 32 | # The primary network interface 33 | auto eth0 34 | #Your static network configuration 35 | iface eth0 inet static 36 | # Guest on vmbr1 behind NAT 37 | address $staticip 38 | netmask $netmask 39 | gateway $gatewayip 40 | EOF 41 | 42 | # add pointopoint for external IP address 43 | if [[ $addip == "Y" || $addip == "y" ]]; then 44 | echo "pointopoint $gatewayip" >> /etc/network/interfaces 45 | echo "# use vmbr0 on Proxmox server" >> /etc/network/interfaces 46 | fi 47 | 48 | # change hosts 49 | cat << EOF > /etc/hosts 50 | 127.0.0.1 localhost 51 | $staticip $newhostname.lightinasia.org $newhostname 52 | 53 | # The following lines are desirable for IPv6 capable hosts 54 | ::1 localhost ip6-localhost ip6-loopback 55 | ff02::1 ip6-allnodes 56 | ff02::2 ip6-allrouters 57 | EOF 58 | #don't use any space before of after 'EOF' in the previous lines 59 | 60 | # change hostname 61 | echo "$newhostname" > /etc/hostname 62 | hostname -F /etc/hostname 63 | 64 | echo "" 65 | echo "Your settings were saved in" 66 | echo " /etc/network/interfaces" 67 | echo " /etc/hosts" 68 | echo " /etc/hostname" 69 | echo "" 70 | echo "restarting networking..." 71 | systemctl restart networking; systemctl status networking 72 | echo "" 73 | echo "NETWORK:" 74 | ip addr show dev eth0 75 | echo "ROUTE:" 76 | ip route 77 | exit 0 78 | } 79 | 80 | checkinfo() { 81 | read -p "Are you configuring this server with an additional external IP (answer no if using NAT)? [y/n]: " addip 82 | case $addip in 83 | [Yy]* ) getinfoaddip;; 84 | [Nn]* ) getinfo;; 85 | * ) echo "Please enter y or n!" 86 | exit 1 87 | ;; 88 | esac 89 | echo "" 90 | echo "Your settings will be changed to the following:" 91 | echo "Your hostname is: $newhostname" 92 | echo "Your decicated Server IP is: $staticip" 93 | echo "The mask for the Network is: $netmask" 94 | echo "Address of your Gateway is: $gatewayip" 95 | echo "" 96 | } 97 | 98 | clear 99 | echo "Let's set up a static IP address and hostname for your VM" 100 | echo "" 101 | checkinfo 102 | 103 | while true; do 104 | read -p "Are these settings correct? [y/n]: " yn 105 | case $yn in 106 | [Yy]* ) writenetworkfile;; 107 | [Nn]* ) checkinfo;; 108 | * ) echo "Please enter y or n!";; 109 | esac 110 | done 111 | --------------------------------------------------------------------------------