2006-04-29 * md5backup.c (target): added @- for reading data from stdin 2005-04-10 * doc/sqlite.txt: clarified, as I will provide an external migration process. 2005-04-09 * DESCRIPTION: important notes added and corrected (made it longer, sigh) * doc/archive_format.txt: Added 2005-03-04 * md5backup.c (md5backup): restructured (sc_scandir): obsoleted 2005-03-03 * md5backup.c (error, fatal): oboleted by tino_err and tino_fatal. (vlog, log): changes for new verror behavior (verror, main): tino_verror_fn compatibility (progress): timing moved here, saves a syscall (vlog): now uses new progress interface (struct config, process_targets, target, init): config.target_list now is SLIST and config.dirlist now is always initialized (fixes minor memory leak). * bin/check.sh: minor change to allow to check softlinked multi file path, too. * md5backup.c (struct outpath_iterate_type, outpath_scan, outpath_iterate): multi file store changes (md5exists): now uses outpath_scan (existsfile): used in outpath_scan, so no more conditional compile 2005-02-27 * md5backup.c (struct config, cleanup): config.double added (compare_or_link): changes for multi file store * doc/sqlite.txt: added 2005-02-21 * README: Multiple file store added, other information revised. * md5backup.c (struct config, md5exists): outpaths iteration for multiple file store added (md5exists_iterate, struct md5exists_iterate_type): added 2005-02-20 * bin/sc-mysql.sh (mysqldump): -q added for less memory consumption 2004-12-12 * ign/dist-ign-DEBIAN, ign/dist-ign-TINO: added 2004-11-03 * md5backup.c (init, ignore_add, is_ignored, struct config): wildcard ignore list added 2004-10-05 * doc/restore.txt: updated to reflect bin/compare.sh * bin/compare.sh: added * md5backup.c (readcmp, compare_file, md5copy, compare_or_link): tino_file_read/write used now, readit() and writeall() deleted. (is_ignored, dirlist_add): screen output of ignores dropped as they "spam" too much, in favor of new sparse file ignores (I don't have any good idea how to fully support them). (vnote, note): added (main): the log now became a note (ignore_add): degraded ingore argument problems severity from warning to note. 2004-10-03 * bin/sc-mysql.sh: added better MySQL presence checking and dump now is written to subdirectory YYYYMM * bin/check.sh: cosmetic changes 2004-10-02 * md5backup.c (init, main): nice added (md5hunt): file flush added (to reduce the number of dirty buffers) 2004-09-30 * bin/sc-mysql.sh: Removed the trap that an accidential delete of mysqldump silently drops the backup of mysql. If you don't want mysql, comment it out in the calling script, that's safer. * bin/sc-backup.sh: give some meaningfull return value and remove the "networking wait loop". In case the network fails, just leave the rest for the next cycle. * bin/sc-loop.sh: it did no backup any more, oops ;) (PWFILE): lazy me, it was not named correctly, sorry. 2004-09-29 * bin/backup.sh (allfs): iso9660 (CD-ROMs/DVDs) filesystems and loop mounts are now not backed up, too. * md5backup.c (backup): new byte estimation which were transferred into the backup area. (md5copy): now returns the number of bytes copied. (md5log): line buffering added to md5 file to make ist unlikely that the last line is truncated. 2004-09-28 * doc/sc-backup.txt: new sc-loop.sh noted in the document * bin/sc-loop.sh: added 2004-08-31 * ign/dist-ign-MAIL: clientmqueue * bin/backup.sh (backupper): Improved hostname detection: The first time I started this script on a non networked debian computer the command `hostname -f` failed. 2004-08-25 * test/README: added. Please note that md5backup is able to back up *two* files which have different content and the same MD5 sum. I would like to prove this for *five* such files. Can one *please* create some for me? Thanks! *eg* 2004-08-17 U-KOSH\Administrator * md5backup.c (readcmp): bugfix. On short read 0 was returned, which actually means "identical", now 1 is returned. 2004-07-25 * md5backup.c (backup): logging now shows "known md5". (init): writing version string into log at startup (is_ignored): renamed "autoignore" to "ignore" 2004-07-09 * bin/dobackup.sh: minor changes in "root" detection - $USER not defined in all environments * bin/sc-backup.sh: logging improved * ign/dist-ign-MAIL, ign/dist-ign-LOG, ign/dist-ign-CACHE: more ignores added 2004-07-06 * md5backup.c (verror, vwarn): va_copy is not available on SuSE 7.2. In this case we must use __va_copy. 2004-07-05 * bin/sc-*.sh: logging added * bin/sc-backup.sh (sc-move): needed more move instances as we need 2 runs for one round and 2 rounds minimum. As some old data may be there, too, and we need 1 retry loops as well. 2004-07-04 * bin/sc-move.sh (buildlist): inverted result code - true if nothing to do as it should be. Additionally the name of the file shortened, as the lastest inclusion of the target made it too long. 2004-07-03 * bin/sc-backup.sh: ignores added * ign/dist-ign-LOG, ign/dist-ign-CACHE: new standard ignore files * bin/dobackup.sh (setup): standard ignores added * Makefile (tar): added 2004-06-27 * bin/sc-backup.sh: corrected. I really don't know what bullshit I edited into this last time .. Now it should work. 2004-06-20 * md5backup.c (init): ignore_add of config.tmpfile not needed and now leads to an unneccessary warning. * bin/backup.sh (backupper): ign/ directory now can contain files with ignore lists. * md5backup.c (vlog): removed double logging of prefix. 2004-06-19 * bin/sc-move.sh (MOVESPEED): unset, so the default is to use maximum bandwidth. You can limit it in sc-move.conf again. (buildlist): randomnized the splitting process, just to make sure irregularities in the file store have lesser impact. * md5backup.c (ignore_add): some warnings added on irregularities (linkpath_iterate_fn): clarified(?) warning text * bin/sc-backup.sh: bugfixes, was written a little bit lazy * bin/sc-move.sh: bugfixes, was written a little bit lazy * bin/dobackup.sh (DIRS, setup): ign and hint for it added * bin/backup.sh (backupper): Updated to changes in ignore_add of md5backup.c * md5backup.c (cleanup): forgot to print out warnings / format buffer error fixed. This corrects wroing output of last run line in logfile. (ignore_add): lstat() changed to stat() such that softlinks ignore file they point to. 2004-06-12 * md5backup.c (linkpath_iterate_fn): If you run md5backup over a new system with linked file store active, it produced too many warnings. Therefor we now check if the known file and the file in he linked file store are hardlinked. 2004-05-23 * md5backup.c (md5backup): Bug found (had no time any more yesterday), printing config.target before it was set. Nasty bug accessing a freed pointer which cannot be overwritten in meanwhile, completely harmless and even if not only affects screen output. Just moved down logging 3 lines after the target initializiation. (progress, md5backup): well, a second coredump in cleanup() because of the same problem. while finishing. Now fixed. 2004-05-22 * VERSION: Increment, as there is a bug .. * Makefile (LDLIBSEFENCE): As I had some memory issues lately with ptybuffer in tinolib, I included this define in the Makefile. You don't want to enable it yourself, trust me ;) However, I found out this way that I had a memory issue in md5backup as well. I am just too lazy, sigh. Now tracking down what it is .. It's in the outer loop. I am confident that it's an access to an already freed memory area, which is not all too bad .. 2004-05-21 * bin/dobackup.sh: finished - worked on ptybuffer in the meanwhile, this was more urgent. * tino/: Library functions updated from CVS. However tino/buf.h still is 1.3 instead of 1.5, will check this later. 2004-05-10 VERSION 0.3.2 Test version before freshmeat announcement ============= * README, TODO: moved many sections into doc/ * doc/full_backup.txt: Some basic words about how backups are handled. * doc/linked_file_store.txt: Description of the new feature and why I needed it. With this help the networked backup can be done. * doc/sc-backup.txt: Description of the new, experimental network backup scripts which are based on scylla-charybdis, this has to be verified before freshmeat announcement. * doc/results.txt: README.results moved here * doc/growing_files.txt: idea of a future enhancement * doc/restore.txt: written as a first attempt to describe how restore could be done * doc/rationale.txt: copied from README * md5backup.c: Known files in the file store are now re-linked to the linked file store. This is needed to make a complete network run again in case a full backup is done (by deleting the database in dbm/). (md5link, compare_or_link, linkpath_iterate_fn, linkpath_run, struct linkpath_user): in case we hit an already known file we must re-link the file in the file store into the linked file store. This is not config.tmpfile in this case. For now, if we hit an already known file in the linked file store in this case, we assume silently that both are the same file. (linkpath_iterate_fn): BUG removed: In case the hardlink to the linked file store does not work due to another cause than an existing file, md5backup does no more go rampant in a wild-loop. (verror): oops, forgot a va_copy (which is a dummy under linux) (progress, cleanup, vwarn, warn, struct config): warnings added 2004-05-04 VERSION 0.3.1 ============= * bin/sc-move.sh: Script to move(literally!) linked file store to the backup server using scylla-charybids. Used in sc-backup.sh * bin/sc-mysql.sh: mysql backup script for sc-backup.sh * bin/sc-backup.sh: new basic backup script to do a networked backup. It uses linked file store and using scylla+charybdis. see doc/sc-backup.txt * bin/dobackup.sh: create this script for convenience * README: restructured documentation, this is an ongoing effort from now on. See new directory doc/ * README.results: now in doc/results.txt * Well, sorry, I forgot to maintain ChangeLog, so this sums up some major changes in the last time. 2004-01-26 * README (Output): Section added 2004-01-12 * md5backup.c (md5backup): memory leak fixed. (target): target processing (excludes, includes) added. 2004-01-11 * version.h.in: Version information for extended usage added * bin/backup.sh (backupper): sample script for new call to md5backup added. * md5backup.c (vlog): printed month from 0 to 11 instead from 1 to 12. (init): ignores added (is_ignored): some files and directories are automatically ignored (md5backup): Added method to stay in same filesystem, so you have to give a full 'df -P' list on the command line to backup everything. See bin/backup.sh for an example.