1 2008-08-02 Andreas J. Koenig <andreas.koenig.7os6VVqR@franz.ak.mind.de>
3 * overhead of connecting seems high. When setting
4 max_files_per_connection to 1 we see that.
6 2008-08-01 Andreas J. Koenig <andreas.koenig.7os6VVqR@franz.ak.mind.de>
8 * 1217622571.0889 - 1217597432.86734 = 25138.2215600014
10 25138.2215600014/3600 = 6.98283932222261
12 It jumps into the eye that this is ~ 7 hours, not ~6, so there seems to
13 be a bug in the aggregator.
15 2008-07-27 Andreas J. Koenig <andreas.koenig.7os6VVqR@franz.ak.mind.de>
17 * e.g. id/Y/YE/YEWENBIN/Emacs-PDE-0.2.16.tar.gz: Do we have it, should
18 we have it, can we mirror it, mirror it!
20 I fear this needs a new class which might be called
21 File::Rsync::Mirror::Recent. It would collect all recentfiles of a kind
22 and treat them as an entity. I realize that a single recentfile may be
23 sufficient for certain tasks and that it is handy for the low level
24 programmer but it is not nice to use. If there is a delete in the 1h
25 file then the 6h file still contains it. Seekers of the best information
26 need to combine at least some of the recentfiles most of the time.
28 There is the place for the Z loop!
30 But the combination is something to collect in a database, isn't it. Did
33 2008-07-26 Andreas J. Koenig <andreas.koenig.7os6VVqR@franz.ak.mind.de>
35 * it just occurred to me that hosts in the same mirroring pool could
36 help out each other even without rewriting the recentfile. Just fetch
37 the stuff to mirror from several places, bingo. But that's something
38 that should rather live in a separate package or in rsync directly.
40 * cronjobs are unsuited because with ntp they would all come at the full
41 minute and disturb each other. Besides that I'd hate to have a backbone
42 with more than a few seconds latency.
44 2008-07-25 Andreas J. Koenig <andreas.koenig.7os6VVqR@franz.ak.mind.de>
46 * a second rsync server with access control for PAUSE. Port? 873 is the
47 standard port, let's take 8873.
49 * if there were a filesystem based on this, it would have a slow access
50 to inexistent files. It would probably provide wrong readdir (only based
51 on current content) or also a slow one (based on a recentfile written
52 after the call). But it would provide fast access to existing files. Or
53 one would deliberately allow slightly blurred answers based on some
54 sqlite reflection of the recentfiles.
56 * todo: write a variant of mirror() that combines two or more
57 recentfiles and treats them like one
59 * todo: signal handler to remove the tempfile
61 2008-07-24 Andreas J. Koenig <andreas.koenig.7os6VVqR@franz.ak.mind.de>
63 * now that we have the symlink I forgot how it should be used in
66 * the z loop: add missing files to Z file. Just append them (instead of
67 prepending). So one guy prepends something from the Y file from time to
68 time and another guy appends something rather frequently. Collecting
69 pond. When Y merges into Z, things get epoch and the collecting pond
70 gets smaller. What exactly are "missing files"?
72 take note of current epoch of the alpha file, let's call it the
75 find all files on disk
77 remove all files registered in the recentworld up to recent-ts
79 remove all files that have been deleted after recent-ts according to
82 2008-07-23 Andreas J. Koenig <andreas.koenig.7os6VVqR@franz.ak.mind.de>
84 * rersyncrecent might be a cronjob with a (locked) state file which
85 contains things like after and maybe last z sync or such?
87 rrr-mirror might be an alternative name but how would we justify the
88 three Rs when there is no Re-Rsync-Recent?
90 With the --loop parameter it is an endless loop, without it is no loop.
91 At least this is simple.
93 * todo: new accssor z-interval specifies how often the Z file is updated
94 against the filesystem. We probably want no epoch stamp on these
95 entries. And we want to be able to filter the entries (e.g. no
96 by-modules and by-category tree)
98 2008-07-20 Andreas J. Koenig <andreas.koenig.7os6VVqR@franz.ak.mind.de>
100 * Fill the Z file. gc or fsck or both. Somehow we must get the old files
101 into Z. We do not need the other files filled up with filesystem
104 * need interface to query for a file in order to NOT call update on
105 PAUSE a second time within a short time.
107 2008-07-19 Andreas J. Koenig <andreas.koenig.7os6VVqR@franz.ak.mind.de>
109 * recommended update interval? Makes no sense, is different for
116 change-log-default-name: "Todo"