4 [NB: I use this as a thought record/scribble, not everything on here
5 makes sense and/or is actually ever going to get done, so IIWY I
6 wouldn't use it as gospel for the future of katie or as a TODO
7 list for random hacking.]
9 ================================================================================
14 o UrgencyLog stuff should minimize it's bombing out(?)
15 o Log stuff should open the log file g+w lamer
16 <aj> elmo_home: (although, if you haven't already, you might want to add a `Reject: invalid character in Version:' check to katie sometime)
17 <aj> elmo_home: (at least while auric's apt doesn't handle ~'s)
22 <drow> Can't read file.: /org/security.debian.org/queue/accepted/accepted/apache-perl_1.3.9-14.1-1.21.20000309-1_sparc.katie. You assume that the filenames are relative to accepted/, might want to doc or fix that.
24 <neuro> the orig was in NEW, the changes that caused it to be NEW were pulled out in -2, and we end up with no orig in the archive :(
26 o SecurityAcceptedAutoBuild doesn't handle the case of foo_3.3woody1
27 with a new .orig.tar.gz followed by a foo_3.3potato1 with the same
28 .orig.tar.gz; jennifer sees it and copes, but the AA code doesn't
29 and can't really easily know so the potato AA dir is left with no
30 .orig.tar.gz copy. doh.
32 o orig.tar.gz in accepted not handled properly (?)
34 o amber doesn't include .orig.tar.gz but it should
36 o permissions (paranoia, group write, etc.) configurability and overhaul
38 o remember duplicate copyrights in lisaand skip them, per package
40 o <M>ove option for lisa byhand proecessing
42 o rene could do with overrides
44 o db_access.get_location_id should handle the lack of archive_id properly
46 o the whole versioncmp thing should be documented
48 o lisa doesn't do the right thing with -2 and -1 uploads, as you can
49 end up with the .orig.tar.gz not in the pool
51 o lisa exits if you check twice (aj)
53 o lisa doesn't trap signals from fernanda properly
55 o queued and/or perl on sparc stable sucks - reimplement it.
57 o aj's bin nmu changes
60 * priority >> optional
62 * build-depends wrong (via andrea)
65 * notification/stats to admin daily
66 o trap fernanda exiting
67 o distinguish binary only versus others (neuro)
69 o cache changes parsed from ordering (careful tho: would be caching
70 .changes from world writable incoming, not holding); katie should
71 certainly be using .katie files, not parsing changes, that's just
74 o katie doesn't recognise binonlyNMUs correctly in terms of telling
75 who their source is; source-must-exist does, but the info is not
78 o Fix BTS vs. katie sync issues by queueing(via BSMTP) BTS mail so
79 that it can be released on deman (e.g. ETRN to exim).
81 o write our own locking module or in some other way fix things so we
82 don't require a patch to python since upstream refuse to fix it.
84 o maintainers file needs overrides
86 [ change override.maintainer to override.maintainer-from +
87 override.maintainer-to and have them reference the maintainers
88 table. Then fix charisma to use them and write some scripting
89 to handle the Santiago situation. ]
91 o (Depends) <aj> elmo: it should match \(\s*(<<|<|<=|=|>=|>|>>)\s*<VERSIONREGEXP>\) fwiw
93 o Clean up DONE; archive to tar file every 2 weeks, update tar tvzf INDEX file.
95 o testing-updates suite: if binary-only and version << version in
96 unstable and source-ver ~= source-ver in testing; then map
97 unstable -> testing-updates ?
99 o hooks or configurability for debian specific checks (e.g. check_urgency, auto-building support)
101 o morgue needs auto-cleaning (?)
103 ================================================================================
108 o change utils.copy to try rename() first
110 o [hard, long term] unchecked -> accepted should go into the db, not
111 a suite, but similar. this would allow katie to get even faster,
112 make madison more useful, decomplexify specialacceptedautobuild and
113 generally be more sane. may even be helpful to have e.g. new in the
114 DB, so that we avoid corner cases like the .orig.tar.gz disappearing
115 'cos the package has been entirely removed but was still on
116 stayofexecution when it entered new.
118 o Logging [mostly done] (todo: rhona (hard), .. ?)
120 o jennifer is leaking file descriptors..
122 o the tar extractor class doesn't need to be redone for each package
124 o reverse of source-must-exist; i.e. binary-for-source-must-not-exist
125 o REJECT reminders in shania.
126 o fernanda should check for conflicts and warn about them visavis priority [rmurray]
127 o store a list of removed/files versions; also compare against them.
128 [but be careful about scalability]
130 o fernanda: print_copyright should be a lot more intelligent
131 @ handle copyright.gz
132 @ handle copyright.ja and copyright
133 @ handle (detect at least) symlinks to another package's doc directory
134 @ handle and/or fall back on source files (?)
136 o To incorporate from utils:
139 o auto-purge out-of-date stuff from non-free/contrib so that testing and stuff works
140 o doogie's binary -> source index
141 o jt's web stuff, matt's changelog stuff (overlap)
143 o [Hard] Need to merge non-non-US and non-US DBs.
145 o experimental needs to auto clean (relative to unstable) [partial: rene warns about this]
147 o Do a checkpc(1)-a-like which sanitizes a config files.
148 o fix parse_changes()/build_file_list() to sanity check filenames
149 o saftey check and/or rename debs so they match what they should be
152 o Need to optimize all the queries by using EXAMINE and building some INDEXs.
153 [postgresql 7.2 will help here]
154 o Need to enclose all the setting SQL stuff in transactions (mostly done).
155 o Need to finish alyson (a way to sync katie.conf and the DB)
156 o Need the ability to rebuild all other tables from dists _or_ pools (in the event of disaster) (?)
157 o Make the --help and --version options do stuff for all scripts
159 o charisma can't handle whitespace-only lines (for the moment, this is feature)
161 o generic way of saying isabinary and isadsc. (?)
163 o s/distribution/suite/g
166 @ weekly postins to d-c (?)
167 @ backup of report (?)
168 @ backup of changes.tgz (?)
172 o interrupting of stracing jennifer causes exceptions errors from apt_inst calls
173 o dependency checking (esp. stable) (partially done)
174 o override checks sucks; it needs to track changes made by the
175 maintainer and pass them onto ftpmaster instead of warning the
177 o need to do proper rfc822 escaping of from lines (as opposed to s/\.//g)
178 o Revisit linking of binary->source in install() in katie.
179 o Fix component handling in overrides (aj)
180 o Fix lack of entires in source overrides (aj)
181 o direport misreports things as section 'devel' (? we don't use direport)
182 o vrfy check of every Maintainer+Changed-By address; valid for 3 months.
183 o binary-all should be done on a per-source, per-architecture package
184 basis to avoid, e.g. the perl-modules problem.
185 o a source-missing-diff check: if the version has a - in it, and it
186 is sourceful, it needs orig and diff, e.g. if someone uploads
187 esound_0.2.22-6, and it is sourceful, and there is no diff ->
188 REJECT (version has a dash, therefore not debian native.)
189 o check linking of .tar.gz's to .dsc's.. see proftpd 1.2.1 as an example
190 o archive needs md5sum'ed regularly, but takes too long to do all
191 in one go; make progressive or weekly.
192 o katie/jenna/rhona/whatever needs to clear out .changes
193 files from p-u when removing stuff superseded by newer versions.
194 [but for now we have halle]
195 o test sig checking stuff in test/ (stupid thing is not modularized due to global abuse)
196 o when encountering suspicous things (e.g. file tainting) do something more drastic
200 o suite mapping and component mapping are parsed per changes file,
201 they should probably be stored in a dictionary created at startup.
202 o don't stat/md5sum files you have entries for in the DB, moron
203 boy (Katie.check_source_blah_blah)
204 o promote changes["changes"] to mandatory in katie.py(dump_vars)
205 after a month or so (or all .katie files contain in the queue
207 o melanie should behave better with -a and without -b; see
208 gcc-defaults removal for an example.
209 o Reject on misconfigured kernel-package uploads
210 o utils.extract_component_from_section: main/utils -> main/utils, main rather than utils, main
211 o Fix jennier to warn if run when not in incoming or p-u
212 o katie should validate multi-suite uploads; only possible valid one
214 o cron.daily* should change umask (aj sucks)
215 o Rene doesn't look at debian-installer but should.
216 o Rene needs to check for binary-less source packages.
217 o Rene could accept a suite argument (?)
218 o byhand stuff should send notification
219 o catherine should udpate db; move files, not the other way around [neuro]
220 o melanie should update the stable changelog [joey]
225 o drop rather dubious currval stuff (?)
226 o rationalize os.path.join() usage
227 o Rene also doesn't seem to warn about missing binary packages (??)
228 o logging: hostname + pid ?
229 o ANAIS should be done in katie (?)
230 o Add an 'add' ability to melanie (? separate prog maybe)
231 o Replicate old dinstall report stuff (? needed ?)
232 o Handle the case of 1:1.1 which would overwrite 1.1 (?)
233 o maybe drop -r/--regex in madison, make it the default and
234 implement -e/--exact (a la joey's "elmo")
235 o dsc files are not checked for existence/perms (only an issue if
236 they're in the .dsc, but not the .changes.. possible?)
240 o db_access' get_files needs to use exceptions not this None, > 0, < 0 return val BS (?)
241 o The untouchable flag doesn't stop new packages being added to ``untouchable'' suites
243 ================================================================================
248 o Fix stuff to look in sensible places for libs and config file in debian package (?)
250 ================================================================================