sync

[dak.git] / TODO

                                 TODO
                                 ====

================================================================================

Actually Urgent
---------------

  o lisa doesn't do the right thing with -2 and -1 uploads, as you can
    end up with the .orig.tar.gz not in the pool

  o lisa exits if you check twice (aj)

  o lisa doesn't trap signals from fernanda properly

More Urgent
-----------

  o cross-suite version checking

     Priority based; stable == 1, proposed-update == 2, etc.

      i.e. A package targeted for a suite, must have a higher (or
      equal) version number than anything in a suite with a lower
      priority and also must have a lower (or equal) version number
      than anything in a suite with a higher priorty.  The checks are
      always "or equal to" because two seperate uploads with the same
      version will fail thanks to the file overwrite errors (at least
      ignoring potato) and multi-suite uploads (e.g. "stable
      unstable") need to work.

  o jenna sucks

  o queued and/or perl on sparc stable sucks

  o aj's bin nmu changes

  o Lisa:
    * priority >> optional
    * arch != {any,all}
    * build-depends wrong (via andrea)
    * suid
    * conficlits
    * notification/stats to admin daily
    o trap fernanda exiting
    o distinguish binary only versus others (neuro)

  o change utils.copy to try rename() first

  o cache changes parsed from ordering (careful tho: would be caching
    .changes from world writable incoming, not holding)

  o katie doesn't recognise binonlyNMUs correctly in terms of telling
    who their source is; source-must-exist does, but the info is not
    propogated down.

  o DONE

  o clean fingerprint

  o Fix BTS vs. katie sync issues by queueing(via BSMTP) BTS mail so
    that it can be released on deman (e.g. ETRN to exim).

  o write our own locking module or in some other way fix things so we
    don't require a patch to python since upstream refuse to fix it.
 
  o maintainers file needs overrides  
 
    [ change override.maintainer to override.maintainer-from +
      override.maintainer-to and have them reference the maintainers
      table.  Then fix charisma to use them and write some scripting
      to handle the Santiago situation. ]

  o (Depends) <aj> elmo: it should match  \(\s*(<<|<|<=|=|>=|>|>>)\s*<VERSIONREGEXP>\) fwiw

  o Clean up DONE; archive to tar file every 2 weeks, update tar tvzf INDEX file.

  o testing-updates suite: if binary-only and version << version in
    unstable and source-ver ~= source-ver in testing; then map
    unstable -> testing-updates ?

  o [Hard] dependency checking (esp. stable) (partially done)

  o hooks for debian specific checks (e.g. check_urgency)

  o Logging [mostly done]

  o Abstraction of suite hardcoding (q.v. progengy)

  o morgue needs auto-cleaning (?)

  o auto-building crap should be optional

================================================================================

Less Urgent
-----------

  o jennifer is leaking file descriptors..

  o the tar extractor class doesn't need to be redone for each package

  o interrupting of stracing jennifer causes exceptions errors from apt_inst calls 

  o reverse of source-must-exist; i.e. binary-for-source-must-not-exist
  o REJECT reminders in shania.
  o fernanda should check for conflicts and warn about them visavis priority [rmurray]
  o store a list of removed/files versions; also compare against them.
    [but be careful about scalability]

  o fernanda: print_copyright should be a lot more intelligent
     @ handle copyright.gz
     @ handle copyright.ja and copyright
     @ handle (detect at least) symlinks to another package's doc directory
     @ handle and/or fall back on source files (?)

  o To incorporate from utils:
     @ unreject

  o katie could vrfy email addresses (?) [errge@]
  o auto-purge out-of-date stuff from non-free/contrib so that testing and stuff works
  o doogie's binary -> source index
  o Add urgency + installed date to the DB for aj/testing (? still needed ?)
  o jt's web stuff, matt's changelog stuff (overlap)

  o [Hard] Need to merge non-non-US and non-US DBs.

  o experimental needs to auto clean (relative to unstable) [partial: rene warns about this]

  o Do a checkpc(1)-a-like which sanitizes a config files.
  o fix parse_changes()/build_file_list() to sanity check filenames
  o saftey check and/or rename debs so they match what they should be

  o Improve andrea.
  o Need to optimize all the queries by using EXAMINE and building some INDEXs.
  o Need to enclose all the setting SQL stuff in transactions (mostly done).
  o Need to finish alyson (a way to sync katie.conf and the DB)
  o Need the ability to rebuild all other tables from dists _or_ pools (in the event of disaster) (?)
  o Make the --help and --version options do stuff for all scripts

  o charisma can't handle whitespace-only lines (for the moment, this is feature)

  o generic way of saying isabinary and isadsc. (?)

  o s/distribution/suite/g

  o cron.weekly:
     @ weekly postins to d-c (?)
     @ backup of report (?)
     @ backup of changes.tgz (?)

 * Harder:

    o override checks sucks; it needs to track changes made by the
      maintainer and pass them onto ftpmaster instead of warning the
      maintainer.
    o need to do proper rfc822 escaping of from lines (as opposed to s/\.//g)
    o when dinstall is run in install mode but not as a cron job, it
      should probably run jenna to avoid madison originated user confusion
    o Revisit linking of binary->source in install() in katie.
    o Fix component handling in overrides (aj)
    o Fix lack of entires in source overrides (aj)
    o direport misreports things as section 'devel'
    o vrfy check of every Maintainer+Changed-By address; valid for 3 months.
    o binary-all should be done on a per-source, per-architecture package
      basis to avoid, e.g. the perl-modules problem.
    o a source-missing-diff check: if the version has a - in it, and it
      is sourceful, it needs orig and diff, e.g. if someone uploads
      esound_0.2.22-6, and it is sourceful, and there is no diff ->
      REJECT (version has a dash, therefore not debian native.)
    o check linking of .tar.gz's to .dsc's.. see proftpd 1.2.1 as an example
    o archive needs md5sum'ed regularly, but takes too long to do all
      in one go; make progressive or weekly.
    o katie/jenna/rhona/whatever needs to clear out .changes
      files from p-u when removing stuff superseded by newer versions.
      [but for now we have halle]
    o test sig checking stuff in test/ (stupid thing is not modularized)
    o when encountering suspicous things (e.g. file tainting) do something more drastic

 * Easy:

    o promote changes["changes"] to mandatory in katie.py(dump_vars)
      after a month or so (or all .katie files contain in the queue
      contain it).
    o Rationalize config stuff.. Dir::Foo not Dir::FooDir [breaks other people??] 
      Also Dir::Queue::Foo, not Dir::QueueFooDir
    o melanie should behave better with -a and without -b; see
      gcc-defaults removal for an example.
    o Reject on misconfigured kernel-package uploads
    o denise abuses sys.stdout == badly  
    o utils.extract_component_from_section: main/utils -> main/utils, main rather than utils, main
    o Fix katie to warn if run when not in incoming or p-u
    o check for empty debs; check for empty (or small (<1k ?)) .tar.gz's.
    o katie should validate multi-suite uploads; only possible valid one
      is "stable unstable"
    o cron.daily* should change umask (aj sucks)
    o Rene doesn't look at debian-installer but should.
    o Rene needs to check for binary-less source packages.
    o Rene could accept a suite argument (?)
    o run shania every day (?) [ryan]
    o we don't check for .orig.tar.gz's, so it's possible to upload -2 with no .orig.tar.gz.
    o byhand stuff should send notification
    o catherine should udpate db; move files, not the other way around [neuro]
    o melanie should update the stable changelog [joey]
    o update tagdb.dia
  
 * Bizzare/uncertain:
   
    o validate source consistency, i.e. .dsc and .tar.gz as minimum (??)
    o Rene also doesn't seem to warn about missing binary packages (??)
    o jenna should not delete things because they don't exist (?)
    o logging: hostname + pid ?
    o ANAIS should be done in katie (?)
    o Add an 'add' ability to melanie (? separate prog maybe)
    o Replicate old dinstall report stuff (? needed ?)
    o Handle the case of 1:1.1 which would overwrite 1.1 (?)
    o maybe drop -r/--regex in madison, make it the default and
      implement -e/--exact (a la joey's "elmo")
  
 * Cleanups & misc: 
   
    o db_access' get_files needs to use exceptions not this None, > 0, < 0 return val BS (?)
    o The untouchable flag doesn't stop new packages being added to ``untouchable'' suites
    o jenna is too slow
    o jenna doesn't handle arch: any -> arch: all transitions 
      [aj worked around; need to revisit]

 * Stable:

<neuro> well, there's one other thing that doesn't work so well
<neuro> you probably should have stable_install ignore Closes:
<neuro> or it might be unique to the case of stable unstable uploads

================================================================================

Packaging
---------

  o Fix stuff to look in sensible places for libs and config file in debian package (?)

================================================================================