no longer run a-f cleanup in weekly

Signed-off-by: Joerg Jaspert <joerg@debian.org>

dont output tag lines from metadata table, only external overrides

Signed-off-by: Joerg Jaspert <joerg@debian.org>

use gps2 in unchecked. also disable gen-filelists in dinstall

Signed-off-by: Joerg Jaspert <joerg@debian.org>

also do it for imports

Signed-off-by: Joerg Jaspert <joerg@debian.org>

switch of a-f

Signed-off-by: Joerg Jaspert <joerg@debian.org>

Merge remote branch 'mhy/multiproc' into merge

* mhy/multiproc:
  Get syntax right
  Deal with args being a tuple
  Add backwards compatibility code
  Make daklog be a Singleton
  Bugfixes for usage of DakProcessPool API
  remove unused variable
  Fix variable name
  Fix function name
  Fix up pool usage
  Enhance process pool implementation

Signed-off-by: Joerg Jaspert <joerg@debian.org>

Merge remote branch 'ftpmaster/master' into multiproc

Conflicts:
dak/generate_packages_sources2.py

Signed-off-by: Mark Hymers <mhy@debian.org>

kick out useless print stuff that only annoys in logs

Signed-off-by: Joerg Jaspert <joerg@debian.org>

Merge remote branch 'ansgar/p-s-from-db' into merge

* ansgar/p-s-from-db:
  do not generate binary-source/Packages
  look for already existing files in build queues
  fix typo in email address
  sort Packages by source name first

Signed-off-by: Joerg Jaspert <joerg@debian.org>

do not generate binary-source/Packages

look for already existing files in build queues

fix typo in email address

sort Packages by source name first

Merge remote branch 'ftpmaster/master' into multiproc

cron.unchecked: call generate-filelist with arguments.

Signed-off-by: Torsten Werner <twerner@debian.org>

Fix exception handling in process-new.

closes: #620361

Signed-off-by: Torsten Werner <twerner@debian.org>

Fall back to Maintainer if Changed-By missing

Signed-off-by: Mark Hymers <mhy@debian.org>

Merge remote branch 'ftpmaster/master' into multiproc

Conflicts:
dak/show_new.py

Signed-off-by: Mark Hymers <mhy@debian.org>

Merge remote branch 'ansgar/p-s-from-db' into merge

Signed-off-by: Mark Hymers <mhy@debian.org>

Merge remote-tracking branch 'origin/master' into p-s-from-db

Fix function add_dsc_to_db().

Signed-off-by: Torsten Werner <twerner@debian.org>

Update metadata for test DB.

Signed-off-by: Torsten Werner <twerner@debian.org>

Do not sync any lock files.

Signed-off-by: Torsten Werner <twerner@debian.org>

Install default SIGPIPE handler before calling dpkg-deb.

Signed-off-by: Torsten Werner <twerner@debian.org>

Don't remove files we previously generated

Signed-off-by: Mark Hymers <mhy@debian.org>

Short circuit already processed packages much more quickly

Signed-off-by: Mark Hymers <mhy@debian.org>

Pass session

Signed-off-by: Mark Hymers <mhy@debian.org>

Don't end up with multiple database sessions in check_sig call

Signed-off-by: Mark Hymers <mhy@debian.org>

Linearise show_new for now

Signed-off-by: Mark Hymers <mhy@debian.org>

Map squeeze-updates and stable-updates

Signed-off-by: Mark Hymers <mhy@debian.org>

Limit show-new to one process for now

Signed-off-by: Mark Hymers <mhy@debian.org>

Re-enable queue_rss after deleting the old pickle file

Signed-off-by: Mark Hymers <mhy@debian.org>

use new debian module name

Signed-off-by: Mark Hymers <mhy@debian.org>

Python behaves differently if you're redirecting to a file or not...

Signed-off-by: Mark Hymers <mhy@debian.org>

Encode using utf-8 and hope for the best

Signed-off-by: Mark Hymers <mhy@debian.org>

dak graph seems ok too

Signed-off-by: Mark Hymers <mhy@debian.org>

Re-enable show-new, but don't kill cron.hourly if it dies

Signed-off-by: Mark Hymers <mhy@debian.org>

Fix typo

Signed-off-by: Mark Hymers <mhy@debian.org>

temporary hack to fix squeeze-updates / stable-updates suite name

Signed-off-by: Mark Hymers <mhy@debian.org>

Comment out some things in cron.hourly which are broken

Signed-off-by: Mark Hymers <mhy@debian.org>

Merge remote branch 'ftpmaster/master'

Make cron.daily shell script more robust.

... and reindent it.

Signed-off-by: Torsten Werner <twerner@debian.org>

Excluding more directories from syncing.

Signed-off-by: Torsten Werner <twerner@debian.org>

copy external overrides from unstable to testing

Signed-off-by: Ansgar Burchardt <ansgar@debian.org>

Merge remote-tracking branch 'origin/master' into p-s-from-db

sick

Signed-off-by: Joerg Jaspert <joerg@debian.org>

function pg_timestamp

Signed-off-by: Joerg Jaspert <joerg@debian.org>

updates

Signed-off-by: Joerg Jaspert <joerg@debian.org>

Get syntax right

Signed-off-by: Mark Hymers <mhy@debian.org>

Deal with args being a tuple

Signed-off-by: Mark Hymers <mhy@debian.org>

Add backwards compatibility code

Signed-off-by: Mark Hymers <mhy@debian.org>

Make daklog be a Singleton

Signed-off-by: Mark Hymers <mhy@debian.org>

Merge branch 'master', remote branch 'ftpmaster/master'

off you are

Signed-off-by: Joerg Jaspert <joerg@debian.org>

moved ddaccess push into locks

Signed-off-by: Joerg Jaspert <joerg@debian.org>

no need for extra step

Signed-off-by: Joerg Jaspert <joerg@debian.org>

Bugfixes for usage of DakProcessPool API

Signed-off-by: Mark Hymers <mhy@debian.org>

remove unused variable

Signed-off-by: Mark Hymers <mhy@debian.org>

Fix variable name

Signed-off-by: Mark Hymers <mhy@debian.org>

Fix function name

Signed-off-by: Mark Hymers <mhy@debian.org>

Fix up pool usage

Signed-off-by: Mark Hymers <mhy@debian.org>

Enhance process pool implementation

Signed-off-by: Mark Hymers <mhy@debian.org>

Close log so we log program end

Signed-off-by: Mark Hymers <mhy@debian.org>

Fix up function call

Signed-off-by: Mark Hymers <mhy@debian.org>

Make external overrides specific for (suite, component)

Signed-off-by: Ansgar Burchardt <ansgar@debian.org>

Tidy up logging

Signed-off-by: Mark Hymers <mhy@debian.org>

And the right arguments

Signed-off-by: Mark Hymers <mhy@debian.org>

Actually call the functions...

Signed-off-by: Mark Hymers <mhy@debian.org>

Our log function expects a single list argument

Signed-off-by: Mark Hymers <mhy@debian.org>

Run linearly until we can debug why the multiprocessing stuff hangs

Signed-off-by: Mark Hymers <mhy@debian.org>

Comment out results gathering to test for hang failure

Signed-off-by: Mark Hymers <mhy@debian.org>

Merge branch 'master' of ssh://ftp-master.debian.org/srv/ftp.debian.org/git/dak

close logger

Signed-off-by: Mark Hymers <mhy@debian.org>

Merge remote-tracking branch 'ansgar/p-s-from-db' into merge

* ansgar/p-s-from-db:
  Add external-overrides to byhand scripts.

Signed-off-by: Joerg Jaspert <joerg@debian.org>

Add external-overrides to byhand scripts.

Signed-off-by: Ansgar Burchardt <ansgar@debian.org>

and one = is enough for the scripts

Signed-off-by: Joerg Jaspert <joerg@debian.org>

holy fuck goddamn lunatics

whoever had the fuck broken stupid idea of making dash the default
/bin/sh should be shot. fucking stupid damn lunatics, go die you
suckers. or use windows. whatever. LEAVE THE WORLD SANE. stupid bitches.

Signed-off-by: Joerg Jaspert <joerg@debian.org>

no deferred queue

Signed-off-by: Joerg Jaspert <joerg@debian.org>

shutup

Signed-off-by: Joerg Jaspert <joerg@debian.org>

Merge remote-tracking branch 'ansgar/p-s-from-db' into merge

* ansgar/p-s-from-db:
  generate-packages-sources2: respect overridesuite
  process-upload: Add counter for rejected packages

Signed-off-by: Joerg Jaspert <joerg@debian.org>

generate-packages-sources2: respect overridesuite

Signed-off-by: Ansgar Burchardt <ansgar@debian.org>

process-upload: Add counter for rejected packages

Signed-off-by: Ansgar Burchardt <ansgar@debian.org>

also call dak gps2

Signed-off-by: Joerg Jaspert <joerg@debian.org>

Add self. to rejects

Signed-off-by: Mark Hymers <mhy@debian.org>

Merge branch 'master' of ssh://ftp-master.debian.org/srv/ftp.debian.org/git/dak

Mark dsc as invalid if we find any reject reasons

Signed-off-by: Mark Hymers <mhy@debian.org>

Use the newdists dir as temporary output dir for g-p-s2.

It should be changed back after more testing.

Signed-off-by: Torsten Werner <twerner@debian.org>

Be more robust to missing suites

Signed-off-by: Mark Hymers <mhy@debian.org>

Map -proposed-updates properly

Signed-off-by: Mark Hymers <mhy@debian.org>

Merge remote-tracking branch 'ansgar/p-s-from-db' into merge

* ansgar/p-s-from-db:
  daklib/changes.py: add logger parameter
  generate-packages-sources2: Add external overrides
  Add external-overrides.

Signed-off-by: Joerg Jaspert <joerg@debian.org>

daklib/changes.py: add logger parameter

Signed-off-by: Ansgar Burchardt <ansgar@debian.org>

generate-packages-sources2: Add external overrides

Signed-off-by: Ansgar Burchardt <ansgar@debian.org>

Add external-overrides.

Signed-off-by: Ansgar Burchardt <ansgar@debian.org>

Get function name right...

Signed-off-by: Mark Hymers <mhy@debian.org>

Merge branch 'master' of ssh://ftp-master.debian.org/srv/ftp.debian.org/git/dak

make sure we've applied distribution maps before trying to use the distribution

Signed-off-by: Mark Hymers <mhy@debian.org>

add a bit more verbose logging

Signed-off-by: Joerg Jaspert <joerg@debian.org>

Merge remote-tracking branch 'ansgar/p-s-from-db' into merge

* ansgar/p-s-from-db:
  show-new: Use dakmultiprocessing
  dakmultiprocessing: close all session
  Add missing directories in filewriter.py.
  dont have GOODSIG in the output
  mention who submitted the key
  wtf?
  i hate gpg
  change to using the debian buildd host list
  Fix unicode issue in show-deferred.
  generate-packages-sources2: Use new filewriter
  dakmultiprocessing: Add a helpful comment
  generate-packages-sources2: Use dakmultiprocessing
  generate-filelist: Use dakmultiprocessing
  Add a simple multiprocessing wrapper to catch exceptions

Signed-off-by: Joerg Jaspert <joerg@debian.org>

Merge remote branch 'origin/master' into p-s-from-db

show-new: Use dakmultiprocessing

Signed-off-by: Ansgar Burchardt <ansgar@debian.org>