git.decadent.org.uk Git

Joerg Jaspert [Mon, 9 May 2011 21:30:01 +0000 (23:30 +0200)]

import_dataset

we also dont need gps called in here

Signed-off-by: Joerg Jaspert <joerg@debian.org>

Joerg Jaspert [Mon, 9 May 2011 21:28:19 +0000 (23:28 +0200)]

kill do_dists

no need to write packages files in unchecked anymore. gps2 doesnt have
braindead berkeley db shit to update

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Sun, 8 May 2011 20:51:21 +0000 (22:51 +0200)]

s/base/basen/

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Sun, 8 May 2011 20:31:54 +0000 (22:31 +0200)]

s/foo/base

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Sun, 8 May 2011 15:41:15 +0000 (17:41 +0200)]

pdiff shit

add a function to fill up a git tree for the possible replacement of the shit script thats currently creating pdiff files

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Sun, 8 May 2011 12:28:26 +0000 (14:28 +0200)]

check mirror

we check the mirror before we push anything. We currently parse
the SHA1 field, checking for existence, size and checksum.
this means we should catch the HASH SUM MISMATCH crap.

of course this means the ones using ftp-master.d.o directly still lose, but we cant help
that.

Signed-off-by: Joerg Jaspert <joerg@debian.org>
Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Sun, 8 May 2011 10:26:07 +0000 (12:26 +0200)]

import a bit from from processpool

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Sat, 7 May 2011 21:28:54 +0000 (23:28 +0200)]

no longer run a-f cleanup in weekly

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Sat, 7 May 2011 18:37:38 +0000 (20:37 +0200)]

dont output tag lines from metadata table, only external overrides

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Sat, 7 May 2011 15:27:00 +0000 (17:27 +0200)]

use gps2 in unchecked. also disable gen-filelists in dinstall

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Sat, 7 May 2011 12:52:11 +0000 (14:52 +0200)]

also do it for imports

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Sat, 7 May 2011 12:51:02 +0000 (14:51 +0200)]

switch of a-f

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Sat, 7 May 2011 12:39:34 +0000 (14:39 +0200)]

Merge remote branch 'mhy/multiproc' into merge

* mhy/multiproc:
  Get syntax right
  Deal with args being a tuple
  Add backwards compatibility code
  Make daklog be a Singleton
  Bugfixes for usage of DakProcessPool API
  remove unused variable
  Fix variable name
  Fix function name
  Fix up pool usage
  Enhance process pool implementation

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Mark Hymers [Sat, 7 May 2011 12:35:26 +0000 (13:35 +0100)]

Merge remote branch 'ftpmaster/master' into multiproc

Conflicts:
dak/generate_packages_sources2.py

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Fri, 6 May 2011 21:14:37 +0000 (23:14 +0200)]

kick out useless print stuff that only annoys in logs

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Sun, 1 May 2011 21:51:58 +0000 (23:51 +0200)]

Merge remote branch 'ansgar/p-s-from-db' into merge

* ansgar/p-s-from-db:
  do not generate binary-source/Packages
  look for already existing files in build queues
  fix typo in email address
  sort Packages by source name first

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Ansgar Burchardt [Sun, 1 May 2011 18:54:05 +0000 (18:54 +0000)]

do not generate binary-source/Packages

commit | commitdiff | tree

Ansgar Burchardt [Thu, 28 Apr 2011 22:57:55 +0000 (22:57 +0000)]

look for already existing files in build queues

commit | commitdiff | tree

Ansgar Burchardt [Thu, 28 Apr 2011 19:38:38 +0000 (19:38 +0000)]

fix typo in email address

commit | commitdiff | tree

Ansgar Burchardt [Thu, 28 Apr 2011 17:35:14 +0000 (17:35 +0000)]

sort Packages by source name first

commit | commitdiff | tree

Mark Hymers [Wed, 20 Apr 2011 20:11:48 +0000 (21:11 +0100)]

Merge remote branch 'ftpmaster/master' into multiproc

commit | commitdiff | tree

Torsten Werner [Sun, 17 Apr 2011 21:31:33 +0000 (23:31 +0200)]

cron.unchecked: call generate-filelist with arguments.

Signed-off-by: Torsten Werner <twerner@debian.org>

commit | commitdiff | tree

Torsten Werner [Tue, 12 Apr 2011 19:08:34 +0000 (21:08 +0200)]

Fix exception handling in process-new.

closes: #620361

Signed-off-by: Torsten Werner <twerner@debian.org>

commit | commitdiff | tree

Mark Hymers [Sun, 10 Apr 2011 19:29:54 +0000 (20:29 +0100)]

Fall back to Maintainer if Changed-By missing

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Mark Hymers [Sat, 9 Apr 2011 08:42:22 +0000 (09:42 +0100)]

Merge remote branch 'ftpmaster/master' into multiproc

Conflicts:
dak/show_new.py

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Mark Hymers [Fri, 8 Apr 2011 20:31:52 +0000 (21:31 +0100)]

Merge remote branch 'ansgar/p-s-from-db' into merge

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Ansgar Burchardt [Fri, 8 Apr 2011 19:31:26 +0000 (21:31 +0200)]

Merge remote-tracking branch 'origin/master' into p-s-from-db

commit | commitdiff | tree

Torsten Werner [Wed, 6 Apr 2011 19:17:13 +0000 (21:17 +0200)]

Fix function add_dsc_to_db().

Signed-off-by: Torsten Werner <twerner@debian.org>

commit | commitdiff | tree

Torsten Werner [Wed, 6 Apr 2011 18:22:40 +0000 (18:22 +0000)]

Update metadata for test DB.

Signed-off-by: Torsten Werner <twerner@debian.org>

commit | commitdiff | tree

Torsten Werner [Sun, 3 Apr 2011 09:14:13 +0000 (11:14 +0200)]

Do not sync any lock files.

Signed-off-by: Torsten Werner <twerner@debian.org>

commit | commitdiff | tree

Torsten Werner [Sat, 2 Apr 2011 08:38:43 +0000 (10:38 +0200)]

Install default SIGPIPE handler before calling dpkg-deb.

Signed-off-by: Torsten Werner <twerner@debian.org>

commit | commitdiff | tree

Mark Hymers [Fri, 1 Apr 2011 16:17:19 +0000 (16:17 +0000)]

Don't remove files we previously generated

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Mark Hymers [Fri, 1 Apr 2011 16:03:11 +0000 (16:03 +0000)]

Short circuit already processed packages much more quickly

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Mark Hymers [Fri, 1 Apr 2011 15:52:42 +0000 (15:52 +0000)]

Pass session

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Mark Hymers [Fri, 1 Apr 2011 15:51:27 +0000 (15:51 +0000)]

Don't end up with multiple database sessions in check_sig call

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Mark Hymers [Fri, 1 Apr 2011 14:54:14 +0000 (14:54 +0000)]

Linearise show_new for now

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Mark Hymers [Fri, 1 Apr 2011 12:56:08 +0000 (12:56 +0000)]

Map squeeze-updates and stable-updates

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Mark Hymers [Fri, 1 Apr 2011 12:08:47 +0000 (12:08 +0000)]

Limit show-new to one process for now

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Mark Hymers [Fri, 1 Apr 2011 11:38:57 +0000 (11:38 +0000)]

Re-enable queue_rss after deleting the old pickle file

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Mark Hymers [Fri, 1 Apr 2011 11:34:59 +0000 (11:34 +0000)]

use new debian module name

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Mark Hymers [Fri, 1 Apr 2011 11:31:51 +0000 (11:31 +0000)]

Python behaves differently if you're redirecting to a file or not...

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Mark Hymers [Fri, 1 Apr 2011 11:27:19 +0000 (11:27 +0000)]

Encode using utf-8 and hope for the best

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Mark Hymers [Fri, 1 Apr 2011 11:22:32 +0000 (11:22 +0000)]

dak graph seems ok too

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Mark Hymers [Fri, 1 Apr 2011 11:21:09 +0000 (11:21 +0000)]

Re-enable show-new, but don't kill cron.hourly if it dies

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Mark Hymers [Fri, 1 Apr 2011 11:06:37 +0000 (11:06 +0000)]

Fix typo

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Mark Hymers [Fri, 1 Apr 2011 11:06:20 +0000 (11:06 +0000)]

temporary hack to fix squeeze-updates / stable-updates suite name

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Mark Hymers [Fri, 1 Apr 2011 11:02:23 +0000 (11:02 +0000)]

Comment out some things in cron.hourly which are broken

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Mark Hymers [Fri, 1 Apr 2011 11:01:27 +0000 (11:01 +0000)]

Merge remote branch 'ftpmaster/master'

commit | commitdiff | tree

Torsten Werner [Fri, 1 Apr 2011 05:54:36 +0000 (07:54 +0200)]

Make cron.daily shell script more robust.

... and reindent it.

Signed-off-by: Torsten Werner <twerner@debian.org>

commit | commitdiff | tree

Torsten Werner [Thu, 31 Mar 2011 17:23:21 +0000 (19:23 +0200)]

Excluding more directories from syncing.

Signed-off-by: Torsten Werner <twerner@debian.org>

commit | commitdiff | tree

Ansgar Burchardt [Thu, 31 Mar 2011 10:52:34 +0000 (12:52 +0200)]

copy external overrides from unstable to testing

Signed-off-by: Ansgar Burchardt <ansgar@debian.org>

commit | commitdiff | tree

Ansgar Burchardt [Thu, 31 Mar 2011 10:41:34 +0000 (12:41 +0200)]

Merge remote-tracking branch 'origin/master' into p-s-from-db

commit | commitdiff | tree

Joerg Jaspert [Tue, 29 Mar 2011 20:47:28 +0000 (22:47 +0200)]

sick

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Tue, 29 Mar 2011 20:43:36 +0000 (22:43 +0200)]

function pg_timestamp

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Tue, 29 Mar 2011 20:34:37 +0000 (22:34 +0200)]

updates

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Mark Hymers [Tue, 29 Mar 2011 20:10:03 +0000 (21:10 +0100)]

Get syntax right

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Mark Hymers [Tue, 29 Mar 2011 20:09:04 +0000 (21:09 +0100)]

Deal with args being a tuple

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Mark Hymers [Tue, 29 Mar 2011 20:07:56 +0000 (21:07 +0100)]

Add backwards compatibility code

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Mark Hymers [Tue, 29 Mar 2011 19:53:40 +0000 (20:53 +0100)]

Make daklog be a Singleton

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Mark Hymers [Tue, 29 Mar 2011 08:00:18 +0000 (08:00 +0000)]

Merge branch 'master', remote branch 'ftpmaster/master'

commit | commitdiff | tree

Joerg Jaspert [Tue, 29 Mar 2011 06:39:08 +0000 (08:39 +0200)]

off you are

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Mon, 28 Mar 2011 19:16:00 +0000 (21:16 +0200)]

moved ddaccess push into locks

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Mon, 28 Mar 2011 19:12:00 +0000 (21:12 +0200)]

no need for extra step

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Mark Hymers [Mon, 28 Mar 2011 18:33:46 +0000 (19:33 +0100)]

Bugfixes for usage of DakProcessPool API

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Mark Hymers [Mon, 28 Mar 2011 18:07:40 +0000 (19:07 +0100)]

remove unused variable

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Mark Hymers [Mon, 28 Mar 2011 00:39:37 +0000 (01:39 +0100)]

Fix variable name

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Mark Hymers [Mon, 28 Mar 2011 00:37:32 +0000 (01:37 +0100)]

Fix function name

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Mark Hymers [Mon, 28 Mar 2011 00:36:36 +0000 (01:36 +0100)]

Fix up pool usage

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Mark Hymers [Mon, 28 Mar 2011 00:12:39 +0000 (01:12 +0100)]

Enhance process pool implementation

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Mark Hymers [Sun, 27 Mar 2011 09:55:08 +0000 (10:55 +0100)]

Close log so we log program end

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Mark Hymers [Sun, 27 Mar 2011 09:45:34 +0000 (10:45 +0100)]

Fix up function call

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Ansgar Burchardt [Sun, 27 Mar 2011 09:42:40 +0000 (09:42 +0000)]

Make external overrides specific for (suite, component)

Signed-off-by: Ansgar Burchardt <ansgar@debian.org>

commit | commitdiff | tree

Mark Hymers [Sun, 27 Mar 2011 09:37:17 +0000 (10:37 +0100)]

Tidy up logging

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Mark Hymers [Sun, 27 Mar 2011 09:35:24 +0000 (10:35 +0100)]

And the right arguments

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Mark Hymers [Sun, 27 Mar 2011 09:34:27 +0000 (10:34 +0100)]

Actually call the functions...

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Mark Hymers [Sun, 27 Mar 2011 09:33:27 +0000 (10:33 +0100)]

Our log function expects a single list argument

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Mark Hymers [Sun, 27 Mar 2011 09:28:14 +0000 (10:28 +0100)]

Run linearly until we can debug why the multiprocessing stuff hangs

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Mark Hymers [Sun, 27 Mar 2011 08:08:56 +0000 (09:08 +0100)]

Comment out results gathering to test for hang failure

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Mark Hymers [Sun, 27 Mar 2011 08:06:41 +0000 (09:06 +0100)]

Merge branch 'master' of ssh://ftp-master.debian.org/srv/ftp.debian.org/git/dak

commit | commitdiff | tree

Mark Hymers [Sun, 27 Mar 2011 08:06:35 +0000 (09:06 +0100)]

close logger

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Sun, 27 Mar 2011 08:02:54 +0000 (10:02 +0200)]

Merge remote-tracking branch 'ansgar/p-s-from-db' into merge

* ansgar/p-s-from-db:
Add external-overrides to byhand scripts.

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Ansgar Burchardt [Sun, 27 Mar 2011 08:00:14 +0000 (10:00 +0200)]

Add external-overrides to byhand scripts.

Signed-off-by: Ansgar Burchardt <ansgar@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Sun, 27 Mar 2011 07:54:26 +0000 (09:54 +0200)]

and one = is enough for the scripts

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Sun, 27 Mar 2011 07:50:22 +0000 (09:50 +0200)]

holy fuck goddamn lunatics

whoever had the fuck broken stupid idea of making dash the default
/bin/sh should be shot. fucking stupid damn lunatics, go die you
suckers. or use windows. whatever. LEAVE THE WORLD SANE. stupid bitches.

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Sun, 27 Mar 2011 07:42:32 +0000 (09:42 +0200)]

no deferred queue

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Sun, 27 Mar 2011 07:31:10 +0000 (09:31 +0200)]

shutup

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Sat, 26 Mar 2011 22:55:41 +0000 (23:55 +0100)]

Merge remote-tracking branch 'ansgar/p-s-from-db' into merge

* ansgar/p-s-from-db:
generate-packages-sources2: respect overridesuite
process-upload: Add counter for rejected packages

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Ansgar Burchardt [Sat, 26 Mar 2011 22:49:17 +0000 (22:49 +0000)]

generate-packages-sources2: respect overridesuite

Signed-off-by: Ansgar Burchardt <ansgar@debian.org>

commit | commitdiff | tree

Ansgar Burchardt [Sat, 26 Mar 2011 22:26:55 +0000 (22:26 +0000)]

process-upload: Add counter for rejected packages

Signed-off-by: Ansgar Burchardt <ansgar@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Sat, 26 Mar 2011 22:26:20 +0000 (23:26 +0100)]

also call dak gps2

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Mark Hymers [Sat, 26 Mar 2011 22:12:38 +0000 (22:12 +0000)]

Add self. to rejects

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Mark Hymers [Sat, 26 Mar 2011 22:12:02 +0000 (22:12 +0000)]

Merge branch 'master' of ssh://ftp-master.debian.org/srv/ftp.debian.org/git/dak

commit | commitdiff | tree

Mark Hymers [Sat, 26 Mar 2011 22:11:46 +0000 (22:11 +0000)]

Mark dsc as invalid if we find any reject reasons

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Torsten Werner [Sat, 26 Mar 2011 22:10:33 +0000 (23:10 +0100)]

Use the newdists dir as temporary output dir for g-p-s2.

It should be changed back after more testing.

Signed-off-by: Torsten Werner <twerner@debian.org>

commit | commitdiff | tree

Mark Hymers [Sat, 26 Mar 2011 21:43:01 +0000 (21:43 +0000)]

Be more robust to missing suites

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Mark Hymers [Sat, 26 Mar 2011 21:38:53 +0000 (21:38 +0000)]

Map -proposed-updates properly

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Sat, 26 Mar 2011 21:07:29 +0000 (22:07 +0100)]

Merge remote-tracking branch 'ansgar/p-s-from-db' into merge

* ansgar/p-s-from-db:
  daklib/changes.py: add logger parameter
  generate-packages-sources2: Add external overrides
  Add external-overrides.

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Ansgar Burchardt [Sat, 26 Mar 2011 21:03:35 +0000 (21:03 +0000)]

daklib/changes.py: add logger parameter

Signed-off-by: Ansgar Burchardt <ansgar@debian.org>

commit | commitdiff | tree

Ansgar Burchardt [Sat, 26 Mar 2011 20:40:05 +0000 (20:40 +0000)]

generate-packages-sources2: Add external overrides

Signed-off-by: Ansgar Burchardt <ansgar@debian.org>

commit | commitdiff | tree

Ansgar Burchardt [Sat, 26 Mar 2011 18:08:37 +0000 (18:08 +0000)]