git.decadent.org.uk Git

]> git.decadent.org.uk Git - dak.git/log

projects / dak.git / log

commit | commitdiff | tree

Joerg Jaspert [Fri, 30 Jul 2010 02:11:12 +0000 (04:11 +0200)]

[mhy] Remove malo and add poulenc/porpora

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Fri, 30 Jul 2010 02:10:43 +0000 (04:10 +0200)]

Add the web-users dir and a rewriterule for it

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Mark Hymers [Fri, 23 Jul 2010 18:48:19 +0000 (18:48 +0000)]

We can't allow unchecked until we've hardlinked the mirrors now that we're doing apt-ftparchive as part of it

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Sat, 17 Jul 2010 07:53:06 +0000 (09:53 +0200)]

Run without -i

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Thu, 15 Jul 2010 22:17:49 +0000 (00:17 +0200)]

Timestamps

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Thu, 15 Jul 2010 21:51:10 +0000 (23:51 +0200)]

Merge remote branch 'twerner/gf' into merge

* twerner/gf:
generate-filelist: create fewer DB sessions

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Torsten Werner [Thu, 15 Jul 2010 21:47:44 +0000 (21:47 +0000)]

generate-filelist: create fewer DB sessions

Signed-off-by: Torsten Werner <twerner@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Wed, 14 Jul 2010 22:49:50 +0000 (00:49 +0200)]

run g-p-s in unchecked

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Wed, 14 Jul 2010 21:59:40 +0000 (23:59 +0200)]

missing t

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Wed, 14 Jul 2010 21:59:14 +0000 (23:59 +0200)]

Merge remote branch 'twerner/gf' into merge

* twerner/gf:
drop an obsolete view by db update34
generate-filelist: implement incremental mode

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Torsten Werner [Wed, 14 Jul 2010 21:46:12 +0000 (21:46 +0000)]

drop an obsolete view by db update34

Signed-off-by: Torsten Werner <twerner@debian.org>

commit | commitdiff | tree

Torsten Werner [Wed, 14 Jul 2010 19:10:01 +0000 (19:10 +0000)]

generate-filelist: implement incremental mode

Signed-off-by: Torsten Werner <twerner@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Mon, 12 Jul 2010 21:52:23 +0000 (23:52 +0200)]

Merge remote branch 'twerner/show-new' into merge

* twerner/show-new:
examine-package: replace lock by thread.local()

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Torsten Werner [Mon, 12 Jul 2010 21:09:34 +0000 (21:09 +0000)]

Merge branch 'master' into show-new

commit | commitdiff | tree

Torsten Werner [Mon, 12 Jul 2010 21:07:48 +0000 (21:07 +0000)]

examine-package: replace lock by thread.local()

- thread local storage is more robust than locks
- the code is more correct than before

Signed-off-by: Torsten Werner <twerner@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Mon, 12 Jul 2010 19:30:31 +0000 (21:30 +0200)]

Serialize by suite

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Mon, 12 Jul 2010 19:29:56 +0000 (21:29 +0200)]

Slightly more useful tempfile names

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Sun, 11 Jul 2010 21:40:25 +0000 (23:40 +0200)]

Merge branch 'gps' into merge

* gps:
  Use the new script in dinstall
  generate-packages-sources
  generate-packages-sources
  dont replace the path in DAILY_APT_CONF right now, make it nicer later in an AptCOnf class. also dont call with the suite name, it knows it anyways
  generate-packages-sources
  Add start of a generate_packages_sources command

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Sun, 11 Jul 2010 21:40:05 +0000 (23:40 +0200)]

Use the new script in dinstall

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Sun, 11 Jul 2010 21:30:51 +0000 (23:30 +0200)]

generate-packages-sources

finalize the first step. there needs to be a rework of the apt-trees part
into an aptconfig class. Much to inflexible the way it is now, but we can
start testing this out in real life now.

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Mark Hymers [Sun, 11 Jul 2010 21:03:13 +0000 (21:03 +0000)]

Merge commit 'ftpmaster/master'

commit | commitdiff | tree

Mark Hymers [Sun, 11 Jul 2010 21:03:04 +0000 (21:03 +0000)]

Extend a hack

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Sat, 10 Jul 2010 14:08:53 +0000 (16:08 +0200)]

Remove an entirely unused config section

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Thu, 8 Jul 2010 21:33:00 +0000 (23:33 +0200)]

Merge remote branch 'twerner/show-new' into merge

* twerner/show-new:
show-new: reduce DB sessions even more

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Torsten Werner [Thu, 8 Jul 2010 21:27:52 +0000 (21:27 +0000)]

show-new: reduce DB sessions even more

Signed-off-by: Torsten Werner <twerner@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Thu, 8 Jul 2010 19:44:40 +0000 (21:44 +0200)]

We use upload.d.o now

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Wed, 7 Jul 2010 21:52:43 +0000 (23:52 +0200)]

Merge remote branch 'twerner/show-new' into merge

* twerner/show-new:
show-new: reduce number of open DB sessions

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Torsten Werner [Wed, 7 Jul 2010 21:40:03 +0000 (21:40 +0000)]

Merge branch 'master' into show-new

commit | commitdiff | tree

Torsten Werner [Wed, 7 Jul 2010 21:38:51 +0000 (21:38 +0000)]

show-new: reduce number of open DB sessions

Signed-off-by: Torsten Werner <twerner@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Wed, 7 Jul 2010 21:28:24 +0000 (23:28 +0200)]

Merge remote branch 'lamby/master' into merge

* lamby/master:
  Popen.communicate calls stdout.close() which looks like is causing errors w/threads..
  Finally kill m68k
  Support +b[0-9] versions in autobyhand for di

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Chris Lamb [Wed, 7 Jul 2010 21:24:36 +0000 (22:24 +0100)]

Popen.communicate calls stdout.close() which looks like is causing errors w/threads..

commit | commitdiff | tree

Mark Hymers [Wed, 7 Jul 2010 17:45:44 +0000 (17:45 +0000)]

Finally kill m68k

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Mark Hymers [Wed, 7 Jul 2010 17:24:31 +0000 (17:24 +0000)]

Support +b[0-9] versions in autobyhand for di

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Wed, 7 Jul 2010 21:03:59 +0000 (23:03 +0200)]

Merge branch 'master' of ssh://franck.debian.org/srv/ftp.debian.org/git/dak

* 'master' of ssh://franck.debian.org/srv/ftp.debian.org/git/dak:
Finally kill m68k
Support +b[0-9] versions in autobyhand for di

commit | commitdiff | tree

Joerg Jaspert [Wed, 7 Jul 2010 21:03:38 +0000 (23:03 +0200)]

Merge remote branch 'lamby/master' into merge

* lamby/master:
Fix race condition in our commands.getstatusoutput monkeypatch

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Mark Hymers [Wed, 7 Jul 2010 17:45:44 +0000 (17:45 +0000)]

Finally kill m68k

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Mark Hymers [Wed, 7 Jul 2010 17:24:31 +0000 (17:24 +0000)]

Support +b[0-9] versions in autobyhand for di

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Chris Lamb [Wed, 7 Jul 2010 13:22:44 +0000 (14:22 +0100)]

Fix race condition in our commands.getstatusoutput monkeypatch

Previously we were returning from this method before the process had actually
finished, introducing issues where we relied on process actually finishing or
simply not returning all the data the process was going to produce.

commit | commitdiff | tree

Joerg Jaspert [Wed, 7 Jul 2010 08:20:32 +0000 (10:20 +0200)]

Merge remote branch 'twerner/show-new' into merge

* twerner/show-new:
examine-package: do not create useless DB sessions

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Torsten Werner [Wed, 7 Jul 2010 08:15:38 +0000 (08:15 +0000)]

examine-package: do not create useless DB sessions

Signed-off-by: Torsten Werner <twerner@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Wed, 7 Jul 2010 07:40:06 +0000 (09:40 +0200)]

Merge remote branch 'twerner/show-new' into merge

* twerner/show-new:
show-new: close ressources earlier

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Torsten Werner [Wed, 7 Jul 2010 07:38:08 +0000 (07:38 +0000)]

show-new: close ressources earlier

Signed-off-by: Torsten Werner <twerner@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Tue, 6 Jul 2010 23:57:45 +0000 (01:57 +0200)]

generate-packages-sources

some more changes:
- chdir before we call the generate function
- dont include architecture all
- use commands.getstatusoutput
    this breaks the try, finally: block. using os.system() it works nicely,
    but the output is a hell. using commands.getstatusoutput the finally:
    is called to early, removing the config for apt-ftparchive, breaking it.
    ugh, bad.
- the whole mess with the config inside dbconn.py needs to go, as well
   as the special cases for the tree configs. should be an aptconf class,
   but thats a task for when this fully works

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Tue, 6 Jul 2010 22:17:22 +0000 (00:17 +0200)]

Merge branch 'master' into gps

* master:
  examine-package: lock access to printed_copyrights
  show-new: multithreading support
  show-new: no longer fiddle with sys.stdout
  examine_package: make most functions functional
  examine-package: really support option -H
  examine-package: add missing newlines to output
  examine-package: make foldable_output functional()
  examine-package: make headline() functional
  call check_deb() with correct arguments
  Add config for volatile

commit | commitdiff | tree

Joerg Jaspert [Tue, 6 Jul 2010 22:13:29 +0000 (00:13 +0200)]

Merge remote branch 'twerner/show-new' into merge

* twerner/show-new:
  examine-package: lock access to printed_copyrights
  show-new: multithreading support
  show-new: no longer fiddle with sys.stdout
  examine_package: make most functions functional
  examine-package: really support option -H
  examine-package: add missing newlines to output
  examine-package: make foldable_output functional()
  examine-package: make headline() functional
  call check_deb() with correct arguments
  Add config for volatile

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Tue, 6 Jul 2010 20:54:41 +0000 (22:54 +0200)]

dont replace the path in DAILY_APT_CONF right now, make it nicer later in an AptCOnf class. also dont call with the suite name, it knows it anyways

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Torsten Werner [Tue, 6 Jul 2010 20:38:48 +0000 (20:38 +0000)]

examine-package: lock access to printed_copyrights

FIXME: the global variable printed_copyrights is still broken...

Signed-off-by: Torsten Werner <twerner@debian.org>

commit | commitdiff | tree

Torsten Werner [Tue, 6 Jul 2010 20:18:45 +0000 (20:18 +0000)]

show-new: multithreading support

Signed-off-by: Torsten Werner <twerner@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Tue, 6 Jul 2010 20:08:35 +0000 (22:08 +0200)]

generate-packages-sources

generate packages sources files, threaded, one thread per suite/arch

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Torsten Werner [Tue, 6 Jul 2010 20:00:45 +0000 (20:00 +0000)]

show-new: no longer fiddle with sys.stdout

Signed-off-by: Torsten Werner <twerner@debian.org>

commit | commitdiff | tree

Torsten Werner [Tue, 6 Jul 2010 18:57:04 +0000 (18:57 +0000)]

examine_package: make most functions functional

Signed-off-by: Torsten Werner <twerner@debian.org>

commit | commitdiff | tree

Torsten Werner [Tue, 6 Jul 2010 08:33:07 +0000 (08:33 +0000)]

examine-package: really support option -H

Signed-off-by: Torsten Werner <twerner@debian.org>

commit | commitdiff | tree

Torsten Werner [Tue, 6 Jul 2010 08:30:11 +0000 (08:30 +0000)]

examine-package: add missing newlines to output

Signed-off-by: Torsten Werner <twerner@debian.org>

commit | commitdiff | tree

Torsten Werner [Tue, 6 Jul 2010 05:31:50 +0000 (05:31 +0000)]

examine-package: make foldable_output functional()

Signed-off-by: Torsten Werner <twerner@debian.org>

commit | commitdiff | tree

Torsten Werner [Tue, 6 Jul 2010 05:23:12 +0000 (05:23 +0000)]

examine-package: make headline() functional

Signed-off-by: Torsten Werner <twerner@debian.org>

commit | commitdiff | tree

Torsten Werner [Tue, 6 Jul 2010 05:15:58 +0000 (05:15 +0000)]

Merge branch 'master' into show-new

commit | commitdiff | tree

Torsten Werner [Tue, 6 Jul 2010 05:15:05 +0000 (05:15 +0000)]

call check_deb() with correct arguments

Signed-off-by: Torsten Werner <twerner@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Mon, 5 Jul 2010 22:29:44 +0000 (00:29 +0200)]

Add start of a generate_packages_sources command

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Mark Hymers [Mon, 5 Jul 2010 21:59:49 +0000 (21:59 +0000)]

Add config for volatile

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Mark Hymers [Mon, 5 Jul 2010 21:35:36 +0000 (21:35 +0000)]

Merge commit 'ftpmaster/master'

commit | commitdiff | tree

Mark Hymers [Mon, 5 Jul 2010 21:29:28 +0000 (21:29 +0000)]

Add volatile testing dists files

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Mon, 5 Jul 2010 21:28:13 +0000 (23:28 +0200)]

Less backgrounding before a-f

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Mon, 5 Jul 2010 21:19:54 +0000 (23:19 +0200)]

Merge remote branch 'twerner/show-new' into merge

* twerner/show-new:
show-new: open a new session for every source package

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Torsten Werner [Mon, 5 Jul 2010 20:44:11 +0000 (20:44 +0000)]

show-new: open a new session for every source package

Signed-off-by: Torsten Werner <twerner@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Mon, 5 Jul 2010 20:12:30 +0000 (22:12 +0200)]

Sigh

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Sun, 4 Jul 2010 20:20:27 +0000 (22:20 +0200)]

Merge remote branch 'twerner/msfl' into merge

* twerner/msfl:
introduce defaultThreadCount
add key Common::ThreadCount to dak.conf

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Mark Hymers [Sun, 4 Jul 2010 17:24:01 +0000 (17:24 +0000)]

Use the real path, not my local one - whoops

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Torsten Werner [Sun, 4 Jul 2010 17:17:24 +0000 (17:17 +0000)]

introduce defaultThreadCount

... make it an int and let it default to 1 (single threading)

Signed-off-by: Torsten Werner <twerner@debian.org>

commit | commitdiff | tree

Mark Hymers [Sun, 4 Jul 2010 17:09:46 +0000 (17:09 +0000)]

Move franck's dak to 5433

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Mark Hymers [Sun, 4 Jul 2010 16:51:33 +0000 (16:51 +0000)]

What, are we still using postgres 7.4 or something?

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Mark Hymers [Sun, 4 Jul 2010 16:51:16 +0000 (16:51 +0000)]

Remove hardcoding of database name, port etc

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Mark Hymers [Sun, 4 Jul 2010 16:45:04 +0000 (16:45 +0000)]

We really don't want environment variables to cause us to drop the wrong damn database

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Mark Hymers [Sun, 4 Jul 2010 16:44:44 +0000 (16:44 +0000)]

Don't need a database connection for this

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Torsten Werner [Sun, 4 Jul 2010 16:40:50 +0000 (18:40 +0200)]

Merge branch 'master' into msfl

commit | commitdiff | tree

Torsten Werner [Sun, 4 Jul 2010 16:37:55 +0000 (18:37 +0200)]

add key Common::ThreadCount to dak.conf

That is the default number of threads created for the ThreadPool() but
the value can be overwritten when calling the constructor.

Signed-off-by: Torsten Werner <twerner@debian.org>

commit | commitdiff | tree

Mark Hymers [Sun, 4 Jul 2010 16:29:53 +0000 (17:29 +0100)]

Allow getting db config out easily

Signed-off-by: Mark Hymers <mhy@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Sun, 4 Jul 2010 14:56:06 +0000 (16:56 +0200)]

Merge remote branch 'twerner/msfl' into merge

* twerner/msfl:
make generate-filelist multithreaded

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Torsten Werner [Sun, 4 Jul 2010 14:11:32 +0000 (14:11 +0000)]

make generate-filelist multithreaded

Signed-off-by: Torsten Werner <twerner@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Sun, 4 Jul 2010 13:20:49 +0000 (15:20 +0200)]

Merge remote branch 'twerner/msfl' into merge

* twerner/msfl:
add threadpool implementation
improve multithread robustness

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Sun, 4 Jul 2010 13:17:18 +0000 (15:17 +0200)]

And more public

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Torsten Werner [Sun, 4 Jul 2010 13:05:03 +0000 (15:05 +0200)]

add threadpool implementation

... and its license information

Signed-off-by: Torsten Werner <twerner@debian.org>

commit | commitdiff | tree

Torsten Werner [Sun, 4 Jul 2010 12:50:28 +0000 (14:50 +0200)]

improve multithread robustness

- create a separate db session per suite and component in writeSourceList()

Signed-off-by: Torsten Werner <twerner@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Sun, 4 Jul 2010 10:24:08 +0000 (12:24 +0200)]

And this also public. ohmy

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Sun, 4 Jul 2010 09:51:36 +0000 (11:51 +0200)]

use template1

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Sun, 4 Jul 2010 08:39:59 +0000 (10:39 +0200)]

debianqueued

rename does not work across devices. Use move from File::Copy instead.

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Sat, 3 Jul 2010 19:01:59 +0000 (21:01 +0200)]

And one more in public

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Sat, 3 Jul 2010 18:30:34 +0000 (20:30 +0200)]

And thats in public view

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Sat, 3 Jul 2010 18:28:21 +0000 (20:28 +0200)]

Unfortunately DSA doesnt give us all rights anymore for no good reason to do a sane backup, including our roles, so deactivate that part. :(

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Sat, 3 Jul 2010 17:07:18 +0000 (19:07 +0200)]

One would think at some point one got all

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Sat, 3 Jul 2010 17:00:36 +0000 (19:00 +0200)]

One would think at some point one got all

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Sat, 3 Jul 2010 17:00:01 +0000 (19:00 +0200)]

One would think at some point one got all

Signed-off-by: Joerg Jaspert <joerg@debian.org>

commit | commitdiff | tree

Joerg Jaspert [Sat, 3 Jul 2010 16:59:12 +0000 (18:59 +0200)]

No, webdir is public, damnit

Signed-off-by: Joerg Jaspert <joerg@debian.org>