dak.git
2 years agoLOCAL: Remove replay check master
Ben Hutchings [Wed, 29 Jun 2016 13:42:25 +0000 (15:42 +0200)]
LOCAL: Remove replay check

2 years agoLOCAL: Define key and certificate files for byhand-code-sign
Ben Hutchings [Tue, 28 Jun 2016 22:53:38 +0000 (00:53 +0200)]
LOCAL: Define key and certificate files for byhand-code-sign

2 years agobyhand-code-sign: Put signature tarballs for security uploads in .../updates
Ben Hutchings [Mon, 29 Aug 2016 14:10:18 +0000 (15:10 +0100)]
byhand-code-sign: Put signature tarballs for security uploads in .../updates

This is consistent with the Release and Packages files.

2 years agobyhand-code-sign: Use script path, not suite name, to find the config directory
Ben Hutchings [Mon, 29 Aug 2016 14:07:11 +0000 (15:07 +0100)]
byhand-code-sign: Use script path, not suite name, to find the config directory

At this point the suite name for a security upload no longer has the
'-security' suffix.

2 years agodaklib.regexes: Add signature tarballs to re_includeinrelease
Ben Hutchings [Wed, 29 Jun 2016 16:34:10 +0000 (18:34 +0200)]
daklib.regexes: Add signature tarballs to re_includeinrelease

2 years agoAdd (incomplete) configuration for signing code for linux
Ben Hutchings [Mon, 27 Jun 2016 21:43:01 +0000 (23:43 +0200)]
Add (incomplete) configuration for signing code for linux

2 years agoAdd byhand script to perform code signing
Ben Hutchings [Mon, 27 Jun 2016 21:34:36 +0000 (23:34 +0200)]
Add byhand script to perform code signing

It takes a tarball of code objects and generates a tarball of
corresponding detached PKCS#7 signatures (with '.sig' suffixes).

It will sign:
- EFI binaries (*.efi, vmlinuz-*) using pesign
- Linux kernel modules (*.ko) using sign-file from linux-kbuild-<version>

Currently it should work with private key files and certificates.  It
may be able to sign kernel modules with a key on a PKCS#11 device.
It definitely can't sign EFI binaries using a PKCS#11 device yet.

2 years agoAnd check for existance, not type too
Joerg Jaspert [Sun, 19 Jun 2016 11:53:40 +0000 (13:53 +0200)]
And check for existance, not type too

2 years agodont die if you cant touch a file
Joerg Jaspert [Sun, 19 Jun 2016 11:51:44 +0000 (13:51 +0200)]
dont die if you cant touch a file

2 years agoInitial version of an actual script to run a pointrelease
Joerg Jaspert [Sun, 5 Jun 2016 12:46:34 +0000 (14:46 +0200)]
Initial version of an actual script to run a pointrelease

2 years agoUpdate with latest point release changes
Joerg Jaspert [Sat, 4 Jun 2016 13:30:09 +0000 (15:30 +0200)]
Update with latest point release changes

2 years agoGive read permissions to the comment file
Emilio Pozuelo Monfort [Tue, 31 May 2016 21:36:34 +0000 (23:36 +0200)]
Give read permissions to the comment file

As queue-viewer needs access to them.

Signed-off-by: Emilio Pozuelo Monfort <pochu@debian.org>
2 years agoFix path
Emilio Pozuelo Monfort [Sun, 29 May 2016 12:55:30 +0000 (14:55 +0200)]
Fix path

Signed-off-by: Emilio Pozuelo Monfort <pochu@debian.org>
2 years agoAdd authorization for p-u-comment.sh
Emilio Pozuelo Monfort [Sat, 28 May 2016 15:23:31 +0000 (17:23 +0200)]
Add authorization for p-u-comment.sh

Signed-off-by: Emilio Pozuelo Monfort <pochu@debian.org>
2 years agoAdd a ssh trigger for p-u comment handling
Emilio Pozuelo Monfort [Sat, 28 May 2016 13:44:08 +0000 (15:44 +0200)]
Add a ssh trigger for p-u comment handling

This will allow to create comment files once release.debian.org
is no longer in the same machine as ftp-master.debian.org and
the RT loses access to the various COMMENTS folders.

Signed-off-by: Emilio Pozuelo Monfort <pochu@debian.org>
2 years agoAdd a timestamp to the cruft-report
Emilio Pozuelo Monfort [Fri, 27 May 2016 10:35:20 +0000 (12:35 +0200)]
Add a timestamp to the cruft-report

Signed-off-by: Emilio Pozuelo Monfort <pochu@debian.org>
2 years agoDon't generate the cruft report in-place
Emilio Pozuelo Monfort [Fri, 27 May 2016 10:03:37 +0000 (12:03 +0200)]
Don't generate the cruft report in-place

So that we don't get an empty or incomplete report while it
is being generated.

Signed-off-by: Emilio Pozuelo Monfort <pochu@debian.org>
2 years agoMerge remote-tracking branch 'jcristau/remote-import-dataset'
Joerg Jaspert [Fri, 27 May 2016 07:08:55 +0000 (09:08 +0200)]
Merge remote-tracking branch 'jcristau/remote-import-dataset'

* jcristau/remote-import-dataset:
  Fix syntax error in import_dataset.sh
  Move urgency log from release.d.o to our web dir

Signed-off-by: Joerg Jaspert <joerg@debian.org>
2 years agoFix syntax error in import_dataset.sh
Julien Cristau [Fri, 27 May 2016 07:04:28 +0000 (09:04 +0200)]
Fix syntax error in import_dataset.sh

Signed-off-by: Julien Cristau <jcristau@debian.org>
2 years agoMerge remote-tracking branch 'jcristau/remote-import-dataset'
Joerg Jaspert [Thu, 26 May 2016 21:03:30 +0000 (23:03 +0200)]
Merge remote-tracking branch 'jcristau/remote-import-dataset'

* jcristau/remote-import-dataset:
  Make release_team_removals.sh take input from stdin

Signed-off-by: Joerg Jaspert <joerg@debian.org>
2 years agoMove urgency log from release.d.o to our web dir
Julien Cristau [Thu, 26 May 2016 14:39:32 +0000 (16:39 +0200)]
Move urgency log from release.d.o to our web dir

And clean it up ourselves after a while instead of relying on the
release user for that.

Signed-off-by: Julien Cristau <jcristau@debian.org>
2 years agoMake release_team_removals.sh take input from stdin
Julien Cristau [Thu, 26 May 2016 13:19:58 +0000 (15:19 +0200)]
Make release_team_removals.sh take input from stdin

Similarly to import_dataset, relying on a shared filesystem prevents us
from moving release.d.o elsewhere.

Signed-off-by: Julien Cristau <jcristau@debian.org>
2 years agoMerge remote-tracking branch 'jcristau/gps2-log-list'
Joerg Jaspert [Thu, 26 May 2016 12:42:24 +0000 (14:42 +0200)]
Merge remote-tracking branch 'jcristau/gps2-log-list'

* jcristau/gps2-log-list:
  gps2: fix typo in error logging
  gps2: fix logging call

Signed-off-by: Joerg Jaspert <joerg@debian.org>
2 years agoAllow release ssh triggers from respighi.d.o
Julien Cristau [Thu, 26 May 2016 11:19:02 +0000 (13:19 +0200)]
Allow release ssh triggers from respighi.d.o

Signed-off-by: Julien Cristau <jcristau@debian.org>
2 years agoChange import_dataset.sh to take its input from stdin
Julien Cristau [Wed, 25 May 2016 12:25:45 +0000 (14:25 +0200)]
Change import_dataset.sh to take its input from stdin

We plan on moving release.debian.org to a separate host, so won't be
able to share a filesystem between release and dak.  Instead take the
dataset from stdin, with a md5sum passed through the command line (via
SSH_ORIGINAL_COMMAND).

Signed-off-by: Julien Cristau <jcristau@debian.org>
2 years agoDo not remove "by-hash" directory
Ansgar Burchardt [Sun, 22 May 2016 14:10:48 +0000 (16:10 +0200)]
Do not remove "by-hash" directory

2 years agoQuote argument to --exclude
Ansgar Burchardt [Sun, 22 May 2016 14:07:07 +0000 (16:07 +0200)]
Quote argument to --exclude

There must only be one argument passed to rsync's --exclude option,
the wildcard should not be expanded by the shell.

2 years agodep11-basic-validate: Forbid symlinks for now
Ansgar Burchardt [Sun, 22 May 2016 14:06:56 +0000 (16:06 +0200)]
dep11-basic-validate: Forbid symlinks for now

2 years agoCorrect indention.
Ansgar Burchardt [Sun, 22 May 2016 14:04:03 +0000 (16:04 +0200)]
Correct indention.

3 years agogps2: fix typo in error logging
Julien Cristau [Sat, 21 May 2016 14:12:11 +0000 (16:12 +0200)]
gps2: fix typo in error logging

Signed-off-by: Julien Cristau <jcristau@debian.org>
3 years agogps2: fix logging call
Julien Cristau [Sat, 21 May 2016 13:55:49 +0000 (15:55 +0200)]
gps2: fix logging call

The multiprocessing workers return a list already, no need to embed that
in another one.

This should change logging from
generate-packages-sources2|dak|['generate-packages', 'unstable', 'main', 's390x']
to
generate-packages-sources2|dak|generate-packages|unstable|main|s390x

Signed-off-by: Julien Cristau <jcristau@debian.org>
3 years agoMerge remote-tracking branch 'jcristau/cs-set-log-suite'
Ansgar Burchardt [Sat, 21 May 2016 13:51:17 +0000 (15:51 +0200)]
Merge remote-tracking branch 'jcristau/cs-set-log-suite'

3 years agocontrol_suite: log suite name in "dak control-suite --set"
Julien Cristau [Sat, 21 May 2016 13:48:17 +0000 (15:48 +0200)]
control_suite: log suite name in "dak control-suite --set"

Signed-off-by: Julien Cristau <jcristau@debian.org>
3 years agoMerge remote-tracking branch 'jcristau/formatone-no-tar-sig'
Ansgar Burchardt [Sat, 21 May 2016 12:20:27 +0000 (14:20 +0200)]
Merge remote-tracking branch 'jcristau/formatone-no-tar-sig'

3 years agosrcformats: reject orig.tar.gz.asc files in source format 1.0
Julien Cristau [Fri, 20 May 2016 11:03:52 +0000 (13:03 +0200)]
srcformats: reject orig.tar.gz.asc files in source format 1.0

dpkg-source in jessie doesn't know what to do with them.

Signed-off-by: Julien Cristau <jcristau@debian.org>
3 years agoMerge remote-tracking branch 'jcristau/fix-orig-sig-check'
Ansgar Burchardt [Fri, 20 May 2016 07:34:46 +0000 (09:34 +0200)]
Merge remote-tracking branch 'jcristau/fix-orig-sig-check'

3 years agoAdd a couple of check_dsc_files tests
Julien Cristau [Fri, 20 May 2016 07:27:41 +0000 (09:27 +0200)]
Add a couple of check_dsc_files tests

Signed-off-by: Julien Cristau <jcristau@debian.org>
3 years agoMerge remote-tracking branch 'jcristau/fix-orig-sig-check'
Ansgar Burchardt [Fri, 20 May 2016 07:04:26 +0000 (09:04 +0200)]
Merge remote-tracking branch 'jcristau/fix-orig-sig-check'

3 years agodep11: Properly validate Time and Priority fields
Matthias Klumpp [Wed, 18 May 2016 20:11:00 +0000 (22:11 +0200)]
dep11: Properly validate Time and Priority fields

3 years agodep11: Validate .xz compressed files as well
Matthias Klumpp [Wed, 18 May 2016 20:11:20 +0000 (22:11 +0200)]
dep11: Validate .xz compressed files as well

3 years agoMove more specific source file regexes before general ones, again
Julien Cristau [Fri, 20 May 2016 06:31:03 +0000 (08:31 +0200)]
Move more specific source file regexes before general ones, again

Otherwise foo.orig.tar.gz.asc matches orig_tar before it has a change to
be matched against orig_tar_sig.

Signed-off-by: Julien Cristau <jcristau@debian.org>
3 years agoDo not try to add same hashfile multiple times
Ansgar Burchardt [Wed, 18 May 2016 21:53:03 +0000 (23:53 +0200)]
Do not try to add same hashfile multiple times

Doing so would violate the database constraints.

3 years agoUse correct db_name for MD5 hash
Ansgar Burchardt [Wed, 18 May 2016 17:17:43 +0000 (19:17 +0200)]
Use correct db_name for MD5 hash

3 years agoupdate-buildd-archive: Also copy zzz-dists
Ansgar Burchardt [Wed, 18 May 2016 16:34:57 +0000 (18:34 +0200)]
update-buildd-archive: Also copy zzz-dists

3 years agoMerge remote-tracking branch 'jcristau/by-hash-v5'
Ansgar Burchardt [Wed, 18 May 2016 15:31:40 +0000 (17:31 +0200)]
Merge remote-tracking branch 'jcristau/by-hash-v5'

3 years agoMerge remote-tracking branch 'jcristau/known-hashes'
Ansgar Burchardt [Wed, 18 May 2016 15:21:42 +0000 (17:21 +0200)]
Merge remote-tracking branch 'jcristau/known-hashes'

3 years agoMerge remote-tracking branch 'jcristau/multivalued'
Ansgar Burchardt [Wed, 18 May 2016 15:20:34 +0000 (17:20 +0200)]
Merge remote-tracking branch 'jcristau/multivalued'

3 years agodaklib: kill unused utils.known_hashes
Julien Cristau [Tue, 17 May 2016 14:20:46 +0000 (16:20 +0200)]
daklib: kill unused utils.known_hashes

Its last use seems to have been removed in
90885e3cbeee73afe199d6c77cd8d4e58cedf5ac.

Signed-off-by: Julien Cristau <jcristau@debian.org>
3 years agoclean_suites: fix clean_byhash when Dinstall::SuiteSuffix is set
Julien Cristau [Wed, 18 May 2016 14:10:01 +0000 (16:10 +0200)]
clean_suites: fix clean_byhash when Dinstall::SuiteSuffix is set

Signed-off-by: Julien Cristau <jcristau@debian.org>
3 years agogenerate_releases: refactor by-hash handling
Julien Cristau [Wed, 18 May 2016 13:50:17 +0000 (15:50 +0200)]
generate_releases: refactor by-hash handling

Move hashfile update and by-hash links creation to separate methods.  No
actual code changes.

Signed-off-by: Julien Cristau <jcristau@debian.org>
3 years agogenerate_releases: reduce number of sql queries for by-hash files
Julien Cristau [Wed, 18 May 2016 13:45:57 +0000 (15:45 +0200)]
generate_releases: reduce number of sql queries for by-hash files

Instead of doing two queries per filename and per hash function, store a
set of known hashfiles up front and group the UPDATEs in a single query.

Suggested by Colin Watson.

Signed-off-by: Julien Cristau <jcristau@debian.org>
3 years agogenerate_releases: expire by-hash files for all suites
Julien Cristau [Wed, 18 May 2016 13:38:47 +0000 (15:38 +0200)]
generate_releases: expire by-hash files for all suites

When setting suite.byhash to false, the suite's existing hashfiles need
to be marked as unreferenced so they can be cleaned up.

Signed-off-by: Julien Cristau <jcristau@debian.org>
3 years agogenerate_releases: separate hashfile table update from hardlink creation
Julien Cristau [Wed, 18 May 2016 13:33:07 +0000 (15:33 +0200)]
generate_releases: separate hashfile table update from hardlink creation

This way we only touch the filesystem after the db is updated.

Signed-off-by: Julien Cristau <jcristau@debian.org>
3 years agogenerate_releases: replace hashfuncs initialization with a legible version
Julien Cristau [Tue, 17 May 2016 14:16:42 +0000 (16:16 +0200)]
generate_releases: replace hashfuncs initialization with a legible version

Group knowledge of hash function and corresponding name in our db and in
Release files in a class instead of playing clever but unreadable
tricks.

Suggested by Colin Watson.

Signed-off-by: Julien Cristau <jcristau@debian.org>
3 years agoMove Release files to zzz-dists
Ansgar Burchardt [Wed, 18 May 2016 08:03:55 +0000 (10:03 +0200)]
Move Release files to zzz-dists

This makes sure the Release files are synced last, after all Packages
indices (and their correspondig by-hash files).

3 years agoshow_deferred: drop workaround for old python-debian bug
Julien Cristau [Tue, 17 May 2016 08:14:19 +0000 (10:14 +0200)]
show_deferred: drop workaround for old python-debian bug

Fixed in python-debian 0.1.11; squeeze had 0.1.18.

Signed-off-by: Julien Cristau <jcristau@debian.org>
3 years agoRemove more changelog-related settings
Ansgar Burchardt [Mon, 16 May 2016 18:15:04 +0000 (20:15 +0200)]
Remove more changelog-related settings

These seem to no longer be used as of c91ff0bda6190f7b80b7976b578c10e68f97c5b1

3 years agodak.conf: Remove changelog export path
Ansgar Burchardt [Mon, 16 May 2016 18:13:19 +0000 (20:13 +0200)]
dak.conf: Remove changelog export path

This is controlled via the database, however
fcfcdcc15785c01785b18fecc903b3aef2b367f6 left the setting in
config/debian/dak.conf.

3 years agodebian-security/dak.conf: Remove `Security-Install` block
Ansgar Burchardt [Mon, 16 May 2016 18:01:00 +0000 (20:01 +0200)]
debian-security/dak.conf: Remove `Security-Install` block

It doesn't seem to be used anywhere.

3 years agodebian-security/dak.conf: Remove references to non-US
Ansgar Burchardt [Mon, 16 May 2016 17:59:40 +0000 (19:59 +0200)]
debian-security/dak.conf: Remove references to non-US

3 years agodebian-security/dak.conf: set changelog export directory
Ansgar Burchardt [Mon, 16 May 2016 17:57:15 +0000 (19:57 +0200)]
debian-security/dak.conf: set changelog export directory

3 years agoMerge remote-tracking branch 'jcristau/by-hash-v4'
Ansgar Burchardt [Mon, 16 May 2016 15:58:50 +0000 (17:58 +0200)]
Merge remote-tracking branch 'jcristau/by-hash-v4'

3 years agoAdd by-hash support
Julien Cristau [Wed, 27 Apr 2016 08:06:08 +0000 (10:06 +0200)]
Add by-hash support

Add a per-suite boolean to enable by-hash; store the by-hash files in
the db, and record when they stopped being referenced, so that
clean-suites can delete them after the archive's stayofexecution time.

In generate-release, where we have checksums for all the things,
hardlink files to the by-hash dir for each of the suite's configured
hash methods.

Signed-off-by: Julien Cristau <jcristau@debian.org>
---
changes in v2:
- use archive.stayofexecution as delay before removing files from
  by-hash
- don't assume any particular ordering for suite.checksums

changes in v3:
- rebase on latest master, update115 is now update116
- handle missing files in clean_byhash

changes in v4:
- use hardlinks instead of symlinks
- don't initialize `unreferenced` to its default value
- in clean_byhash, remove useless fetchall, and handle ENOENT from
  unlink instead of checking for existence beforehand

3 years agoAdd python-debianbts as a dependency in setup/README (Closes: #823118)
Luke Faraone [Sat, 30 Apr 2016 21:59:52 +0000 (21:59 +0000)]
Add python-debianbts as a dependency in setup/README (Closes: #823118)

Needed to run the test suite:

    ======================================================================
    ERROR: test_importing_rm (test_imports.ImportTestCase)
    ----------------------------------------------------------------------
    Traceback (most recent call last):
      File "/srv/daksrc/tests/test_imports.py", line 15, in test_fn
        __import__('dak', fromlist=[cmd])
      File "/srv/daksrc/dak/rm.py", line 54, in <module>
        from daklib.rm import remove
      File "/srv/daksrc/dak/daklib/rm.py", line 52, in <module>
        import debianbts as bts
    ImportError: No module named debianbts

Signed-off-by: Luke Faraone <lfaraone@debian.org>
3 years agoNotify w-b earlier
Ansgar Burchardt [Tue, 3 May 2016 20:57:57 +0000 (22:57 +0200)]
Notify w-b earlier

Before Debian LTS started to use the security archive, all uploads that
would trigger buildds would be sourceful uploads to a policy queue. So
new packages entering the build queues and pushing the public mirrors
would likely not happen in the same cron.unchecked run.

With Debian LTS, uploads would go to both the build queues and trigger a
public mirror push. If the mirror push takes more than three minutes,
cron.buildd would however not notify w-b of changes.

This patch moves the w-b notification right behind the update of the
build queues and before the mirror push to avoid the problem. Ideally
we would not rely on anything happening within the last three minutes
though.

3 years agodak: don't ignore SystemExit
Julien Cristau [Wed, 27 Apr 2016 08:26:28 +0000 (10:26 +0200)]
dak: don't ignore SystemExit

Let the python interpreter handle it and actually exit with the right
status, otherwise when a sub-command calls sys.exit(1) we end up exiting
0 instead, which is confusing if not dangerous.

Signed-off-by: Julien Cristau <jcristau@debian.org>
3 years agoPublish security archive on all changes
Ansgar Burchardt [Sun, 1 May 2016 14:56:35 +0000 (16:56 +0200)]
Publish security archive on all changes

With "wheezy" being used for Debian LTS, the archive needs to be
published not only when policy queue uploads are accepted, but also
when direct uploads to "wheezy" arrive.

The same applies to uploads to "jessie-kfreebsd".

3 years agoKeep track of when a package was last added to a suite
Ansgar Burchardt [Sun, 1 May 2016 14:55:11 +0000 (16:55 +0200)]
Keep track of when a package was last added to a suite

3 years agoWork with newer SQLAlchemy versions
Ansgar Burchardt [Sun, 1 May 2016 14:48:22 +0000 (16:48 +0200)]
Work with newer SQLAlchemy versions

Newer SQLAlchemy versions seem to track the `binary` attribute of
`BinaryMetadata`.  This means the association proxy in `DBBinary`
would first create a `BinaryMetadata` with `binary` set to `None`,
flush this to the database and then set the actual value of `binary`
we want.  However the flush fails, as `NULL` is not allowed for the
`binary_id` column.

The problem can be avoided by not setting `binary` to `None`.  This is
treated as an "undefined value" by SQLAlchemy and changing it later
means the database row never sees `NULL`.

The same applies to the `source` attribute of `SourceMetadata`.

3 years agoMove more specific source file regexes before general ones
Guillem Jover [Sat, 23 Apr 2016 12:02:16 +0000 (14:02 +0200)]
Move more specific source file regexes before general ones

The orig tarball regexes match also the orig tarball detached
signatures because they are not anchored at the end, and the loop
short-circuits on first match. So we have to move them before their
more general counterparts.

Fixes commit 84f230b6cfb4b3eb1ef5fbe672e121b1a8e7aabb.

3 years agoRead files in chunks
Ansgar Burchardt [Fri, 15 Apr 2016 07:49:54 +0000 (09:49 +0200)]
Read files in chunks

Calling `f.read()` would read the entire file at once which is
wasteful. It's also not intended given the read loop.

Also replace a use of `readline()` with `read(65536)` as well where we
want to read the entire file and not only single lines.

3 years agoDo not pass all file descriptiors to external process.
Ansgar Burchardt [Fri, 15 Apr 2016 06:37:10 +0000 (08:37 +0200)]
Do not pass all file descriptiors to external process.

3 years agoFix support for detached upstream signatures
Guillem Jover [Thu, 11 Feb 2016 09:27:16 +0000 (10:27 +0100)]
Fix support for detached upstream signatures

We should only allow upstream tarballs with detached signatures, but not
native tarballs, «<source>_<version>.orig.asc» or «<source>_<version>.asc»
filenames. We also need to allow this on all relevant regexes. This commit
fixes and refactors the regexes to implement the above, and to make it
easier to modify a single place in the future.

Fixes commit 4911282cbf231b116872a6f16eb838f7862ebc36.

Closes: #759401

3 years agoStop using undefined reject function in check_dsc_files
Guillem Jover [Thu, 11 Feb 2016 09:27:13 +0000 (10:27 +0100)]
Stop using undefined reject function in check_dsc_files

When there's an unknown file in a source package, the function spits
this:

  ,---
  Processing raised an exception: global name 'reject' is not defined.
  Traceback (most recent call last):
    File "/srv/ftp-master.debian.org/dak/dak/daklib/archive.py", line 966, in check
      chk().check(self)
    File "/srv/ftp-master.debian.org/dak/dak/daklib/checks.py", line 497, in check
      rejects = utils.check_dsc_files(dsc_fn, control, source.files.keys())
    File "/srv/ftp-master.debian.org/dak/dak/daklib/utils.py", line 343, in check_dsc_files
      reject("%s: unexpected source file '%s'" % (dsc_filename, f))
  NameError: global name 'reject' is not defined
  `---

Just set the reject message and break from the loop.

3 years agoRemove unused re_source_ext import
Guillem Jover [Thu, 11 Feb 2016 09:27:10 +0000 (10:27 +0100)]
Remove unused re_source_ext import

3 years agoEscape dots in file type check in check_dsc_files
Guillem Jover [Thu, 11 Feb 2016 09:26:57 +0000 (10:26 +0100)]
Escape dots in file type check in check_dsc_files

3 years agoImplement mirrorpush-release function
Joerg Jaspert [Sat, 2 Apr 2016 13:03:52 +0000 (15:03 +0200)]
Implement mirrorpush-release function

3 years agoAdd "mirror" so POSSIBLEARGS
Ansgar Burchardt [Sat, 2 Apr 2016 12:21:02 +0000 (14:21 +0200)]
Add "mirror" so POSSIBLEARGS

3 years agoREADME.stable-point-release: updates from 7.10
Ansgar Burchardt [Sat, 2 Apr 2016 12:20:41 +0000 (14:20 +0200)]
README.stable-point-release: updates from 7.10

3 years agoUps, that backports dir is still in use
Joerg Jaspert [Sat, 2 Apr 2016 12:05:22 +0000 (14:05 +0200)]
Ups, that backports dir is still in use

3 years agoGenerate new.html stuff atomic
Joerg Jaspert [Sat, 2 Apr 2016 12:01:37 +0000 (14:01 +0200)]
Generate new.html stuff atomic

3 years agoRemove an old backports-master dir, remove lock unchecked after usage
Joerg Jaspert [Sat, 2 Apr 2016 11:59:34 +0000 (13:59 +0200)]
Remove an old backports-master dir, remove lock unchecked after usage

3 years agoREADME.stable-point-release: updates from 8.4
Ansgar Burchardt [Sat, 2 Apr 2016 10:05:04 +0000 (12:05 +0200)]
README.stable-point-release: updates from 8.4

3 years agoUse parameter passed to the --suite option
Ansgar Burchardt [Thu, 31 Mar 2016 19:17:44 +0000 (21:17 +0200)]
Use parameter passed to the --suite option

We used the remaining parameters before which is somewhat confusing.

3 years agoThe --suite option has an argument.
Ansgar Burchardt [Thu, 31 Mar 2016 19:12:54 +0000 (21:12 +0200)]
The --suite option has an argument.

3 years agodebian: Add release team key to import testing-debug
Ansgar Burchardt [Thu, 31 Mar 2016 18:32:50 +0000 (20:32 +0200)]
debian: Add release team key to import testing-debug

3 years agoRevert "Use only 'xz' as default compression for Sources and Packages"
Ansgar Burchardt [Wed, 30 Mar 2016 22:04:58 +0000 (00:04 +0200)]
Revert "Use only 'xz' as default compression for Sources and Packages"

This reverts commit 196b3433d455b925758d6a46751a1f0b01617213.

3 years agoAcquire a lock in the main process when writing Contents
Ansgar Burchardt [Wed, 30 Mar 2016 21:36:23 +0000 (23:36 +0200)]
Acquire a lock in the main process when writing Contents

This should prevent changes to the {src,bin}_contents tables and result
in all helper processes seeing the same data.

3 years agoUse only 'xz' as default compression for Sources and Packages
Ansgar Burchardt [Wed, 30 Mar 2016 21:26:17 +0000 (23:26 +0200)]
Use only 'xz' as default compression for Sources and Packages

3 years agoRemove files that are (no longer) generated
Ansgar Burchardt [Wed, 30 Mar 2016 21:23:13 +0000 (23:23 +0200)]
Remove files that are (no longer) generated

This makes it less error-prone to switch compression methods: the files
that are no longer generated are automatically removed. Before they had
to be removed manually.

3 years agoHopefully enable g-i-d to deal with .xz files
Joerg Jaspert [Tue, 15 Mar 2016 22:25:59 +0000 (23:25 +0100)]
Hopefully enable g-i-d to deal with .xz files

which is helpful when there are no .gz/.bz2 ones around to
look at.

3 years agoRemove suite alias, use suite directly
Joerg Jaspert [Tue, 15 Mar 2016 21:57:18 +0000 (22:57 +0100)]
Remove suite alias, use suite directly

3 years agoMerge remote-tracking branch 'juliank/master'
Joerg Jaspert [Tue, 15 Mar 2016 21:44:30 +0000 (22:44 +0100)]
Merge remote-tracking branch 'juliank/master'

* juliank/master:
  Only generate binary checksum fields for the requested ones
  Only generate fields in Sources for requested checksums

Signed-off-by: Joerg Jaspert <joerg@debian.org>
3 years agoReplace hardcoded hashfuncs with values generated from database
Joerg Jaspert [Sun, 13 Mar 2016 14:23:34 +0000 (15:23 +0100)]
Replace hardcoded hashfuncs with values generated from database

3 years agoOnly generate binary checksum fields for the requested ones
Julian Andres Klode [Sun, 13 Mar 2016 14:01:46 +0000 (15:01 +0100)]
Only generate binary checksum fields for the requested ones

This is the second step. As we are simply concatenating things,
we can just concatenate an empty string if we do not want a
checksum.

3 years agoOnly generate fields in Sources for requested checksums
Julian Andres Klode [Sun, 13 Mar 2016 13:48:51 +0000 (14:48 +0100)]
Only generate fields in Sources for requested checksums

We make use of the fact that STRING_AGG ignores NULL values
when joining the values, so we do not get empty lines in there.

3 years agoAdd checksums column to suite table
Joerg Jaspert [Sun, 13 Mar 2016 13:29:54 +0000 (14:29 +0100)]
Add checksums column to suite table

3 years agoNo need to export backports changelogs anymore
Joerg Jaspert [Sun, 13 Mar 2016 13:02:41 +0000 (14:02 +0100)]
No need to export backports changelogs anymore

3 years agoStop work in the backports archive
Joerg Jaspert [Sun, 13 Mar 2016 12:57:40 +0000 (13:57 +0100)]
Stop work in the backports archive

Mind, its still configured and exists, need to remove that, but this
should stop pushing the mirrors and changing it around.

3 years agoArchitecture names can have more than one character
Ansgar Burchardt [Sat, 6 Feb 2016 13:38:58 +0000 (14:38 +0100)]
Architecture names can have more than one character