• Re: Some severities to reconsider due to flaky tests

    From =?UTF-8?Q?Jeremy_B=C3=ADcha?=@21:1/5 to sanvila@debian.org on Wed Apr 9 14:30:01 2025
    XPost: linux.debian.devel.release

    On Wed, Apr 9, 2025 at 7:02 AM Santiago Vila <sanvila@debian.org> wrote:
    Dear Release Managers:

    Based on this reply by Paul:

    https://lists.debian.org/debian-devel/2025/04/msg00065.html

    I'd like to request that the severity of the following bugs is raised
    to serious again:
    ..
    https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=1057562

    (Raised by Sebastian to serious, downgraded later by the maintainer)

    https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=1069402

    This is essentially the same as #1057562, except that it's
    for gcr version 3 which is in a different package.

    Note that both gcr and gcr4 are key packages, so a serious severity
    will not make the package to be removed.

    It feels like there is less reason to argue about severity for gcr & gcr4 then?

    A brief explanation for the maintainers that we don't want
    flaky tests in trixie would also be nice.

    "flaky" is vague and until there is a specific standard for failure
    rate, this is going to be subject to maintainer discretion to some
    degree.

    As of 4.4.0.1, gcr4 does not appear to be flaky at all in the official
    buildds or on the reproducible builds server: https://buildd.debian.org/status/package.php?p=gcr4 https://tests.reproducible-builds.org/debian/history/gcr4.html

    I cherry-picked the fix to gcr which now shows the same result.

    The particular test is not used in autopkgtests so that isn't a concern here.

    Thank you,
    Jeremy Bícha

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Santiago Vila@21:1/5 to All on Wed Apr 9 14:50:01 2025
    XPost: linux.debian.devel.release

    El 9/4/25 a las 14:26, Jeremy Bícha escribió:
    Note that both gcr and gcr4 are key packages, so a serious severity
    will not make the package to be removed.

    It feels like there is less reason to argue about severity for gcr & gcr4 then?

    Less reason to downgrade without asking RMs first, as you did.

    Remember: we do not hide problems. Somebody should look at this bug
    during Bug Squashing Parties, even if it does not make the package
    to be removed.

    A brief explanation for the maintainers that we don't want
    flaky tests in trixie would also be nice.

    "flaky" is vague and until there is a specific standard for failure
    rate, this is going to be subject to maintainer discretion to some
    degree.

    As of 4.4.0.1, gcr4 does not appear to be flaky at all in the official buildds or on the reproducible builds server:

    What happens in the buildds remains in the buildds. Whoever wants to
    rebuild the package from source will not do so in the official buildds.

    You are still violating Policy 4.2 for no particular reason.

    If build-time dependencies are specified, it must be possible to build the package and produce > working binaries on a system with only essential and build-essential packages installed and also those required to satisfy the build-time relationships (
    including any implied relationships).

    We should not rely on a test which segfaults to determine if the package
    is good or not. If the Release Managers still think this is ok
    "because it works in the buildds", I can still call the TC for
    your unwillingness to follow Debian Policy 4.2.

    Please stop wasting everyone's time and disable the test which segfaults.
    Do you need a patch for that?

    Thanks.

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Paul Gevers@21:1/5 to =?UTF-8?Q?Jeremy_B=C3=ADcha?= on Wed Apr 9 19:30:01 2025
    XPost: linux.debian.devel.release
    To: sanvila@debian.org (Santiago Vila)
    Copy: debian-release@lists.debian.org (Debian Release Team)
    Copy: 1057562@bugs.debian.org

    This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --------------DvssebfoJ0b3Q1n60uGWNKvp
    Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: base64

    SGkgYWxsLA0KDQpPbiAwOS0wNC0yMDI1IDE0OjI2LCBKZXJlbXkgQsOtY2hhIHdyb3RlOg0K PiAiZmxha3kiIGlzIHZhZ3VlIGFuZCB1bnRpbCB0aGVyZSBpcyBhIHNwZWNpZmljIHN0YW5k YXJkIGZvciBmYWlsdXJlDQo+IHJhdGUsIHRoaXMgaXMgZ29pbmcgdG8gYmUgc3ViamVjdCB0 byBtYWludGFpbmVyIGRpc2NyZXRpb24gdG8gc29tZQ0KPiBkZWdyZWUuDQoNCg0KTXkgcGVy c29uYWwgc3RhbmRhcmQgKGJ1dCB3aXRoIFJlbGVhc2UgVGVhbSBoYXQgaW4gbWluZCkgaXMg dGhhdCBJIGZpbGUgDQpSQyBidWdzIGFib3V0IGZsYWtpbmVzcyBpZiBhIHRlc3QgZmFpbHMg bW9yZSB0aGFuIGFib3V0IDEgb3V0IG9mIDYgdGltZXMgDQoob24gYSBwYXJ0aWN1bGFyIGFy Y2hpdGVjdHVyZSBpZiBpdCdzIGFyY2hpdGVjdHVyZSBzcGVjaWZpYykuDQoNClBhdWwNCg0K


    --------------DvssebfoJ0b3Q1n60uGWNKvp--

    -----BEGIN PGP SIGNATURE-----

    wsB5BAABCAAjFiEEWLZtSHNr6TsFLeZynFyZ6wW9dQoFAmf2rl0FAwAAAAAACgkQnFyZ6wW9dQqM pgf9HgijvuII94ys6FkZ4k87xy//yHfANPGDt28NkQeqXyaL9VhZgPvnuCh7fdsbhpwjo1ncOjAN TshHUkg/ml7+ZzMgAGOeT/s60XMvelqHq3qajnn41xBKQA/79GMi32JN+Uncy1hbTZCPR4uVQMzS pkRhwyoIegZaNkHy4q1V89TqCWYjurXRVX5VhJlVS1gxIe6xI8LY5nz5G2yqGWupEIfYOqcV+LuX 3zrYnDSYRpQOQV1KCLmyHfOWYBJ43bZ05f63FEynglWhLofWCnEjzRILY8Nu7fUSphCmnxxNj/AH KOzMlC1cvmPq0t09GANHDfGy+E1a9NdPRS9eQ8Zo4Q==
    =xwh+
    -----END PGP SIGNATURE-----

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)