• Bug#1103356: surf autopkgtest "command 2" is flaky on riscv64

    From Ian Jackson@21:1/5 to All on Wed Apr 16 20:30:02 2025
    Package: surf
    Version: 2.1+git20240324-1
    Severity: serious
    Justification: Preventing migrations in ci.d.n

    Hi. I'm working on src:autopkgtest. Currently, we're having a
    problem with testing migration because the 2nd listed autopkgtest is
    failing in ci.debian.net. That's the one with the command
    timeout -v 10m xvfb-run debian/tests/test_http.py

    Here's the logs for one such run:
    https://ci.debian.net/packages/s/surf/testing/riscv64/59960211/

    This test apparently passed in the baseline but failed when run in the migration test for autopkgtest 5.48. But, autopkgtest.deb is not used
    by that particular test case ("command2"). It's not even installed by
    the CI test runner.

    The migration test was triggered by the existence of the 3rd test
    case, which *does* depend on autopkgtest, and also fails with similar
    looking error messages. That 3rd test case is marked flaky so isn't a regression. That test uses some files from autopkgtest's doc
    directory as test cases. That seems to be the only connection to autopkgtest.ceb.

    Note: it is important to distinguish the two autopkgtests in this
    scenario:

    1. src:autopkgtest whose possible testing migration triggered this
    test run, and its autopkgtest.deb which is installed in the flaky surf
    test case. This is the autopkgtest that the test appears to impugn,
    but which I think cannot be implicated in the blocking test failure.

    2. The outer autopkgest used by ci.d.n to run all these tests. ci.d.n
    uses a fixed version of autopkgtest, not the version under test.

    Looking at tracker.d.o the failure seems to be arch-specific, only
    occurring on riscv64. I think, probably, the test is simply flaky.

    Please would you mark this 2nd test flaky too. In the meantime I will
    probably end up asking the release team to override it.

    Ian.

    --
    Ian Jackson <ijackson@chiark.greenend.org.uk> These opinions are my own.

    Pronouns: they/he. If I emailed you from @fyvzl.net or @evade.org.uk,
    that is a private address which bypasses my fierce spamfilter.

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Debian Bug Tracking System@21:1/5 to All on Sun Apr 20 22:40:02 2025
    This is a multi-part message in MIME format...

    Your message dated Sun, 20 Apr 2025 20:36:46 +0000
    with message-id <E1u6bPC-00HD2s-Gu@fasolo.debian.org>
    and subject line Bug#1103356: fixed in surf 2.1+git20250419-1
    has caused the Debian Bug report #1103356,
    regarding surf autopkgtest "command 2" is flaky on riscv64
    to be marked as done.

    This means that you claim that the problem has been dealt with.
    If this is not the case it is now your responsibility to reopen the
    Bug report if necessary, and/or fix the problem forthwith.

    (NB: If you are a system administrator and have no idea what this
    message is talking about, this may indicate a serious mail system misconfiguration somewhere. Please contact owner@bugs.debian.org
    immediately.)


    --
    1103356: https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=1103356
    Debian Bug Tracking System
    Contact owner@bugs.debian.org with problems

    Received: (at submit) by bugs.debian.org; 16 Apr 2025 18:24:08 +0000 X-Spam-Checker-Version: SpamAssassin 3.4.6-bugs.debian.org_2005_01_02
    (2021-04-09) on buxtehude.debian.org
    X-Spam-Level:
    X-Spam-Status: No, score=-15.1 required=4.0 tests=BAYES_00,
    BODY_INCLUDES_PACKAGE,DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,HAS_PACKAGE,
    SPF_HELO_NONE,SPF_NONE autolearn=ham autolearn_force=no
    version=3.4.6-bugs.debian.org_2005_01_02
    X-Spam-Bayes: score:0.0000 Tokens: new, 27; hammy, 150; neutral, 124; spammy,
    0. spammytokens: hammytokens:0.000-+--H*UA:sk:x86_64-,
    0.000-+--autopkgtest, 0.000-+--H*x:sk:x86_64-, 0.000-+--autopkgtests,
    0.000-+--cidebiannet
    Return-path: <ijackson@chiark.greenend.org.uk>
    Received: from permutation-city.chiark.greenend.org.uk ([2a00:1098:86:130::194]:56333 helo=chiark.greenend.org.uk)
    by buxtehude.debian.org with esmtps (TLS1.3:ECDHE