• vim-command-t upload errors

    From Sam Morris@21:1/5 to All on Wed Sep 21 12:00:01 2022
    I'm trying & failing to manage to upload a new version of vim-command-t.

    Starting from a clean slate:

    $ dput --force -d mentors ../vim-command-t_5.0.5-1_source.changes
    [...]
    [DEBUG] 1663751661.771559: (initialize) Logging into mentors.debian.net as anonymous
    [DEBUG] 1663751662.005920: (initialize) Enable PASV mode
    [DEBUG] 1663751662.006143: (initialize) Change directory to /pub/UploadQueue/
    Uploading vim-command-t_5.0.5-1.dsc
    [INFO] 1663751662.048132: (invoke_dput) Uploading vim-command-t_5.0.5-1.dsc
    Uploading vim-command-t_5.0.5.orig.tar.gz
    [INFO] 1663751662.248703: (invoke_dput) Uploading vim-command-t_5.0.5.orig.tar.gz
    cannot read from timed out object
    [CRITICAL] 1663751672.420859: (<module>) cannot read from timed out object

    It looks like the connection's being closed during the transfer; the
    original file is about 84 KiB but the file left in the upload queue is
    only 14500 bytes:

    lftp mentors.debian.net:/pub/UploadQueue> ls
    -rw------- 1 1010 110 13932 Sep 21 08:03 vim-command-t-dbgsym_5.0.5-1_amd64.deb
    -rw------- 1 1010 110 1351 Sep 21 09:14 vim-command-t_5.0.5-1.dsc
    -rw------- 1 1010 110 6979 Sep 21 08:06 vim-command-t_5.0.5-1_amd64.buildinfo
    -rw------- 1 1010 110 14500 Sep 21 08:06 vim-command-t_5.0.5-1_amd64.deb
    -rw------- 1 1010 110 14500 Sep 21 09:14 vim-command-t_5.0.5.orig.tar.gz

    Ignore the older files left behind by a previous upload attempt that incorrectly included binary package. Although it's interesting that the
    .deb and the .orig.tar.gz were both truncated to the same size...

    In case anyone else runs into this problem, the solution is to re-run
    dput with the --force option; it will skip uploading any files that
    exist in the remote queue, and continue on to upload subsequent files
    including the .changes file. Then queue processing will send out a
    REJECT and delete the files.

    While composing the above I did a bit of testing. I found that uploading
    a 1 MiB file with lftp fails:

    lftp mentors.debian.net:/pub/UploadQueue> put /tmp/1MiBtest -o 1MiBtest.3
    ---> TYPE I
    <--- 200 Switching to Binary mode.
    ---> PASV
    <--- 227 Entering Passive Mode (185,22,221,46,55,235)
    ---- Connecting data socket to (185.22.221.46) port 14315
    ---- Data connection established
    ---> STOR 1MiBtest.3
    <--- 150 Ok to send data.
    **** data-socket: Connection reset by peer

    lftp mentors.debian.net:/pub/UploadQueue> ls 1MiBtest.3
    -rw------- 1 1010 110 14500 Sep 21 09:36 1MiBtest.3

    ... and the result is that the upload file is truncated to the same
    length.

    I also discovered that I was uploading my packages with dput-ng. After I removed it and installed dput:

    $ dput -f mentors ../vim-command-t_5.0.5-1_source.changes
    Checking signature on .changes
    gpg: ../vim-command-t_5.0.5-1_source.changes: Valid signature from 4E11A28B8650188A
    Checking signature on .dsc
    gpg: ../vim-command-t_5.0.5-1.dsc: Valid signature from 4E11A28B8650188A
    Uploading to mentors (via ftp to mentors.debian.net):
    Uploading vim-command-t_5.0.5-1.dsc: done.
    Uploading vim-command-t_5.0.5.orig.tar.gz: done.
    Uploading vim-command-t_5.0.5-1.debian.tar.xz: done.
    Uploading vim-command-t_5.0.5-1_source.buildinfo: done.
    Uploading vim-command-t_5.0.5-1_source.changes: done.
    Successfully uploaded packages.

    It works!

    dput-ng's error handling could certainly do with some improvement ... it
    should (IMO) have continued on to upload the .changes file so that the
    queue could REJCT the upload & delete the partial files. As for why
    dput-ng and lftp both have trouble uploading to the server, but dput
    does not, I've no idea...

    --
    Sam Morris <https://robots.org.uk/>
    PGP: rsa4096/CAAA AA1A CA69 A83A 892B 1855 D20B 4202 5CDA 27B9

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Paul Wise@21:1/5 to Sam Morris on Thu Sep 22 02:00:01 2022
    On Wed, 2022-09-21 at 10:44 +0100, Sam Morris wrote:

    It looks like the connection's being closed during the transfer;

    If you are able to try the upload from a different Internet connection,
    or with a VPN or via Tor that might help narrow down the issue.

    dput-ng's error handling could certainly do with some improvement ...

    Please do report a bug about that, hopefully it can get fixed.

    As for why dput-ng and lftp both have trouble uploading to the
    server, but dput does not, I've no idea...

    You might be able to figure this out by using Wireshark to obtain
    network traces of successful and unsuccessful uploads and comparing
    them to see where the process goes wrong.

    --
    bye,
    pabs

    https://wiki.debian.org/PaulWise

    -----BEGIN PGP SIGNATURE-----

    iQIzBAABCgAdFiEEYQsotVz8/kXqG1Y7MRa6Xp/6aaMFAmMrpJwACgkQMRa6Xp/6 aaMQDBAAj4nHnZTn4N4eu7XAPb3umSr0CLK7hsZhpiw8zwKWR7qiDSOLvbUg3XeE mVLAT8VPsmUkIOObbBLc6BbqMIUcjYA4toq1RPGElDzbVo7+MISRhdUly0K8EbrQ mXjH45bM0tX1rrb5xZiyEOXlacOrj44aH0WYeyUqlsTA05dfh7878V0I5KJce8Xp UnAWNiaFceDXh2hG1VrPFdkovS2j78LcN0bKKDbS7QrWIVlWW/5bvRy60c9OAmxD 5yfeNhNPFV2s2TbL1EMUQJrHjb49Ec9r/weOSt9obRG8GDJq3Eq15nOa67tHDVO+ jlNidKsBUhBLc3AteTYDBRuTWY0hN0QI24EEVqrUQ5wjgYR2fNPCbetB5yu1F5CE +RGzMw+FyQSYddT+BJXP7nq/5xNQd1XP4JAsPnXA3LkQGUauMjCR/JF6MEKuzv1m T+71AyWHG/PmxaK4YE5gAuw8nnGVQhXcDUlUb1pmKVtuGltqC8i9e2p+TWWLxn3G W5T805g/cA49XjOFVOH7/OycmeReH5XThyXqhjeoT3bmQ4SXLq26PJSSkLppMedq sPA0wucj/lOwRsGS5G3e6YvYuWT9rEALSpbPWy4grOEBeQ8XPOZM2HtXZsnYLy4U uYRBGmuI9jHZbw8RYxCSsQPAXihLBIm3WAfgYDszv+11bZNunNg=
    =TBZ9
    -----END PGP SIGNATURE-----

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Sam Morris@21:1/5 to All on Thu Sep 22 11:30:01 2022
    (Forgot to say in the first message, please CC me as I'm not subscribed
    to the list).

    I've done a bit more troubleshooting and it appears that my success with
    dput was just blind luck: I tried re-uploading the same package and it
    now fails in the same way as dput-ng and lftp.

    I've attached a couple of packet traces from two machines on my network.
    I'm no network expert but it looks like in each case one of the uploads
    gets a little way in and then stalls because the client isn't receiving
    any ACK for transmitted data.

    I had the opportunity to try uploading from a server I have directly
    connected to the Internet and had no problems. So it appears there's a
    problem with conenctions from my ISP (Virgin Media Business in the UK)
    and mentors.debian.net... great!

    Oh and the dput-ng bug is <https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=992636> :)

    --
    Sam Morris <https://robots.org.uk/>
    PGP: rsa4096/CAAA AA1A CA69 A83A 892B 1855 D20B 4202 5CDA 27B9

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)