1. Forum
  2. Usenet
  3. NEWS.SOFTWARE.NNTP

  • "googlegroups.com" - combined totals for all groups

    From D@21:1/5 to All on Thu Nov 9 13:35:59 2023
    of the many thousands of unmoderated newsgroups (e.g., last check 2 Nov 2023 news.mixmin.net http://mixmin.net/active list [2.03 MB] shows 39,385 "y" and 5,936 "m"), is there any, preferably easy way for news admins to post totals for all articles in all unmoderated newsgroups containing "googlegroups.com"
    in message-id headers, and separately for reference headers of replies which also contain "googlegroups.com", e.g., since 1 January 2023 to current date?

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Jakob Bohm@21:1/5 to All on Fri Nov 10 17:50:56 2023
    On 2023-11-09 13:35, D wrote:
    of the many thousands of unmoderated newsgroups (e.g., last check 2 Nov 2023 news.mixmin.net http://mixmin.net/active list [2.03 MB] shows 39,385 "y" and 5,936 "m"), is there any, preferably easy way for news admins to post totals for all articles in all unmoderated newsgroups containing "googlegroups.com" in message-id headers, and separately for reference headers of replies which also contain "googlegroups.com", e.g., since 1 January 2023 to current date?


    Any news admin with at least 320 days of message retention would be able
    to run scripts against the message files on their servers.

    For speed, this should be done in a fast language that can parse RFC822
    headers on the fly, do regex matches and remember a hashed table of
    msgIds. Perl or Python might do with enough RAM for the table.

    One check could be run backwards (newest post first) and special case
    messages whose own msgId was not seen as a reference/inreplyto in a
    newer message. Such messages would be at a higher chance of being of
    little interest to other participants, though there will be many
    misdetections both ways with that crude metric.

    For detection of GG traffic, look at the Path header, not the msgId .

    Enjoy

    Jakob
    --
    Jakob Bohm, CIO, Partner, WiseMo A/S. https://www.wisemo.com
    Transformervej 29, 2860 Søborg, Denmark. Direct +45 31 13 16 10
    This public discussion message is non-binding and may contain errors.
    WiseMo - Remote Service Management for PCs, Phones and Embedded

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From D@21:1/5 to Jakob Bohm on Fri Nov 10 20:16:49 2023
    On Fri, 10 Nov 2023 17:50:56 +0100, Jakob Bohm <jb-usenet@wisemo.com.invalid> wrote:
    On 2023-11-09 13:35, D wrote:
    of the many thousands of unmoderated newsgroups (e.g., last check 2 Nov 2023 >> news.mixmin.net http://mixmin.net/active list [2.03 MB] shows 39,385 "y" and >> 5,936 "m"), is there any, preferably easy way for news admins to post totals >> for all articles in all unmoderated newsgroups containing "googlegroups.com" >> in message-id headers, and separately for reference headers of replies which >> also contain "googlegroups.com", e.g., since 1 January 2023 to current date?

    Any news admin with at least 320 days of message retention would be able
    to run scripts against the message files on their servers.
    For speed, this should be done in a fast language that can parse RFC822 >headers on the fly, do regex matches and remember a hashed table of
    msgIds. Perl or Python might do with enough RAM for the table.
    One check could be run backwards (newest post first) and special case >messages whose own msgId was not seen as a reference/inreplyto in a
    newer message. Such messages would be at a higher chance of being of
    little interest to other participants, though there will be many >misdetections both ways with that crude metric.
    For detection of GG traffic, look at the Path header, not the msgId .
    Enjoy
    Jakob

    a million thanks for sharing your expertise! this is more technical
    than anything i am able to understand . . . maybe nntp server admins
    could use this type of information to find out just how many "google"
    articles have graced the usenet world with their burgeoning presence

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)