• s.g.m archives

    From Stewart Baldwin@21:1/5 to All on Fri Mar 14 14:39:11 2025
    It appears that Google Groups still has a lot more early s.g.m messages
    than I realized. Searching for "soc.genealogy.medieval" on Google takes
    you to the Google Groups website with a clear message that you can't
    post new stuff, but a large number of early postings can be found by
    searching by date only, with many going back to January 1996, and a
    handful from 1995. If I recall correctly, the group was formed in June
    of 1996.

    I wonder if there would be a simple way to just download and save all of
    the 51117 postings which are still available at Google Groups. I think
    that we have found out the hard way that big corporations can't be
    trusted to preserve stuff like this. Perhaps it would be better if a
    handful of regulars had it all saved on an external hard drive, updated
    from time to time and stored somewhere, just in case the archives
    disappeared from everywhere they are available.

    Stewart Baldwin

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Stewart Baldwin@21:1/5 to taf on Mon Mar 17 19:19:28 2025
    On 3/16/2025 9:12 PM, taf wrote:
    On 3/14/2025 12:39 PM, Stewart Baldwin wrote:
    It appears that Google Groups still has a lot more early s.g.m
    messages than I realized.  Searching for "soc.genealogy.medieval" on
    Google takes you to the Google Groups website with a clear message
    that you can't post new stuff, but a large number of early postings
    can be found by searching by date only, with many going back to
    January 1996, and a handful from 1995.  If I recall correctly, the
    group was formed in June of 1996.

    Two things here:

    That handful of posts from late 1995 and early 1996, before the group actually started, come from people who didn't set their computer date correctly, and so their software attached the wrong date to the header
    of their outgoing posts. This was before Windows synchronized computer clock/calendar dates automatically, and before recipient computers
    started installing date filters to block backdated messages.

    The ones from the earliest years of the group, '96 and '97 (and I don't remember how much longer), aren't representative of the early activity.
    Right before Google bought the Deja News archive, the latter lost the
    early years of s.g.m. This was not discovered until after the handover
    and then it was too late to try to recover them. When I looked into it
    years later, almost the entirety of the posts on Google Groups from the
    early years were those that had been cross-posted between s.g.m and
    another group, typically soc.history.medieval, and it was their presence
    in those other groups that allowed those posts to be preserved when the
    rest of them were lost. They probably don't represent more than 5% of
    the total, and likewise, their topics tend to be genealogy-adjacent (or worse), which is what led them to be cross-posted, rather than
    containing the focused genealogical discussions from the time. Still, something is better than nothing.

    taf

    I am pretty sure that the newsgroup started in June of 1995. I tried to
    save all of the messages from the very first, but I didn't realize for
    some time that my newsreader was deleting older messages because of
    settings which I didn't know about. Still, I have a reasonably complete archive of s.g.m. on my current laptop's hard drive from July of 1996
    through December of 1997. When I found out that old messages could be retrieved in chunks from Deja News, I used this feature to retrieve some
    of the old messages, but I foolishly thought by this time that the
    archives would be around forever, so the only older ones I have are from December of 1995 (by which time I was a regular contributor to the
    group), and April and May of 1996. I transferred these from old
    desktops to my current laptop's hard drive in 2018, and at the time I
    saw that I could recover pretty much all of the messages through 2004,
    but it was a r e a l l y s l o w process using floppies, and my
    efforts ended with the December 1997 postings, with the thought that I
    would get around to the rest later. I have not used either of my two
    old desktops since pre-pandemic, and I have no idea if they still work.
    Still, I DO have those old postings from December 1995, April-May & July-December 1996, and pretty much all of 1997 in easily available form
    (with the possible exception of certain vacation periods when I was away
    from my desktops). [Note: These include the headers that would allow
    for threading.]

    Stewart Baldwin

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Denis Beauregard@21:1/5 to taf on Tue Mar 18 14:59:48 2025
    On Sun, 16 Mar 2025 19:12:43 -0700, taf <taf.medieval@gmail.com> wrote
    in soc.genealogy.medieval:

    Two things here:

    That handful of posts from late 1995 and early 1996, before the group >actually started, come from people who didn't set their computer date >correctly, and so their software attached the wrong date to the header
    of their outgoing posts. This was before Windows synchronized computer >clock/calendar dates automatically, and before recipient computers
    started installing date filters to block backdated messages.

    Are you sure ? The first message I got from the eworld server begins
    with:

    =========================

    From: stone@mars.rowan.edu (DON STONE)
    Date: Mon, 5 Jun 1995 17:19:50 GMT
    Subject: WELCOME!

    Welcome to soc.genealogy.medieval. This is an unmoderated newsgroup
    with an associated mailing list (now in the process of being set up).
    We have begun work on a Frequently Asked Questions (FAQ) document. In
    the meantime, here are the Charter and Rationale that were part of the
    Request For Discussion (RFD) and Call For Votes (CFV):

    =========================

    Looking at the timestamps, there are more in June 1995.

    The first group of messages begin with:

    From MAILER-DAEMON Mon Mar 24 08:30 EST 1997
    Received: from VMS.DC.LSOFT.COM (vms.dc.lsoft.com [206.241.12.2])
    by Hydro.CAM.ORG (8.8.4/8.8.4) with ESMTP
    id IAA08324 for <beaur@CAM.ORG>; Mon, 24 Mar 1997 08:30:38
    -0500 (EST)
    Received: from apple (206.241.12.8) by VMS.DC.LSOFT.COM (LSMTP for
    OpenVMS v1.1a) with SMTP id <4.1D6497BC@VMS.DC.LSOFT.COM>; Mon, 24 Mar
    1997 8:30:38 -0500
    Message-Id: <199703241330.IAA08324@Hydro.CAM.ORG>
    Date: Mon, 24 Mar 1997 08:30:40 -0500
    From: "L-Soft list server at Apple (1.8c)" <LISTSERV@MAIL.EWORLD.COM>
    Subject: File: "GEN-MEDIEVAL LOG9506A"
    To: Denis Beauregard <****>
    Content-Type: text
    Content-Length: 12473
    Status: O
    X-Status:


    the eWorld server was set up by a VP of Apple who was also a
    genealogist.


    Denis

    --
    Denis Beauregard - généalogiste émérite (FQSG)
    Les Français d'Amérique du Nord - http://www.francogene.com/gfan/gfan/998/ French in North America before 1722 - http://www.francogene.com/gfna/gfna/998/ Sur cédérom/DVD/USB à 1790 - On CD-ROM/DVD/USB to 1790

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Denis Beauregard@21:1/5 to All on Tue Mar 18 15:03:21 2025
    For those curious: I have more old archives (depending on my
    personal interest, not for all soc.gen. newsgroups, not even for
    soc.roots), but I found later that the messages in French were
    altered and almost unreadable because the accepted letters were
    removed !


    Denis

    --
    Denis Beauregard - généalogiste émérite (FQSG)
    Les Français d'Amérique du Nord - http://www.francogene.com/gfan/gfan/998/ French in North America before 1722 - http://www.francogene.com/gfna/gfna/998/ Sur cédérom/DVD/USB à 1790 - On CD-ROM/DVD/USB to 1790

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Denis Beauregard@21:1/5 to sbaldw@mindspring.com on Tue Mar 18 14:49:41 2025
    On Fri, 14 Mar 2025 14:39:11 -0500, Stewart Baldwin
    <sbaldw@mindspring.com> wrote in soc.genealogy.medieval:

    I wonder if there would be a simple way to just download and save all of
    the 51117 postings which are still available at Google Groups. I think
    that we have found out the hard way that big corporations can't be
    trusted to preserve stuff like this. Perhaps it would be better if a
    handful of regulars had it all saved on an external hard drive, updated
    from time to time and stored somewhere, just in case the archives
    disappeared from everywhere they are available.

    If someone wants a nearly complete archive of the SGM messages,
    I may help by providing the messages in raw format.

    I use Forte Agent for years and it keeps emails and usenet messages
    in the internal format, i.e. with full headers. For some reason,
    2004 is missing, but I have the complete archives (except the
    spams I erased and some irrelevant messages like happy new year)
    since June 1995.

    So if someone wants to set up a server to make the files available,
    I can provide most of them. I don't want to distribute this to
    everybody, only to someone who will make them available to all.
    I will zip the files and put them on my server for retrieving.

    For those curious, I was in the committee that redefined the
    soc.roots forum in 1995. I don't know if my archives are complete
    however. I may have deleted some messages by mistake.


    Denis

    --
    Denis Beauregard - généalogiste émérite (FQSG)
    Les Français d'Amérique du Nord - http://www.francogene.com/gfan/gfan/998/ French in North America before 1722 - http://www.francogene.com/gfna/gfna/998/ Sur cédérom/DVD/USB à 1790 - On CD-ROM/DVD/USB to 1790

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Stewart Baldwin@21:1/5 to Denis Beauregard on Tue Mar 18 14:30:12 2025
    On 3/18/2025 2:03 PM, Denis Beauregard wrote:
    For those curious: I have more old archives (depending on my
    personal interest, not for all soc.gen. newsgroups, not even for
    soc.roots), but I found later that the messages in French were
    altered and almost unreadable because the accepted letters were
    removed !
    As I remember, this happened to my messages quite a bit when I was
    accessing the old archives. Numerous accents from French, Irish,
    Anglo-Saxon etc. names were made unreadable, and nearly all of my
    carefully composed genealogical tables were made incomprehensible by
    replacing a sequences of consecutive spaces by a single space. (And I
    have no idea how such archives would treat my recent attempts to use the Armenian alphabet, but I am not confident.)

    Stewart Baldwin

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Adrian Channing@21:1/5 to Denis Beauregard on Sat Mar 22 00:55:11 2025
    On 18/03/2025 18:49, Denis Beauregard wrote:
    On Fri, 14 Mar 2025 14:39:11 -0500, Stewart Baldwin
    <sbaldw@mindspring.com> wrote in soc.genealogy.medieval:

    I wonder if there would be a simple way to just download and save all of
    the 51117 postings which are still available at Google Groups. I think
    that we have found out the hard way that big corporations can't be
    trusted to preserve stuff like this. Perhaps it would be better if a
    handful of regulars had it all saved on an external hard drive, updated >>from time to time and stored somewhere, just in case the archives
    disappeared from everywhere they are available.

    If someone wants a nearly complete archive of the SGM messages,
    I may help by providing the messages in raw format.

    I use Forte Agent for years and it keeps emails and usenet messages
    in the internal format, i.e. with full headers. For some reason,
    2004 is missing, but I have the complete archives (except the
    spams I erased and some irrelevant messages like happy new year)
    since June 1995.

    So if someone wants to set up a server to make the files available,
    I can provide most of them. I don't want to distribute this to
    everybody, only to someone who will make them available to all.
    I will zip the files and put them on my server for retrieving.

    For those curious, I was in the committee that redefined the
    soc.roots forum in 1995. I don't know if my archives are complete
    however. I may have deleted some messages by mistake.


    Denis


    If of any use, I have the daily digests for April 1998 to November 2011.
    Adrian

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Stewart Baldwin@21:1/5 to Adrian Channing on Sat Mar 22 13:18:17 2025
    On 3/21/2025 7:55 PM, Adrian Channing wrote:

    If of any use, I have the daily digests for April 1998 to November 2011. Adrian
    So, if some of us supply whatever we have of the older messages, how
    hard would it be to eliminate the duplicates and make a combined file
    (or collection of files)?

    Stewart Baldwin

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Denis Beauregard@21:1/5 to sbaldw@mindspring.com on Tue Mar 25 17:29:52 2025
    On Sat, 22 Mar 2025 13:18:17 -0500, Stewart Baldwin
    <sbaldw@mindspring.com> wrote in soc.genealogy.medieval:

    On 3/21/2025 7:55 PM, Adrian Channing wrote:

    If of any use, I have the daily digests for April 1998 to November 2011.
    Adrian
    So, if some of us supply whatever we have of the older messages, how
    hard would it be to eliminate the duplicates and make a combined file
    (or collection of files)?

    There are basically 2 kinds of archives for SGM: full messages and
    digest.

    The digest has the messages for a specific day with a header but I see
    there is no separator. So someone will have to write some script to
    put each message in a separate file.

    In both cases, some lines in the headers can be removed to ease
    reading.

    Then, the timestamp and email of the poster can be used to identify
    duplicates. Timestamp may need some adjustment but we may presume
    GMT was used.


    Denis

    --
    Denis Beauregard - généalogiste émérite (FQSG)
    Les Français d'Amérique du Nord - http://www.francogene.com/gfan/gfan/998/ French in North America before 1722 - http://www.francogene.com/gfna/gfna/998/ Sur cédérom/DVD/USB à 1790 - On CD-ROM/DVD/USB to 1790

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From miked@21:1/5 to Stewart Baldwin on Wed Mar 26 23:40:13 2025
    On Fri, 14 Mar 2025 19:39:11 +0000, Stewart Baldwin wrote:

    It appears that Google Groups still has a lot more early s.g.m messages
    than I realized. Searching for "soc.genealogy.medieval" on Google takes
    you to the Google Groups website with a clear message that you can't
    post new stuff, but a large number of early postings can be found by searching by date only, with many going back to January 1996, and a
    handful from 1995. If I recall correctly, the group was formed in June
    of 1996.

    I wonder if there would be a simple way to just download and save all of
    the 51117 postings which are still available at Google Groups. I think
    that we have found out the hard way that big corporations can't be
    trusted to preserve stuff like this. Perhaps it would be better if a
    handful of regulars had it all saved on an external hard drive, updated
    from time to time and stored somewhere, just in case the archives
    disappeared from everywhere they are available.

    Stewart Baldwin

    i thought there was a site called narkive that was doing exactly that
    with all the usenet groups including sgm. It has the advantage over
    google in that it is still updating, although the user interface to my
    mind is rather unhelpful.

    whats to stop someone from buying the copyright of a usenet group or
    groups from google only making them available for a fee, threatening
    anyone else who makes them available with legal action? could that
    happen?

    mike

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From miked@21:1/5 to taf on Tue Apr 8 00:17:12 2025
    On Thu, 27 Mar 2025 18:33:45 +0000, taf wrote:

    On 3/26/2025 4:40 PM, miked wrote:
    i thought there was a site called narkive that was doing exactly that
    with all the usenet groups including sgm. It has the advantage over
    google in that it is still updating, although the user interface to my
    mind is rather unhelpful.
    Narchiv does host a Usenet archive, and if you dig into their site
    deeply enough, you will find a request that anyone with their own
    collection of Usenet posts not already on Narchiv submit them for
    inclusion. However, there is a problem.

    At least some of the archives of this group that people have been
    talking about aren't actually for soc.genealogy.medieval. They are
    instead archives of its sister gatewayed mailing list GEN-MEDIEVAL,
    which contained (mostly) the same content in an email format. Denis and Adrian are talking about Digests elsewhere in this thread - that is a GEN-MEDIEVAL thing, not a soc.gen.med thing. These will have mailing
    list headers rather than Usenet headers, and I don't know whether it is possible for a script to convert one to the other, or if instead some of
    the information necessary for integration into Narchiv's Usenet archive
    is not preserved.

    taf

    yes i found this too, but i've also found this in what i call the google archive. I dunno where narchive copied the messages from, but there are duplicate posts and threads in the google archiv and, overlapping
    threads, which seem to be a mix of GEN-MED and sgm. I dunno how this
    stuff worked, but when you search the google archive, you often find
    this duplication and end up going round in circles.

    mike

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From miked@21:1/5 to miked on Wed Apr 9 16:34:45 2025
    On Tue, 8 Apr 2025 0:17:12 +0000, miked wrote:

    On Thu, 27 Mar 2025 18:33:45 +0000, taf wrote:

    On 3/26/2025 4:40 PM, miked wrote:
    i thought there was a site called narkive that was doing exactly that
    with all the usenet groups including sgm. It has the advantage over
    google in that it is still updating, although the user interface to my
    mind is rather unhelpful.
    Narchiv does host a Usenet archive, and if you dig into their site
    deeply enough, you will find a request that anyone with their own
    collection of Usenet posts not already on Narchiv submit them for
    inclusion. However, there is a problem.

    At least some of the archives of this group that people have been
    talking about aren't actually for soc.genealogy.medieval. They are
    instead archives of its sister gatewayed mailing list GEN-MEDIEVAL,
    which contained (mostly) the same content in an email format. Denis and
    Adrian are talking about Digests elsewhere in this thread - that is a
    GEN-MEDIEVAL thing, not a soc.gen.med thing. These will have mailing
    list headers rather than Usenet headers, and I don't know whether it is
    possible for a script to convert one to the other, or if instead some of
    the information necessary for integration into Narchiv's Usenet archive
    is not preserved.

    taf

    yes i found this too, but i've also found this in what i call the google archive. I dunno where narchive copied the messages from, but there are duplicate posts and threads in the google archiv and, overlapping
    threads, which seem to be a mix of GEN-MED and sgm. I dunno how this
    stuff worked, but when you search the google archive, you often find
    this duplication and end up going round in circles.

    miKE

    For the few wondering where these archives are

    https://sites.rootsweb.com/~medieval/ https://soc.genealogy.medieval.narkive.com/ https://groups.google.com/g/soc.genealogy.medieval [stops after Feb 22
    2024.]

    mike

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)