I have a couple of Pis which run all the time, one is the DNS server
for our home LAN the other is a 'NAS' in the garage. So they're on
all the time but not particularly hard worked.
Over the past year or so both of them have failed once with some sort
of corruption of the micro-SD card. Not life-threatening by any means
but quite annoying and both took quite a while (like half a day) to
restore and get back to fully configured and working.
So I'm wondering how to either find extra reliable SD cards or to
change to something else such as a USB disk (on of the two systems is
a Pi 4 so that one at least is easy to boot from USB).
The storage can be tiny by modern standards, a 4Gb SD card would be
perfectly OK.
So what does the panel suggest? Preferably cheap! :-)
On 12/12/2021 18:03, Chris Green wrote:
I have a couple of Pis which run all the time, one is the DNS server
for our home LAN the other is a 'NAS' in the garage. So they're on
all the time but not particularly hard worked.
Over the past year or so both of them have failed once with some sort
of corruption of the micro-SD card. Not life-threatening by any means
but quite annoying and both took quite a while (like half a day) to
restore and get back to fully configured and working.
So I'm wondering how to either find extra reliable SD cards or to
change to something else such as a USB disk (on of the two systems is
a Pi 4 so that one at least is easy to boot from USB).
The storage can be tiny by modern standards, a 4Gb SD card would be
perfectly OK.
So what does the panel suggest? Preferably cheap! :-)
For my music/video system (Pi3), I have 128Mb SD card (FAT, boot)
booting to a 128Gb USB SSD (ext4, root) and a 5Tb powered USB HDD NTFS
as /media. It's been running for years with no problems.
Just changed the cmdline.txt file root=UUID= to point to the SSD partition.
I have a couple of Pis which run all the time, one is the DNS server for
our home LAN the other is a 'NAS' in the garage. So they're on all the
time but not particularly hard worked.
Over the past year or so both of them have failed once with some sort of corruption of the micro-SD card. Not life-threatening by any means but
quite annoying and both took quite a while (like half a day) to restore
and get back to fully configured and working.
So I'm wondering how to either find extra reliable SD cards or to
change to something else such as a USB disk (on of the two systems is
a Pi 4 so that one at least is easy to boot from USB).
The storage can be tiny by modern standards, a 4Gb SD card would be
perfectly OK.
So what does the panel suggest? Preferably cheap! :-)
So I'm wondering how to either find extra reliable SD cards or to
change to something else such as a USB disk (on of the two systems is
a Pi 4 so that one at least is easy to boot from USB).
So what does the panel suggest? Preferably cheap! :-)
On 2021-12-12, Chris Elvidge <chris@mshome.net> wrote:
On 12/12/2021 18:03, Chris Green wrote:
I have a couple of Pis which run all the time, one is the DNS server
for our home LAN the other is a 'NAS' in the garage. So they're on
all the time but not particularly hard worked.
Over the past year or so both of them have failed once with some sort
of corruption of the micro-SD card. Not life-threatening by any means
but quite annoying and both took quite a while (like half a day) to
restore and get back to fully configured and working.
So I'm wondering how to either find extra reliable SD cards or to
change to something else such as a USB disk (on of the two systems is
a Pi 4 so that one at least is easy to boot from USB).
The storage can be tiny by modern standards, a 4Gb SD card would be
perfectly OK.
So what does the panel suggest? Preferably cheap! :-)
For my music/video system (Pi3), I have 128Mb SD card (FAT, boot)
booting to a 128Gb USB SSD (ext4, root) and a 5Tb powered USB HDD NTFS
as /media. It's been running for years with no problems.
Just changed the cmdline.txt file root=UUID= to point to the SSD partition.
Yes I have a home server Pi3B - imap, DNS, NTP, NFS, SMTP, web, syslog, backup etc server....
19:47 root@mercury:~# uptime
19:47:03 up 641 days, 23:06, 1 user, load average: 0.13, 0.05, 0.15
under a similar scheme, but with a spinning USB HD. The SD card's boot partition is mounted ReadOnly to protect it from corruption, and I keep
a backup copy of the root filesystem of the USB HD on the SD card copied every week by a script that mounts the SD ext4fs rsyncs then unmounts it
- again to protect the SD card.
If I need to upgrade the OS and there is a chance the boot code might be upgraded I remount that partition readwrite for the upgrade only.
I'm commisioning a Pi4 as a replacement with 2 USB3 Attached HDs. The
extra throughput on USB3 and Gigabit ethernet will make the backups go a
lot quicker. Other things just work a charm.
On Sun, 12 Dec 2021 18:03:45 +0000, Chris Green wrote:
I have a couple of Pis which run all the time, one is the DNS server for our home LAN the other is a 'NAS' in the garage. So they're on all the time but not particularly hard worked.
Over the past year or so both of them have failed once with some sort of corruption of the micro-SD card. Not life-threatening by any means but quite annoying and both took quite a while (like half a day) to restore
and get back to fully configured and working.
A good, reliable way to corrupt an SD card is to have a power outage, or
even just a glitch while the card is being written to. This is part of
the design of SD cards - they were designed to be cheap and are not
really designed to replace an HDD or SDD - the job they were designed for
is one where writing to the card is FAR less frequent than reading it.
Short answer - there is no super-reliable SD card.
Solutions - in no particular order are:
1) Use a cheap SSD, but many of these may also get corrupted
if there's a power fail while the SSD is being written to.
2) build or purchase a small UPS for the Pi. Designs and Pi-HAT UPS
products are available.
3) Assuming that you update the Pi's software every week or so,
Back up the Pi's SD card using rsync. Rsync is reliable, fast
and can write the backup, via the link you use to talk to the
Pi, onto backup media attached to your your main computer(s).
Make the backup immediately before you do the software update.
I use a pair of Western Digital Elements USB-connected 1GB hard drives to
If I need to upgrade the OS and there is a chance the boot code might be
upgraded I remount that partition readwrite for the upgrade only.
I'm commisioning a Pi4 as a replacement with 2 USB3 Attached HDs. The
extra throughput on USB3 and Gigabit ethernet will make the backups go a
lot quicker. Other things just work a charm.
OP here. My 'NAS' is an early Pi 4, only 1Gb memory. It has an 8TB
USB drive as the backup drive and just the standard micro USB as
everything else.
I have backups of everything that's extra/non standard so when it died yesterday it was [fairly] easy to reinstate but I'd prefer not to have--- SoupGate-Win32 v1.05
to do it again.
a Pi 4 so that one at least is easy to boot from USB).
The storage can be tiny by modern standards, a 4Gb SD card would be perfectly OK.
So what does the panel suggest? Preferably cheap! :-)
Yes, but how do you tell the difference between a 'cheap SSD' and a USB
stick that is essentially just an[other] SD card?
3) Assuming that you update the Pi's software every week or so,All my backups *to* the Pi NAS use rsync already, I use rsync
Back up the Pi's SD card using rsync. Rsync is reliable, fast and
can write the backup, via the link you use to talk to the Pi, onto
backup media attached to your your main computer(s). Make the backup
immediately before you do the software update.
everywhere. I don't have an image of the Pi software but I can restore fairly quickly, that's why it only took a few hours to sort things out
when it died.
Are you sure about those units? I would suspect those are 1TB
drives.
On Sun, 12 Dec 2021 21:45:32 +0000, Chris Green wrote:
Yes, but how do you tell the difference between a 'cheap SSD' and a USB stick that is essentially just an[other] SD card?
You dont and cant. Short answer, like for SD cards, only buy them from reputable sources.
I have a SanDisk 128 GB SSD in a Lenovo R16i which just sits there and
does its thing: no problems after several years, the last two spent
running protein folding software 24/7. Its original disk was a Hitachi
120GB HDD that failed at around the 37000 hours mark. So, it was either
fit the SanDisk 128 GB SSD or junk the laptop because its disk interface hardware doesn't support disks of more than 200GB: I know that because it would not accept a 500GB WD drive and a search of its manual didn't show acceptable replacement disks of over 250GB and, by the time the Hitachi
went titsup you couldn't buy a hard disk smaller than 320GB.
3) Assuming that you update the Pi's software every week or so,All my backups *to* the Pi NAS use rsync already, I use rsync
Back up the Pi's SD card using rsync. Rsync is reliable, fast and
can write the backup, via the link you use to talk to the Pi, onto
backup media attached to your your main computer(s). Make the backup
immediately before you do the software update.
everywhere. I don't have an image of the Pi software but I can restore fairly quickly, that's why it only took a few hours to sort things out
when it died.
Excellent. rsyncing 'live' disks to a set of at least 2 offline backup
disks, stored offline, preferably in a firesafe or other building is
about as good as it gets.
If I need to upgrade the OS and there is a chance the boot code might be >> upgraded I remount that partition readwrite for the upgrade only.
I'm commisioning a Pi4 as a replacement with 2 USB3 Attached HDs. The
extra throughput on USB3 and Gigabit ethernet will make the backups go a >> lot quicker. Other things just work a charm.
OP here. My 'NAS' is an early Pi 4, only 1Gb memory. It has an 8TB
USB drive as the backup drive and just the standard micro USB as
everything else.
I'd suggest partitioning the 8TB disk to have a root partition.
Essentially a copy of the root image on the SD card, then do what
someone else said, change the cmdline.txt file to specify the uuid of
this partition at the root file system.
Alter /etc/fstab to make /boot on the SD card to be mounted readonly.
Don't mount anything alse on the SDcard by default.
If the power goes unexpectedly then as the SD card has no writes is
won't get corrupted. THe root partition on the spinner will get dirty,
but under most circumstances it won't be corrupted too badly. Disconnet
plug into another linux box - run fsck to correct problems - return
to pi and all should be ok.
Hello Chris!
12 Dec 21 18:03, you wrote to All:
a Pi 4 so that one at least is easy to boot from USB).
The storage can be tiny by modern standards, a 4Gb SD card would be perfectly OK.
So what does the panel suggest? Preferably cheap! :-)
When using SSD cards, do not use the cheapest ypou can find. Buy one that
is really oversised and run "sudo fstrim -av" at regular intervals, e.g.
once a week.
I have 2;280/5006 running for a couple of years now. If I remember well,
I only had to replace the SSD card once. That was before I started using
fsrim.
I have a couple of Pis which run all the time, one is the DNS server
for our home LAN the other is a 'NAS' in the garage. So they're on
all the time but not particularly hard worked.
Over the past year or so both of them have failed once with some sort
of corruption of the micro-SD card. Not life-threatening by any means
but quite annoying and both took quite a while (like half a day) to
restore and get back to fully configured and working.
So I'm wondering how to either find extra reliable SD cards or to
change to something else such as a USB disk (on of the two systems is
a Pi 4 so that one at least is easy to boot from USB).
The storage can be tiny by modern standards, a 4Gb SD card would be
perfectly OK.
So what does the panel suggest? Preferably cheap! :-)
of the micro-SD card. Not life-threatening by any means but
quite annoying and both took quite a while (like half a day) to restore and get back to fully configured and working.
A good, reliable way to corrupt an SD card is to have a power outage, or even just a glitch while the card is being written to. This is part of
the design of SD cards - they were designed to be cheap and are not
really designed to replace an HDD or SDD - the job they were designed for
is one where writing to the card is FAR less frequent than reading it.
Short answer - there is no super-reliable SD card.
Solutions - in no particular order are:
Kees van Eeten <nospam.Kees.van.Eeten@p4.f5003.n280.z2.fidonet.org> wrote:
Hello Chris!Doesn't running fstrim effectively try and outguess the SSD's built in
12 Dec 21 18:03, you wrote to All:
a Pi 4 so that one at least is easy to boot from USB).
The storage can be tiny by modern standards, a 4Gb SD card would be
perfectly OK.
So what does the panel suggest? Preferably cheap! :-)
When using SSD cards, do not use the cheapest ypou can find. Buy one that >> is really oversised and run "sudo fstrim -av" at regular intervals, e.g.
once a week.
I have 2;280/5006 running for a couple of years now. If I remember well,
I only had to replace the SSD card once. That was before I started using
fsrim.
wear levelling?
I have a couple of Pis which run all the time, one is the DNS server
for our home LAN the other is a 'NAS' in the garage. So they're on
all the time but not particularly hard worked.
Yes, but how do you tell the difference between a 'cheap SSD' and a
USB stick that is essentially just an[other] SD card?
Sysop: | Keyop |
---|---|
Location: | Huddersfield, West Yorkshire, UK |
Users: | 418 |
Nodes: | 16 (2 / 14) |
Uptime: | 23:27:08 |
Calls: | 8,804 |
Calls today: | 2 |
Files: | 13,304 |
Messages: | 5,970,205 |