Folder symbol..

V

VanguardLH

Nil said:
And hoping that disk #13 hadn't become corrupt or demagnatized...
Actually all magnetic storage media suffer dipole stress. The dipoles
want to realign to minimize the force between them and this results in
error in reading the bits. I remember using GRC's SpinRite with its
refresh ability that reads the bits, wipes the sectors, rewrites them,
wipes them, and then returns the data and checks it's okay all to
eliminate the soft errors due to dipole stress. Reading a file doesn't
rewrite its bits so eventually all non-modified files become unreadable.

However, I don't ever keep my hard disks around longer than around 10
years so I haven't much need for SpinRite anymore (and it's cost is
greater than buying a whole new disk in case the old one is going dead -
rather than revive, I just replace). Floppies are easy to refresh just
by copying off the files, format, and write them back (or just do floppy
to floppy copying).

However, once the data has become corrupted through dipole stress, it
may not be recoverable even when using SpinRite. It's too muddied.
 
N

Nil

Actually all magnetic storage media suffer dipole stress.
I suppose that's true, although I've never found found a hard disk
that failed in a way I would attribute to that. It's usually a
mechanical failure. I do have a few very old ones in storage that
I'm sometimes curious to see if they can still be read, but not
enough to actually try it, yet.

I've got tons of diskettes that have gone bad just sitting there,
and they're not all that old.
Floppies are easy to refresh just by copying off the files,
format, and write them back (or just do floppy to floppy copying).
Most of the old diskettes in my collection that still have some
value to me, I've made images of them and stored them to hard disk
and/or CDR. Never know when I'll need that old copy of MS-DOS 3.0 or
dBase.
 
B

BillW50

Actually all magnetic storage media suffer dipole stress. The dipoles
want to realign to minimize the force between them and this results in
error in reading the bits. I remember using GRC's SpinRite with its
refresh ability that reads the bits, wipes the sectors, rewrites them,
wipes them, and then returns the data and checks it's okay all to
eliminate the soft errors due to dipole stress. Reading a file doesn't
rewrite its bits so eventually all non-modified files become unreadable.

However, I don't ever keep my hard disks around longer than around 10
years so I haven't much need for SpinRite anymore (and it's cost is
greater than buying a whole new disk in case the old one is going dead -
rather than revive, I just replace). Floppies are easy to refresh just
by copying off the files, format, and write them back (or just do floppy
to floppy copying).

However, once the data has become corrupted through dipole stress, it
may not be recoverable even when using SpinRite. It's too muddied.
OH BOY! I remember that the National Bureau of Standards tested this
theory back I believe in the 90's. And they had found no truth to this
theory.

I did my own tests and I found like 5% of floppies this was true and the
other 95% it wasn't. The 5% was odd too. They would pass being formatted
on a Commodore 8-bit computer. But what you had stored on them would
fade away in 6 months. Rewriting them they were good for another 6
months and then fade away at the same track and sectors.

Although if formatted under MS-DOS, they would instantly fail.
Apparently MS-DOS saw right through the flaky floppies while Commodore
apparently thought they were just fine. I am sure I tried formatting
these disks under CP/M too, but I don't recall what happened there.

What the National Bureau of Standards stated did make a lot of sense.
They stated that magnetic data requires a huge magnetic field to change
anything on a disk. And the magnetic material on the disk itself is way
to weak to change any data right next to it. And in my tests, this was
indeed true. And only a manufacturing defect changed things.
 
C

Char Jackson

Actually all magnetic storage media suffer dipole stress. The dipoles
want to realign to minimize the force between them and this results in
error in reading the bits. I remember using GRC's SpinRite with its
refresh ability that reads the bits, wipes the sectors, rewrites them,
wipes them, and then returns the data and checks it's okay all to
eliminate the soft errors due to dipole stress. Reading a file doesn't
rewrite its bits so eventually all non-modified files become unreadable.
Sounds like you're describing data rot, bit rot, or any number of
other names for the same thing, right?

<http://en.wikipedia.org/wiki/Data_Rot>
 
B

BillW50

I suppose that's true, although I've never found found a hard disk
that failed in a way I would attribute to that. It's usually a
mechanical failure. I do have a few very old ones in storage that
I'm sometimes curious to see if they can still be read, but not
enough to actually try it, yet.
Old MFM hard drives from the 80's were flaky at any rate. It was hard to
keep them running more than a few years.

IDE hard drives changed everything. Totally different technology. My
first one was one of the first 2.5 inch IDE hard drive I ever saw. I
bought one and that one failed to spin up within a week. Got a
replacement from the manufacture and that one had labels on it that said
PROTOTYPE and the factory seals were broken. Plus there was about 30 bad
sectors on it.

So I called them up. And back then the customer support line was still
manned by *real* engineers! I loved that! Anyway I gave him hell for
sending me this drive. He asked if it was still working? I said yes. He
then asked anymore new bad sectors showing up? And I said no. Then he
said don't worry about it until it does. I was now speechless.

Well the dang thing still works fine to this very day. I haven't written
anything to it in over 15 years (just read it). And not a single extra
bad sector even showed up. So I don't think you have to worry about the
media on the disc(s).

Those places that recover hard drives have learned that some
manufacturing processes by some manufactures this isn't always true. As
sometimes they change something in the formula and sometimes the
magnetic media can crack, flake, etc. But these are usually the
exception to the rule.
I've got tons of diskettes that have gone bad just sitting there,
and they're not all that old.
It can happen. Most of the time it is a manufacturing defect. Although
the substrate can only hold the material together just so long. I have
thousands of disks that are over 30 years old. I haven't tested them
lately, so I don't know how well they are holding up today.

Another thing that shortens a floppy's life is wear. I have found if say
you are using one for booting for example. They can handle this for
about 300 to 500 boots. But you have the head and the jacket rubbing
against the disk. So depending how often you use a disk, you could wear
one out in 6 months or so period of time.
 
S

Seth

VanguardLH said:
Junctions weren't created to support legacy apps. They're used by
recent apps, too.
Didn't say that's why they were created for that purpose just pointing out
the most user noticeable item that requires them. There are plenty of
reasons to keep and use them but for most users "Doing X will stop your 8
year old version of software Y from working" is usually argument enough for
keeping them.
 
B

BillW50

Didn't say that's why they were created for that purpose just pointing
out the most user noticeable item that requires them. There are plenty
of reasons to keep and use them but for most users "Doing X will stop
your 8 year old version of software Y from working" is usually argument
enough for keeping them.
See... I don't get that? Why create new folders that never existed
before in earlier NT Windows anyway? That way you wouldn't need to use
silly junctions in the first place, am I right?
 
B

BillW50

In
BillW50 said:
IDE hard drives changed everything. Totally different technology. My
first one was one of the first 2.5 inch IDE hard drive I ever saw. I
bought one and that one failed to spin up within a week. Got a
replacement from the manufacture and that one had labels on it that
said PROTOTYPE and the factory seals were broken. Plus there was
about 30 bad sectors on it.

So I called them up. And back then the customer support line was still
manned by *real* engineers! I loved that! Anyway I gave him hell for
sending me this drive. He asked if it was still working? I said yes.
He then asked anymore new bad sectors showing up? And I said no. Then
he said don't worry about it until it does. I was now speechless.

Well the dang thing still works fine to this very day. I haven't
written anything to it in over 15 years (just read it). And not a
single extra bad sector even showed up. So I don't think you have to
worry about the media on the disc(s).
P.S. I forgot to mention I bought this drive back in '91.
 
V

VanguardLH

Char said:
Sounds like you're describing data rot, bit rot, or any number of
other names for the same thing, right?

<http://en.wikipedia.org/wiki/Data_Rot>
"bits lose magnetic orientation". That's the dipole stress of which I
spoke. Different materials have different rates of magnetic decay.
Rust is not a crystalline material to permanently fix the dipole (but
which are still suspect to shock and temperature).

Folks also save data on (burn it to) recordable CDs or DVDs. Yet the
technology to press masters with pits is not the same as the chemical
change produced by heat via lasers. That's why you can leave a
commercially pressed music CD and your burned copy on a recordable CD in
your car and those hot days to which they are exposed inside the
confines of your closed parked vehicle result in the later becoming too
corrupted to read properly any longer. There are archive-rated optical
media to store data for 100 to 200 years but that's not the writable
CD/DVD/BluRay stuff that consumers are using.

Permanence of data is often something not considered for more than maybe
a decade. That was the attitude when films were created but the acetate
degraded over time from self destruction. Unless important data is
repeatedly transfered to new media or the old media retested and
refreshed, it will disappear from all that rust- and chemically-based
storage media.
 
V

VanguardLH

BillW50 said:
OH BOY! I remember that the National Bureau of Standards tested this
theory back I believe in the 90's. And they had found no truth to this
theory.
You've obviously never been in charge of a data archive where, for
example, a company saves its testing scripts, procedures, documents, and
results on hard disks or tapes. Unlike magnets where their effect is
fixed by crystalline structure, dipoles in rust will decay. "Soft"
materials used for recording won't hold their state indefinitely.
I did my own tests and I found like 5% of floppies this was true and the
other 95% it wasn't. The 5% was odd too. They would pass being formatted
on a Commodore 8-bit computer. But what you had stored on them would
fade away in 6 months. Rewriting them they were good for another 6
months and then fade away at the same track and sectors.
Floppies degrade faster because of the physical wear presented to them
by the heads actually rubbing against the recording media (rust). They
aren't hermetically sealed so the media and heads get dirty and that
filth damages both media and heads. The media also moves which also
flexes the "soft" recording material (rust).
Although if formatted under MS-DOS, they would instantly fail.
Apparently MS-DOS saw right through the flaky floppies while Commodore
apparently thought they were just fine. I am sure I tried formatting
these disks under CP/M too, but I don't recall what happened there.

What the National Bureau of Standards stated did make a lot of sense.
They stated that magnetic data requires a huge magnetic field to change
anything on a disk. And the magnetic material on the disk itself is way
to weak to change any data right next to it. And in my tests, this was
indeed true. And only a manufacturing defect changed things.
That's a different issue regarding corruption of magnetically stored
data. That's where you are concerned about actually changing alignment
of dipoles by influence of a higher magnetic field (like the one used to
record the bits in the first place). I'm talking about dipole stress on
data that is never again rewritten. The loss will still occur with the
tape or disk stored in a vault with shielding around each tape or disk
with humidity and temperature control and without any physical shock
experienced by the media (all of which are other causes for loss of
data).

Perhaps you think a decade is longer than anyone wants to save data. As
I recall, actuarial data used by insurance companies must be retained
for a minimum of 50 years. What good would electronically stored data
(on rust) be for geneology information about you if it didn't outlive
you and your decendants? There are writable optical discs claimed to
retain data for 200 years but that's not forever and only if the discs
are stored under ideal conditions in an ideal vault storage space. In a
home or office, the data would survive maybe 100 years for the best
rated discs (only 30 years for consumer-grade media). Even after 100 or
200 years, would you really want all history that was electronically
recorded to fade away after a couple centuries? You really think anyone
would trust history saved on hard disks for more than 30 years, if even
that long? It WILL have to be rewritten (refreshed) to retain that data
(and probably to something other than optical discs by then).

Rust-based recording media doesn't have anywhere near that longevity for
uncorrupted data retention. Of course, another factor for why hard
disks are not good for long data retention is that them being idle for
so long often results in them siezing. They won't spin when powered up.
When the mechanicals fail, the hard disk is useless and you need a lab
to read from the platters. Removable media can be used by a different
drive when the old drive's mechanicals happen to fail. Hard disks still
have the advantage of higher data volume storage but they'll have to be
refreshed at shorter intervals.
 
V

VanguardLH

BillW50 said:
In

P.S. I forgot to mention I bought this drive back in '91.
Have you ever tested your theory that the hard disk is still usable?
Unless you do a sector-by-sector clone of the hard disk to ensure that
all bits on it are readable (and with no errors), you don't know. Also
remember that the OS will retry failed reads as well as the interface
logic on the hard disk itself. I forget the tool (if it wasn't
SpinRite) that let me see just how may retries there were so it became
visible just how "soft" a cluster might become over time.
 
B

BillW50

Have you ever tested your theory that the hard disk is still usable?
Unless you do a sector-by-sector clone of the hard disk to ensure that
all bits on it are readable (and with no errors), you don't know. Also
remember that the OS will retry failed reads as well as the interface
logic on the hard disk itself. I forget the tool (if it wasn't
SpinRite) that let me see just how may retries there were so it became
visible just how "soft" a cluster might become over time.
I have no problem testing my theory at all. And I can't think of
anything on it that I would want to keep. And it is only a 10MB IDE hard
drive anyway. And that is nothing to store on something else today.

I have known about SpinRite for many years. Although I never bothered
with it. As I have my own testing measures for hard drives. And as far
as I am concern they either work 100% or they are junk if they preform
anything less.

So when I have some time to kill, I'll let you know what I find and run
it through the paces. I am sure the speed can't be very much. Since it
is the first IDE drive I ever owned. The earlier drives I had before
were all MFM hard drives and they just didn't last very long.
 
B

BillW50

You've obviously never been in charge of a data archive where, for
example, a company saves its testing scripts, procedures, documents, and
results on hard disks or tapes. Unlike magnets where their effect is
fixed by crystalline structure, dipoles in rust will decay. "Soft"
materials used for recording won't hold their state indefinitely.
Nope, you are right. I never was in charge of data archiving. Although I
do have my own archives that has been around for 30 years now. So I
think that stands for something. ;-)
Floppies degrade faster because of the physical wear presented to them
by the heads actually rubbing against the recording media (rust). They
aren't hermetically sealed so the media and heads get dirty and that
filth damages both media and heads. The media also moves which also
flexes the "soft" recording material (rust).
Yes of course. And with use, I have found that you can boot from a
floppy about 300 to 500 times and then that disk would become useless.
The data sheets I saw, said something more like 800 times. But I think
they were just being wishful on their part. Maybe if you did this within
a week's time, you might get it lasting about 800 times.
That's a different issue regarding corruption of magnetically stored
data. That's where you are concerned about actually changing alignment
of dipoles by influence of a higher magnetic field (like the one used to
record the bits in the first place). I'm talking about dipole stress on
data that is never again rewritten. The loss will still occur with the
tape or disk stored in a vault with shielding around each tape or disk
with humidity and temperature control and without any physical shock
experienced by the media (all of which are other causes for loss of
data).
Yes, but my tests had shown that this is only possible with a
manufacturing defect. Then it can and does happen. And oddly enough, the
Bureau of Standards never saw any of this.
Perhaps you think a decade is longer than anyone wants to save data. As
I recall, actuarial data used by insurance companies must be retained
for a minimum of 50 years. What good would electronically stored data
(on rust) be for geneology information about you if it didn't outlive
you and your decendants? There are writable optical discs claimed to
retain data for 200 years but that's not forever and only if the discs
are stored under ideal conditions in an ideal vault storage space. In a
home or office, the data would survive maybe 100 years for the best
rated discs (only 30 years for consumer-grade media). Even after 100 or
200 years, would you really want all history that was electronically
recorded to fade away after a couple centuries? You really think anyone
would trust history saved on hard disks for more than 30 years, if even
that long? It WILL have to be rewritten (refreshed) to retain that data
(and probably to something other than optical discs by then).
Well I think it is pretty easy to keep data for as long as you want. As
I have data kept for 30 years now.
Rust-based recording media doesn't have anywhere near that longevity for
uncorrupted data retention. Of course, another factor for why hard
disks are not good for long data retention is that them being idle for
so long often results in them siezing. They won't spin when powered up.
When the mechanicals fail, the hard disk is useless and you need a lab
to read from the platters. Removable media can be used by a different
drive when the old drive's mechanicals happen to fail. Hard disks still
have the advantage of higher data volume storage but they'll have to be
refreshed at shorter intervals.
Speaking about hard drives, I've known since virtually day one that any
hard drive can fail at anytime. Most don't though, thank goodness. And
if you want to use hard drives to keep your important data, I would
never trust a single hard drive to do so. I would keep at least two hard
drives to store cloned copies of each other at least. That is what I do.
And the really important stuff I keep on five hard drives at least.

I my own personal experience, my hard drive failure rate is 14.286%
overtime. I have seen two other studies that show their failure rate was
better than mine. Although their's was over a much shorter period of
time. So that and they didn't test consumer grade hard drives like I
did, but commercial grade hard drives which are far more expensive than
what I buy to test.

If you want to talk about other media for storage, well in my experience
tape format is one of the worst (consumer grade anyway). As the tape
tends to stretch and becomes unreadable.

Floppy disks as I mentioned, most are fine overtime while a small
percentage can't even hold data for more than 6 months. I really don't
know how long they can last, but I have tons of them over 30 years old
that I should test one of these days. I did test some of them about 5
years ago and they were still just fine.

As for optical discs like CDs and DVDs. Well those RW formats are the
worst. DON'T STORE ANYTHING WORTH SAVING ON THOSE! As in 5 to 10 years I
don't think there would be much readable on them. The R format are much
better. Although I haven't tested them much either and I don't know how
far you can trust them.

The ROM format is the king as far as longevity in the optical disc
format. I don't think anybody really knows how long they can last. As
you said they claim 200 years, but nobody had one that long yet. And I
don't put too much stock in any of those claims until the real data
actually starts coming in.

Other formats like EEPROMs and flash drives, they say can hold data for
about ten years. You can rewrite them of course for another ten years.
Although I think this figure is very conservative. As I programmed some
EEPROMs myself back in the late 80's that are still perfectly readable
today. The oldest flash drive I have is about 10 years old (without
rewrites) and it too is still readable.
 
V

VanguardLH

BillW50 said:
Nope, you are right. I never was in charge of data archiving. Although I
do have my own archives that has been around for 30 years now. So I
think that stands for something. ;-)


Yes of course. And with use, I have found that you can boot from a
floppy about 300 to 500 times and then that disk would become useless.
The data sheets I saw, said something more like 800 times. But I think
they were just being wishful on their part. Maybe if you did this within
a week's time, you might get it lasting about 800 times.


Yes, but my tests had shown that this is only possible with a
manufacturing defect. Then it can and does happen. And oddly enough, the
Bureau of Standards never saw any of this.


Well I think it is pretty easy to keep data for as long as you want. As
I have data kept for 30 years now.


Speaking about hard drives, I've known since virtually day one that any
hard drive can fail at anytime. Most don't though, thank goodness. And
if you want to use hard drives to keep your important data, I would
never trust a single hard drive to do so. I would keep at least two hard
drives to store cloned copies of each other at least. That is what I do.
And the really important stuff I keep on five hard drives at least.

I my own personal experience, my hard drive failure rate is 14.286%
overtime. I have seen two other studies that show their failure rate was
better than mine. Although their's was over a much shorter period of
time. So that and they didn't test consumer grade hard drives like I
did, but commercial grade hard drives which are far more expensive than
what I buy to test.

If you want to talk about other media for storage, well in my experience
tape format is one of the worst (consumer grade anyway). As the tape
tends to stretch and becomes unreadable.

Floppy disks as I mentioned, most are fine overtime while a small
percentage can't even hold data for more than 6 months. I really don't
know how long they can last, but I have tons of them over 30 years old
that I should test one of these days. I did test some of them about 5
years ago and they were still just fine.

As for optical discs like CDs and DVDs. Well those RW formats are the
worst. DON'T STORE ANYTHING WORTH SAVING ON THOSE! As in 5 to 10 years I
don't think there would be much readable on them. The R format are much
better. Although I haven't tested them much either and I don't know how
far you can trust them.

The ROM format is the king as far as longevity in the optical disc
format. I don't think anybody really knows how long they can last. As
you said they claim 200 years, but nobody had one that long yet. And I
don't put too much stock in any of those claims until the real data
actually starts coming in.

Other formats like EEPROMs and flash drives, they say can hold data for
about ten years. You can rewrite them of course for another ten years.
Although I think this figure is very conservative. As I programmed some
EEPROMs myself back in the late 80's that are still perfectly readable
today. The oldest flash drive I have is about 10 years old (without
rewrites) and it too is still readable.
What I forgot to mention is that companies that have to archive for
several decades or longer also store the drives in the vault (with the
removable media) or a complete host (mobo, CPU, min memory, OS, backup
app, and drives) to ensure that technology changes don't render the
archival media useless. Remember the old Pelican 8" floppy drives.
Then there are several formats for tape. Don't know anyone still
archiving punch cards but with the hardware to read them then they are
just bookmarkers. MFM, ATA, SATA have or will fade away as new
techonologies replace them.

I remember one company that I worked for had an archive of all their old
tests. You'd be surprised how often a customer using an ancient version
of the product - but still paying for support - wanted to have something
retested for that old version. The tapes, disks, and discs in a couple
cases weren't usable because the drives no longer worked, we no longer
had the hardware base platform in which to install them and we didn't
have time searching around for some hardware archive that had the
required hardware, we couldn't get the exact version of the OS with any
service pack and updates, and so on. We had the backups but no longer
any means of reproducing the exact hardware platform in which they were
used to perform the testing back then. That's when the company decided
they needed to save a host for each major version release along with the
hard disk or optical discs so we had the exact same state of hardware,
OS, and other software. We had to get a bigger vault.
 

Ask a Question

Want to reply to this thread or ask your own question?

You'll need to choose a username for the site, which only take a couple of moments. After that, you can post your question and our members will help you out.

Ask a Question

Top