"Backups" aren't just "copying files"...

The technical section

Moderator: Global Moderators

Dz

"Backups" aren't just "copying files"...

Post by Dz » Sat Dec 18, 2004 11:26 am

When is a backup not really a backup at all?
  • When it is copied to the same physical hard drive you seek to protect from a crash.
  • When it depends upon a windows (graphical) program before it can be restored.
  • When it depends upon a windows driver (.DLLs and others) in order to access some external-storage device where the backup resides.
  • When it has not been accomplished via a "backup/restore" program, and isn't much more than a copy of non-system files.
  • When it is stored on a remote internet or network site that you can't reach until windows is once again operational.
The windows knowledge base of "helpful hints", for example:
http://support.microsoft.com/kb/322756
doesn't address the idea at all that backups of any type (and the above deals only with a small registry backup) - MUST be stored externally to the physical hard drive - on:
  • a backup tape
  • dozens of writeable CDs (or a few DVDs)
  • hundreds of floppy disks
  • a removeable hard disk
  • or a remote internet/network site that you can access by booting from a floppy disk or CD - usually in a white-on-black text screen.
Complicating things is the fact that no longer will the latest bloated versions of basic "windows files" even fit on a single floppy disk or writeable CD.
Not by pointing and clicking, anyway.

The next installment will attempt to address this problem. Fortunately, it is solvable, with only a little work (and perhaps a little learning about methods that have existed for nearly 20 years...).

.

Dz

2. Windows Backup Bag of Tricks

Post by Dz » Mon Dec 20, 2004 8:12 pm

In addition to the common files, directories, and "folders" we all use on a daily basis, backup programs and their associated devices also function among a nether world of almost-unreachable boot records, file-allocation "maps", attributes, and virtual operating systems.

These are truly low-level files - far below the "hidden", "system", and "registered" files which a default windows installation tries to hide from you. (Those who have never selected their C: drive in "My Computer", and clicked on View/Options/"View" tab, should do so now. Click on "Show all files" and "Display full path in title bar", then Un-click any option containing the word "Hide" to remove the default blindfolds. You'll be very surprised to finally see all of the files windows was using behind your back...)

With files no longer hidden from your view, you still can't see the critical low-level stuff; neither windows nor the lower-level DOS can directly access these profoundly-important file areas. But hackers can, via their malicious coding.

Why should you have these hidden files made visible? ANS: Even a homemade "copying" scheme (which some might think is a true backup of files) can require inclusion of hidden or system files. If you can't see them, you can't copy them.

Backup Devices

For decades, an often-expensive tape drive has been the standard for backups. Other means have been developed for backups, too: large-capacity removeable disks, CD-ROMS and DVDs, etc. - but few of these offered the unattended convenience of a tape backup, scheduled at some time when you are not using your computer. Hardware schemes of writing everything to two or more hard drives at once are an expensive way of having an instant backup if one disk has a hardware failure - but such systems have a major fault: an undetected virus which destroys the data on one disk will destroy them all.

However, just as RAM memory prices have fallen, so too have hard disk prices. Installing a second clone of your current hard disk into your computer is today a lot less expensive than most other means of creating a good backup. "Ghosting" programs (many of them completely free of cost, provided by hard drive manufacturers) will write an entire IMAGE of your main hard drive to the clone, on command - and do so much faster than any tape drive. Shopping around, one can find good 20-80 GB hard drives for about the same cost as a good CD or DVD-burner. (Under $70, US.)

An example scenario: Once a week, disconnect your network connection, reboot your machine and run your favorite frequently-updated third-party (that is, non-microsoft) virus checker, along with the freeware "Ad-Aware" or "Spybot Search and Destroy" programs to be reasonably certain that no malicious code exists on your hard disk. You're finally ready to make a "ghost" image of the entire thing to your second drive.

The next installment will cover where you can get these FREE programs, and how to use them effectively, regardless of the device you use for your backups - even if it is only a floppy drive. (You already possess some of them - but may not have ever tried them.)

By the way: that floppy drive (and a few disks) is still the most essential portion of your "backup arsenal". When all else fails, you still should be able to bring up your backup system from an emergency boot disk in a minimal way. Your "restore" disks and devices can then be accessed.

---- (C) 2004, John P. Tomany ----

P.S. - Why choose a third-party virus scanner when a decent one has been bundled along with windows? Ans: There is no telling IF microsoft designed its virus protection to exclude from scanning a series of file types which third parties may consider potentially dangerous. Better safe than sorry - or you could run both: microsoft's first.

Andy
Posts: 735
Joined: Sun Dec 12, 2004 8:06 am
Location: Gourock

Post by Andy » Tue Dec 21, 2004 1:08 am

Hi John,

We've had good natured "run-in" in the past but your advice is EXCELLENT.

My computers have always been "Workhorses" doing graphics, video editing, music sequencing/editing. Plus a wee bit of genealogy.

I've set up my systems in every possible "Array" starting with mirrored SCSI (to cope with video), then onto bigger (and much cheaper) format ATA drives with wee experiments into RAID array.

Regardless of all this I got a DOUBLE harddrive failure about 2 and a half years ago that almost gave me apoplexy (all my Scotland Origin stuff was on the drives). (LOST IT ALL)

However, may I suggest an easier option. RAM STICKS. Even here in UK you can "Back Up" your information on a stick up to about 1.2 Gb for £50.

Sure, you may lose the program BUT, if you've got the memory stick, you can reload the original program and import the data.

I reckon this is a much easier process than (PROPER) external back-ups.
Searching for Keogh, Kelly, Fitzgerald, Riddell, Stewart, Wilson, McQuilkin, Lynch, Boyle, Cairney, Ross, King, McIlravey, McCurdy, Drennan and Woods (to name but a few).

Also looking for any information on Rathlin Island, County Antrim, Ireland.

Dz

Post by Dz » Tue Dec 21, 2004 2:46 am

Hi Andy!

The "memory stick" idea is a great one, especially if you already have a reader slot in, or attached to, your machine. The keychain-mounted devices that plug into a USB port are also very popular (particularly in the workplace, for privacy reasons), and as the prices drop, the capacity seems to go up dramatically.

These make wonderful, secure <I>off-board</I> devices for copies of important files/documents/images/programs, etc. But they, too can have a problem restoring stuff if your computer won't boot, the USB driver on your hard disk is scrambled, or malicious code has locked out the drive assignments.

(Besides - there aren't a lot of BIOSes capable of booting from a USB port! You might still need a complete, low-level backup.)

.

DavidWW
Posts: 5057
Joined: Sat Dec 11, 2004 9:47 pm

Post by DavidWW » Tue Dec 21, 2004 7:31 am

For anyone needing that level of technical advice the Fred Langa newsletter had a thread on booting from "memory sticks" a few issues back, including how to set up sytems and such USB port drives so that they are bootable.

My own backup method is a pair of external 80Gb hard drives, set up with the relevant software to do a so-called "one touch" backup. All that this is is an incremental backup system. Every evening when I leave my study, I just hit one button and a full incremental backup takes place. I switch the drives every few days. Expensive? Yes! (About £80 for each drive about a year ago.) Peace of mind? Massive! (The software includes the facility to create a "recovery" CD that can be used to boot.)

Wullie.

PS And yes!, I have tested restoring files from the backup drives :!:

Dz

3. Stocking the Windows Backup arsenal

Post by Dz » Sat Dec 25, 2004 2:26 pm

Successful backups depend upon both your hardware and software selection. If you possess a "mass storage" device designed with backup/restore in mind (tape drive, Zip or Jazz, USB drive, etc.), it came with software useful for that purpose. Rather - "useful as long as windows is working". Those with some later Windows versions may have an unrealistic sense of security, since the system offers the ability to "roll-back" the system to some previous backup, stored on hard disk.
(Unrealistic? Yes. It depends upon windows being functional, which cannot be guaranteed after a viral - or worse, a direct attack via a network intruder.) There's always the purely-mechanical hardware disk glitch, too.

Fortunately, some third-party backup software is designed to work with common devices: floppies, CD or DVD-ROM burners. There are even ways to build your own suite of useful items for good CDROM backups - usually from (older) DOS software which can boot from a floppy (or even a CD - though making a bootable, fully self-supporting CD is often difficult). Those who are uncomfortable stumbling around in an unfamiliar non-windows world might want to give the free month's trial of http://www.superwin.com/rescue.htm (different versions for each windows version) which comes highly recommended by the commercial press. I've never tried it, however; I just don't fully trust any backup software that absolutely requires windows to function.

In the last segment, I mentioned the free diagnostics from the hard disk manufacturers. Some of these have the capability to clone a copy of your hard disk to a second hard drive. Some have tools that can bring a balky drive back to health (without destroying your files!)
Rather than list them all here, links to many of these diagnostics (and other useful programs) can be found in the contents of the "Ultimate Boot CD" here: http://www.ultimatebootcd.com/ or at
http://www.ubcd4win.com/contents.htm
Both the "plain vanilla" UBCD (which requires too much work for my tastes) and the windows version (which also requires some work) are NOT recommended for most people. Both assume a level of user computer skills that is quite high - and both assume you will be restoring some flavor of windows XP. However, their website's categorized links, full of useful restore programs, are exceptional!

The safest bet for restoration: starting with DOS

Windows has the capability to create an "Emergency Boot Disk" - even though the floppy doesn't have enough room for many of the large (and important) files which are essential to a good restore - such as your windows registry (system.dat). In most windows versions, you can find it under the "Startup Disk" tab of "Add/Remove Programs" in your Control Panel. Alternately, "find files" (search) for the terms "eru" or "ebd" under your C:\windows directory, and run the "ERU.EXE" program. (Your computer manufacturer may have included a better means of booting a crashed system in a special program. Use it, instead of the generic windows stuff, because it is likely to include a driver for your specific CD-ROM and other hardware.)

NOTE: One thing you don't want to do is run any "Setup" program, which is typically a windows re-install program. You want to restore your existing system to health - not start over, with a "clean" machine, thus losing all of your files and program additions!

That's where DOS comes in. You really do need a floppy or CD copy of a functional DOS, no matter which windows version you are using, including XP. Back in the late '70s when young Bill Gates purchased the source code for Seattle Computing's "Quick and Dirty Operating System" (QDOS) - and renamed it MS-DOS - Digital Research was also working on a DOS that functioned very well with IBM's new personal computer BIOS. Digital Research is no more - but their DRDOS was improved through the years, even while it passed through many corporate owners. Along the way, DRDOS versions in the 7.xx range were offered freely to individual users - and 7.03 is still available as a unique set of 3 or 5 floppy "disk image" files, which are simply DISKCOPY'd to floppies. The larger set includes personal NETWARE - still the premier networking software.

Free DRDOS versions aren't available from the current owner of the code, but two previous owners essentially set version 7.03 free forever. And the best part is that the unique DRDOS "Diskcopy.com" - which (unlike the MSDOS version with the same name) can create diskimages on hard disk - or any removable disk! Get the complete package here: http://www.drdos.net/download.htm

Along the same lines, this little DOS-based program (free) can save or restore a floppy image of your hard disk's Master Boot Record - the most important of those rare "invisible and untouchable" records that is critical for a functional hard disk. Very experienced users can even use it to edit disk partitions!
http://mbrwizard.tripod.com/MBRWiz.zip

Ah - above, we've introduced a ZIP file into the arsenal. Most people are aware of the value in "zipped", or compressed, files. Many have used WINZIP to de-compress downloaded files... but we can't depend upon having a functional windows system if our hard drive crashed! That leaves WINZIP and similar out of our arsenal. Fortunately, the original DOS "zipper", PKZIP/PKUNZIP is still freely available as non-expiring shareware. The self-extractor version from 1993 is here:
http://downloads.pcworld.com/pub/new/ut ... kz204g.exe
If you are using (32-bit) Win98SE or later versions as your DOS boot, you can also use info-zip, the freeware long-filename DOS "zipper" that is the actual core of WINZIP: http://www.info-zip.org/pub/infozip/

I recommend having the original (16-bit) PKZIP on hand, anyway; it is the "gold standard" by which all the others are compared. Nothing says you can't use both, in the rare instance where long filenames are absolutely required. (You probably didn't notice, but ALL of the important windows "system" files are short, 8.3-style DOS filenames! There's a reason!)

With zipping, (or RAR - a much more compressive alternative) you can, for example shrink down the essential parts of your entire C:\Windows\ directory (and all it's sub-folders) into about 50-60 megabytes - which can easily be burned into a CDROM for later restoration via DOS. PKZIPs can easily span multiple floppy disks - but it would take hours to feed 50 or more floppies into the slot!

But first, you'll have to be able to access that CDROM under DOS. It's easy if your boot floppy contains MSCDEX.EXE and your specific CD driver (along with an AUTOEXEC.BAT and CONFIG.SYS copied from you C:\ drive) - but there are a couple of nearly-universal drivers available, too. Here's the one used in Win98 and ME emergency boot disks:http://www.onecomputerguy.com/software/oakcdrom.sys

I guess I should also recommend one of the oldest DOS programs still in regular use, as well: Vern Beurg's tiny LIST.COM. (Honestly - I'd be lost without it; I've been using it since 1987 or '88.)
Why list.com? It is so simple, yet powerful. Want to save your SYSTEM.DAT registry to a CD or Zip disk? You'll have to change its file attributes from "hidden, system, read-only" before you can even see it in windows - but list.com will show you everything about every file (depending upon how many columns you want on-screen). If you highlight the file and press "A", LIST.COM will show you the current attributes as capital letters ("ASHR" is normal for the registry files). Typing lower-case "sh" will remove the System and Hidden attributes; it's that simple. No need to painstakingly type DOS's "Attribute" command lines for every file. ftp://209.204.189.9/list.com

Next installment: What can go wrong, requiring a floppy/CD "restore" ...

Dawn Geddes
Posts: 2
Joined: Tue Jan 25, 2005 11:56 am
Location: Sydney, Australia

Backups and such.

Post by Dawn Geddes » Tue Jan 25, 2005 2:13 pm

You guys are frightening the life out of me. I just do a plain old backup to CD, now I've got to think about all this other stuff. I've got a headache already. :cry:
Dawn Geddes
Researching Geddes, Funnell, Barrett

sporran
Posts: 496
Joined: Sat Dec 11, 2004 11:40 pm
Location: Leominster, Herefordshire, UK

Re: backups

Post by sporran » Tue Jan 25, 2005 3:52 pm

Hello Dawn,


I would not worry too much about following John's (dweezild) suggestions to the letter, since they are designed to get you back into a working state as quickly as possible. That is not to dispute his advice: it was excellent, but it is not necessarily the only solution.

If there has been a disaster such as a disk crash or damaged boot file, there are advantages in doing a fresh installation. When you have used your PC for a while, and particularly if you have added and removed software, the system becomes bloated with unnecessary files, such as DLLs, and lots of entries in the registry that are not needed. These conspire to slow down the system, in some cases drastically.

Working with a clean disk, and re-installing the software that you use and want, means that the PC will be running as minimally and cleanly as possible. However, there are several downsides. Firstly, you need to have recorded all your settings or have a wonderful memory that recalls every step and fix that you did. Secondly, you should have backed-up obscure key files, such as templates for Word, Excel, Powerpoint, and the like. Lastly, it takes a very long time, especially if you have to download all the vital security features that Microsoft have released (Apple users can snigger in the corner): allow at least one day, and more probably two. I write from personal experience.

In the business world, where time is money, this makes no sense. But for home users, backing up only your key data can make sense.


Regards,

John
Last edited by sporran on Sun Mar 13, 2005 7:54 pm, edited 1 time in total.

Dawn Geddes
Posts: 2
Joined: Tue Jan 25, 2005 11:56 am
Location: Sydney, Australia

Thanks John

Post by Dawn Geddes » Tue Jan 25, 2005 10:35 pm

So far no crashes etc. Severe thunderstorms last weekend in Sydney, unplugged all automaticall, EXCEPT phone line. Will do so next time.

Dawn
Dawn Geddes
Researching Geddes, Funnell, Barrett

Scottishlass
Posts: 48
Joined: Fri Mar 04, 2005 1:29 am
Location: somewhere out there

Post by Scottishlass » Sun Mar 13, 2005 1:51 pm

Not sure if this is the correct place to ask , I have all my records presently on an old windows 98 with only the floppy availabe to save all my work to .I have compressed it and saved it to a floppy but now having trouble transfering it to my new computer that has xp .Do I have to run an orginal program first.......which I don't have.