Re: Best way to move HUGE data from one folder to another
- From: Seum <Seum@xxxxxxxxxxx>
- Date: Sun, 14 Aug 2011 08:38:31 +0100
Paul wrote:
Seum wrote:Paul wrote:Seum wrote:I have a folder with about 35GB of data and, after I started
moving file after file, from one column F: to another N:, it seemed very slow and tedious. I could not select all the files, not even 2 together, and I thought about renaming the two folders.
I renamed N with O, but it ended up with (O:)(N:).
Any safe and quick way to do this?
TIA
Robocopy, running in file synchronization mode (mirroring).
I use this, to copy one partition to another, with the intent to
preserve every aspect of the file system.
robocopy J:\ E:\ /mir /copy:datso /dcopy:t /r:3 /w:2 /zb /np /tee /v /log:robocopy_j_to_e3.log
You run that from command prompt, being *very careful* to check
syntax. Why ? Because in that example, E: will be erased, before
J: is transferred. What robocopy will be doing, is trying to mirror
the contents of J:, onto E:. If E: had "extra files" on it, then
it would no longer be a mirror. Robocopy also has other operating
modes besides mirror, but mirror is what I use for the things I do.
By typing the wrong drive letter by accident, I've had the contents
of E: start to be erased, before I could stop the command. I lost
a gigabyte of files, by making a typing mistake.
As far as I know, version XP026 comes with this download. This would be
the minimum version I would consider using. I think version XP027 may
come with Windows 7.
http://technet.microsoft.com/en-us/magazine/2006.11.utilityspotlight.aspx
You can find more info on the various versions, here.
http://en.wikipedia.org/wiki/Robocopy
That is supposed to be a folder copying tool, but seems to work at the
partition level. You could also use it like this:
robocopy J:\some_folder E:\some_other_folder ...
to copy just the "some_folder".
I've never used the GUI for it, and I don't know if the
GUI helps at all, or not. I've basically been using the same
command parameters, for a long time, without changing them. I
just change the drive letters, when copying an entire drive
from one place to another.
Be careful!
Paul
OK Paul, I'll take your word for it. My E is already empty.
Here was my first attempt:
Microsoft Windows [Version 6.1.7600]
Copyright (c) 2009 Microsoft Corporation. All rights reserved.
C:\Users\jvalh>robocopy K:\ N:\ /mir /copy:datso /dcopy:t /r:3 /w:2 /zb /np /tee /v /log:robocopy_j_to_e3.log
Log File : C:\Users\jvalh\robocopy_j_to_e3.log
-------------------------------------------------------------------------------
ROBOCOPY :: Robust File Copy for Windows
-------------------------------------------------------------------------------
Started : Sat Aug 13 09:58:16 2011
Source : K:\
Dest : N:\
Files : *.*
Options : *.* /V /TEE /S /E /COPY:DATSO /DCOPY:T /PURGE /MIR /ZB /NP /R:3 /W:2
------------------------------------------------------------------------------
ERROR : You do not have the Backup and Restore Files user rights.
***** You need these to perform Backup copies (/B or /ZB).
ERROR : Robocopy ran out of memory, exiting.
ERROR : Invalid Parameter #%d : "%s"
ERROR : Invalid Job File, Line #%d :"%s"
Started : %hs
Source %c
Dest %c
Simple Usage :: ROBOCOPY source destination /MIR
source :: Source Directory (drive:\path or \\server\share\path).
destination :: Destination Dir (drive:\path or \\server\share\path).
/MIR :: Mirror a complete directory tree.
For more usage information run ROBOCOPY /?
**** /MIR can DELETE files as well as copy them !
C:\Users\jvalh>
================================================
More problems here:
1 2GB memory is not enough for (greedy!) Robocopy.
2 I don't have the authority. This one has problems.
The computer has two users - a big 'un and a small 'un. Big 'un
has all the authority but the user interface is totally
different e.g. no emails at all in T'Bird. Q: Was the big 'un
sleeping?
I hope this doesn't keep you awake at night Paul :-)
All I can tell you is, it works for me, running as Admin.
Some of those parameters in the command, are to preserve
ownership and permissions on the files, so that the
copy is as exact as possible.
I understand that.
If a "little user", tries to transfer files owned by a
"big user", what would you expect the outcome to be ? The
command has to be run with sufficient permissions, to
wrangle the file ownership properly. You wouldn't expect
a limited user, to be trashing the Administrator's files...
Again agreed :-)
The main advantage of robocopy, is asynchronous operation.
It can be reading one disk, and writing the other disk, at
the same time. It makes maximum usage of any hardware
performance you've got. That's why I like it, versus
some kinda copy and paste. If you transfer thousands of
small files, it works as slow as any other transfer method,
because the transfer speed in that case, is affected by
the rate you can move the disk head around.
I would have used robocopy if I had enough memory. I had thought about buying another 2GB chip but, since I never before needed even 2GB, I decided to use it. Next order will include that extra 2GB.
Paul
Thanks again :-)
I have already posted info about the Seagate being cleared completely and it is now in the "new" box.
.
- References:
- Prev by Date: Re: Best way to move HUGE data from one folder to another
- Next by Date: Re: Best way to move HUGE data from one folder to another
- Previous by thread: Re: Best way to move HUGE data from one folder to another
- Next by thread: Re: Best way to move HUGE data from one folder to another
- Index(es):
Relevant Pages
|