Re: parallel processing trouble

Edric M Ellis <eellis@xxxxxxxxxxxxx> wrote in message <ytwmy29d6v8.fsf@xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx>...
"rcarrese " <carrese7@xxxxxxxxxxx> writes:

I am having a bit of trouble with parallel processing on windows machine. I am
running parallel jobs on both unix and windows machine. on the unix machine the
parallel job is submitted to a cluster (and it works just fine), whereas on my
windows comp I use the local scheduler. In my parallel job I have to access a
number of programs and generate/move/delete files and folders. I have made sure
that all files and folders are indexed. For the majority of the time, this
process works ok however every so often I receive an error that says one of the
directories cannot be deleted. There is no conflicts with the folder because
once the parallel job shuts down I can delete it manually from the command
window. Has anybody encountered an error like this before..? and if so has
anyone happend to find a solution?

Windows is much more likely than UNIX to refuse to delete a file or directory if
some other process is accessing it.

Within MATLAB, I think if one of your workers has a given directory as its PWD
or on the path then one of the other workers may well not be able to delete
it. If that is the case, it's not surprising that when the workers exit you are
able to delete things afterwards.

One tool that I use to debug stuff like this is the excellent "Process Explorer"
from sysinternals, at:

http://technet.microsoft.com/en-us/sysinternals/default.aspx

Enable the "handle view", and you can see a list of files and directories that a
process has open.

Cheers,

Edric.

I second Edric's suggestion regarding the excellent Process Explorer. Actually, many SysInternals utilities are excellent, but ProcExplorer is indispensable. I use it all the time to kill zombie or wild processes, set process priorities, see process memory/CPU/IO usage etc.

Another free utility you can use to debug this problem is Unlocker - http://ccollomb.free.fr/unlocker/ - this utility alerts you with a popup message whenever there is a file-locking conflict, tells you which process is locking, and enables you to ignore or kill or erase etc.

One final idea: maybe the folder cannot be deleted because it is not empty?

Yair Altman
http://UndocumentedMatlab.com

.

Relevant Pages

  • Re: Delete Folders
    ... > Unix, Linux, OS/2, Windows, DOS, folders are directories. ... Windows started using little file-folder icons for directories in the ... Unix in those days.. ... Please learn generic English phrases. ...
    (comp.lang.perl.misc)
  • Re: parallel processing trouble
    ... running parallel jobs on both unix and windows machine. ... parallel job is submitted to a cluster, ...
    (comp.soft-sys.matlab)
  • Re: UNIX and Windows Permissions problem...
    ... You'd have better luck posting this to the Unix Services for Windows ... > access the folders from UNIX as permission is denied. ... > i change the permissions from UNIX to allow me to access ...
    (microsoft.public.win2000.security)
  • UNIX and Windows Permissions problem...
    ... i have Unix services for windows running on a 2K machine. ... access the folders from UNIX as permission is denied. ... i change the permissions from UNIX to allow me to access ...
    (microsoft.public.win2000.security)
  • NFS permission in windows environment
    ... My client upgraded to windows and now they cannot create folders on a unix box. ... We are dealing with 2 kind of permissions, ...
    (microsoft.public.windowsxp.general)