We've got a strange issue in the field on windows with a mounted share

Help and Support
1

Hello,

I use rclone to sync millions of files to my cloud infrastructure, lately while installing into the field on a few machines we’re having issues where a drive is mounted, P: for example to a remote system, but for whatever reason, I get permission errors, or file doesn’t exist errors on windows systems.

I’ve had to move some of our software to the server, where the files are stored at a couple locations, but if I could figure out how to make rclone play nice with file shares, it’d kill a bunch of work for 3 guys and 900 systems that would be manually moved for last resort.

Is there some permission I need to give it to work? Normally I’d give it admin when I run into this, but it seems even if I run my script as Administrator I get the same errors. Currently, in the field, I have a script run that grabs the .conf and a google key stored in MySQL, and the rclone.exe application, and runs a cmd script to actually copy the files.

The error I am seeing, cleaned up for security on my bucket:

event_msg": "rclone stdout [b''], stderr [b'2018/10/16 14:45:02 ERROR : : error reading source directory: directory not found
2018/10/16 14:45:02 ERROR : Storage bucket img.domain.com path Inventory/EX694/: not deleting files as there were IO errors
2018/10/16 14:45:02 ERROR : Storage bucket img.domain.com path Inventory/EX694/: not deleting directories as there were IO errors
2018/10/16 14:45:02 ERROR : Attempt 1/3 failed with 1 errors and: not deleting files as there were IO errors
2018/10/16 14:45:02 ERROR : : error reading source directory: directory not found
2018/10/16 14:45:02 ERROR : Storage bucket img.domain.com path Inventory/EX694/: not deleting files as there were IO errors
2018/10/16 14:45:02 ERROR : Storage bucket img.domain.com path Inventory/EX694/: not deleting directories as there were IO errors
2018/10/16 14:45:02 ERROR : Attempt 2/3 failed with 1 errors and: not deleting files as there were IO errors
2018/10/16 14:45:02 ERROR : : error reading source directory: directory not found
2018/10/16 14:45:02 ERROR : Storage bucket img.domain.com path Inventory/EX694/: not deleting files as there were IO errors
2018/10/16 14:45:02 ERROR : Storage bucket img.domain.com path Inventory/EX694/: not deleting directories as there were IO errors
2018/10/16 14:45:02 ERROR : Attempt 3/3 failed with 1 errors and: not deleting files as there were IO errors
2018/10/16 14:45:02 Failed to sync: not deleting files as there were IO errors
']",

Hopefully, someone knows a workaround in this situation, some of these servers we do not have easy access to. I’d love to be able to run it from a workstation that has the mount on it.

2

This (cryptic error!) means that rclone couldn’t read the root of the source directory and got “directory not found”.

What was the source and what was the destination for your sync?

This is rclone saying that since it got an IO error (not being able to read the source directory) it isn’t going to delete all the files in the destination!

So this looks like the source directory isn’t properly specified somehow? I’m not sure how that relates to the mounted drive part of your question?

Can you share the command line you are using with rclone?

3

The source was a mounted windows 10 drive share, the destination was google cloud storage.

I’m almost positive this is windows being evil with permissions. I believe we are going to try remounting the same path to the same drive letter with our python app when it runs and see if this fixes it. It looks like my script cannot see shares it did not mount itself.

4

Strange indeed! I’m not a Windows expert though, so I’ll have to await the results of your experiment :slight_smile:

5

definitely windows issue… works fine on good old *nix. My only workaround atm is running it on the server who actually contains the files, not mounted in windows.

1 Like
6