Error reading source directory: directory not found

Taylor_B · July 7, 2020, 2:26pm

What is the problem you are having with rclone?

3 of my 130 users are getting the following errors when trying to initiate a sync.

: error reading source directory: directory not found
Local file system at //?/E:/ToolDrive: not deleting files as there were IO errors

Screenshot - https://imgur.com/c8Ejge5

In troubleshooting the problem I determined the sync will run correctly by omitting the directory from the remote. e.g. rclone sync --fast-list ToolDrive: "k:\Tool Drive" -P

I suspect there may be something injecting smartquotes but have not been able to prove it conclusively. I've tried copy/pasting the command from notepad to ensure plaintext, and even typing directly into the command line.

What is your rclone version (output from `rclone version`)

User #1:
rclone v1.51.0

os/arch: windows/amd64
go version: go1.13.7

User #2:
rclone v1.52.2

os/arch: windows/amd64
go version: go1.14.4

Which OS you are using and how many bits (eg Windows 7, 64 bit)

Windows 10 64bit

Which cloud storage system are you using? (eg Google Drive)

FTP

The command you were trying to run (eg `rclone copy /tmp remote:tmp`)

rclone sync --fast-list "ToolDrive:Tool Drive" "k:\Tool Drive" -P

The rclone config contents with secrets removed.

Not provided

A log from the command with the `-vv` flag

Paste  log here

asdffdsa · July 7, 2020, 2:45pm

are you sure that the folder exists?
can do you a rclone lsd ToolDrive:

what is the software used for the ftp server?
windows or linux server?

if you can, post the text, instead of screenshots

the problem is occuring for both user#1 and user#2

Taylor_B · July 7, 2020, 4:47pm

Sorry, I don't have access to the users who are having the issue but I will ask them for the output.

When troubleshooting I did run the lsd ToolDrive: and confirmed it was able to list the directory.

I did the same for the local path and also confirmed it was able to list that directory as well.

FTP server software is CrushFTP 9.3.2_13 running on Mac OS High Sierra.

ncw · July 8, 2020, 11:10am

If you can get your user to add -vv --retries 1 to the command and post the output it will be obvious whether this is a smart quote problem.

Taylor_B · July 14, 2020, 12:52am

Sorry for the delay. Here's the output from the debug. Worth noting D:\ is a USB attached drive, not network attached storage.

C:\rclone>rclone sync --fast-list "ToolDrive: Tool Drive" "D:\ToolDrive" -P -vv --retries 1

2020/07/13 17:45:40 DEBUG : rclone: Version "v1.52.2" starting with parameters ["rclone" "sync" "--fast-list" "ToolDrive: Tool Drive" "D:\ToolDrive" "-P" "-vv" "--retries" "1"]
2020/07/13 17:45:40 DEBUG : Using config file from "C:\Users\Administrator\.config\rclone\rclone.conf"
2020/07/13 17:45:40 DEBUG : ftp://tooldriveproject.net:21/ Tool Drive: Connecting to FTP server
2020/07/13 17:45:41 DEBUG : fs cache: renaming cache item "D:\ToolDrive" to be canonical "//?/D:/ToolDrive"
2020-07-13 17:45:41 ERROR : : error reading source directory: directory not found
2020-07-13 17:45:41 DEBUG : Local file system at //?/D:/ToolDrive: Waiting for checks to finish
2020-07-13 17:45:41 DEBUG : Local file system at //?/D:/ToolDrive: Waiting for transfers to finish
2020-07-13 17:45:41 ERROR : Local file system at //?/D:/ToolDrive: not deleting files as there were IO errors
2020-07-13 17:45:41 ERROR : Local file system at //?/D:/ToolDrive: not deleting directories as there were IO errors
2020-07-13 17:45:41 INFO : There was nothing to transfer
2020-07-13 17:45:41 ERROR : Attempt 1/1 failed with 1 errors and: directory not found
Transferred: 0 / 0 Bytes, -, 0 Bytes/s, ETA -
Errors: 1 (retrying may help)
Elapsed time: 0.0s
2020/07/13 17:45:41 INFO :
Transferred: 0 / 0 Bytes, -, 0 Bytes/s, ETA -
Errors: 1 (retrying may help)
Elapsed time: 0.0s

2020/07/13 17:45:41 DEBUG : 2 go routines active
2020/07/13 17:45:41 Failed to sync: directory not found

asdffdsa · July 14, 2020, 1:31pm

try removing the space character between the remote and path, like this.
"ToolDrive:Tool Drive"

Taylor_B · July 14, 2020, 1:40pm

I've asked the user to remove the space after the colon. Here's output from another user having this same problem (user #2).

c:\rclone>rclone sync --fast-list "ToolDrive:Tool Drive" "H:\TOOL\Tool Drive" -P -vv --retries 1

2020/07/14 11:04:12 DEBUG : rclone: Version "v1.51.0" starting with parameters ["rclone" "sync" "--fast-list" "ToolDrive:Tool Drive" "H:\TOOL\Tool Drive" "-P" "-vv" "--retries" "1"]
2020/07/14 11:04:12 DEBUG : Using config file from "C:\Users\jlegn\.config\rclone\rclone.conf"
2020/07/14 11:04:12 DEBUG : ftp://tooldriveproject.net:21/Tool Drive: Connecting to FTP server
2020-07-14 11:04:17 ERROR : : error reading source directory: directory not found
2020-07-14 11:04:17 INFO : Local file system at //?/H:/TOOL/Tool Drive: Waiting for checks to finish
2020-07-14 11:04:17 INFO : Local file system at //?/H:/TOOL/Tool Drive: Waiting for transfers to finish
2020-07-14 11:04:17 ERROR : Local file system at //?/H:/TOOL/Tool Drive: not deleting files as there were IO errors
2020-07-14 11:04:17 ERROR : Local file system at //?/H:/TOOL/Tool Drive: not deleting directories as there were IO errors
2020-07-14 11:04:17 ERROR : Attempt 1/1 failed with 1 errors and: directory not found
Transferred: 0 / 0 Bytes, -, 0 Bytes/s, ETA -
Errors: 1 (retrying may help)
Elapsed time: 0.0s
2020/07/14 11:04:17 Failed to sync: directory not found

asdffdsa · July 14, 2020, 2:11pm

at least removing the space, now rclone has the correct remote path
before: ftp://tooldriveproject.net:21/
after: ftp://tooldriveproject.net:21/Tool Drive

as far as i know this is not documented anywhere
there is a difference between
"ToolDrive:Tool Drive"
and
"ToolDrive:/Tool Drive"

Without the / it is relative to the users home directory

ncw · July 14, 2020, 2:34pm

It probably should be... The sftp backend is the same...

Taylor_B · July 14, 2020, 2:35pm

C:\rclone>rclone sync --fast-list "ToolDrive:/Tool Drive" "D:\ToolDrive" -P -vv --retries 1

2020/07/14 07:32:49 DEBUG : rclone: Version "v1.52.2" starting with parameters ["rclone" "sync" "--fast-list" "ToolDrive:/Tool Drive" "D:\ToolDrive" "-P" "-vv" "--retries" "1"]
2020/07/14 07:32:49 DEBUG : Using config file from "C:\Users\Administrator\.config\rclone\rclone.conf"
2020/07/14 07:32:49 DEBUG : ftp://tooldriveproject.net:21/Tool Drive: Connecting to FTP server
2020/07/14 07:32:49 DEBUG : fs cache: renaming cache item "D:\ToolDrive" to be canonical "//?/D:/ToolDrive"
2020-07-14 07:32:50 ERROR : : error reading source directory: directory not found
2020-07-14 07:32:50 DEBUG : Local file system at //?/D:/ToolDrive: Waiting for checks to finish
2020-07-14 07:32:50 DEBUG : Local file system at //?/D:/ToolDrive: Waiting for transfers to finish
2020-07-14 07:32:50 ERROR : Local file system at //?/D:/ToolDrive: not deleting files as there were IO errors
2020-07-14 07:32:50 ERROR : Local file system at //?/D:/ToolDrive: not deleting directories as there were IO errors
2020-07-14 07:32:50 INFO : There was nothing to transfer
2020-07-14 07:32:50 ERROR : Attempt 1/1 failed with 1 errors and: directory not found
Transferred: 0 / 0 Bytes, -, 0 Bytes/s, ETA -
Errors: 1 (retrying may help)
Elapsed time: 0.0s
2020/07/14 07:32:50 INFO :
Transferred: 0 / 0 Bytes, -, 0 Bytes/s, ETA -
Errors: 1 (retrying may help)
Elapsed time: 0.0s

2020/07/14 07:32:50 DEBUG : 2 go routines active
2020/07/14 07:32:50 Failed to sync: directory not found

asdffdsa · July 14, 2020, 2:47pm

i created a new post under site feedback.

Taylor_B · July 14, 2020, 3:41pm

Sorry, I'm not sure i follow. What is the correct command?

asdffdsa · July 14, 2020, 4:07pm

correct command for what?

try removing --fast-list

Taylor_B · July 14, 2020, 4:14pm

What is the correct command to sync from the source "ToolDrive:Tool Drive" to the destination D:\ToolDrive and not receive the local file system errors?

asdffdsa · July 14, 2020, 4:16pm

i do not see local file system errors?

Taylor_B · July 14, 2020, 4:18pm

Perhaps I'm not understanding the actual problem. It was suggested to add / to the destination as without it, the directory is relative to the user's home directory. I had the user try that, but it did not fix the problem. So then what is the actual problem?

asdffdsa · July 14, 2020, 4:27pm

the problem is with the source, not dest
as in the title of your post
"Error reading source directory: directory not found"
and the error in the log
"error reading source directory: directory not found"

in this case, the source is ftp so this is applicable

Paths are specified as remote:path . If the path does not begin with a / it is relative to the home directory of the user. An empty path remote: refers to the user's home directory.

the dest D:\ToolDrive looks fine

you can test this
rclone ls D:\ToolDrive

https://rclone.org/local/
Local paths are specified as normal filesystem paths, eg /path/to/wherever`

system · September 13, 2020, 12:27pm

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.