I am creating a new Ubuntu 20.04 VM instance. With rclone version 1.52.2 installed, I'm seeing a bunch of "failed to read directory entry: readdirent: no such file or directory" errors in the log.
I roll back to version 1.51 and I see no errors in the log.
The directory it says it can't read changes each time the copy is run. There are no issues listing the directories from commandline as the habskilla user.
rclone is running as habskilla
To keep everything simple, everything is running as habskilla.
Hello ncw,
Just helping here : I had the exact same errors (hundreds of "readdirent: no such file or directory" over a 200k files SMB mounted directory) and your workaround worked like a charm : I'm now getting ~ 50 errors over a full scan when previoulsy it was ~1000.
Thanks - I have been seeing this issue since the upgrade from 1.49, or so, I think. Allhough not sure what caused it and I never asked..... The workaround (export GODEBUG=asyncpreemptoff=1) also worked for me for the few attempts I tried. I saw the issue during "rclone sync".
I have also tried the beta: rclone-v1.52.2-223-g811b30d1-beta-linux-amd64.gz, however, I'm still getting errors on this. They are fairly consistent...
Here's a snapshot of the log:
2020/07/29 14:38:27 DEBUG : rclone: Version "v1.52.2-223-g811b30d1-beta" starting with parameters ["./rclone-beta" "sync" "xx/Billeder/" "private-crypt:/Photos" "--fast-list" "--checkers" "2" "--transfers" "2" >
2020/07/29 14:38:27 DEBUG : Using config file from "/home/xx/.config/rclone/rclone.conf"
2020/07/29 14:38:27 INFO : Starting bandwidth limiter at 10MBytes/s
......... (a lot of size identical and skipping)
2020/07/29 14:39:42 ERROR : 2016 - Jul: error reading source directory: failed to read directory entry: readdirent: no such file or directory
......... (a lot of size identical and skipping)
2020/07/29 14:39:44 DEBUG : Encrypted drive 'private-crypt:/Photos': Waiting for transfers to finish
2020/07/29 14:39:44 ERROR : Encrypted drive 'private-crypt:/Photos': not deleting files as there were IO errors
2020/07/29 14:39:44 ERROR : Encrypted drive 'private-crypt:/Photos': not deleting directories as there were IO errors
2020/07/29 14:39:44 INFO : There was nothing to transfer
2020/07/29 14:39:44 ERROR : Attempt 3/3 failed with 3 errors and: march failed with 2 error(s): first error: failed to read directory entry: readdirent: no such file or directory
2020/07/29 14:39:44 INFO :
Transferred: 0 / 0 Bytes, -, 0 Bytes/s, ETA -
Errors: 3 (retrying may help)
Checks: 10163 / 10163, 100%
Elapsed time: 0.4s
2020/07/29 14:39:44 DEBUG : 8 go routines active
2020/07/29 14:39:44 Failed to sync with 3 errors: last error was: march failed with 2 error(s): first error: failed to read directory entry: readdirent: no such file or directory
SMB mounted directory:
ls -al "2016 - Jul"
total 63664
drwxr-xr-x 2 root root 0 Sep 1 2019 .
drwxr-xr-x 2 root root 0 Feb 19 20:42 ..
-rwxr-xr-x 1 root root 3524474 Dec 23 2016 20161223_153123.jpg
......
Linux vm-ubuntu 5.4.0-42-generic #46-Ubuntu SMP Fri Jul 10 00:24:02 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux