What is the problem you are having with rclone?
Rclone is copying files/folders successfully in two different situations:
- Copies most files in a folder, while some are outputting errors
- Copies folders over the course of 2 tries/attempts
This happens when I try to copy larger folders >500MB in size of varying file types. Sometimes
it would be music (.flac, .mp3) or video (.mkv, .mp4), and other filetypes as well.
In the log file below I tried to upload a folder of .mkv videos, but the error can be replicated by uploading any other >500MB folders.
Tried following advice from this thread: Windows - local system mount permissions
Updated my WinFSP installation to the 2020 version, passed the flag "-o --UserName=nameofaccount" just in case I was running rclone as the system user but to no avail.
I've tried mounting it from a normal CMD window (which produces the same error) and using nssm to start rclone as a local service (using my windows credentials) and passed the following flags to nssm:
mount crypt-drive: Y: --config "X:\Users\aragane.config\rclone\rclone.conf" --vfs-cache-mode writes
The same error keeps popping up "Failed to copy: chtimes ..." but the upload completes with no visible problems with the files (I just did a quick pull from the mounted storage and opened the file in VLC, video plays fine). Could it be possible the way I passed the flags are wrongly formatted/typed? Would really appreciate your help solving this, cheers!
What is your rclone version (output from rclone version
)
rclone v1.51.0
Which OS you are using and how many bits (eg Windows 7, 64 bit)
Windows 10 Build 1903
os/arch: windows/amd64
Which cloud storage system are you using? (eg Google Drive)
OneDrive Personal
The command you were trying to run (eg rclone copy /tmp remote:tmp
)
rclone copy "X:/folder/some-folder" "Y:/new-folder/some-folder/" -P -vv
A log from the command with the -vv
flag (eg output from rclone -vv copy /tmp remote:tmp
)
2020/04/15 20:11:48 DEBUG : rclone: Version "v1.51.0" starting with parameters ["rclone" "copy" "X:/folder/some-folder" "Y:/new-folder/some-folder/" "-P" "-vv"]
2020/04/15 20:11:49 DEBUG : Using config file from "X:\Users\aragane\.config\rclone\rclone.conf"
2020-04-15 20:11:50 INFO : Local file system at //?/Y:/new-folder/some-folder/: Waiting for checks to finish
2020-04-15 20:11:50 INFO : Local file system at //?/Y:/new-folder/some-folder/: Waiting for transfers to finish
Transferred: 323.984M / 11.544 GBytes, 3%, 32.397 MBytes/s, ETA 5m54s
Transferred: 0 / 12, 0%
Elapsed time: 10.0s
Transferring:
- file_xx_01.mkv: 6% /1.140G, 8.000M/s, 2m16s
- file_xx_02.mkv: 6% /1016.387M, 6.224M/s, 2m33s
- file_xx_03.mkv: 10% /915.516M, 9.389M/s, 1m27s
- file_xx_04.mkv: 10% /916.859M, 10.663M/s, 1m16s
X:\Users\aragane>rclone copy "X:/folder/some-folder" "Y:/new-folder/some-folder/" -P -vv --bwlimit 15M
2020/04/15 20:12:21 DEBUG : rclone: Version "v1.51.0" starting with parameters ["rclone" "copy" "X:/folder/some-folder" "Y:/new-folder/some-folder/" "-P" "-vv" "--bwlimit" "15M"]
2020/04/15 20:12:21 DEBUG : Using config file from "X:\Users\aragane\.config\rclone\rclone.conf"
2020/04/15 20:12:21 INFO : Starting bandwidth limiter at 15MBytes/s
2020-04-15 20:12:21 DEBUG : file_xx_01.mkv: Sizes differ (src 959988095 vs dst 98562048)
2020-04-15 20:12:21 DEBUG : file_xx_03.mkv: Sizes differ (src 961396553 vs dst 104853504)
2020-04-15 20:12:21 DEBUG : file_xx_04.mkv: Sizes differ (src 1223567911 vs dst 77590528)
2020-04-15 20:12:21 INFO : Local file system at //?/Y:/new-folder/some-folder/: Waiting for checks to finish
2020-04-15 20:12:21 DEBUG : file_xx_02.mkv: Sizes differ (src 1065758854 vs dst 69201920)
2020-04-15 20:12:21 INFO : Local file system at //?/Y:/new-folder/some-folder/: Waiting for transfers to finish
2020-04-15 20:18:03 ERROR : file_xx_07.mkv: Failed to copy: chtimes \?\Y:\new-folder\some-folder\07: The system cannot find the file specified.
2020-04-15 20:18:07 DEBUG : file_xx_05.mkv: MD5 = 14a52ba3be07b1bc612605d29b154d0e OK
2020-04-15 20:18:07 INFO : file_xx_05.mkv: Copied (new)
2020-04-15 20:18:39 ERROR : file_xx_08.mkv: Failed to copy: chtimes \?\Y:\new-folder\some-folder\08: The system cannot find the file specified.
2020-04-15 20:18:59 ERROR : file_xx_06.mkv: Failed to copy: chtimes \?\Y:\new-folder\some-folder\06: The system cannot find the file specified.
2020-04-15 20:24:14 DEBUG : file_xx_10.mkv: MD5 = 290e418e72c3b857ce920f58c7027d67 OK
2020-04-15 20:24:14 INFO : file_xx_10.mkv: Copied (new)
2020-04-15 20:24:21 ERROR : file_xx_09.mkv: Failed to copy: chtimes \?\Y:\new-folder\some-folder\09: The system cannot find the file specified.
2020-04-15 20:25:03 ERROR : file_xx_11.mkv: Failed to copy: chtimes \?\Y:\new-folder\some-folder\11: The system cannot find the file specified.
2020-04-15 20:25:06 ERROR : file_xx_12.mkv: Failed to copy: chtimes \?\Y:\new-folder\some-folder\12: The system cannot find the file specified.
2020-04-15 20:31:47 DEBUG : file_xx_01.mkv: MD5 = 7951e14ae59a6764fa423904c6c21f06 OK
2020-04-15 20:31:47 INFO : file_xx_01.mkv: Copied (replaced existing)
2020-04-15 20:31:50 DEBUG : file_xx_03.mkv: MD5 = dbc21592248ca1723c4e167b96a79955 OK
2020-04-15 20:31:50 INFO : file_xx_03.mkv: Copied (replaced existing)
2020-04-15 20:34:15 DEBUG : file_xx_02.mkv: MD5 = f4e9b504281567313334c595b3fd0ecd OK
2020-04-15 20:34:15 INFO : file_xx_02.mkv: Copied (replaced existing)
2020-04-15 20:36:23 DEBUG : file_xx_04.mkv: MD5 = e7948eeac97154a11191bf187fd95b51 OK
2020-04-15 20:36:23 INFO : file_xx_04.mkv: Copied (replaced existing)
2020-04-15 20:36:23 ERROR : Attempt 1/3 failed with 6 errors and: chtimes \?\Y:\new-folder\some-folder\12: The system cannot find the file specified.
2020-04-15 20:36:23 INFO : Local file system at //?/Y:/new-folder/some-folder/: Waiting for checks to finish
2020-04-15 20:36:23 DEBUG : file_xx_04.mkv: Modification times differ by -663.0803ms: 2020-04-15 17:51:08.6630803 +0800 +08, 2020-04-15 17:51:08 +0800 +08
2020-04-15 20:36:23 DEBUG : file_xx_01.mkv: Modification times differ by -405.9595ms: 2020-04-15 17:50:23.4059595 +0800 +08, 2020-04-15 17:50:23 +0800 +08
2020-04-15 20:36:23 DEBUG : file_xx_05.mkv: Modification times differ by -389.0768ms: 2020-04-15 17:51:45.3890768 +0800 +08, 2020-04-15 17:51:45 +0800 +08
2020-04-15 20:36:23 DEBUG : file_xx_06.mkv: Modification times differ by 2h26m45.7669146s: 2020-04-15 17:52:13.2330854 +0800 +08, 2020-04-15 20:18:59 +0800 +08
2020-04-15 20:36:23 DEBUG : file_xx_07.mkv: Modification times differ by 2h25m33.9158488s: 2020-04-15 17:52:28.0841512 +0800 +08, 2020-04-15 20:18:02 +0800 +08
2020-04-15 20:36:23 DEBUG : file_xx_03.mkv: Modification times differ by -502.6724ms: 2020-04-15 17:50:42.5026724 +0800 +08, 2020-04-15 17:50:42 +0800 +08
2020-04-15 20:36:23 DEBUG : file_xx_02.mkv: Modification times differ by -186.5218ms: 2020-04-15 17:50:28.1865218 +0800 +08, 2020-04-15 17:50:28 +0800 +08
2020-04-15 20:36:23 DEBUG : file_xx_08.mkv: Modification times differ by 2h25m52.5224187s: 2020-04-15 17:52:46.4775813 +0800 +08, 2020-04-15 20:18:39 +0800 +08