Files with ":" seem to be having issues

Before opening a bug I thought I would make sure I’m not doing anything wrong. When doing a copy or sync from gdrive, if the filename has a “:” in it, rclone doesn’t seem to be acting correctly. Of course filenames with a : are not valid in windows so rclone replaces that character with “_”. That’s fine, but when I do another copy or sync, the local file is named with a _ and the remote is named with :, so it attempts to download the file again and then rename it again. Seems like what it should do is look for a file renamed to contain _. Maybe I don’t know what I’m doing, can anyone confirm this is an issue for them?

Note: server side operations are not affected. When copying the file to another gdrive remote, there are no issues… it’s only whe I copy/sync to a local computer, and the OS doesn’t seem to matter.

Can you share your rclone version, the command you are running and the output of the same command with -vv in it?

You bet! I’m on rclone 1.46. Below is the output from an lsl and then a copy and another copy. You’ll see that the first lsl contains 1 file named “test:file.zip” . When rclone downloads the file with the first copy, you can see where it renamed the file. In the 2nd copy, you can see where it looks at the local files and determines that it needs to download the same file again, even though it has not changed.

This is (obviously) on windows, but it does the same thing on Ubuntu, i just can’t get to that box right now…

LSL

c:\Program Files (other)\rclone-v1.46>rclone -vvP lsl gdrive-test:test
2019/04/23 10:54:26 DEBUG : rclone: Version "v1.46" starting with parameters ["rclone" "-vvP" "lsl" "gdrive-test:test"]
2019/04/23 10:54:26 DEBUG : Using config file from "C:\\Users\\bill\\.config\\rclone\\rclone.conf"
1919316816 2019-04-23 10:51:50.604000000 test:file.zip
Transferred:             0 / 0 Bytes, -, 0 Bytes/s, ETA -
Errors:                 0
Checks:                 1 / 1, 100%
Transferred:            0 / 0, -
Elapsed time:        1.2s
2019/04/23 10:54:27 DEBUG : 4 go routines active
2019/04/23 10:54:27 DEBUG : rclone: Version "v1.46" finishing with parameters ["rclone" "-vvP" "lsl" "gdrive-test:test"]

COPY 1

c:\Program Files (other)\rclone-v1.46>rclone -vvP copy gdrive-test:test c:\temp
2019/04/23 10:54:57 DEBUG : rclone: Version "v1.46" starting with parameters ["rclone" "-vvP" "copy" "gdrive-test:test" "c:\\temp"]
2019/04/23 10:54:57 DEBUG : Using config file from "C:\\Users\\bill\\.config\\rclone\\rclone.conf"
2019-04-23 10:54:58 INFO  : Local file system at \\?\c:\temp: Waiting for checks to finish
2019-04-23 10:54:58 INFO  : Local file system at \\?\c:\temp: Waiting for transfers to finish
2019-04-23 10:54:58 NOTICE: Local file system at \\?\c:\temp: Replacing invalid characters in "\\temp\\test:file.zip" to "\\\\?\\c:\\temp\\test_file.zip"
2019-04-23 10:59:29 INFO  : test:file.zip: Copied (new)MBytes/s, ETA 0sssss
Transferred:        1.788G / 1.788 GBytes, 100%, 6.705 MBytes/s, ETA 0s
Errors:                 0 / 0, -%
Checks:                 0 / 0, -%
Transferred:            1 / 1, 100%test:file.zip: transferring
Elapsed time:     4m32.9s          test:file.zip: transferring
2019/04/23 10:59:29 INFO  :        test:file.zip: transferring 5.309M/s, 0sssss
Transferred:        1.788G / 1.788 GBytes, 100%, 6.705 MBytes/s, ETA 0s
Errors:                 0
Checks:                 0 / 0, -
Transferred:            1 / 1, 100%
Elapsed time:       4m33s

2019/04/23 10:59:29 DEBUG : 4 go routines active
2019/04/23 10:59:29 DEBUG : rclone: Version "v1.46" finishing with parameters ["rclone" "-vvP" "copy" "gdrive-test:test" "c:\\temp"]

DIR of temp

c:\temp>dir
 Volume in drive C is Computer C
 Volume Serial Number is 1234-5678

 Directory of c:\temp

04/23/2019  10:54 AM    <DIR>          .
04/23/2019  10:54 AM    <DIR>          ..
04/23/2019  10:59 AM                 0 test_file.zip
               1 File(s)              0 bytes
               2 Dir(s)   9,706,561,536 bytes free

c:\temp>

COPY 2

c:\Program Files (other)\rclone-v1.46>rclone -vvP copy gdrive-test:test c:\temp
2019/04/23 10:59:42 DEBUG : rclone: Version "v1.46" starting with parameters ["rclone" "-vvP" "copy" "gdrive-test:test" "c:\\temp"]
2019/04/23 10:59:42 DEBUG : Using config file from "C:\\Users\\bill\\.config\\rclone\\rclone.conf"
2019-04-23 10:59:43 INFO  : Local file system at \\?\c:\temp: Waiting for checks to finish
2019-04-23 10:59:43 INFO  : Local file system at \\?\c:\temp: Waiting for transfers to finish
2019-04-23 10:59:44 NOTICE: Local file system at \\?\c:\temp: Replacing invalid characters in "\\temp\\test:file.zip" to "\\\\?\\c:\\temp\\test_file.zip"
2019-04-23 11:03:56 INFO  : test:file.zip: Copied (new)MBytes/s, ETA 0sss
Transferred:        1.788G / 1.788 GBytes, 100%, 7.195 MBytes/s, ETA 0s
Errors:                 0 / 0, -%
Checks:                 0 / 0, -%
Transferred:            1 / 1, 100%test:file.zip: transferring
Elapsed time:     4m14.4s          test:file.zip: transferring
2019/04/23 11:03:56 INFO  :        test:file.zip: 99% /1.788G, 7.812M/s, 0sssss
Transferred:        1.788G / 1.788 GBytes, 100%, 7.195 MBytes/s, ETA 0s
Errors:                 0
Checks:                 0 / 0, -
Transferred:            1 / 1, 100%
Elapsed time:     4m14.4s

2019/04/23 11:03:56 DEBUG : 4 go routines active
2019/04/23 11:03:56 DEBUG : rclone: Version "v1.46" finishing with parameters ["rclone" "-vvP" "copy" "gdrive-test:test" "c:\\temp"]

DIR of temp again (the timestamps on this one are loopy for some reason, not sure it gives you any info… it says this file was stamped prior to it being downloaded, so who knows what it’s doing there. This copy paste was DEFINITELY taken after the 2nd copy completed.)

c:\temp>dir
 Volume in drive C is Computer C
 Volume Serial Number is 1234-5678

 Directory of c:\temp

04/23/2019  10:54 AM    <DIR>          .
04/23/2019  10:54 AM    <DIR>          ..
04/23/2019  10:51 AM     1,919,316,816 test_file.zip
               1 File(s)  1,919,316,816 bytes
               2 Dir(s)   9,701,298,176 bytes free

Yeah, issue is logged here:

and there is one related to the semi colon as well

I’d add some comments there.

1 Like

Thank you! I’ll do that.

This topic was automatically closed 90 days after the last reply. New replies are no longer allowed.