Rclone Char encoding

tb582 · July 17, 2022, 10:08pm

2022/07/17 17:36:03.156812 DEBUG : rclone: Version "v1.59.0" starting with parameters ["C:\\Program Files (x86)\\rclone\\rclone.exe" "hashsum" "MD5" "remote:" "-P" "--dry-run" "--max-age" "2022-01-07" "--filter-from" "P:\\scripts\\filter-file.txt" "--log-file=P:\\scripts\\log_prod_md5.txt" "--log-level" "DEBUG" "--log-format" "date,time,microseconds"]
2022/07/17 17:36:03.156812 DEBUG : Creating backend with remote "remote:"
2022/07/17 17:36:03.163525 DEBUG : Using config file from "C:\\Users\\Tony\\.config\\rclone\\rclone.conf"

seeing some file/folder paths like:

Checking:

 * My Pictures/Tony/AutomΓÇª22-07-13 16-43-54.heic: checking
 * My Pictures/Tony/AutomΓÇª22-07-14 11-03-00.heic: checking
 * My Pictures/Tony/AutomΓÇª22-07-14 11-03-01.heic: checking
40edb274d570cbdaca7daab867d9cb29  My Pictures/Tony/Automatic Upload/TonyΓÇÖs iPhone/2022-07-13 16-43-54.heic
Transferred:              0 B / 0 B, -, 0 B/s, ETA -
Checks:               731 / 734, 100%
Elapsed time:      1m12.3s
Checking:
 * My Pictures/Tony/AutomΓÇª22-07-14 11-03-00.heic: checking
 * My Pictures/Tony/AutomΓÇª22-07-14 11-03-01.heic: checking
 * My Pictures/Tony/AutomΓÇª22-07-15 19-06-52.heic: checking
3c55484e45dbb9d545c5aedd185f51a4  My Pictures/Tony/Automatic Upload/TonyΓÇÖs iPhone/2022-07-14 11-03-00.heic
Transferred:              0 B / 0 B, -, 0 B/s, ETA -
Checks:               732 / 735, 100%
Elapsed time:      1m12.4s
Checking:
 * My Pictures/Tony/AutomΓÇª22-07-14 11-03-01.heic: checking
 * My Pictures/Tony/AutomΓÇª22-07-15 19-06-52.heic: checking
 * My Pictures/Tony/AutomΓÇª22-07-15 19-06-53.heic: checking
e72774c140c342238dae04e9eb66fe48  My Pictures/Tony/Automatic Upload/TonyΓÇÖs iPhone/2022-07-15 19-06-52.heic
Transferred:              0 B / 0 B, -, 0 B/s, ETA -
Checks:               733 / 736, 100%
Elapsed time:      1m12.4s

I was thinking it was just a console or the progress flag output but since I do store these file paths as a variable for further processing its throwing off things later in my script.

Running lsf on the directory produces the desired output though... so strange?

PS C:\Users\Tony> rclone lsf -vv remote:"My Pictures/Tony/" -R -vv | select -first 10
2022/07/17 18:07:09 DEBUG : rclone: Version "v1.59.0" starting with parameters ["C:\\Program Files (x86)\\rclone\\rclone.exe" "lsf" "-vv" "remote:My Pictures/Tony/" "-R" "-vv"]
2022/07/17 18:07:09 DEBUG : Creating backend with remote "remote:My Pictures/Tony/"
2022/07/17 18:07:09 DEBUG : Using config file from "C:\\Users\\Tony\\.config\\rclone\\rclone.conf"
2022/07/17 18:07:10 DEBUG : fs cache: renaming cache item "remote:My Pictures/Tony/" to be canonical "remote:My Pictures/Tony"
Automatic Upload/
Automatic Upload/Tony iPhone/
Automatic Upload/Tony iPhone/Flood_2019/
Automatic Upload/Tony iPhone/Flood_2019/2019-06-20 06-04-04.mov
Automatic Upload/Tony iPhone/Flood_2019/2019-06-20 09-38-02 (2).heic
Automatic Upload/Tony iPhone/Flood_2019/2019-06-20 07-20-17.mov
Automatic Upload/Tony iPhone/Flood_2019/2019-06-20 05-45-24.mov

ncw · July 18, 2022, 10:31pm

What is that character supposed to be? Tony's iPhone? Can you cut and paste the path from explorer?

It is just missing in the rclone lsf output.

tb582 · July 18, 2022, 10:33pm

yes - that is it, in that it should be an apostrophe ex:

Automatic Upload/Tony’s iPhone/2022-07-07 17-42-02.jpeg
Automatic Upload/Tony’s iPhone/2022-07-01 12-05-17.jpeg
Automatic Upload/Tony’s iPhone/2022-07-13 14-32-55.heic
Automatic Upload/Tony’s iPhone/2022-07-01 12-05-39.jpeg

Actually have I both variations - here's the same LSF output:

PS C:\Users\Tony> rclone lsf -vv remote:"My Pictures/Tony" -R -vv | select -first 10
2022/07/18 18:34:53 DEBUG : rclone: Version "v1.59.0" starting with parameters ["C:\\Program Files (x86)\\rclone\\rclone.exe" "lsf" "-vv" "remote:My Pictures/Tony" "-R" "-vv"]
2022/07/18 18:34:53 DEBUG : Creating backend with remote "remote:My Pictures/Tony"
2022/07/18 18:34:53 DEBUG : Using config file from "C:\\Users\\Tony\\.config\\rclone\\rclone.conf"
Automatic Upload/
Automatic Upload/Tony iPhone/
Automatic Upload/Tony iPhone/Flood_2019/
Automatic Upload/Tony iPhone/Flood_2019/2019-06-20 06-04-04.mov
Automatic Upload/Tony iPhone/Flood_2019/2019-06-20 09-38-02 (2).heic
Automatic Upload/Tony iPhone/Flood_2019/2019-06-20 07-20-17.mov
Automatic Upload/Tony iPhone/Flood_2019/2019-06-20 05-45-24.mov
Automatic Upload/Tony iPhone/Flood_2019/2019-06-20 05-58-30.mov
Automatic Upload/Tony iPhone/Flood_2019/2019-06-20 07-26-05.mov
Automatic Upload/Tony iPhone/Flood_2019/2019-06-20 09-18-12.mov

ncw · July 19, 2022, 8:34am

I just realized what that character is.

It is an elipsis ... Used to shorten path names with the stats to make them for in 80 characters.

It isn't displaying properly in your terminal for some reason.

Can you terminal normally display utf-8 characters?

tb582 · July 19, 2022, 7:22pm

ohh hmmm - its Visual Studio Code and its set to UTF8 - BOM ... which seems like it should be right unless BOM is throwing it off.

ncw · July 19, 2022, 10:23pm

Rclone doesn't emit a BOM - shouldn't be necessary with utf-8 AFAIK. Can you use plain utf-8?

tb582 · July 22, 2022, 4:46pm

I still have been unable to figure out the cause here ... I did find this post but its quite old:

ncw · July 22, 2022, 4:51pm

Hmm. Looks like a bug in VS but it isn't fixed in your version?

tb582 · July 22, 2022, 5:08pm

I highly doubt that I'm running the very latest --- but I'll go to a VScode forum and see whats what

tb582 · July 22, 2022, 5:35pm

@ncw is it possible this is a rclone issue? this code hasn't changed but I did self-update to the latest release earlier this week. I guess I can try to downgrade and retest?

ncw · July 22, 2022, 5:39pm

I don't think it is an rclone issue but worth trying an older version.

tb582 · July 22, 2022, 11:04pm

FWIW oddly enough this fixed my issue

system · July 25, 2022, 11:04pm

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.