MacOS - rclone mount with accent in filename can't be open by Plex and mis

Help and Support
1

What is the problem you are having with rclone?

When mounting my google drive with rclone, Plex is not able to access to the files containing acccent. File are visible in plex but can't be play or analyse.

No issue to play the file from Finder using the same directory

Similar issue to Strange behavior with accentuated characters

When using test build with fuse flag, files are not visible in the Finder

Files have been renamed using filebot from MacOS computer.

What is your rclone version (output from rclone version)

rclone v1.51.0-148-g2a62471e-beta

  • os/arch: darwin/amd64
  • go version: go1.14.1

Which OS you are using and how many bits (eg Windows 7, 64 bit)

MacOS 10.15.4 (19E266)

Which cloud storage system are you using? (eg Google Drive)

Google Drive encrypted

The command you were trying to run (eg rclone copy /tmp remote:tmp)

Logs from Plex Media Scanner :
Apr 01, 2020 07:48:46.030 [0x700000c20000] DEBUG - HTTP 200 response from GET http://127.0.0.1:32400/library/changestamp

Apr 01, 2020 07:48:46.030 [0x700000c20000] DEBUG - Updating metadata item (save) (Frère des ours) with ID 820

Apr 01, 2020 07:48:46.031 [0x700000c20000] DEBUG - Updating part with ID=1341 [/Users/jeanmichel/GSuite/Films/Frère des ours (2003)/Frère des ours (2003) -1080p.mkv]

Apr 01, 2020 07:48:46.031 [0x700000c20000] DEBUG - [ID 1341] Media part analysis: /Users/jeanmichel/GSuite/Films/Frère des ours (2003)/Frère des ours (2003) -1080p.mkv

Apr 01, 2020 07:48:46.031 [0x700000c20000] DEBUG - [MI] Opening input file: "/Users/jeanmichel/GSuite/Films/Frère des ours (2003)/Frère des ours (2003) -1080p.mkv"

Apr 01, 2020 07:48:46.031 [0x700000c20000] DEBUG - [FFMPEG] - Opening '/Users/jeanmichel/GSuite/Films/Frère des ours (2003)/Frère des ours (2003) -1080p.mkv' for reading

Apr 01, 2020 07:48:46.031 [0x700000c20000] DEBUG - [FFMPEG] - Setting default whitelist 'file,crypto'

Apr 01, 2020 07:48:46.032 [0x700000c20000] ERROR - Exception analyzing media file '/Users/jeanmichel/GSuite/Films/Frère des ours (2003)/Frère des ours (2003) -1080p.mkv' (Could not parse /Users/jeanmichel/GSuite/Films/Frère des ours (2003)/Frère des ours (2003) -1080p.mkv (error=-2): No such file or directory)

Apr 01, 2020 07:48:46.032 [0x700000c20000] DEBUG - Streams didn't change in analysis, not saving.

Apr 01, 2020 07:48:46.032 [0x700000c20000] DEBUG - Updating media item 1341, size=18446744073709551615, metadata_item_id=820

Apr 01, 2020 07:48:46.032 [0x700000c20000] DEBUG - Updating part with ID=1341 [/Users/jeanmichel/GSuite/Films/Frère des ours (2003)/Frère des ours (2003) -1080p.mkv]

Apr 01, 2020 07:48:46.040 [0x700000c20000] DEBUG - Downloading document http:/127.0.0.1:32400/library/changestamp

Apr 01, 2020 07:48:46.040 [0x700000c20000] DEBUG - HTTP requesting GET http:/127.0.0.1:32400/library/changestamp

Apr 01, 2020 07:48:46.043 [0x700000c20000] DEBUG - HTTP 200 response from GET http:/127.0.0.1:32400/library/changestamp

Apr 01, 2020 07:48:46.043 [0x700000c20000] DEBUG - Updating metadata item (save) (Frère des ours) with ID 820

A log from the command with the -vv flag (eg output from rclone -vv copy /tmp remote:tmp)

2020/04/01 08:19:14 DEBUG : Films/: Lookup: name="Frère des ours (2003)"
2020/04/01 08:19:14 DEBUG : Films/: >Lookup: node=, err=no such file or directory

2

This certainly looks like a unicode normalization problem.

In the first line above the è in the file name is u'\xe8' so a normal UTF-8 accented e

And so is this one.

I wonder if plex is doing NFD (unicode decomposition) or maybe reversing that the rclone did...

Can you paste the result of an rclone lsf showing the accented file in question please? Then I can check what its unicode status is.

3

i'm starting to clean the files names using a windows.

I take another file with the same issue:
jeanmichel@Mac-Mini ~ % rclone lsf Drive:haldir/Series/9-1-1/Season\ 01/9-1-1\ -\ S01E02\ -\ Laďż˝<0082>cher-prise\ WEBDL-1080p.mkv
9-1-1 - S01E02 - Lâcher-prise WEBDL-1080p.mkv

I can't copy the file name if i release the mouse from ssh connexion on windows computer

4

That word Lâcher the â is u'a\u0302' according to python so it is decomposed UTF-8 (which is the macOS standard way).

What appears to be happening then is plex is normalizing the unicode names but when it asks rclone for that name rclone doesn't recognise it since it has been normalised.

I don't know whether macOS file systems are expected to respond to the unicode normalised version and unnormalised versions of files?

5

Even without use Plex, i have renamed files using Filebot with accent in the folders and name. Once updated through the mount, i get the encoding issue.
On rclone cli, i have the issue and on the mount on windows, i can fix by remove the "ĂŞ", the the "e" and add the "ĂŞ".
Then back to rclone cli on MacOS, the name are correct and folders browsable.

6

Were the files uploaded with a much older version of rclone?

7

I used netdrive 3 to upload some old files, then use Rclone web to move files to a new gdrive and my current mount is on the new drive with encryption.

rclone version used are 1.50 or 1.51 beta

I'm using this command to mount the drive:
rclone mount Drive:haldir ~/GSuite --allow-other --buffer-size 256M --dir-cache-time 720h --drive-chunk-size 512M --log-level INFO --vfs-read-chunk-size 128M --vfs-read-chunk-size-limit off --vfs-cache-mode writes --rc &

The filebot version is from the filebot site (4.9.0 build 7234) and the pattern to rename the file is:
{fn =~ /2160p|4K|4k|UHD/ ? 'Films4k' : 'Films'}/{plex.tail} {fn =~ /.WEB.|WEB.RIP|WEBRip|WEBDL|WEB.DL/ ? /WEBDL/ : fn =~ /Remux|RemuX|REMUX/ ? /Remux/ : vs}-{vf}

Filebot configured in Opportunist mode and get metadata in French

To rename files, I selected root folder in the mount and filebot has been used to rename and move files to the new hierarchy.

8

OK thanks for the info

Are you happy renaming files to fix the problem or do you think there is something we shoud fix in rclone?

9

Unfortunally, now i can't open anymore files from the Finder after "fix" from Windows.

Plex is able to access to the file through the mount but can't open the file with VLC or Filebot.

Just tested the test build with the -o modules=iconv,from_code=UTF-8,to_code=UTF-8-MAC and i can open files from the finder or any program on the Mac.

I will continue test with the fuse option if i still have issue when copying files to the mount folder but i would like to use all my configuration with filebot and rclone on the mac instead of go to a linux or windows to fixe.

Thanks

10

Yes it would be nice to have a fix.

So that kind of implies that rclone should be outputting UTF-8-MAC unicode not normal UTF-8 on the rclone mount.

I could make an option which does this for macOS so convert listings to NFD and convert them back to NFC on stat etc.

Technically speaking "utf-8-mac is the utf 8 version of a text after application of Unicode normalization NFD (e.g accented characters are represented by the base character plus a combining accent character)" from the docs

The rclone cmount option uses OSXFUSE which has the option built in whereas normal rclone mount doesn't.

I don't understand why more macOS users aren't complaining about this, is is specific to how your files got uploaded?

11

Using the standard rclone binary, if the upload is done by a Windows computer using SMB to open the mount folder, encoding is ok and plex can index and play the file.
If i get a file from the Finder, rename by adding accent, then copy to the mount filen Plex can see the file because a new entry has been added in the database with the name but file can't be open and display as "Unavailable".

Is there some limitation to leave the standard branch to support cmount command ?

12

You need to build it with the cmount tag I believe:

cd ~/go/src/github.com/ncw/rclone
go install -tags cmount
1 Like
13

I have a strange behaviour using cmount command. The folder used for the mount is empty from Finder or terminal but if i go to a subfolder from my gdrive, the folder is reachable and display all content. Don’t have this issue with regular mount command

14

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.