What is the problem you are having with rclone?
Hello,
I am trying to synchronize a hosting at OVH with a Synology NAS.
the 2 file systems are in UTF8.
OVH:
LANG = fr_FR.UTF-8
LANGUAGE =
LC_CTYPE = "fr_FR.UTF-8"
LC_NUMERIC = "fr_FR.UTF-8"
LC_TIME = "fr_FR.UTF-8"
LC_COLLATE = "fr_FR.UTF-8"
LC_MONETARY = "fr_FR.UTF-8"
LC_MESSAGES = "fr_FR.UTF-8"
LC_PAPER = "fr_FR.UTF-8"
LC_NAME = "fr_FR.UTF-8"
LC_ADDRESS = "fr_FR.UTF-8"
LC_TELEPHONE = "fr_FR.UTF-8"
LC_MEASUREMENT = "fr_FR.UTF-8"
LC_IDENTIFICATION = "fr_FR.UTF-8"
LC_ALL =
Synology:
LANG = en_US.utf8
LC_CTYPE = "en_US.utf8"
LC_NUMERIC = "en_US.utf8"
LC_TIME = "en_US.utf8"
LC_COLLATE = "en_US.utf8"
LC_MONETARY = "en_US.utf8"
LC_MESSAGES = "en_US.utf8"
LC_PAPER = "en_US.utf8"
LC_NAME = "en_US.utf8"
LC_ADDRESS = "en_US.utf8"
LC_TELEPHONE = "en_US.utf8"
LC_MEASUREMENT = "en_US.utf8"
LC_IDENTIFICATION = "en_US.utf8"
LC_ALL = en_US.utf8
however when I try to transfer the data, it is converted and the filename no longer matches (see log).
the file names appear correctly on OVH via WinSCP with UTF8 = OFF, and via filezilla which here is the log:
Status: Retrieving the contents of the "/ apps / documents / DOSSIER_TEMP" folder ...
Status: Invalid sequence of characters received, UTF-8 disabled. Select the UTF-8 option in the Site Manager to force the use of UTF-8.
Status: Content of the "/ apps / documents / DOSSIER_TEMP" folder successfully displayed
I cannot reproduce this operation via Rclone.
the connection with OVH is made in SFTP or FTP, this does not affect the problem.
I hope there is a solution without modifying the filesystem on the hosting.
What is your rclone version (output from rclone version)
rclone v1.56.2
- os/version: unknown
- os/kernel: 4.4.180+ (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.16.8
- go/linking: static
- go/tags: none
Which cloud storage system are you using? (eg Google Drive)
SFTP and FTP
The command you were trying to run (eg rclone copy /tmp remote:tmp)
rclone --config /volume1/homes/admin/rclone/rclone.conf sync OVH:applis/documents /volume1/OVH/documents --transfers 50 --include *.ZIP
The rclone config contents with secrets removed.
[OVH_Horiante]
type = sftp
host = ftp.cluster***.hosting.ovh.net
user = *****************
port = 22
pass = ****************
md5sum_command = md5sum
sha1sum_command = sha1sum
A log from the command with the -vv flag
2021/10/27 11:23:36 DEBUG : rclone: Version "v1.56.2" starting with parameters ["/volume1/homes/admin/rclone/rclone" "--config" "/volume1/homes/admin/rclone/rclone.conf" "sync" "OVH:applis/documents/DOSSIER_TEMP" "/volume1/OVH/documents/DOSSIER_TEMP" "--transfers" "50" "--include" "*.ZIP" "-vv"]
2021/10/27 11:23:36 DEBUG : Creating backend with remote "OVH:applis/documents/DOSSIER_TEMP"
2021/10/27 11:23:36 DEBUG : Using config file from "/volume1/homes/admin/rclone/rclone.conf"
2021/10/27 11:23:36 DEBUG : sftp://***********@ftp.cluster***.hosting.ovh.net:22/applis/documents/DOSSIER_TEMP: New connection *.*.*.*:37256->*.*.*.*:22 to "SSH-2.0-OpenSSH_7.4p1"
2021/10/27 11:23:36 DEBUG : sftp://***********@ftp.cluster***.hosting.ovh.net:22/applis/documents/DOSSIER_TEMP: Using absolute root directory "/applis/documents/DOSSIER_TEMP"
2021/10/27 11:23:36 DEBUG : Creating backend with remote "/volume1/OVH/documents/DOSSIER_TEMP"
2021/10/27 11:23:36 NOTICE: Local file system at /volume1/OVH/documents/DOSSIER_TEMP: Replacing invalid UTF-8 characters in "DOC;172737343413;DOSSIER_TEMP;Temporaire;D\xe9pliant LEONCE BLANC.pdf;20190624;091321.ZIP"
2021/10/27 11:23:36 NOTICE: Local file system at /volume1/OVH/documents/DOSSIER_TEMP: Replacing invalid UTF-8 characters in "DOC;172737343413;DOSSIER_TEMP;Temporaire;MODELE-1 Fiche de cr\xe9ation nouveau client.xlsx;20170209;144047.ZIP"
2021/10/27 11:23:36 NOTICE: Local file system at /volume1/OVH/documents/DOSSIER_TEMP: Replacing invalid UTF-8 characters in "DOC;172737343413;DOSSIER_TEMP;Temporaire;Tarif G\xe9neral 2018 Union des Viticulteurs de Chablis.pdf;20180116;191157.ZIP"
2021/10/27 11:23:36 NOTICE: Local file system at /volume1/OVH/documents/DOSSIER_TEMP: Replacing invalid UTF-8 characters in "PHO;172737343413;DOSSIER_TEMP;Temporaire;Boite fer r\xe9glisse menthe bio.JPEG;20190419;110434.ZIP"
2021/10/27 11:23:36 NOTICE: Local file system at /volume1/OVH/documents/DOSSIER_TEMP: Replacing invalid UTF-8 characters in "PHO;172737343413;DOSSIER_TEMP;Temporaire;Bourgogne Aligot\xe9 UVC 251.JPEG;20190419;134920.ZIP"
2021/10/27 11:23:36 NOTICE: Local file system at /volume1/OVH/documents/DOSSIER_TEMP: Replacing invalid UTF-8 characters in "PHO;172737343413;DOSSIER_TEMP;Temporaire;Carr\xe9 P\xe2te vanill\xe9e +10%.JPEG;20180208;123436.ZIP"
2021/10/27 11:23:36 NOTICE: Local file system at /volume1/OVH/documents/DOSSIER_TEMP: Replacing invalid UTF-8 characters in "PHO;172737343413;DOSSIER_TEMP;Temporaire;Compotes BIo panach\xe9 x 8.JPEG;20181113;161326.ZIP"
2021/10/27 11:23:36 NOTICE: Local file system at /volume1/OVH/documents/DOSSIER_TEMP: Replacing invalid UTF-8 characters in "PHO;172737343413;DOSSIER_TEMP;Temporaire;Compotes Bio panach\xe9 x 16.JPEG;20181113;162143.ZIP"
2021/10/27 11:23:36 NOTICE: Local file system at /volume1/OVH/documents/DOSSIER_TEMP: Replacing invalid UTF-8 characters in "PHO;172737343413;DOSSIER_TEMP;Temporaire;Compotes panach\xe9 x 8.JPEG;20180903;171219.ZIP"
2021/10/27 11:23:36 NOTICE: Local file system at /volume1/OVH/documents/DOSSIER_TEMP: Replacing invalid UTF-8 characters in "PHO;172737343413;DOSSIER_TEMP;Temporaire;Compotes pommes Bio all\xe9g\xe9e en sucre 630g.JPEG;20181113;161503.ZIP"