RClone lsf works perfectly but can't copy files properly

Help and Support
1

What is the problem you are having with rclone?

Can't download files properly, listing works perfectly, so it's not permission issues
I'm starting to think that special char is the problem. I'm a Portuguese speaker so ç, á, é, ê, ú, ó etc will be used into naming things

Run the command 'rclone version' and share the full output of the command.

rclone v1.60.1

Which cloud storage system are you using? (eg Google Drive)

Storj

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone lsf -R Cursos:sca01/

The rclone config contents with secrets removed.

Paste config here

A log from the command with the -vv flag

[Paste  log here](https://pastebin.com/a1kC76Fh)
2

Actually I tried to run rclone copy --progress -vv --log-file RCLONE.log Cursos:sca01/ /Volumes/InLand256GB/A/

3

Thank you for the log.

Here is the first failure

  1. 2022/11/27 12:16:11 ERROR : Pablo Spyer - Touro de Ouro (Completo)/Modulo 1/09 PMIS - Índice de compra.mp4: Failed to copy: multipart copy: failed to open source: uplink: object not found ("Pablo Spyer - Touro de Ouro (Completo)/Modulo 1/09 PMIS - Índice de compra.mp4")

Can you find out which character is causing the failure? the '`' is a possibility also.

Also can you try the latest beta as I updated the Storj module recently which might have fixed it.

1 Like
4

I'd say all special char are going to cause the error :confused: É Ó Ú etc. I'll try your suggestion;
Is there a way to replace those while transfering?! Like a from-to table?! Like, where "É" replace for a "Eh" etc?

5

These shouldn't be causing a problem and if I try it here I can't replicate the problem, so if you could a) try the beta and b) see if you can narrow down the problem that would be great.

1 Like
6

The only thing I could pin down is: Files over 69MB can't be downloaded :confused: No matter what the extension is.
All other files, small files, goes normally. I couldnt find anything related to that issue over google.

7

That is odd!

Can you try the recently release v1.61.0 and show the log trying to transfer a single file > 69M. Please include the flags -vv for debug info.

Thanks

8

Ok here's, what i did:

  • Upgraded RClone via HomeBrew to latest; Still using latest beta as well in parallel just because (v1.62.0-beta.6657.5aac8cfee5)

  • Uploaded same file (different names) to a specific folder to nail down what's going on

    • ÁÉÍÓÚáéíóúç.mkv and SameFileNoSpecialChar.mkv

  • SameFileNoSpecialChar.mkv transfered, no errors at all

  • LOG FOR ÁÉÍÓÚáéíóúç.mkv:

2022/12/21 10:48:17 DEBUG : rclone: Version "v1.61.0" starting with parameters ["rclone" "copy" "--progress" "-vv" "--log-file" "/Volumes/InLand256GB/A/RCLONE.log" "Cursos:001/ÁÉÍÓÚáéíóúç.mkv" "/Volumes/InLand256GB/A/"]
2022/12/21 10:48:17 DEBUG : Creating backend with remote "Cursos:001/ÁÉÍÓÚáéíóúç.mkv"
2022/12/21 10:48:17 DEBUG : Using config file from "/Users/josidu/.config/rclone/rclone.conf"
2022/12/21 10:48:17 DEBUG : FS sj://001/ÁÉÍÓÚáéíóúç.mkv: connecting...
2022/12/21 10:48:17 DEBUG : FS sj://001/ÁÉÍÓÚáéíóúç.mkv: connected:
2022/12/21 10:48:17 DEBUG : Creating backend with remote "/Volumes/InLand256GB/A/"
2022/12/21 10:48:17 DEBUG : fs cache: renaming cache item "/Volumes/InLand256GB/A/" to be canonical "/Volumes/InLand256GB/A"
2022/12/21 10:48:17 DEBUG : FS sj://001/ÁÉÍÓÚáéíóúç.mkv: ls ./
2022/12/21 10:48:17 DEBUG : FS sj://001/ÁÉÍÓÚáéíóúç.mkv: OBJ ls ./ ("001", "ÁÉÍÓÚáéíóúç.mkv")
2022/12/21 10:48:17 DEBUG : FS sj://001/ÁÉÍÓÚáéíóúç.mkv: opts &{Prefix:ÁÉÍÓÚáéíóúç.mkv/ Cursor: Recursive:false System:true Custom:true}
2022/12/21 10:48:17 DEBUG : Local file system at /Volumes/InLand256GB/A: Waiting for checks to finish
2022/12/21 10:48:17 DEBUG : Local file system at /Volumes/InLand256GB/A: Waiting for transfers to finish
2022/12/21 10:48:17 INFO : There was nothing to transfer
2022/12/21 10:48:17 INFO :
Transferred: 0 B / 0 B, -, 0 B/s, ETA -
Elapsed time: 0.1s

2022/12/21 10:48:17 DEBUG : 7 go routines active

Could be this related to Storj limitations and not RClone itself?

9

Ah, you are using a mac.

I suspect this is another episode of macOS and denormalized UTF-8 as when I try your example on Linux it works fine.

If you do

rclone lsf Cursos:001

do you see the file?

Try copying it back, but take its file name by cut and pasting the output of rclone lsf from the terminal.

I suspect you will find that works OK.

10

One special character in one folder name caused my entire remote mount (of rclone serve webdav remotecrypt:) to appear empty in Finder, but normal in Safari browser. Fixed by removing character.

edit: v1.61 beta, macOS 13, crypt remote of gdrive remote

11

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.