Unable to copy from remote but mount works

agneev · May 13, 2020, 2:26pm

What is the problem you are having with rclone?

I can copy files from the rclone mount but copying directly from the remote doesn't work.

What is your rclone version (output from `rclone version`)

rclone v1.51.0
- os/arch: linux/arm
- go version: go1.13.7

Which OS you are using and how many bits (eg Windows 7, 64 bit)

Raspbian Buster - 32-bit

Which cloud storage system are you using? (eg Google Drive)

<Put.io>

The command you were trying to run (eg `rclone copy /tmp remote:tmp`)

rclone copy putio:test_folder/ ~/fwb --multi-thread-streams 6 -vv --buffer-size 128M --dry-run

A log from the command with the `-vv` flag (eg output from `rclone -vv copy /tmp remote:tmp`)

agneev@pi4:~ $ rclone copy putio:test_folder/ ~/fwb --multi-thread-streams 6 -vv --buffer-size 128M --dry-run

2020/05/13 19:50:57 DEBUG : rclone: Version "v1.51.0" starting with parameters ["rclone" "copy" "putio:test_folder/" "/home/agneev/fwb" "--multi-thread-streams" "6" "-vv" "--buffer-size" "128M" "--dry-run"]
2020/05/13 19:50:57 DEBUG : Using config file from "/home/agneev/.config/rclone/rclone.conf"
2020/05/13 19:50:59 ERROR : : error reading source directory: directory not found
2020/05/13 19:50:59 INFO  : Local file system at /home/agneev/fwb: Waiting for checks to finish
2020/05/13 19:50:59 INFO  : Local file system at /home/agneev/fwb: Waiting for transfers to finish
2020/05/13 19:50:59 ERROR : Attempt 1/3 failed with 1 errors and: directory not found
2020/05/13 19:50:59 ERROR : : error reading source directory: directory not found
2020/05/13 19:50:59 INFO  : Local file system at /home/agneev/fwb: Waiting for checks to finish
2020/05/13 19:50:59 INFO  : Local file system at /home/agneev/fwb: Waiting for transfers to finish
2020/05/13 19:50:59 ERROR : Attempt 2/3 failed with 1 errors and: directory not found
2020/05/13 19:50:59 ERROR : : error reading source directory: directory not found
2020/05/13 19:50:59 INFO  : Local file system at /home/agneev/fwb: Waiting for checks to finish
2020/05/13 19:50:59 INFO  : Local file system at /home/agneev/fwb: Waiting for transfers to finish
2020/05/13 19:50:59 ERROR : Attempt 3/3 failed with 1 errors and: directory not found
2020/05/13 19:50:59 Failed to copy: directory not found

Copying from the mount:

agneev@pi4:~ $ rclone copy /mnt/putio/test_folder/ ~/fwb --multi-thread-streams 6 -vv --buffer-size 128M --dry-run
2020/05/13 19:51:31 DEBUG : rclone: Version "v1.51.0" starting with parameters ["rclone" "copy" "/mnt/putio/test_folder/" "/home/agneev/fwb" "--multi-thread-streams" "6" "-vv" "--buffer-size" "128M" "--dry-run"]
2020/05/13 19:51:31 DEBUG : Using config file from "/home/agneev/.config/rclone/rclone.conf"
2020/05/13 19:51:33 NOTICE: test.mkv: Not copying as --dry-run
2020/05/13 19:51:33 NOTICE: test2.txt: Not copying as --dry-run
2020/05/13 19:51:33 INFO  : Local file system at /home/agneev/fwb: Waiting for checks to finish
2020/05/13 19:51:33 INFO  : Local file system at /home/agneev/fwb: Waiting for transfers to finish
2020/05/13 19:51:33 NOTICE: test3.nfo: Not copying as --dry-run
2020/05/13 19:51:33 INFO  : 
Transferred:   	         0 / 0 Bytes, -, 0 Bytes/s, ETA -
Transferred:            3 / 3, 100%
Elapsed time:         0.0s

2020/05/13 19:51:33 DEBUG : 3 go routines active
2020/05/13 19:51:33 DEBUG : rclone: Version "v1.51.0" finishing with parameters ["rclone" "copy" "/mnt/putio/test_folder/" "/home/agneev/fwb" "--multi-thread-streams" "6" "-vv" "--buffer-size" "128M" "--dry-run"]

asdffdsa · May 13, 2020, 2:33pm

hi,
your command you posted and the command in the debug do not match.

is this correct "putio:test_follder/ as there are two l characters?

agneev · May 13, 2020, 2:35pm

Attempted to mask the actual filenames

Animosity022 · May 13, 2020, 4:38pm

What does:

rclone ls putio:test_folder

show?

agneev · May 13, 2020, 4:53pm

The correct files.

Animosity022 · May 13, 2020, 4:56pm

Ok, I can't see your screen so not sure what the output looks like to help progress.

agneev · May 13, 2020, 5:01pm

Apparently the trailing slash (rclone copy putio:test_folder /) is causing the issue...

Without it, it works as expected...

agneev@pi4:~ $ rclone copy putio:Snitch.2013.1080p.BluRay.x264.TrueHD.7.1.Atmos-SWTYBLZ/  ~/fwb --multi-thread-streams 6 -vv --buffer-size 128M --dry-run
2020/05/13 22:30:08 DEBUG : rclone: Version "v1.51.0" starting with parameters ["rclone" "copy" "putio:Snitch.2013.1080p.BluRay.x264.TrueHD.7.1.Atmos-SWTYBLZ/" "/home/agneev/fwb" "--multi-thread-streams" "6" "-vv" "--buffer-size" "128M" "--dry-run"]
2020/05/13 22:30:08 DEBUG : Using config file from "/home/agneev/.config/rclone/rclone.conf"
2020/05/13 22:30:10 ERROR : : error reading source directory: directory not found
2020/05/13 22:30:10 INFO  : Local file system at /home/agneev/fwb: Waiting for checks to finish
2020/05/13 22:30:10 INFO  : Local file system at /home/agneev/fwb: Waiting for transfers to finish
2020/05/13 22:30:10 ERROR : Attempt 1/3 failed with 1 errors and: directory not found
2020/05/13 22:30:10 ERROR : : error reading source directory: directory not found
2020/05/13 22:30:10 INFO  : Local file system at /home/agneev/fwb: Waiting for checks to finish
2020/05/13 22:30:10 INFO  : Local file system at /home/agneev/fwb: Waiting for transfers to finish
2020/05/13 22:30:10 ERROR : Attempt 2/3 failed with 1 errors and: directory not found
2020/05/13 22:30:11 ERROR : : error reading source directory: directory not found
2020/05/13 22:30:11 INFO  : Local file system at /home/agneev/fwb: Waiting for checks to finish
2020/05/13 22:30:11 INFO  : Local file system at /home/agneev/fwb: Waiting for transfers to finish
2020/05/13 22:30:11 ERROR : Attempt 3/3 failed with 1 errors and: directory not found
2020/05/13 22:30:11 Failed to copy: directory not found

agneev@pi4:~ $ rclone copy putio:Snitch.2013.1080p.BluRay.x264.TrueHD.7.1.Atmos-SWTYBLZ  ~/fwb --multi-thread-streams 6 -vv --buffer-size 128M --dry-run
2020/05/13 22:30:18 DEBUG : rclone: Version "v1.51.0" starting with parameters ["rclone" "copy" "putio:Snitch.2013.1080p.BluRay.x264.TrueHD.7.1.Atmos-SWTYBLZ" "/home/agneev/fwb" "--multi-thread-streams" "6" "-vv" "--buffer-size" "128M" "--dry-run"]
2020/05/13 22:30:18 DEBUG : Using config file from "/home/agneev/.config/rclone/rclone.conf"
2020/05/13 22:30:20 NOTICE: RARBG.txt: Not copying as --dry-run
2020/05/13 22:30:20 NOTICE: Snitch.2013.1080p.BluRay.x264.TrueHD.7.1.Atmos-SWTYBLZ.mkv: Not copying as --dry-run
2020/05/13 22:30:20 INFO  : Local file system at /home/agneev/fwb: Waiting for checks to finish
2020/05/13 22:30:20 INFO  : Local file system at /home/agneev/fwb: Waiting for transfers to finish
2020/05/13 22:30:20 INFO  : 
Transferred:   	         0 / 0 Bytes, -, 0 Bytes/s, ETA -
Transferred:            2 / 2, 100%
Elapsed time:         0.0s

2020/05/13 22:30:20 DEBUG : 4 go routines active
2020/05/13 22:30:20 DEBUG : rclone: Version "v1.51.0" finishing with parameters ["rclone" "copy" "putio:Snitch.2013.1080p.BluRay.x264.TrueHD.7.1.Atmos-SWTYBLZ" "/home/agneev/fwb" "--multi-thread-streams" "6" "-vv" "--buffer-size" "128M" "--dry-run"]

Animosity022 · May 13, 2020, 5:05pm

Without seeing what the ls looks like, dunno.

agneev · May 13, 2020, 5:17pm

agneev@pi4:~ $ rclone ls putio:Snitch.2013.1080p.BluRay.x264.TrueHD.7.1.Atmos-SWTYBLZ
       31 RARBG.txt
13726219324 Snitch.2013.1080p.BluRay.x264.TrueHD.7.1.Atmos-SWTYBLZ.mkv

Animosity022 · May 13, 2020, 5:21pm

I'd assume with putio, it's trying to find a directory matching that to transfer but not a file based on your two tests. In general, a trailing slash is looking for a directory rather than a file so if you are looking for a file, it's best to not use a trailing /.

agneev · May 14, 2020, 7:58am

Obviously I'm trying to transfer a folder here in case the logs above weren't clear enough.

ncw · May 14, 2020, 10:54am

Ah, this is a bug then! Try this which should fix the problem.

https://beta.rclone.org/v1.51.0-322-g8c9c86c3-beta/ (uploaded in 15-30 mins)

system · June 16, 2020, 9:53am

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.