What is the problem you are having with rclone?
moving a file from a serve to another I got
Not deleting source as copy failed: Update ReadFrom failed: sftp: "Failure" (SSH_FX_FAILURE)
Run the command 'rclone version' and share the full output of the command.
rclone v1.57.0
- os/version: debian 11.2 (64 bit)
- os/kernel: 5.10.0-9-amd64 (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.17.2
- go/linking: static
- go/tags: none
Which cloud storage system are you using? (eg Google Drive)
sftp
Source server is a debian 11, target server is a debian 10
The command you were trying to run (eg rclone copy /tmp remote:tmp
)
rclone move /var/www/backend/storage/product_image/outcoming assets:/var/www/asset-server/storage/app/originals_from_backend -vv
The rclone config contents with secrets removed.
Paste config here
[assets]
type = sftp
host = 192.168.x.y
user = realtebo
port = 22
pass = redacted
md5sum_command = md5sum
sha1sum_command = sha1sum
A log from the command with the -vv
flag
2022/02/21 10:27:53 DEBUG : rclone: Version "v1.57.0" starting with parameters ["rclone" "move" "/var/www/backend/storage/product_image/outcoming" "assets:/var/www/asset-server/storage/app/originals_from_backend" "-vv"]
2022/02/21 10:27:53 DEBUG : Creating backend with remote "/var/www/backend/storage/product_image/outcoming"
2022/02/21 10:27:53 DEBUG : Using config file from "/home/realtebo/.config/rclone/rclone.conf"
2022/02/21 10:27:53 DEBUG : Creating backend with remote "assets:/var/www/asset-server/storage/app/originals_from_backend"
2022/02/21 10:27:53 DEBUG : sftp://realtebo@192.168.w.z:22//var/www/asset-server/storage/app/originals_from_backend: New connection 192.168.x.y:44526->192.168.w.z:22 to "SSH-2.0-OpenSSH_7.9p1 Debian-10+deb10u2"
2022/02/21 10:27:55 DEBUG : 000984ec-732c-4192-bdc2-1d0c02d40f20.jpg: Removed after failed upload: sftp: "Failure" (SSH_FX_FAILURE)
2022/02/21 10:27:55 ERROR : 000984ec-732c-4192-bdc2-1d0c02d40f20.jpg: Failed to copy: Update ReadFrom failed: sftp: "Failure" (SSH_FX_FAILURE)
2022/02/21 10:27:55 ERROR : 000984ec-732c-4192-bdc2-1d0c02d40f20.jpg: Not deleting source as copy failed: Update ReadFrom failed: sftp: "Failure" (SSH_FX_FAILURE)
2022/02/21 10:27:55 DEBUG : sftp://realtebo@192.168.w.z:22//var/www/asset-server/storage/app/originals_from_backend: New connection 192.168.x.y:44820->192.168.w.z:22 to "SSH-2.0-OpenSSH_7.9p1 Debian-10+deb10u2"
2022/02/21 10:27:55 DEBUG : 00069582-77aa-4711-9880-d88d14f6a9f1.jpg: Removed after failed upload: sftp: "Failure" (SSH_FX_FAILURE)
2022/02/21 10:27:55 ERROR : 00069582-77aa-4711-9880-d88d14f6a9f1.jpg: Failed to copy: Update ReadFrom failed: sftp: "Failure" (SSH_FX_FAILURE)
2022/02/21 10:27:55 ERROR : 00069582-77aa-4711-9880-d88d14f6a9f1.jpg: Not deleting source as copy failed: Update ReadFrom failed: sftp: "Failure" (SSH_FX_FAILURE)
2022/02/21 10:27:55 DEBUG : 000b4a5e-dc57-41ac-b253-55937b6db245.jpg: Removed after failed upload: sftp: "Failure" (SSH_FX_FAILURE)
2022/02/21 10:27:55 ERROR : 000b4a5e-dc57-41ac-b253-55937b6db245.jpg: Failed to copy: Update ReadFrom failed: sftp: "Failure" (SSH_FX_FAILURE)
2022/02/21 10:27:55 ERROR : 000b4a5e-dc57-41ac-b253-55937b6db245.jpg: Not deleting source as copy failed: Update ReadFrom failed: sftp: "Failure" (SSH_FX_FAILURE)
2022/02/21 10:27:55 DEBUG : 0001b5f3-a1e6-4935-9eed-5da86fa42a56.jpg: Removed after failed upload: sftp: "Failure" (SSH_FX_FAILURE)
2022/02/21 10:27:55 ERROR : 0001b5f3-a1e6-4935-9eed-5da86fa42a56.jpg: Failed to copy: Update ReadFrom failed: sftp: "Failure" (SSH_FX_FAILURE)
2022/02/21 10:27:55 ERROR : 0001b5f3-a1e6-4935-9eed-5da86fa42a56.jpg: Not deleting source as copy failed: Update ReadFrom failed: sftp: "Failure" (SSH_FX_FAILURE)
2022/02/21 10:27:55 DEBUG : 000b7e37-15d1-4659-8345-06d781761434.jpg: Removed after failed upload: sftp: "Failure" (SSH_FX_FAILURE)
2022/02/21 10:27:55 ERROR : 000b7e37-15d1-4659-8345-06d781761434.jpg: Failed to copy: Update ReadFrom failed: sftp: "Failure" (SSH_FX_FAILURE)
2022/02/21 10:27:55 ERROR : 000b7e37-15d1-4659-8345-06d781761434.jpg: Not deleting source as copy failed: Update ReadFrom failed: sftp: "Failure" (SSH_FX_FAILURE)
The root folder I am trying to copy has this ownership/permissions
drwxrwsr-x 2 realtebo www-data 3538944 21 feb 11.18 outcoming
and rclone
is run as realtebo
from shell, without passing by cron, scripts, sudo,... etc
realtebo
is member of www-data
group
$groups
realtebo cdrom floppy audio dip www-data video plugdev netdev
File are as this
-rw-rw-r-- 1 www-data www-data 63221 18 feb 20.39 0001b5f3-a1e6-4935-9eed-5da86fa42a56.jpg
-rw-rw-r-- 1 www-data www-data 20381 21 feb 10.32 00056705-5552-47ed-8457-d191ac63dc91.jpg
I can manually delete a file from shell from realtebo users.
So I think is not a file permissions problem