Very slow Rclone sync to Ceph S3 bucket

Help and Support
1

What is the problem you are having with rclone?

I am trying to sync snapshots from a Netapp volume to a Ceph S3 bucket.
I used to install rclone with apt-get install command then I realized that this gets an old version of rclone (1.53.3-DEV).

So, I installed the latest version with curl as explained in the official documentation.
The problem is that the sync is very slow: 15 B/s in the last 24 hours.
Is there any way to speed this up considering I am planning to sync around 4TB.

image

Run the command 'rclone version' and share the full output of the command.

rclone v1.65.0

  • os/version: ubuntu 22.04 (64 bit)
  • os/kernel: 4.18.0-372.71.1.el8_6.x86_64 (x86_64)
  • os/type: linux
  • os/arch: amd64
  • go/version: go1.21.4

Which cloud storage system are you using? (eg Google Drive)

Ceph S3 (Crypt)

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone --config /config/rclone.conf --stats-one-line --stats=1s -v sync /data/snapshot crypt:/data

Please run 'rclone config redacted' and share the full output. If you get command not found, please make sure to update rclone.

[ceph]
type = s3
provider = Ceph
env_auth = false
access_key_id = 
secret_access_key = 
endpoint = 

[crypt]
type = crypt
remote = 
filename_encryption = off
password = 
password2 =

A log from the command that you were trying to run with the -vv flag

The logs using -v are attached in the screen above.

2

welcome to the forum,

when you posted, there was a template of questions for you to answer.
help up to help you and answer all the questions.

need to speed-test the ceph server, using something other than rclone.

3

Thank you for your answer.
The ceph server is working fine. I was able to sync the 4TB in 5 days with rclone version (1.53.3-DEV) but the problem appeared with this version when the pod running the rclone script got evicted due to low resources on the node. When I triggered the job again, it got stuck at 0 for hours.
So upon investigation, I realized that I am using an old version with DEV tag and once I upgraded to the latest version, it started the sync again with around 250KB/s but it slows down to 15 B/s in the past 24 hours.

4

keep in mind, for s3 remotes, there is a two step process to upload a file.

  1. compute the md5 hash
  2. upload the file.

please, third time asking for basic info?
need to post the redacted config file and a debug log.

5

understand, we are just volunteers, cannot see into your machine.

post a full debug log, that shows the problem.
use -vv, not -v

or better yet.
rclone sync --log-level=DEBUG --log-file=~/rclone.log --progress --config /config/rclone.conf /data/snapshot crypt:/data

6

Yeah, I really appreciate your help.
I executed it with -vv but since I have 2.3TB already synced the only logs I am getting:
'''
....
2023/11/29 16:13:36 DEBUG : 1.xml: Size and modification time the same (differ by 0s, within tolerance 1ns)
2023/11/29 16:13:36 DEBUG : 1.xml: Unchanged skipping
2023/11/29 16:13:37 INFO : 0 B / 0 B, -, 0 B/s, ETA -
2023/11/29 16:13:37 DEBUG : 2.xml: Size and modification time the same (differ by 0s, within tolerance 1ns)
2023/11/29 16:13:37 DEBUG : 2.xml: Unchanged skipping
2023/11/29 16:13:37 DEBUG : 3.xml: Size and modification time the same (differ by 0s, within tolerance 1ns)
2023/11/29 16:13:37 DEBUG : 3.xml: Unchanged skipping
...
'''
I will provide a full debug once I got another results. Thank you for your help.

7

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.