Some files are not copying to Dest Folder

Help and Support
1

When trying to copy a folder with multiple backup files to oracle cloud object storage some files are getting stuck at 0%.

The same issue happends when trying to copy only 1 file from folder.

                                   RCLONE VERSION

rclone v1.59.0

  • os/version: oracle 7.6 (64 bit)

  • os/kernel: 4.14.35-1844.5.3.el7uek.x86_64 (x86_64)

  • os/type: linux

  • os/arch: amd64

  • go/version: go1.17.5

  • go/linking: dynamic

  • go/tags: none

                                                         RCLONE CONFIG

Current remotes:

Name Type
==== ====
oci-bucket s3

-----Executed Commands

rclone --verbose --cache-workers 64 --transfers 64 --retries 32 copy $SOURCE/Full_bkp/24062022-22 oci-bucket:Backups/Full_Backup/24062022-22

-----Log Output

2022/08/10 20:47:55 NOTICE: s3: s3 provider "" not known - please set correctly
2022/08/10 20:47:55 INFO : backup_FULL_24062022-22.log: Copied (new)
2022/08/10 20:48:03 INFO : cntrl_2436_1_1108247344: Copied (new)
2022/08/10 20:48:55 INFO :
Transferred: 3.029 GiB / 514.080 GiB, 1%, 105.239 MiB/s, ETA 1h22m52s
Transferred: 2 / 14, 14%
Elapsed time: 1m0.1s
Transferring:

  •                      al_2431_1_1108247308: 19% /1.753Gi, 16.892Mi/s, 1m25s

  •                      al_2432_1_1108247309: 85% /1.087Gi, 29.058Mi/s, 5s

  •                      al_2433_1_1108247309: 20% /1.748Gi, 16.587Mi/s, 1m25s

  •                      al_2434_1_1108247309: 22% /1.745Gi, 16.720Mi/s, 1m23s

  •                      al_2435_1_1108247309: 99% /1008.140Mi, 25.847Mi/s, 0s
  • level0_full_PEBBM1_PEB…31_timestamp1108245605: 0% /73.702Gi, 0/s, -
  • level0_full_PEBBM1_PEB…41_timestamp1108245605: 0% /64.730Gi, 0/s, -
  • level0_full_PEBBM1_PEB…51_timestamp1108245605: 0% /83.693Gi, 0/s, -
  • level0_full_PEBBM1_PEB…61_timestamp1108245605: 0% /70.993Gi, 0/s, -
  • level0_full_PEBBM1_PEB…71_timestamp1108245605: 0% /72.116Gi, 0/s, -
  • level0_full_PEBBM1_PEB…81_timestamp1108245605: 0% /75.213Gi, 0/s, -
  • level0_full_PEBBM1_PEB…91_timestamp1108245605: 0% /66.289Gi, 0/s, -

2022/08/10 20:49:00 INFO : al_2435_1_1108247309: Copied (new)
2022/08/10 20:49:01 INFO : al_2432_1_1108247309: Copied (new)
2022/08/10 20:49:36 INFO : al_2434_1_1108247309: Copied (new)
2022/08/10 20:49:37 INFO : al_2433_1_1108247309: Copied (new)
2022/08/10 20:49:38 INFO : al_2431_1_1108247308: Copied (new)
2022/08/10 20:49:55 INFO :
Transferred: 7.344 GiB / 514.080 GiB, 1%, 33.954 MiB/s, ETA 4h14m42s
Transferred: 7 / 14, 50%
Elapsed time: 2m0.1s
Transferring:

  • level0_full_PEBBM1_PEB…31_timestamp1108245605: 0% /73.702Gi, 0/s, -
  • level0_full_PEBBM1_PEB…41_timestamp1108245605: 0% /64.730Gi, 0/s, -
  • level0_full_PEBBM1_PEB…51_timestamp1108245605: 0% /83.693Gi, 0/s, -
  • level0_full_PEBBM1_PEB…61_timestamp1108245605: 0% /70.993Gi, 0/s, -
  • level0_full_PEBBM1_PEB…71_timestamp1108245605: 0% /72.116Gi, 0/s, -
  • level0_full_PEBBM1_PEB…81_timestamp1108245605: 0% /75.213Gi, 0/s, -
  • level0_full_PEBBM1_PEB…91_timestamp1108245605: 0% /66.289Gi, 0/s, -

2022/08/10 20:50:55 INFO :
Transferred: 7.344 GiB / 514.080 GiB, 1%, 723.556 KiB/s, ETA 1w1d11h59m21s
Transferred: 7 / 14, 50%
Elapsed time: 3m0.1s
Transferring:

  • level0_full_PEBBM1_PEB…31_timestamp1108245605: 0% /73.702Gi, 0/s, -
  • level0_full_PEBBM1_PEB…41_timestamp1108245605: 0% /64.730Gi, 0/s, -
  • level0_full_PEBBM1_PEB…51_timestamp1108245605: 0% /83.693Gi, 0/s, -
  • level0_full_PEBBM1_PEB…61_timestamp1108245605: 0% /70.993Gi, 0/s, -
  • level0_full_PEBBM1_PEB…71_timestamp1108245605: 0% /72.116Gi, 0/s, -
  • level0_full_PEBBM1_PEB…81_timestamp1108245605: 0% /75.213Gi, 0/s, -
  • level0_full_PEBBM1_PEB…91_timestamp1108245605: 0% /66.289Gi, 0/s, -

^C2022/08/10 20:51:18 INFO : Signal received: interrupt
2022/08/10 20:51:18 INFO : Exiting...

2

hello and welcome to the forum,

--- the first issue is s3: s3 provider "" not known - please set correctly
oracle is not a first-class S3 provider, not listed at
https://rclone.org/s3/

cannot be sure, as the redacted config for that remote was not posted.
however, with the config file, for remote S3:,
might need to change
provider = xxx to
provider = Other

--- rclone needs to calculate the md5 hash for each file before upload can begin.
that takes time to compute and with that large number of --transfers and --checkers,
could be slowing down the machine.

--- might test without these --transfers 64 --retries 32
--- --cache-workers 64 - does nothing,

3

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.