What is the problem you are having with rclone?
I set up an iclouddrive
remote and a crypt
remote yesterday and ran an initial backup overnight. The estimated backup time is sitting at around 10 weeks.
The same initial backup for OneDrive finished overnight. Also using crypt
.
It looks like it might be due to rate limit errors, but I have tried with default transfers and checkers and still see them occasionally. Transfer speeds generally just seem very slow.
Run the command 'rclone version' and share the full output of the command.
rclone v1.69.0
- os/version: darwin 15.2 (64 bit)
- os/kernel: 24.2.0 (arm64)
- os/type: darwin
- os/arch: arm64 (ARMv8 compatible)
- go/version: go1.23.4
- go/linking: dynamic
- go/tags: none
Which cloud storage system are you using? (eg Google Drive)
iclouddrive
The command you were trying to run (eg rclone copy /tmp remote:tmp
)
rclone sync ~/Documents icloudsecure:Documents --exclude=*/node_modules/ --exclude=*/.angular/ --progress --transfers 16 --checkers 64 --fast-list --max-backlog 999999 --bind 0.0.0.0 --backup-dir icloudsecure:Documents-old_${now}
I also tried with default transfers
and checkers
and get similar results.
Please run 'rclone config redacted' and share the full output. If you get command not found, please make sure to update rclone.
[icloud]
type = iclouddrive
apple_id = XXX
password = XXX
cookies = XXX
trust_token = XXX
[icloudsecure]
type = crypt
remote = icloud:_encrypted
filename_encryption = off
directory_name_encryption = false
password = XXX
A log from the command that you were trying to run with the -vv
flag
2025/02/24 09:32:31 DEBUG : pacer: low level retry 2/10 (error HTTP error 409 (409 Conflict) returned body: "{\n \"uuid\" : \"REDACTED\",\n \"messageForDeveloper\" : \"Sync zone CAS Op-Lock failed. There was a concurrent write and this operation was rejected. Retry request...\",\n \"error_code\" : \"ZONE_BUSY\",\n \"serverErrorCode\" : \"ZONE_BUSY\",\n \"reason\" : \"Sync zone CAS Op-Lock failed. There was a concurrent write and this operation was rejected. Retry request...\"\n}")
Thank you for testing and feedback!
I hope you are not using it for anything important (you should not).
Keep in mind that it is BETA remote. So things can break, change etc.
I'm continuing to use multiple remotes, so it's mainly just a mirror. iCloud support is very welcomed though, since I've got a couple unused terabytes.
Is this a known issue, or is it only affecting some users?
No idea. Let's see if other iCloud users comment.
At the moment any serious use is rather limited IMO - mainly due to 30 day max token validity and multiple bugs:
opened 12:31AM - 23 Feb 25 UTC
#### The associated forum post URL from `https://forum.rclone.org`
https://forum… .rclone.org/t/icloud-drive-crashes-when-accessing-shared-icloud-folder/50162
#### What is the problem you are having with rclone?
When syncing a local directory with my iCloud Drive, rclone crashes when it attempts to access a shared iCloud folder that somebody else created and shared with me.
#### What is your rclone version (output from `rclone version`)
```
rclone v1.69.1
- os/version: fedora 41 (64 bit)
- os/kernel: 6.12.13-200.fc41.x86_64 (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.24.0
- go/linking: static
- go/tags: none
```
#### Which OS you are using and how many bits (e.g. Windows 7, 64 bit)
fedora 41 (64 bit)
#### Which cloud storage system are you using? (e.g. Google Drive)
iclouddrive
#### The command you were trying to run (e.g. `rclone copy /tmp remote:tmp`)
```
rclone mount -vv --vfs-cache-mode full iCloud: iCloud/
```
Config:
```
[iCloud]
type = iclouddrive
apple_id = [email]
password = [password]
cookies = [cookies]
trust_token = [token]
```
#### A log from the command with the `-vv` flag (e.g. output from `rclone -vv copy /tmp remote:tmp`)
```
2025/02/19 20:49:55 DEBUG : /: Lookup: name="[SHARED FOLDER]"
2025/02/19 20:49:55 DEBUG : /: >Lookup: node=[SHARED FOLDER]/, err=<nil>
2025/02/19 20:49:55 DEBUG : [SHARED FOLDER]/: Attr:
2025/02/19 20:49:55 DEBUG : [SHARED FOLDER]/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=<nil>
2025/02/19 20:49:55 DEBUG : /: Lookup: name="[SHARED FOLDER]"
2025/02/19 20:49:55 DEBUG : /: >Lookup: node=[SHARED FOLDER]/, err=<nil>
2025/02/19 20:49:55 DEBUG : [SHARED FOLDER]/: Attr:
2025/02/19 20:49:55 DEBUG : [SHARED FOLDER]/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=<nil>
2025/02/19 20:49:55 DEBUG : /: Lookup: name="[SHARED FOLDER]"
2025/02/19 20:49:55 DEBUG : /: >Lookup: node=[SHARED FOLDER]/, err=<nil>
2025/02/19 20:49:55 DEBUG : [SHARED FOLDER]/: Attr:
2025/02/19 20:49:55 DEBUG : [SHARED FOLDER]/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=<nil>
2025/02/19 20:49:55 DEBUG : /: Attr:
2025/02/19 20:49:55 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=<nil>
2025/02/19 20:49:55 DEBUG : /: Lookup: name=".Trash"
2025/02/19 20:49:55 DEBUG : /: >Lookup: node=<nil>, err=no such file or directory
2025/02/19 20:49:55 DEBUG : /: Lookup: name=".Trash-1000"
2025/02/19 20:49:55 DEBUG : /: >Lookup: node=.Trash-1000/, err=<nil>
2025/02/19 20:49:55 DEBUG : .Trash-1000/: Attr:
2025/02/19 20:49:55 DEBUG : .Trash-1000/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=<nil>
2025/02/19 20:49:55 DEBUG : [SHARED FOLDER]/: ReadDirAll:
2025/02/19 20:49:55 DEBUG : [SHARED FOLDER]/: >ReadDirAll: item=5, err=<nil>
2025/02/19 20:49:55 DEBUG : [SHARED FOLDER]/: Lookup: name="Screenshot 2024-03-05 at 10.14.58\u202fAM.png"
2025/02/19 20:49:55 DEBUG : [SHARED FOLDER]/: >Lookup: node=[SHARED FOLDER]/Screenshot 2024-03-05 at 10.14.58 AM.png, err=<nil>
2025/02/19 20:49:55 DEBUG : [SHARED FOLDER]/Screenshot 2024-03-05 at 10.14.58 AM.png: Attr:
2025/02/19 20:49:55 DEBUG : [SHARED FOLDER]/Screenshot 2024-03-05 at 10.14.58 AM.png: >Attr: a=valid=1s ino=0 size=931855 mode=-rw-r--r--, err=<nil>
2025/02/19 20:49:55 DEBUG : [SHARED FOLDER]/: Lookup: name=".hidden"
2025/02/19 20:49:55 DEBUG : [SHARED FOLDER]/: >Lookup: node=<nil>, err=no such file or directory
2025/02/19 20:49:55 DEBUG : [SHARED FOLDER]/Screenshot 2024-03-05 at 10.14.58 AM.png: Open: flags=OpenReadOnly+0x40000
2025/02/19 20:49:55 DEBUG : [SHARED FOLDER]/Screenshot 2024-03-05 at 10.14.58 AM.png: Open: flags=O_RDONLY|0x40000
2025/02/19 20:49:55 DEBUG : [SHARED FOLDER]/Screenshot 2024-03-05 at 10.14.58 AM.png: newRWFileHandle:
2025/02/19 20:49:55 DEBUG : [SHARED FOLDER]/Screenshot 2024-03-05 at 10.14.58 AM.png: >newRWFileHandle: err=<nil>
2025/02/19 20:49:55 DEBUG : [SHARED FOLDER]/Screenshot 2024-03-05 at 10.14.58 AM.png: >Open: fd=[SHARED FOLDER]/Screenshot 2024-03-05 at 10.14.58 AM.png (rw), err=<nil>
2025/02/19 20:49:55 DEBUG : [SHARED FOLDER]/Screenshot 2024-03-05 at 10.14.58 AM.png: >Open: fh=&{[SHARED FOLDER]/Screenshot 2024-03-05 at 10.14.58 AM.png (rw)}, err=<nil>
2025/02/19 20:49:55 DEBUG : &{[SHARED FOLDER]/Screenshot 2024-03-05 at 10.14.58 AM.png (rw)}: Read: len=32768, offset=0
2025/02/19 20:49:55 DEBUG : [SHARED FOLDER]/Screenshot 2024-03-05 at 10.14.58 AM.png(0xc000c5f840): _readAt: size=32768, off=0
2025/02/19 20:49:55 DEBUG : [SHARED FOLDER]/Screenshot 2024-03-05 at 10.14.58 AM.png(0xc000c5f840): openPending:
2025/02/19 20:49:55 DEBUG : [SHARED FOLDER]/Screenshot 2024-03-05 at 10.14.58 AM.png: vfs cache: checking remote fingerprint "931855,2024-03-05 15:15:04 +0000 UTC" against cached fingerprint "931855,2024-03-05 15:15:04 +0000 UTC"
2025/02/19 20:49:55 DEBUG : [SHARED FOLDER]/Screenshot 2024-03-05 at 10.14.58 AM.png: vfs cache: truncate to size=931855 (not needed as size correct)
2025/02/19 20:49:55 DEBUG : [SHARED FOLDER]: Added virtual directory entry vAddFile: "Screenshot 2024-03-05 at 10.14.58\u202fAM.png"
2025/02/19 20:49:55 DEBUG : [SHARED FOLDER]/Screenshot 2024-03-05 at 10.14.58 AM.png(0xc000c5f840): >openPending: err=<nil>
2025/02/19 20:49:55 DEBUG : vfs cache: looking for range={Pos:0 Size:32768} in [] - present false
2025/02/19 20:49:55 DEBUG : [SHARED FOLDER]/Screenshot 2024-03-05 at 10.14.58 AM.png: ChunkedReader.RangeSeek from -1 to 0 length -1
2025/02/19 20:49:55 DEBUG : [SHARED FOLDER]/Screenshot 2024-03-05 at 10.14.58 AM.png: ChunkedReader.Read at -1 length 32768 chunkOffset 0 chunkSize 134217728
2025/02/19 20:49:55 DEBUG : [SHARED FOLDER]/Screenshot 2024-03-05 at 10.14.58 AM.png: ChunkedReader.openRange at 0 length 134217728
panic: runtime error: invalid memory address or nil pointer dereference
[signal SIGSEGV: segmentation violation code=0x1 addr=0x10 pc=0x1235c2f]
goroutine 720 [running]:
github.com/rclone/rclone/backend/iclouddrive/api.(*DriveService).DownloadFile(0xc00006f240, {0x2c21d88, 0x40da320}, {0x0, 0x0}, {0xc000566bc0, 0x2, 0x2})
github.com/rclone/rclone/backend/iclouddrive/api/drive.go:257 +0x1af
github.com/rclone/rclone/backend/iclouddrive.(*Object).Open.func1()
github.com/rclone/rclone/backend/iclouddrive/iclouddrive.go:1024 +0xd1
github.com/rclone/rclone/fs.pacerInvoker(0x1, 0xa, 0xc000580008?)
github.com/rclone/rclone/fs/pacer.go:88 +0x32
github.com/rclone/rclone/lib/pacer.(*Pacer).call(0xc000bd01e0, 0xc000d657c0, 0xa)
github.com/rclone/rclone/lib/pacer/pacer.go:197 +0x7c
github.com/rclone/rclone/lib/pacer.(*Pacer).Call(0xc000bd01e0, 0xc000d657c0)
github.com/rclone/rclone/lib/pacer/pacer.go:216 +0x93
github.com/rclone/rclone/backend/iclouddrive.(*Object).Open(0xc000db99a0, {0x2c21d88, 0x40da320}, {0xc000566bc0, 0x2, 0x2})
github.com/rclone/rclone/backend/iclouddrive/iclouddrive.go:1013 +0x1ca
github.com/rclone/rclone/fs/chunkedreader.(*sequential).openRange(0xc0000267e0)
github.com/rclone/rclone/fs/chunkedreader/sequential.go:209 +0x4e5
github.com/rclone/rclone/fs/chunkedreader.(*sequential).Read(0xc0000267e0, {0xc000d0a000?, 0xc00092be30?, 0x477e79?})
github.com/rclone/rclone/fs/chunkedreader/sequential.go:73 +0x2ff
io.copyBuffer({0x2bfb1c0, 0xc000b8f530}, {0x7f959bc78020, 0xc0000267e0}, {0x0, 0x0, 0x0})
io/io.go:429 +0x190
io.Copy(...)
io/io.go:388
github.com/rclone/rclone/fs/accounting.(*Account).WriteTo(0xc000b70500, {0x2c0bb00, 0xc000026770})
github.com/rclone/rclone/fs/accounting/accounting.go:413 +0x13c
github.com/rclone/rclone/vfs/vfscache/downloaders.(*downloader).download(0x0?)
github.com/rclone/rclone/vfs/vfscache/downloaders/downloaders.go:628 +0x28
github.com/rclone/rclone/vfs/vfscache/downloaders.(*Downloaders)._newDownloader.func1()
github.com/rclone/rclone/vfs/vfscache/downloaders/downloaders.go:195 +0x72
created by github.com/rclone/rclone/vfs/vfscache/downloaders.(*Downloaders)._newDownloader in goroutine 687
github.com/rclone/rclone/vfs/vfscache/downloaders/downloaders.go:193 +0x1fb
```
#### How to use GitHub
* Please use the 👍 [reaction](https://blog.github.com/2016-03-10-add-reactions-to-pull-requests-issues-and-comments/) to show that you are affected by the same issue.
* Please don't comment if you have no relevant information to add. It's just extra noise for everyone subscribed to this issue.
* Subscribe to receive notifications on status change and new comments.
opened 01:10PM - 18 Feb 25 UTC
iWork files generated or modified by iWork Web does not show correct file size i… n `rclone` and cannot be downloaded successfully.
Just create any file through iWork Web, and then download it using `rclone`.
opened 07:51AM - 27 Nov 24 UTC
bug
Remote: icloud drive
#### The associated forum post URL from `https://forum.rclone.org`
#### W… hat is the problem you are having with rclone?
SIGSEGV crash with iclouddrive backend. Tends to happen after many files (thousands) have been transferred.
#### What is your rclone version (output from `rclone version`)
rclone v1.69.0-beta.8419.ca8860177
- os/version: debian 12.8 (64 bit)
- os/kernel: 6.1.0-26-amd64 (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.23.3
- go/linking: static
- go/tags: none
#### Which OS you are using and how many bits (e.g. Windows 7, 64 bit)
Debian GNU/Linux 12
#### Which cloud storage system are you using? (e.g. Google Drive)
iclouddrive
#### The command you were trying to run (e.g. `rclone copy /tmp remote:tmp`)
rclone sync icloud:/ Drive/ --log-level INFO --log-file=rclone.log --ignore-size --ignore-existing
#### A log from the command with the `-vv` flag (e.g. output from `rclone -vv copy /tmp remote:tmp`)
2024/11/26 17:41:57 INFO : Code/web/deluge-cmd/node_modules/electron-installer-flatpak/node_modules/async/node_modules/lodash/fp/equals.js: Copied (new)
2024/11/26 17:41:58 INFO : Code/web/deluge-cmd/node_modules/electron-installer-flatpak/node_modules/async/node_modules/lodash/fp/escapeRegExp.js: Copied (new)
2024/11/26 17:41:59 INFO : Code/web/deluge-cmd/node_modules/electron-installer-flatpak/node_modules/async/node_modules/lodash/fp/extend.js: Copied (new)
2024/11/26 17:41:59 INFO : Code/web/deluge-cmd/node_modules/electron-installer-flatpak/node_modules/async/node_modules/lodash/fp/every.js: Copied (new)
2024/11/26 17:41:59 INFO : Code/web/deluge-cmd/node_modules/electron-installer-flatpak/node_modules/async/node_modules/lodash/fp/extendAll.js: Copied (new)
2024/11/26 17:41:59 INFO : Code/web/deluge-cmd/node_modules/electron-installer-flatpak/node_modules/async/node_modules/lodash/fp/extendAllWith.js: Copied (new)
2024/11/26 17:42:05 INFO :
Transferred: 8.252 MiB / 269.576 MiB, 3%, 0 B/s, ETA -
Errors: 47 (retrying may help)
Checks: 54714 / 54714, 100%
Transferred: 2159 / 3170, 68%
Elapsed time: 17m59.9s
Transferring:
* Code/web/deluge-cmd/no…odash/fp/extendWith.js: transferring
* Code/web/deluge-cmd/no…ules/lodash/fp/fill.js: transferring
* Code/web/deluge-cmd/no…es/lodash/fp/filter.js: transferring
* Code/web/deluge-cmd/no…ules/lodash/fp/find.js: transferring
panic: runtime error: invalid memory address or nil pointer dereference
[signal SIGSEGV: segmentation violation code=0x1 addr=0x10 pc=0x1238cd2]
goroutine 73 [running]:
github.com/rclone/rclone/backend/iclouddrive/api.(*DriveService).DownloadFile(0xc000ba4cc0, {0x2b71100, 0xc000bd42d0}, {0xc00a12d8c0, 0x205}, {0xc00555b1a0, 0x1, 0x1})
github.com/rclone/rclone/backend/iclouddrive/api/drive.go:257 +0x192
github.com/rclone/rclone/backend/iclouddrive.(*Object).Open.func1()
github.com/rclone/rclone/backend/iclouddrive/iclouddrive.go:1024 +0xd1
github.com/rclone/rclone/fs.pacerInvoker(0x1, 0xa, 0x50?)
github.com/rclone/rclone/fs/pacer.go:88 +0x32
github.com/rclone/rclone/lib/pacer.(*Pacer).call(0xc000bac120, 0xc001c49c20, 0xa)
github.com/rclone/rclone/lib/pacer/pacer.go:197 +0x7c
github.com/rclone/rclone/lib/pacer.(*Pacer).Call(0xc000bac120, 0xc001c49c20)
github.com/rclone/rclone/lib/pacer/pacer.go:216 +0x92
github.com/rclone/rclone/backend/iclouddrive.(*Object).Open(0xc003fb3d60, {0x2b71100, 0xc000bd42d0}, {0xc00555b1a0, 0x1, 0x1})
github.com/rclone/rclone/backend/iclouddrive/iclouddrive.go:1013 +0x1cd
github.com/rclone/rclone/fs/operations.(*ReOpen).open(0xc00024afc0)
github.com/rclone/rclone/fs/operations/reopen.go:147 +0x109
github.com/rclone/rclone/fs/operations.NewReOpen({0x2b71100, 0xc000bd42d0}, {0x2b87e40, 0xc003fb3d60}, 0xa, {0xc00555b180, 0x1, 0x1})
github.com/rclone/rclone/fs/operations/reopen.go:102 +0x50b
github.com/rclone/rclone/fs/operations.Open({0x2b71100, 0xc000bd42d0}, {0x2b87e40, 0xc003fb3d60}, {0xc00555b180, 0x1, 0x1})
github.com/rclone/rclone/fs/operations/reopen.go:124 +0x6b
github.com/rclone/rclone/fs/operations.(*copy).manualCopy(0xc005058bd0, {0x2b71100, 0xc000bd42d0})
github.com/rclone/rclone/fs/operations/copy.go:261 +0x4dc
github.com/rclone/rclone/fs/operations.(*copy).copy(0xc005058bd0, {0x2b71100, 0xc000bd42d0})
github.com/rclone/rclone/fs/operations/copy.go:310 +0x176
github.com/rclone/rclone/fs/operations.Copy({0x2b71100, 0xc000bd42d0}, {0x2b88310, 0xc000bd8000}, {0x0, 0x0}, {0xc003a30000, 0x6d}, {0x2b87e40, 0xc003fb3d60})
github.com/rclone/rclone/fs/operations/copy.go:412 +0x493
github.com/rclone/rclone/fs/sync.(*syncCopyMove).pairCopyOrMove(0xc0001c4508, {0x2b71100, 0xc000bd42d0}, 0xc000bd4230, {0x2b88310, 0xc000bd8000}, 0x4b, 0x0?)
github.com/rclone/rclone/fs/sync/sync.go:501 +0x1fe
created by github.com/rclone/rclone/fs/sync.(*syncCopyMove).startTransfers in goroutine 1
github.com/rclone/rclone/fs/sync/sync.go:531 +0x6b
#### How to use GitHub
* Please use the 👍 [reaction](https://blog.github.com/2016-03-10-add-reactions-to-pull-requests-issues-and-comments/) to show that you are affected by the same issue.
* Please don't comment if you have no relevant information to add. It's just extra noise for everyone subscribed to this issue.
* Subscribe to receive notifications on status change and new comments.
1 Like