Storj error when syncing

Suspected Bug
1

What is the problem you are having with rclone?

While syncing with Storj I see some errors

FS sj://gosrc: cp input ./go-speeltuin/zitadel/docs/static/img/console_clients_my_first_spa_config.png [HashesOption([])]: uplink: upload done: already committed
	storj.io/uplink.errwrapf:99
	storj.io/uplink.(*Upload).Abort:161
	github.com/rclone/rclone/backend/storj.(*Fs).Put.func1:546
	github.com/rclone/rclone/backend/storj.(*Fs).Put:579
	github.com/rclone/rclone/fs/operations.Copy:501
	github.com/rclone/rclone/fs/sync.(*syncCopyMove).pairCopyOrMove:423

Run the command 'rclone version' and share the full output of the command.

1.60

Which cloud storage system are you using? (eg Google Drive)

Storj

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone sync ~/data/ remote_storj:mybucket/ --delete-during -v -P --modify-window 15s --transfers=5 --checkers=50 --copy-links --ignore-size --config=rclone.config


#### The rclone config contents with secrets removed.  
<!--  You should use 3 backticks to begin and end your paste to make it readable.   -->





#### A log from the command with the `-vv` flag  
<!-- You should use 3 backticks to begin and end your paste to make it readable.  Or use a service such as https://pastebin.com or https://gist.github.com/   -->
2

Can you type 'rclone version' and share the ouput.

Can you include your rclone.conf as noted.

Can you run the command with -vv and share the debug log?

3

This is the error message which kind of indicates things are ok and we should be ignoring it.

Can you reproduce this error easily?

4 
rclone v1.60.0
- os/version: darwin 13.0 (64 bit)
- os/kernel: 22.1.0 (x86_64)
- os/type: darwin
- os/arch: amd64
- go/version: go1.19.2
- go/linking: dynamic
- go/tags: cmount
2022/10/29 08:56:21 DEBUG : rclone: Version "v1.60.0" starting with parameters ["/Users/[mydirname]/Applications/RClone/rclone" "sync" "/Users/[mydirname]/data/Go" "remote_storj:gosrc/" "--delete-during" "-v" "-P" "--modify-window" "15s" "--transfers=5" "--checkers=10" "--copy-links" "--ignore-size" "--config=/Users/[mydirname]/Applications/RClone/rclone.config" "-vv"]
2022/10/29 08:56:21 DEBUG : Creating backend with remote "/Users/[mydirname]/data/Go"
2022/10/29 08:56:21 DEBUG : Using config file from "/Users/[mydirname]/Applications/RClone/rclone.config"
2022/10/29 08:56:21 DEBUG : local: detected overridden config - adding "{12rtk}" suffix to name
2022/10/29 08:56:21 DEBUG : fs cache: renaming cache item "/Users/[mydirname]/data/Go" to be canonical "local{12rtk}:/Users/[mydirname]/data/Go"
2022/10/29 08:56:21 DEBUG : Creating backend with remote "remote_storj:gosrc/"
2022/10/29 08:56:21 DEBUG : FS sj://gosrc: connecting...
2022/10/29 08:56:21 DEBUG : FS sj://gosrc: connected: <nil>
2022/10/29 08:56:21 DEBUG : fs cache: renaming cache item "remote_storj:gosrc/" to be canonical "remote_storj:gosrc"
2022-10-29 08:56:21 DEBUG : Waiting for deletions to finish
2022-10-29 08:56:21 DEBUG : FS sj://gosrc: ls ./
2022-10-29 08:56:21 DEBUG : FS sj://gosrc: OBJ ls ./ ("gosrc", "")
2022-10-29 08:56:21 DEBUG : FS sj://gosrc: opts &{Prefix: Cursor: Recursive:false System:true Custom:true}
2022-10-29 08:56:22 DEBUG : FS sj://gosrc: ls ./go-sdv
2022-10-29 08:56:22 DEBUG : FS sj://gosrc: OBJ ls ./go-sdv ("gosrc", "go-sdv")
2022-10-29 08:56:22 DEBUG : FS sj://gosrc: opts &{Prefix:go-sdv/ Cursor: Recursive:false System:true Custom:true}
2022-10-29 08:56:22 DEBUG : SyncSettings_Kingston_Data_Go.ffs_gui: Size and modification time the same (differ by 0s, within tolerance 15s)
2022-10-29 08:56:22 DEBUG : FS sj://gosrc: ls ./go-private
2022-10-29 08:56:22 DEBUG : SyncSettings_NAS_Gitea.ffs_gui: Size and modification time the same (differ by 0s, within tolerance 15s)
2022-10-29 08:56:22 DEBUG : SyncSettings_Kingston_Data_Go.ffs_gui: Unchanged skipping
2022-10-29 08:56:22 DEBUG : SyncSettings_NAS_Gitea.ffs_gui: Unchanged skipping
2022-10-29 08:56:22 DEBUG : FS sj://gosrc: OBJ ls ./go-private ("gosrc", "go-private")
2022-10-29 08:56:22 DEBUG : Git-README.md: Size and modification time the same (differ by 0s, within tolerance 15s)
2022-10-29 08:56:22 DEBUG : Git-README.md: Unchanged skipping
2022-10-29 08:56:22 DEBUG : FS sj://gosrc: ls ./go-libraries
2022-10-29 08:56:22 DEBUG : FS sj://gosrc: OBJ ls ./go-libraries ("gosrc", "go-libraries")
2022-10-29 08:56:22 DEBUG : .sync.ffs_db: Size and modification time the same (differ by 0s, within tolerance 15s)
2022-10-29 08:56:22 DEBUG : FS sj://gosrc: ls ./go-speeltuin
2022-10-29 08:56:22 DEBUG : SyncSettings_Kingston_Gitea.ffs_gui: Size and modification time the same (differ by 0s, within tolerance 15s)
2022-10-29 08:56:22 DEBUG : FS sj://gosrc: ls ./go-tools
2022-10-29 08:56:22 DEBUG : SyncSettings_NAS_Data_Go.ffs_gui: Size and modification time the same (differ by 0s, within tolerance 15s)
2022-10-29 08:56:22 DEBUG : SyncSettings_NAS_Data_Go.ffs_gui: Unchanged skipping
2022-10-29 08:56:22 DEBUG : FS sj://gosrc: opts &{Prefix:go-private/ Cursor: Recursive:false System:true Custom:true}
2022-10-29 08:56:22 DEBUG : FS sj://gosrc: opts &{Prefix:go-libraries/ Cursor: Recursive:false System:true Custom:true}
2022-10-29 08:56:22 DEBUG : FS sj://gosrc: OBJ ls ./go-speeltuin ("gosrc", "go-speeltuin")
2022-10-29 08:56:22 DEBUG : FS sj://gosrc: opts &{Prefix:go-speeltuin/ Cursor: Recursive:false System:true Custom:true}
2022-10-29 08:56:22 DEBUG : .sync.ffs_db: Unchanged skipping
2022-10-29 08:56:22 DEBUG : SyncSettings_Kingston_Gitea.ffs_gui: Unchanged skipping
2022-10-29 08:56:22 DEBUG : FS sj://gosrc: OBJ ls ./go-tools ("gosrc", "go-tools")
2022-10-29 08:56:22 DEBUG : FS sj://gosrc: opts &{Prefix:go-tools/ Cursor: Recursive:false System:true Custom:true}
2022-10-29 08:56:22 DEBUG : FS sj://gosrc: ls ./go-sdv/SDV-LITE-Models
2022-10-29 08:56:22 DEBUG : FS sj://gosrc: OBJ ls ./go-sdv/SDV-LITE-Models ("gosrc", "go-sdv/SDV-LITE-Models")
2022-10-29 08:56:22 DEBUG : FS sj://gosrc: opts &{Prefix:go-sdv/SDV-LITE-Models/ Cursor: Recursive:false System:true Custom:true}
2022-10-29 08:56:22 DEBUG : FS sj://gosrc: ls ./go-sdv/SDV-LITE-Examples
2022-10-29 08:56:22 DEBUG : FS sj://gosrc: OBJ ls ./go-sdv/SDV-LITE-Examples ("gosrc", "go-sdv/SDV-LITE-Examples")
2022-10-29 08:56:22 DEBUG : FS sj://gosrc: opts &{Prefix:go-sdv/SDV-LITE-Examples/ Cursor: Recursive:false System:true Custom:true}
2022-10-29 08:56:22 DEBUG : FS sj://gosrc: ls ./go-sdv/SDV-LITE
2022-10-29 08:56:22 DEBUG : FS sj://gosrc: OBJ ls ./go-sdv/SDV-LITE ("gosrc", "go-sdv/SDV-LITE")
2022-10-29 08:56:22 DEBUG : FS sj://gosrc: opts &{Prefix:go-sdv/SDV-LITE/ Cursor: Recursive:false System:true Custom:true}
2022-10-29 08:56:22 DEBUG : FS sj://gosrc: ls ./go-sdv/SDV-LITE-Libs
2022-10-29 08:56:22 DEBUG : FS sj://gosrc: OBJ ls ./go-sdv/SDV-LITE-Libs ("gosrc", "go-sdv/SDV-LITE-Libs")
2022-10-29 08:56:22 DEBUG : FS sj://gosrc: opts &{Prefix:go-sdv/SDV-LITE-Libs/ Cursor: Recursive:false System:true Custom:true}
5 
FS sj://gosrc: cp input ./go-tools/hugo/snap/plugins/x_nodejs.py [HashesOption([])]: uplink: upload done: already committed
	storj.io/uplink.errwrapf:99
	storj.io/uplink.(*Upload).Abort:161
	github.com/rclone/rclone/backend/storj.(*Fs).Put.func1:546
	github.com/rclone/rclone/backend/storj.(*Fs).Put:579
	github.com/rclone/rclone/fs/operations.Copy:501
	github.com/rclone/rclone/fs/sync.(*syncCopyMove).pairCopyOrMove:423
2022-10-29 09:06:53 DEBUG : go-tools/hugo/snap/plugins/x_nodejs.py: Received error: uplink: stream: ecclient: successful puts (76) less than success threshold (80), ecclient: failed to dial (node:1NbCm2qu9BbPGZUmgpRDffBKDtJ6UsptR2BDRGzzzPUd1MXasz): piecestore: rpc: tcp connector failed: rpc: dial tcp 45.141.101.25:28967: connect: connection refused; ecclient: failed to dial (node:123XcxRJAP38H2GpgCHfQDU4swEa4JpkfCEhVawouarUz5GaZ6G): piecestore: rpc: tcp connector failed: rpc: context deadline exceeded; ecclient: failed to dial (node:12ZaCuXBZoAiFFn1zWRSQgiccKNXVjFohLC2ckocabgaaWMvGMy): piecestore: rpc: tcp connector failed: rpc: context deadline exceeded; ecclient: failed to dial (node:1kYadwHmjZTPF4M2kpVDnimvzDJMs8aT2A2rQV76iBgzCPgfSr): piecestore: rpc: tcp connector failed: rpc: context deadline exceeded; ecclient: failed to dial (node:12LgftDa6tjJJJ86PUuM3XFihD3cFACnADkWkHwXx87VGpbD8oo): piecestore: rpc: tcp connector failed: rpc: context deadline exceeded; ecclient: failed to dial (node:12RLGYt4K5R8KmHQwHqv9ykJgj2d1fGt9PsqEHXh1GEyndKjNMP): piecestore: rpc: tcp connector failed: rpc: context deadline exceeded; ecclient: failed to dial (node:19ZBeZ5rUkcgyvRrRYUueLxtWCyHNkwjduTdoEgW9WxEB8Wv4z): piecestore: rpc: tcp connector failed: rpc: context deadline exceeded; ecclient: failed to dial (node:12hkSjuH8cdS4byda1bykpe2QJz42HXaK1uRtkTbCQdynovAKSz): piecestore: rpc: tcp connector failed: rpc: context deadline exceeded; ecclient: failed to dial (node:12ixcNFvHbdkiKHd2vH9g8b6ejBirrt4NEuAAi8ecEDm2UBCvnk): piecestore: rpc: tcp connector failed: rpc: context deadline exceeded; ecclient: failed to dial (node:1imdQT3F4PzQqweSXACgVyxSmi7oUtDBLZHmRhYhHuRE1jQPyt): piecestore: rpc: tcp connector failed: rpc: context deadline exceeded; ecclient: failed to dial (node:18CzmqbYtjfuCezdFMDi1A4g1qxBHarmcNTbmV5br2Dp9XafoV): piecestore: rpc: tcp connector failed: rpc: context deadline exceeded; ecclient: failed to dial (node:12iukmp8fimua5tW6b3HYREi3e1LZejx9c4HVwrftbggUkwb1Gp): piecestore: rpc: tcp connector failed: rpc: context deadline exceeded; ecclient: failed to dial (node:17SFwbUcDL8RLwhzvde8ugnwqYbb3GzaJyZmhJpwKSSGHfsDzy): piecestore: rpc: tcp connector failed: rpc: context deadline exceeded; ecclient: failed to dial (node:12VERvaVNvXyXyECh3CPAHq1Y834X4qc6DqDeHoemgqdVLG2fvY): piecestore: rpc: tcp connector failed: rpc: context deadline exceeded; ecclient: failed to dial (node:12HthEgzkRSmkKRoQBcvwBE7nvvPTc8QsTDXFfAEVfC4W9sqgWv): piecestore: rpc: tcp connector failed: rpc: context deadline exceeded; ecclient: failed to dial (node:1ijvA8u42jW5gK2yEESu68CWisCXFYUhV4enVKHg6FQUymKvRG): piecestore: rpc: tcp connector failed: rpc: context deadline exceeded; ecclient: failed to dial (node:1dEC9MFfZCZCS3mRuMAzut9jwSrGHrxgZKfwSxAXSXXr1JG2cA): piecestore: rpc: tcp connector failed: rpc: context deadline exceeded; ecclient: failed to dial (node:12uWdZBdggC72Hr4pqCo24pZuknRasa4bpnVxbC6tkZ3rc581Y): piecestore: rpc: tcp connector failed: rpc: context deadline exceeded; ecclient: failed to dial (node:12kCHpHQX5439MNsQ4CLH3rc5zEUuYzHnoPCKb9z2yFMNLJBpdC): piecestore: rpc: tcp connector failed: rpc: context deadline exceeded; ecclient: failed to dial (node:1ZtoenGAVBrgVoJkmkyxDqire258rdYcqC3avm8xAPuBGiD1bU): piecestore: rpc: tcp connector failed: rpc: context deadline exceeded; ecclient: failed to dial (node:12UYncxU7qDCsrVtY4yZeNmvKacABdZ7VdgAB2emYbsBVPC5ApS): piecestore: rpc: tcp connector failed: rpc: context deadline exceeded; ecclient: failed to dial (node:1e8M1wQNs5bHpfDN3spiEZanTK44xnFygRUxowXHmG51q8yEgo): piecestore: rpc: tcp connector failed: rpc: context deadline exceeded; ecclient: failed to dial (node:12PKRCN7jeecwm7UTQeqdYJZs75RvHecjmwJ7wqf92otYAkYYQS): piecestore: rpc: tcp connector failed: rpc: context deadline exceeded; ecclient: failed to dial (node:1sg9dPcYgxJz7yshbDB2EFBFhe7xjUejf6GAXjG7n8MXkLehc6): piecestore: rpc: tcp connector failed: rpc: context deadline exceeded; ecclient: failed to dial (node:1WfxBBeveLi3qdvwDyjH2xYWfEbXm7tUkBUBCdstWEeW3UBgwY): piecestore: rpc: tcp connector failed: rpc: context deadline exceeded; ecclient: failed to dial (node:12sRuyou2jvVxDMFKE5XyCfuZKpsvS46YmHbCRNFG9WMBT7h4CM): piecestore: rpc: tcp connector failed: rpc: context deadline exceeded; ecclient: failed to dial (node:12XKeah5ojnk5GBPCyjikfwU8p58yF7pTNMvrzjvNsiwYRYqiVr): piecestore: rpc: tcp connector failed: rpc: context deadline exceeded; ecclient: failed to dial (node:1HMY6GyJKwkaZNveHLpp3a7VrdSVzuF1bufqMsLhRALQfDpUVo): piecestore: rpc: tcp connector failed: rpc: context deadline exceeded; ecclient: failed to dial (node:1KouqJrixNHGJwkHcQwVonwxZRdVjriZCxP84nkqUCjdND2cdA): piecestore: rpc: tcp connector failed: rpc: context deadline exceeded; ecclient: failed to dial (node:12KkbdG6eTCgjLC5qzZ4MVh7TtEK1c91yHbBoDnN4Hy7ZmRBzE8): piecestore: rpc: tcp connector failed: rpc: context deadline exceeded; ecclient: failed to dial (node:12BrXXpM75jmZUbssD3bJjkoapmiATjNiAm4MhRELpKxSnKsJRT): piecestore: rpc: tcp connector failed: rpc: context deadline exceeded; ecclient: failed to dial (node:1PWna1uGyM7k83W96DLvVc6dDyyvNh9G4dfoPi34pUfguxSVkc): piecestore: rpc: tcp connector failed: rpc: dial tcp 176.124.192.5:19009: i/o timeout; ecclient: failed to dial (node:1HLz8cGMZg4yWPpaYnbuM8PQjfPXfmJJu5akRNB64sx9bBHEpY): piecestore: rpc: tcp connector failed: rpc: dial tcp 195.205.163.107:28967: i/o timeout; ecclient: failed to dial (node:1xZ3sALSsaEgGXfVzXTUrSb72UV14yx3KZHuhU5CoqJ17h6NoA): piecestore: rpc: tcp connector failed: rpc: context deadline exceeded - low level retry 1/10
2022-10-29 09:06:53 DEBUG : FS sj://gosrc: cp input ./go-tools/hugo/snap/plugins/x_nodejs.py # [HashesOption([])] 12557
6

I looked at the code - I think you can ignore this error.

7

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.