Rclone stops upload after 200GB

Hi there,

since the new version my upload is always aborted after exactly 200GB, although my maximum is set to 750GB. I'm not blocked, but I can still download normally via WebUI. When starting again with the remaining 550GB everything runs through. :man_shrugging:

Has any idea why this happens? With version 1.47 everything always ran through completely. Mount runs while uploading

config:

[secretG]
type = crypt
remote = Google:Plex
filename_encryption = off
password = 
password2 = 

[Google]
type = drive
client_id = 
client_secret = 
token = 

mount command:

rclone mount --allow-other --drive-chunk-size 16M --timeout 1h --buffer-size 32M --dir-cache-time 96h --log-level INFO --log-file="/home/hd1/ttopxelp/rclonelogs/rclone.log" secretG: /home/hd1/ttopxelp/cloud-media/ &

rclone v1.48.0

  • os/arch: linux/amd64
  • go version: go1.12.6

move command I'm using:

rclone move -P --fast-list --max-transfer 750G --transfers 3 --checkers 3 --drive-chunk-size 32M --tpslimit 3 -v /home/hd1/ttopxelp/media/ secretG:/

from the terminal:

ERROR : Movies/Happy End (2017)/Happy End (2017).mkv: Failed to copy: Post https://www.googleapis.com/upload/drive/v3/files?alt=json&fields=id%2Cname%2Csize%2Cmd5Checksum%2Ctrashed%2CmodifiedTime%2CcreatedTime%2CmimeType%2Cparents%2CwebViewLink&uploadType=resumable&upload_id=AEnB2UrWbR3NRvg0RS4QIKddX6YNtSlS5SL2yDEnKYw-z63oxNM58GPZO9VWxRj2GUrtO_TnlctRdcT1W5jQqg6Y87jOkWmh_aigfFLnsGc5QQIfPYC8IqE: Max transfer limit reached as set by --max-transfer
2019-06-29 11:59:36 ERROR : Movies/Happy End (2017)/Happy End (2017).mkv: Not deleting source as copy failed: Post https://www.googleapis.com/upload/drive/v3/files?alt=json&fields=id%2Cname%2Csize%2Cmd5Checksum%2Ctrashed%2CmodifiedTime%2CcreatedTime%2CmimeType%2Cparents%2CwebViewLink&uploadType=resumable&upload_id=AEnB2UrWbR3NRvg0RS4QIKddX6YNtSlS5SL2yDEnKYw-z63oxNM58GPZO9VWxRj2GUrtO_TnlctRdcT1W5jQqg6Y87jOkWmh_aigfFLnsGc5QQIfPYC8IqE: Max transfer limit reached as set by --max-transfer
2019-06-29 11:59:36 ERROR : Cancelling sync due to fatal error: Post https://www.googleapis.com/upload/drive/v3/files?alt=json&fields=id%2Cname%2Csize%2Cmd5Checksum%2Ctrashed%2CmodifiedTime%2CcreatedTime%2CmimeType%2Cparents%2CwebViewLink&uploadType=resumable&upload_id=AEnB2UrWbR3NRvg0RS4QIKddX6YNtSlS5SL2yDEnKYw-z63oxNM58GPZO9VWxRj2GUrtO_TnlctRdcT1W5jQqg6Y87jOkWmh_aigfFLnsGc5QQIfPYC8IqE: Max transfer limit reached as set by --max-transfer
2019-06-29 11:59:36 ERROR : Movies/Julieta (2016)/Julieta (2016).mkv: Failed to copy: Post https://www.googleapis.com/upload/drive/v3/files?alt=json&fields=id%2Cname%2Csize%2Cmd5Checksum%2Ctrashed%2CmodifiedTime%2CcreatedTime%2CmimeType%2Cparents%2CwebViewLink&uploadType=resumable&upload_id=AEnB2UoNwhdv9h7XLSGxl8BRYiEy_P3LHn708O9tX2bVnOWTthlydGMU08-aQQDtCggQ6Xy-4BCIcoO4K-BSqkmFJm1Ej-yLFi4a_mrU2fmUiQ4LxEqWTgU: Max transfer limit reached as set by --max-transfer
2019-06-29 11:59:36 ERROR : Movies/Julieta (2016)/Julieta (2016).mkv: Not deleting source as copy failed: Post https://www.googleapis.com/upload/drive/v3/files?alt=json&fields=id%2Cname%2Csize%2Cmd5Checksum%2Ctrashed%2CmodifiedTime%2CcreatedTime%2CmimeType%2Cparents%2CwebViewLink&uploadType=resumable&upload_id=AEnB2UoNwhdv9h7XLSGxl8BRYiEy_P3LHn708O9tX2bVnOWTthlydGMU08-aQQDtCggQ6Xy-4BCIcoO4K-BSqkmFJm1Ej-yLFi4a_mrU2fmUiQ4LxEqWTgU: Max transfer limit reached as set by --max-transfer
2019-06-29 11:59:37 ERROR : Movies/Ingrid Goes West (2017)/Ingrid Goes West (2017).mkv: Failed to copy: Post https://www.googleapis.com/upload/drive/v3/files?alt=json&fields=id%2Cname%2Csize%2Cmd5Checksum%2Ctrashed%2CmodifiedTime%2CcreatedTime%2CmimeType%2Cparents%2CwebViewLink&uploadType=resumable&upload_id=AEnB2UqL3QesFaj7ntMT-y8bkikcf4hwzPiyb2m_VhmFvnmUkGGwDZ4Os4GGvntaLiMiDje_Nca8bWFc94buSnvuvYMqEwSQmIgwhYpgtq52PFnJOF-SeaA: Max transfer limit reached as set by --max-transfer
2019-06-29 11:59:37 ERROR : Movies/Ingrid Goes West (2017)/Ingrid Goes West (2017).mkv: Not deleting source as copy failed: Post https://www.googleapis.com/upload/drive/v3/files?alt=json&fields=id%2Cname%2Csize%2Cmd5Checksum%2Ctrashed%2CmodifiedTime%2CcreatedTime%2CmimeType%2Cparents%2CwebViewLink&uploadType=resumable&upload_id=AEnB2UqL3QesFaj7ntMT-y8bkikcf4hwzPiyb2m_VhmFvnmUkGGwDZ4Os4GGvntaLiMiDje_Nca8bWFc94buSnvuvYMqEwSQmIgwhYpgtq52PFnJOF-SeaA: Max transfer limit reached as set by --max-transfer
2019-06-29 11:59:37 ERROR : Fatal error received - not attempting retries
Transferred:   	  200.000G / 1.020 TBytes, 19%, 67.183 MBytes/s, ETA 3h34m23s
Errors:                 4 (fatal error encountered)
Checks:                38 / 38, 100%
Transferred:           12 / 79, 15%
Elapsed time:    50m48.3s
2019/06/29 11:59:37 Failed to move with 4 errors: last error was: Post https://www.googleapis.com/upload/drive/v3/files?alt=json&fields=id%2Cname%2Csize%2Cmd5Checksum%2Ctrashed%2CmodifiedTime%2CcreatedTime%2CmimeType%2Cparents%2CwebViewLink&uploadType=resumable&upload_id=AEnB2UqL3QesFaj7ntMT-y8bkikcf4hwzPiyb2m_VhmFvnmUkGGwDZ4Os4GGvntaLiMiDje_Nca8bWFc94buSnvuvYMqEwSQmIgwhYpgtq52PFnJOF-SeaA: Max transfer limit reached as set by --max-transfer

from the log:

2019/06/29 11:28:26 NOTICE: Encrypted drive 'secretG:': ChangeNotify was unable to decrypt "Movies/Brigsby Bear (2017)": not an encrypted file - no ".bin" suffix
2019/06/29 11:33:26 NOTICE: Encrypted drive 'secretG:': ChangeNotify was unable to decrypt "Movies/Coco (2017)": not an encrypted file - no ".bin" suffix
2019/06/29 11:39:26 NOTICE: Encrypted drive 'secretG:': ChangeNotify was unable to decrypt "Movies/Deepwater Horizon (2016)": not an encrypted file - no ".bin" suffix
2019/06/29 11:45:26 NOTICE: Encrypted drive 'secretG:': ChangeNotify was unable to decrypt "Movies/Frozen (2013)": not an encrypted file - no ".bin" suffix
2019/06/29 11:49:26 NOTICE: Encrypted drive 'secretG:': ChangeNotify was unable to decrypt "Movies/Happy End (2017)": not an encrypted file - no ".bin" suffix
2019/06/29 11:53:26 NOTICE: Encrypted drive 'secretG:': ChangeNotify was unable to decrypt "Movies/Ingrid Goes West (2017)": not an encrypted file - no ".bin" suffix
2019/06/29 11:56:26 NOTICE: Encrypted drive 'secretG:': ChangeNotify was unable to decrypt "Movies/Julieta (2016)": not an encrypted file - no ".bin" suffix
2019/06/29 12:21:26 NOTICE: Encrypted drive 'secretG:': ChangeNotify was unable to decrypt "": not an encrypted file - no ".bin" suffix

And dont forget, I have my own ID :wink:

Without seeing a debug log, it's pretty hard to guess.

You'd be better off letting it run with a bwlimit imo rather than trying to cap the max transfer.

Do you have other things uploading?

but stops at 200G - strange!

You don't have an environment variable set do you? env | grep RCLONE_ will show them.