Dropbox rate limiting for upload

Help and Support
7

  1. Command used:
    rclone copy my_folder dropbox:remote_folder --progress --tpslimit=10 -vv

  2. Config:
    [dropbox]
    type = dropbox
    token = {"access_token":"...","token_type":"bearer","refresh_token":"...","expiry":"..."}
    client_id = ...
    client_secret = ...

  3. Debug log.
    It's quite big, but here is a small relevant part of it. Please let me know, I can post the whole log file:

2022-03-18 15:32:54 DEBUG : nd5hfqcej1u19nl5pg18s21pa98qi2rdae3o7t4sr3jor0le8ab0: Uploading chunk 27/57
2022-03-18 15:32:59 DEBUG : ve1a6s8i85nkupnho67par21tdmhpgkupdb2ekoo44914tbaincg: Uploading chunk 24/57
2022-03-18 15:35:18 DEBUG : k8as4ph7nqjtgmp2m62mnpmr60rt4pntglodh01c8p3l6k5mm5r0: Uploading chunk 14/57
2022-03-18 15:35:43 DEBUG : pacer: low level retry 1/10 (error Post "https://content.dropboxapi.com/2/files/upload_session/append_v2": read tcp 5.0.0.9:50904->162.125.65.14:443: read: connection reset by peer)
2022-03-18 15:35:43 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2022-03-18 15:35:44 DEBUG : pacer: Reducing sleep to 15ms
2022-03-18 15:35:44 DEBUG : k8as4ph7nqjtgmp2m62mnpmr60rt4pntglodh01c8p3l6k5mm5r0: Uploading chunk 15/57
2022-03-18 15:36:09 DEBUG : pacer: Reducing sleep to 11.25ms
2022-03-18 15:36:09 DEBUG : ve1a6s8i85nkupnho67par21tdmhpgkupdb2ekoo44914tbaincg: Uploading chunk 25/57
2022-03-18 15:36:28 DEBUG : pacer: low level retry 2/10 (error incorrect_offset/.)
2022-03-18 15:36:28 DEBUG : pacer: Rate limited, increasing sleep to 22.5ms
2022-03-18 15:36:48 DEBUG : pacer: Reducing sleep to 16.875ms
2022-03-18 15:36:48 DEBUG : k8as4ph7nqjtgmp2m62mnpmr60rt4pntglodh01c8p3l6k5mm5r0: Uploading chunk 16/57
2022-03-18 15:37:19 DEBUG : pacer: Reducing sleep to 12.65625ms
2022-03-18 15:37:19 DEBUG : ve1a6s8i85nkupnho67par21tdmhpgkupdb2ekoo44914tbaincg: Uploading chunk 26/57
2022-03-18 15:37:38 DEBUG : pacer: Reducing sleep to 10ms
2022-03-18 15:37:38 DEBUG : k8as4ph7nqjtgmp2m62mnpmr60rt4pntglodh01c8p3l6k5mm5r0: Uploading chunk 17/57
2022-03-18 15:37:52 DEBUG : ve1a6s8i85nkupnho67par21tdmhpgkupdb2ekoo44914tbaincg: Uploading chunk 27/57
2022-03-18 15:38:04 DEBUG : k8as4ph7nqjtgmp2m62mnpmr60rt4pntglodh01c8p3l6k5mm5r0: Uploading chunk 18/57
2022-03-18 15:38:08 DEBUG : pacer: low level retry 3/10 (error incorrect_offset/...)
2022-03-18 15:38:08 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2022-03-18 15:38:27 DEBUG : pacer: Reducing sleep to 15ms
2022-03-18 15:38:27 DEBUG : ve1a6s8i85nkupnho67par21tdmhpgkupdb2ekoo44914tbaincg: Uploading chunk 28/57
2022-03-18 15:38:36 DEBUG : pacer: Reducing sleep to 11.25ms
2022-03-18 15:38:36 DEBUG : k8as4ph7nqjtgmp2m62mnpmr60rt4pntglodh01c8p3l6k5mm5r0: Uploading chunk 19/57
2022-03-18 15:38:40 DEBUG : pacer: low level retry 4/10 (error incorrect_offset/.)
2022-03-18 15:38:40 DEBUG : pacer: Rate limited, increasing sleep to 22.5ms
2022-03-18 15:38:46 DEBUG : pacer: low level retry 1/10 (error Post "https://content.dropboxapi.com/2/files/upload_session/append_v2": write tcp 5.0.0.9:50910->162.125.65.14:443: i/o timeout)
2022-03-18 15:38:46 DEBUG : pacer: Rate limited, increasing sleep to 45ms
2022-03-18 15:38:57 DEBUG : pacer: Reducing sleep to 33.75ms
2022-03-18 15:38:57 DEBUG : ve1a6s8i85nkupnho67par21tdmhpgkupdb2ekoo44914tbaincg: Uploading chunk 29/57
2022-03-18 15:39:05 DEBUG : pacer: Reducing sleep to 25.3125ms