Invalid character in list using Dropbox backend

Help and Support
21 
2023/06/25 20:41:18 NOTICE: --dump-headers is obsolete - please use --dump headers instead
2023/06/25 20:41:18 NOTICE: --dump-bodies is obsolete - please use --dump bodies instead
2023/06/25 20:41:18 DEBUG : rclone: Version "v1.62.2" starting with parameters ["rclone" "sync" "/cephfs/Media/preprocess/music/Library/Le Vibrazioni" "dropbox-api:/media/cephfs/Media/preprocess/music/Library/Le Vibrazioni" "--stats-one-line-date" "--stats-log-level" "DEBUG" "-vv" "--log-file" "/tmp/tmp.maTNYquzxt" "--dump-headers" "--dump-bodies"]
2023/06/25 20:41:18 DEBUG : Creating backend with remote "/cephfs/Media/preprocess/music/Library/Le Vibrazioni"
2023/06/25 20:41:18 DEBUG : Using config file from "/home/devster/.config/rclone/rclone.conf"
2023/06/25 20:41:18 DEBUG : Creating backend with remote "dropbox-api:/media/cephfs/Media/preprocess/music/Library/Le Vibrazioni"
2023/06/25 20:41:18 DEBUG : You have specified to dump information. Please be noted that the Accept-Encoding as shown may not be correct in the request and the response may not show Content-Encoding if the go standard libraries auto gzip encoding was in effect. In this case the body of the request will be gunzipped before showing it.
2023/06/25 20:41:18 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/06/25 20:41:18 DEBUG : HTTP REQUEST (req 0xc000e3ed00)
2023/06/25 20:41:18 DEBUG : POST /2/team/members/get_info HTTP/1.1
Host: api.dropboxapi.com
User-Agent: rclone/v1.62.2
Content-Length: 67
Authorization: XXXX
Content-Type: application/json
Accept-Encoding: gzip

{"members":[{".tag":"email","email":"daniele.riccucci@gmail.com"}]}
2023/06/25 20:41:18 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/06/25 20:41:18 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/06/25 20:41:18 DEBUG : HTTP RESPONSE (req 0xc000e3ed00)
2023/06/25 20:41:18 DEBUG : HTTP/2.0 200 OK
Accept-Encoding: identity,gzip
Cache-Control: no-cache
Content-Type: application/json
Date: Sun, 25 Jun 2023 18:41:18 GMT
Server: envoy
Vary: Accept-Encoding
X-Content-Type-Options: nosniff
X-Dropbox-Request-Id: 53feca531b81461d80072d0a34e40d1f
X-Dropbox-Response-Origin: far_remote
X-Frame-Options: SAMEORIGIN
X-Server-Response-Time: 84

[{".tag": "member_info", "profile": {"team_member_id": "dbmid:AAADPfCj1gvcu2j2wruCzUBv8e6_1kY9QZc", "account_id": "dbid:AAAXxfV3EBAUU7T_vuD3gf-X-Ol2jL5eifI", "email": "daniele.riccucci@gmail.com", "email_verified": true, "secondary_emails": [], "status": {".tag": "active"}, "name": {"given_name": "Daniele", "surname": "Riccucci", "familiar_name": "Daniele", "display_name": "Daniele Riccucci", "abbreviated_name": "DR"}, "membership_type": {".tag": "full"}, "joined_on": "2022-01-14T20:42:43Z", "profile_photo_url": "https://dl-web.dropbox.com/account_photo/get/pid_uphoto%3AAAAAAEZZBC1UhTDfWcu-TKLGIUJQTLbqUPAGbrCEwu_DG4Ufgm8bAsFtm4T2tN21fSPpUhan7w6ibBurRyir?size=128x128&vers=1418402522613", "groups": ["g:3d5a714de118427a0000000000000003"], "member_folder_id": "17209536"}, "role": {".tag": "team_admin"}}]
2023/06/25 20:41:18 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/06/25 20:41:18 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/06/25 20:41:18 DEBUG : HTTP REQUEST (req 0xc000061100)
2023/06/25 20:41:18 DEBUG : POST /2/users/get_current_account HTTP/1.1
Host: api.dropboxapi.com
User-Agent: rclone/v1.62.2
Content-Length: 0
Authorization: XXXX
Dropbox-Api-Select-User: dbmid:AAADPfCj1gvcu2j2wruCzUBv8e6_1kY9QZc
Accept-Encoding: gzip

2023/06/25 20:41:18 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/06/25 20:41:19 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/06/25 20:41:19 DEBUG : HTTP RESPONSE (req 0xc000061100)
2023/06/25 20:41:19 DEBUG : HTTP/2.0 200 OK
Accept-Encoding: identity,gzip
Cache-Control: no-cache
Content-Type: application/json
Date: Sun, 25 Jun 2023 18:41:18 GMT
Server: envoy
Vary: Accept-Encoding
X-Content-Type-Options: nosniff
X-Dropbox-Request-Id: 4f9dacd893fe4767bd5551a16c27258c
X-Dropbox-Response-Origin: far_remote
X-Frame-Options: SAMEORIGIN
X-Server-Response-Time: 296

{"account_id": "dbid:AAAXxfV3EBAUU7T_vuD3gf-X-Ol2jL5eifI", "name": {"given_name": "Daniele", "surname": "Riccucci", "familiar_name": "Daniele", "display_name": "Daniele Riccucci", "abbreviated_name": "DR"}, "email": "daniele.riccucci@gmail.com", "email_verified": true, "profile_photo_url": "https://dl-web.dropbox.com/account_photo/get/pid_uphoto%3AAAAAAEZZBC1UhTDfWcu-TKLGIUJQTLbqUPAGbrCEwu_DG4Ufgm8bAsFtm4T2tN21fSPpUhan7w6ibBurRyir?size=128x128&vers=1418402522613", "disabled": false, "country": "IT", "locale": "it", "referral_link": "https://www.dropbox.com/referrals/AAAq50tosaZzWCHCqpTBHpcSm3b5Rl-mtvI?src=app9-10735376", "team": {"id": "dbtid:AAC0QKTNWh-zUxLwI-FJ8DfG4Bak88-Pa1Y", "name": "Dispenser", "sharing_policies": {"shared_folder_member_policy": {".tag": "anyone"}, "shared_folder_join_policy": {".tag": "from_anyone"}, "shared_link_create_policy": {".tag": "default_public"}, "group_creation_policy": {".tag": "admins_and_members"}, "shared_folder_link_restriction_policy": {".tag": "anyone"}}, "office_addin_policy": {".tag": "enabled"}}, "team_member_id": "dbmid:AAADPfCj1gvcu2j2wruCzUBv8e6_1kY9QZc", "is_paired": false, "account_type": {".tag": "business"}, "root_info": {".tag": "team", "root_namespace_id": "10111607536", "home_namespace_id": "17209536", "home_path": "/Daniele Riccucci"}}
2023/06/25 20:41:19 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/06/25 20:41:19 DEBUG : Dropbox root '': Using root namespace "10111607536"
2023/06/25 20:41:19 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/06/25 20:41:19 DEBUG : HTTP REQUEST (req 0xc00029a800)
2023/06/25 20:41:19 DEBUG : POST /2/files/get_metadata HTTP/1.1
Host: api.dropboxapi.com
User-Agent: rclone/v1.62.2
Content-Length: 164
Authorization: XXXX
Content-Type: application/json
Dropbox-Api-Path-Root: {".tag": "namespace_id", "namespace_id": "10111607536"}
Dropbox-Api-Select-User: dbmid:AAADPfCj1gvcu2j2wruCzUBv8e6_1kY9QZc
Accept-Encoding: gzip

{"path":"/media/cephfs/Media/preprocess/music/Library/Le Vibrazioni","include_media_info":false,"include_deleted":false,"include_has_explicit_shared_members":false}
2023/06/25 20:41:19 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/06/25 20:41:19 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/06/25 20:41:19 DEBUG : HTTP RESPONSE (req 0xc00029a800)
2023/06/25 20:41:19 DEBUG : HTTP/2.0 200 OK
Accept-Encoding: identity,gzip
Cache-Control: no-cache
Content-Type: application/json
Date: Sun, 25 Jun 2023 18:41:19 GMT
Server: envoy
Vary: Accept-Encoding
X-Content-Type-Options: nosniff
X-Dropbox-Request-Id: f83adf0d47824b94913de2616fce9835
X-Dropbox-Response-Origin: far_remote
X-Frame-Options: SAMEORIGIN
X-Server-Response-Time: 122

{".tag": "folder", "name": "Le Vibrazioni", "path_lower": "/media/cephfs/media/preprocess/music/library/le vibrazioni", "path_display": "/media/cephfs/Media/preprocess/music/Library/Le Vibrazioni", "parent_shared_folder_id": "2358845329", "id": "id:JHzYfIBnjrkAAAAAAD9UtA", "shared_folder_id": "4343271329", "sharing_info": {"read_only": false, "parent_shared_folder_id": "2358845329", "shared_folder_id": "4343271329", "traverse_only": false, "no_access": false}}
2023/06/25 20:41:19 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/06/25 20:41:19 DEBUG : fs cache: renaming cache item "dropbox-api:/media/cephfs/Media/preprocess/music/Library/Le Vibrazioni" to be canonical "dropbox-api:media/cephfs/Media/preprocess/music/Library/Le Vibrazioni"
2023/06/25 20:41:19 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/06/25 20:41:19 DEBUG : HTTP REQUEST (req 0xc00053a100)
2023/06/25 20:41:19 DEBUG : POST /2/files/list_folder HTTP/1.1
Host: api.dropboxapi.com
User-Agent: rclone/v1.62.2
Content-Length: 266
Authorization: XXXX
Content-Type: application/json
Dropbox-Api-Path-Root: {".tag": "namespace_id", "namespace_id": "10111607536"}
Dropbox-Api-Select-User: dbmid:AAADPfCj1gvcu2j2wruCzUBv8e6_1kY9QZc
Accept-Encoding: gzip

{"path":"/media/cephfs/Media/preprocess/music/Library/Le Vibrazioni","recursive":false,"include_media_info":false,"include_deleted":false,"include_has_explicit_shared_members":false,"include_mounted_folders":false,"limit":1000,"include_non_downloadable_files":false}
2023/06/25 20:41:19 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/06/25 20:41:19 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/06/25 20:41:19 DEBUG : HTTP RESPONSE (req 0xc00053a100)
2023/06/25 20:41:19 DEBUG : HTTP/2.0 200 OK
Accept-Encoding: identity,gzip
Cache-Control: no-cache
Content-Type: application/json
Date: Sun, 25 Jun 2023 18:41:19 GMT
Server: envoy
Vary: Accept-Encoding
X-Content-Type-Options: nosniff
X-Dropbox-Request-Id: 057ae7f8c83148e48c42f5d27e1cc5e3
X-Dropbox-Response-Origin: far_remote
X-Frame-Options: SAMEORIGIN
X-Server-Response-Time: 332

{"entries": [{".tag": "folder", "name": "Le Vibrazioni [2003]", "path_lower": "/media/cephfs/media/preprocess/music/library/le vibrazioni/le vibrazioni [2003]", "path_display": "/media/cephfs/Media/preprocess/music/Library/Le Vibrazioni/Le Vibrazioni [2003]", "parent_shared_folder_id": "4343271329", "id": "id:JHzYfIBnjrkAAAAAAD9UtQ", "sharing_info": {"read_only": false, "parent_shared_folder_id": "4343271329", "traverse_only": false, "no_access": false}}, {".tag": "folder", "name": "Le Vibrazioni II [2005]", "path_lower": "/media/cephfs/media/preprocess/music/library/le vibrazioni/le vibrazioni ii [2005]", "path_display": "/media/cephfs/Media/preprocess/music/Library/Le Vibrazioni/Le Vibrazioni II [2005]", "parent_shared_folder_id": "4343271329", "id": "id:JHzYfIBnjrkAAAAAAD9VXg", "sharing_info": {"read_only": false, "parent_shared_folder_id": "4343271329", "traverse_only": false, "no_access": false}}], "cursor": "AAGXLpgpxyIyTuwj6jQNk998wrmWTOQnPSnVn2pzOAwH84FutZmfI1Dq89SBoFnOOboSzPr7IZawjV1SMpIkqd8IRyUVVJJDL8DEOUIk0vqTFGGwX9bCnNBpNEuE8eemD7ZTrY3QSTO63VtiAzpBiuuTNrdjZofJeQTPEQT5r6vpajoTrRJzIGzNdCvK627H0_648N0hc8lUPPrEzK68Pns49LzhRRT91Aghh10hogmdheqyt1WwlX1Y6pGy_EKRiQltWt25Aexyb545uxCaIw4uirO36LngH5PbpvxlF_PMDwqJ2JKsxVq5dYPBLeGSnyHsJ36uaVjQxERHlhwKhLpfYTJMcX7JMH9OZO4UM8LWYeJ5xtbfqqWOQ81dGiNPThESxM10Ldyfq66E_DMjY43iotJRpB3q9T7PS3g4HLKcJxSUmHyA25TvMTFxy6tR8EijJOq4A1Ht4tnJO_hGl6mqTE_gnxssaTncEMEnLS09xyMFzYKJPBjAP1DL6skf37E", "has_more": false}
2023/06/25 20:41:19 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/06/25 20:41:19 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/06/25 20:41:19 DEBUG : HTTP REQUEST (req 0xc000e3f100)
2023/06/25 20:41:19 DEBUG : POST /2/files/list_folder HTTP/1.1
Host: api.dropboxapi.com
User-Agent: rclone/v1.62.2
Content-Length: 290
Authorization: XXXX
Content-Type: application/json
Dropbox-Api-Path-Root: {".tag": "namespace_id", "namespace_id": "10111607536"}
Dropbox-Api-Select-User: dbmid:AAADPfCj1gvcu2j2wruCzUBv8e6_1kY9QZc
Accept-Encoding: gzip

{"path":"/media/cephfs/Media/preprocess/music/Library/Le Vibrazioni/Le Vibrazioni II [2005]","recursive":false,"include_media_info":false,"include_deleted":false,"include_has_explicit_shared_members":false,"include_mounted_folders":false,"limit":1000,"include_non_downloadable_files":false}
2023/06/25 20:41:19 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/06/25 20:41:19 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/06/25 20:41:19 DEBUG : HTTP REQUEST (req 0xc00029bf00)
2023/06/25 20:41:19 DEBUG : POST /2/files/list_folder HTTP/1.1
Host: api.dropboxapi.com
User-Agent: rclone/v1.62.2
Content-Length: 287
Authorization: XXXX
Content-Type: application/json
Dropbox-Api-Path-Root: {".tag": "namespace_id", "namespace_id": "10111607536"}
Dropbox-Api-Select-User: dbmid:AAADPfCj1gvcu2j2wruCzUBv8e6_1kY9QZc
Accept-Encoding: gzip

{"path":"/media/cephfs/Media/preprocess/music/Library/Le Vibrazioni/Le Vibrazioni [2003]","recursive":false,"include_media_info":false,"include_deleted":false,"include_has_explicit_shared_members":false,"include_mounted_folders":false,"limit":1000,"include_non_downloadable_files":false}
2023/06/25 20:41:19 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/06/25 20:41:20 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/06/25 20:41:20 DEBUG : HTTP RESPONSE (req 0xc000e3f100)
2023/06/25 20:41:20 DEBUG : HTTP/2.0 200 OK
Accept-Encoding: identity,gzip
Cache-Control: no-cache
Content-Type: application/json
Date: Sun, 25 Jun 2023 18:41:19 GMT
Server: envoy
Vary: Accept-Encoding
X-Content-Type-Options: nosniff
X-Dropbox-Request-Id: 2378a20ebc0a4759a994e6d0ac0b0550
X-Dropbox-Response-Origin: far_remote
X-Frame-Options: SAMEORIGIN
X-Server-Response-Time: 128

{"entries": [{".tag": "file", "name": "01.Aspettando.mp3", "path_lower": "/media/cephfs/media/preprocess/music/library/le vibrazioni/le vibrazioni ii [2005]/01.aspettando.mp3", "path_display": "/media/cephfs/Media/preprocess/music/Library/Le Vibrazioni/Le Vibrazioni II [2005]/01.Aspettando.mp3", "parent_shared_folder_id": "4343271329", "id": "id:JHzYfIBnjrkAAAAAAD9VXQ", "client_modified": "2014-02-22T11:37:48Z", "server_modified": "2023-06-25T16:47:10Z", "rev": "015fef6fc3ece380000000102e10fa1", "size": 5065461, "sharing_info": {"read_only": false, "parent_shared_folder_id": "4343271329", "modified_by": "dbid:AAAXxfV3EBAUU7T_vuD3gf-X-Ol2jL5eifI"}, "is_downloadable": true, "content_hash": "550c30279cec767f5333f834eac1814ee964de79d45d0a38fbe5202d44532c4c"}], "cursor": "AAFFiBrdtLA4wx7hTv-Bib_hCEGtIRSzEs5fBbN-BaDnhWeVIW3HwUE6z04ybowVUrm3Nme5kO8M_yRrOdv2GskBF7Y5rKq49CVLeVCC90QynRYfktAV-FF8OV62ZwP30gFXEFdwgLatsR_PTHUs-MbuCqXOr8drv5qw8Sx4U-96-XY4OHZM3UOq48YnGPIy3e6uK1veGGV6DZSHdrjVvDFXYlswY1l08zjxzm0UyC3CoSXPXyPEqj4hh4zp3NgpVvSWyONQTjav3Pmda_UFBHqlm7mHKln0acJEbbSUPcYdv3rbAawvIieOzyIfdEZKu0jI7lauZpmMpdLMVjbJvnkGAFD_xCJbwb7t0hkwiyzd6sOn0tDxqoBd-zdRG8s89Hnnqxhtuvk-WHymrqbpy1Lyq516akxtYyVTMLbfBrA2Qg6rTqbUkWdoHT9jJDReTC04WnsCbLtSb6ApcCNmONbFoe8qMPzXceAE3kbsigsmq5VeKvqSGQZP0vZGjgnk_F7xqhAVldYWEtv8n_nhrsWM-dJYwzr9PIWE1xHx9IOpTtY-xHCaXL_Rfjwlbv8YhFo", "has_more": false}
2023/06/25 20:41:20 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/06/25 20:41:20 DEBUG : Le Vibrazioni II [2005]/01.Aspettando.mp3: Size and modification time the same (differ by 0s, within tolerance 1s)
2023/06/25 20:41:20 DEBUG : Le Vibrazioni II [2005]/01.Aspettando.mp3: Unchanged skipping
2023/06/25 20:41:20 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/06/25 20:41:20 DEBUG : HTTP RESPONSE (req 0xc00029bf00)
2023/06/25 20:41:20 DEBUG : HTTP/2.0 200 OK
Accept-Encoding: identity,gzip
Cache-Control: no-cache
Content-Type: application/json
Date: Sun, 25 Jun 2023 18:41:19 GMT
Server: envoy
Vary: Accept-Encoding
X-Content-Type-Options: nosniff
X-Dropbox-Request-Id: 9b56f4c4022a42e893afceec9357831d
X-Dropbox-Response-Origin: far_remote
X-Frame-Options: SAMEORIGIN
X-Server-Response-Time: 149

{"entries": [{".tag": "file", "name": "02.In Una Notte D'estate.mp3", "path_lower": "/media/cephfs/media/preprocess/music/library/le vibrazioni/le vibrazioni [2003]/02.in una notte d'estate.mp3", "path_display": "/media/cephfs/Media/preprocess/music/Library/Le Vibrazioni/Le Vibrazioni [2003]/02.In Una Notte D'estate.mp3", "parent_shared_folder_id": "4343271329", "id": "id:JHzYfIBnjrkAAAAAAD9Usw", "client_modified": "2014-02-22T11:19:11Z", "server_modified": "2023-06-25T16:47:10Z", "rev": "015fef6fc3ece350000000102e10fa1", "size": 4630967, "sharing_info": {"read_only": false, "parent_shared_folder_id": "4343271329", "modified_by": "dbid:AAAXxfV3EBAUU7T_vuD3gf-X-Ol2jL5eifI"}, "is_downloadable": true, "content_hash": "59ddf981ff8d61fad069c8a7ea0891975f540272141e54f8fec73422733050f9"}, {".tag": "file", "name": "07.Vieni Da Me.mp3", "path_lower": "/media/cephfs/media/preprocess/music/library/le vibrazioni/le vibrazioni [2003]/07.vieni da me.mp3", "path_display": "/media/cephfs/Media/preprocess/music/Library/Le Vibrazioni/Le Vibrazioni [2003]/07.Vieni Da Me.mp3", "parent_shared_folder_id": "4343271329", "id": "id:JHzYfIBnjrkAAAAAAD9Uvg", "client_modified": "2014-02-22T11:19:13Z", "server_modified": "2023-06-25T16:47:10Z", "rev": "015fef6fc3ece360000000102e10fa1", "size": 7990183, "sharing_info": {"read_only": false, "parent_shared_folder_id": "4343271329", "modified_by": "dbid:AAAXxfV3EBAUU7T_vuD3gf-X-Ol2jL5eifI"}, "is_downloadable": true, "content_hash": "099dacbd19ff92af7ff411693886a19ea2565e27533a69909d674615605c26ac"}], "cursor": "AAEhU6E-PcVfOqbw3gnaZGgFTbT92UQRZupETPtAO21MtksTM2KWl3-xuPk8RKcKZw3-InGBQ3hrC-Qr5PVI-rsfEgStSVyGx-3htRQOXbVPJeiRLGI3IJfWG_uh29UOwHfYEeq7mZEt5VP-CJSucsR3xPaKfkREtQISmxQWU8F_LBX6OT2Ut9oJFR9rO6q3Fe4_ix0mtqNcDpNeBJEwHtiGufKkAvnFVioXBpisyANUExibpnFWlf79rs0nG9v0T4044DwZW-BM3Th2DMjBJo4Oa9NV7Rv-7W_scrwtsM-rel7Dxrix4xKdSNLVemeuF7VBTuCdRpcK66x4nPnBmfMemHDduwEoI26XFecrrNrDtBLsoBKQ4fNGiw7xz1Bga9XrZZbzj_W6JW1rOTnr5MM3DxvCqqPHufESqo0qUWrrMA0TmuWlY8XyCvooGMKT8k5LoHPzk8a-im7RmHdo5_zE1w0QWZY7Bsqt_wXSCmiLnvCaCkdNLXOW_5zj-D-0M7X4Qrl0jymwH6Q0boYNc7iOx7P0X-0kJcKxI0Ksfm49ng", "has_more": false}
2023/06/25 20:41:20 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/06/25 20:41:20 DEBUG : Le Vibrazioni [2003]/02.In Una Notte D'estate.mp3: Size and modification time the same (differ by 0s, within tolerance 1s)
2023/06/25 20:41:20 DEBUG : Le Vibrazioni [2003]/02.In Una Notte D'estate.mp3: Unchanged skipping
2023/06/25 20:41:20 DEBUG : Le Vibrazioni [2003]/07.Vieni Da Me.mp3: Size and modification time the same (differ by 0s, within tolerance 1s)
2023/06/25 20:41:20 DEBUG : Dropbox root 'media/cephfs/Media/preprocess/music/Library/Le Vibrazioni': Waiting for checks to finish
2023/06/25 20:41:20 DEBUG : Le Vibrazioni [2003]/07.Vieni Da Me.mp3: Unchanged skipping
2023/06/25 20:41:20 DEBUG : Dropbox root 'media/cephfs/Media/preprocess/music/Library/Le Vibrazioni': Waiting for transfers to finish
2023/06/25 20:41:20 DEBUG : Waiting for deletions to finish
2023/06/25 20:41:20 INFO  : There was nothing to transfer
2023/06/25 20:41:20 DEBUG : 2023/06/25 20:41:20 -           0 B / 0 B, -, 0 B/s, ETA -
2023/06/25 20:41:20 DEBUG : 6 go routines active
2023/06/25 20:41:20 INFO  : Dropbox root 'media/cephfs/Media/preprocess/music/Library/Le Vibrazioni': Committing uploads - please wait...

No issues it seems.

22

OK. This is not what I expected but this are results.

@ncw could you please have a look at this? Something unusual at least for me is going on here.

23

I think this intepretation is correct.

What this error usually means is that instead of sending back JSON the dropbox server sent back some text starting with the letter E.

This is usually when the server gets overloaded and the proxy servers (which don't understand the API) start returning errors like 500 Error can't connect to gateway or something like that.

So I think it is probably not related to actual file names (unless we are extremely unlucky).

@devster

I'd suggest retrying the sync with the --tpslimit 12 parameter which will slow rclone down enough so that it shouldn't trip any Dropbox rate limits. This parameter has been optimized for uploads so you may need to change the number since you are doing downloads.

Hopefully this will cause it to complete.

1 Like
24

I tried again with the suggested parameter with no luck, the error is still being reported, in some cases for the same directories, but these aren't always reproducible; meaning the specific paths change each run.

command I ran:

systemd-run --user --unit=cephfs-rclone --property='KillSignal=SIGINT' -- rclone sync /cephfs/ dropbox-api:/media/cephfs --stats-one-line-date --stats-log-level INFO --tpslimit 12

excerpt of log:

Jun 28 00:52:44 sagittarius rclone[16628]: ERROR : Media/preprocess/music/beets/Bastille - Bad Blood (2012): error reading destination directory: invalid character 'E' looking for beginning of value

Also tried with --tpslimit 10

Jun 28 01:01:56 sagittarius systemd[6914]: Stopped /usr/local/bin/rclone sync /cephfs/ dropbox-api:/media/cephfs --stats-one-line-date --stats-log-level INFO --tpslimit 12.
Jun 28 01:02:14 sagittarius systemd[6914]: Started /usr/local/bin/rclone sync /cephfs/ dropbox-api:/media/cephfs --stats-one-line-date --stats-log-level INFO --tpslimit 8.
Jun 28 01:02:18 sagittarius rclone[22896]: ERROR : Media/preprocess/movies: error reading destination directory: invalid character 'E' looking for beginning of value
25

This confirms ncw diagnosis. Also means that if you still see errors you have to slow things down even further. Unfortunately dropbox throttling limits policies are not publicly available so it has to be tried and tested.

It is possible that even you have client_id/client_secret in your config they are not used. It happens as token is bound to them during authentication so if you added them after initial authentication they are not used. Delete config and recreate your remote setup from scratch providing client_id/client_secret during setup. You will see that your own client_id is used when dropbpx authentication webpage does not show rclone logo/name but one you assigned.

You can add --transfers 1 --checkers 1 to your sync command - it will be much slower than default ones (4/8) but if error free will only further prove dropbox throttling/problems(?).

26

Rate limit is the issue but using --tpslimit 1 --transfers 1 --checkers 1 also returns errors almost immediately after launching the command.

Regarding the API, I'm using a personal Dropbox App, so I can check API hits and they seem to match the calls being made by the mounts and commands I'm running.

image
image2196×484 42.5 KB

The diagnosis seems correct...

2023/06/29 00:32:35 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/06/29 00:32:35 DEBUG : HTTP RESPONSE (req 0xc0009ce200)
2023/06/29 00:32:35 DEBUG : HTTP/2.0 429 Too Many Requests
Content-Length: 85
Accept-Encoding: identity,gzip
Cache-Control: no-cache
Content-Security-Policy: sandbox allow-forms allow-scripts
Content-Type: text/plain; charset=utf-8
Date: Wed, 28 Jun 2023 22:32:35 GMT
Server: envoy
X-Content-Type-Options: nosniff
X-Dropbox-Request-Id: a605e4fda5874a9c8d96ab5627f1a36f
X-Dropbox-Response-Origin: far_remote

Error in call to API function "files/list_folder": Error while authenticating request
2023/06/29 00:32:35 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/06/29 00:32:35 ERROR : Media/Software: error reading destination directory: invalid character 'E' looking for beginning of value

I'm wondering if this could be fixed by having rclone retry after the amount specified by the Dropbox API, they do provide a reason and a Retry-After parameter in their documentation it seems (from DBX Performance Guide - Dropbox):

27

Are you using different client_id for each of them? Or the same. Limits apply per client_id so e.g. for two mounts you should have two different ones and yet another one for your sync. You could try by stopping all mounts and other activities and only run one sync.

I think it is already implemented. But does not apply to your situation where rclone does not receive any clean error but corrupted response from dropbox API.

Using --tpslimit 12 people run dropbox without major problems so there is something else happening here.

28

If you have maybe some VPN you could try it - as problem can be with your specific dropbox server you are connecting to. Pretending to be in different country would use other servers.

29

Rclone should be doing this already.

If you can get me an HTTP trace of it not doing it then I'll fix it.

30

Which commands should I run to try and debug this?

Same client_id but I don't think that's the issue, I think what's happening is that the folder I'm trying to sync is also the same one being mounted, and rclone is reading the file on the mount (making one request to Dropbox), and immediately after making the exact same request remotely.
I'll try stopping the mount.

31

This would be quite interesting test in all this issue context. Dropbox is polling remote which means when you change date on remote it sends information to mount - and as you use the same client_id it consumes whatever are dropbox low limits. More isolated test always better - otherwise quite difficult to pin point the root cause.

32

Even with just one instance of rclone running on the server the issue persists.

2023/07/04 23:42:10 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/07/04 23:42:10 DEBUG : HTTP REQUEST (req 0xc0060fe000)
2023/07/04 23:42:10 DEBUG : POST /2/files/list_folder HTTP/1.1
Host: api.dropboxapi.com
User-Agent: rclone/v1.62.2
Content-Length: 282
Authorization: XXXX
Content-Type: application/json
Dropbox-Api-Path-Root: {".tag": "namespace_id", "namespace_id": "10111607536"}
Dropbox-Api-Select-User: dbmid:AAADPfCj1gvcu2j2wruCzUBv8e6_1kY9QZc
Accept-Encoding: gzip

2023/07/04 23:42:10 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/07/04 23:42:10 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/07/04 23:42:10 DEBUG : HTTP RESPONSE (req 0xc0060fe000)
2023/07/04 23:42:10 DEBUG : HTTP/2.0 429 Too Many Requests
Content-Length: 85
Accept-Encoding: identity,gzip
Cache-Control: no-cache
Content-Security-Policy: sandbox allow-forms allow-scripts
Content-Type: text/plain; charset=utf-8
Date: Tue, 04 Jul 2023 21:42:10 GMT
Server: envoy
X-Content-Type-Options: nosniff
X-Dropbox-Request-Id: 8b9cc9c6791542ff965395526a61c8f5
X-Dropbox-Response-Origin: far_remote

Error in call to API function "files/list_folder": Error while authenticating request
2023/07/04 23:42:10 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/07/04 23:42:10 ERROR : Media/LQ_Movies/10 Cloverfield Lane (2016, Dan Trachtenberg): error reading destination directory: invalid character 'E' looking for beginning of value
33

I don't mean to hijack this, but I get the same issue with DB as well. Interestingly enough, with enough runs of uploading, it goes through later on.

34

Which strongly indicates DB API problem.... sometimes it returns malformed responses...

35

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.