List –s3-versions files looping bug (part two)

the original post was closed.
google replied that it fixed the looping issue.

https://issuetracker.google.com/issues/312292516

but now it looks like we have another one. Versioned files are not listed.
If you could help me with the reason we can answer google if we need anything else...

example: witch flags do you need to get a log?

rclone ls --s3-versions remote:nd-srv/ --max-depth 1 -vv --dump bodies
2023/12/26 15:12:46 DEBUG : rclone: Version "v1.65.0" starting with parameters ["rclone" "ls" "--s3-versions" "remote:nd-srv/" "--max-depth" "1" "-vv" "--dump" "bodies" "--config" "/etc/remote/rclone.conf"]
2023/12/26 15:12:46 DEBUG : Creating backend with remote "remote:nd-srv/"
2023/12/26 15:12:46 DEBUG : Using config file from "/etc/remote/rclone.conf"
2023/12/26 15:12:46 DEBUG : You have specified to dump information. Please be noted that the Accept-Encoding as shown may not be correct in the request and the response may not show Content-Encoding if the go standard libraries auto gzip encoding was in effect. In this case the body of the request will be gunzipped before showing it.
2023/12/26 15:12:46 DEBUG : fs cache: renaming cache item "remote:nd-srv/" to be canonical "remote:nd-srv"
2023/12/26 15:12:46 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/12/26 15:12:46 DEBUG : HTTP REQUEST (req 0xc00050c400)
2023/12/26 15:12:46 DEBUG : POST /token HTTP/1.1
Host: oauth2.googleapis.com
User-Agent: rclone/v1.65.0
Content-Length: 775
Content-Type: application/x-www-form-urlencoded
Accept-Encoding: gzip

assertion=eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCIsImtpZCI6ImIwZmQ5YWE5MDI0M2NkOWRkODE1ZTcyM2EyNzQ2ZGM0ZmQyYzAwNGYifQ.eyJpc3MiOiJuZC1zcnZAbmQtcGFjcy5pYW0uZ3NlcnZpY2VhY2NvdW50LmNvbSIsInNjb3BlIjoiaHR0cHM6Ly93d3cuZ29vZ2xlYXBpcy5jb20vYXV0aC9kZXZzdG9yYWdlLnJlYWRfd3JpdGUiLCJhdWQiOiJodHRwczovL29hdXRoMi5nb29nbGVhcGlzLmNvbS90b2tlbiIsImV4cCI6MTcwMzYxNzk1NiwiaWF0IjoxNzAzNjE0MzU2fQ.mW5BfA4QecR6kat-BXM70SQ0LvCelkdJzWmdaSspY_sKd7XQuSCw-K0RCarhsjPFwfe0ttw5heH3mWwWW067xlMbRAdjUZtkUn2kX1I_f9IHQqoZ3Iw3p75zPOe7rHMCRLcpRxp0bPwL72tPoLWv6sXxP66Yp-BMXsIxYxvVeKXX7rFMFmIjpVpi6PTEZYJvArkxkONLZcAAV2xITYxVwvPNu1jmypIjuYAJAopEuINDn9VbGPxiFNTiGEWQpHiWHfV66-Fj8TW6KmEEidJg7S5kyk8thQrfjTubZm3X0YshiSfAR6t9sui22N5BcKr5XbSbCnrH4umBWI-j_K35Pw&grant_type=urn%3Aietf%3Aparams%3Aoauth%3Agrant-type%3Ajwt-bearer
2023/12/26 15:12:46 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/12/26 15:12:46 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/12/26 15:12:46 DEBUG : HTTP RESPONSE (req 0xc00050c400)
2023/12/26 15:12:46 DEBUG : HTTP/2.0 200 OK
Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
Cache-Control: private
Content-Type: application/json; charset=UTF-8
Date: Tue, 26 Dec 2023 18:12:46 GMT
Server: scaffolding on HTTPServer2
Vary: Origin
Vary: X-Origin
Vary: Referer
X-Content-Type-Options: nosniff
X-Frame-Options: SAMEORIGIN
X-Xss-Protection: 0

{"access_token":"ya29.c.c0AY_VpZjbtcWjiJ-IrccOGHV7-ARLGyweKV2VSgx9GgSD6uaOkbbJRUKzAQFHa5TSZq3TCWvq7pvWQ0rYvFok6QC3SABkrM6krZFHb4kUQaA-l8STW82csFlly-fMtSy8Vn6VZ-YTekxW4IlN9We47SMokbXxpPtZLjTkeyrrxycvRrMWz3b1F900PfJ-tkyh76EGFnpXIEtMsBDao__KIpXAb2TVJOb_G1D8DDyMWYLMT79jm8lZb_yElD5-5E52w5f8lL9tgnijmQn3-pq1JUwOWDgQWGoSWrf360GXkixPAebfYjn59n1IN3L2Gfl3H2ej-Hn9zdt7NPdQOOY6JBxf0AldRT7eGryt-cw2-wp5WJy8S6S4DuUT384AiF0XB9meVBr8_g9Q_WvgM1V8oV0c6g95wv9MoyJY53bo_62cqn8912JsteR2Bqa9-wWXJmebg5ndaWRy3MsiBOV_bJv4ShiFfwboBqsmZhoxr20rVooyb6l38I6Fi6OQmx1bRO8IUBv9VhiM2RqJyBdo26ndxjbBtFgdF0u417mkk04aseczbbZVrx46oBvriUpc8Rx_3-BMdijgutfUcnB8Y_p3pd7m5p7iwYVRa3oom-4nctQqjZShy46vYFIXc98zZm16dZmqyIUkQ32lIglsjX9vFi8hWpFluxfd_MXwjIfof82Sf9s06wVV1OfqFa5sXcRln-FshlrUtll81m1Ji9k97832x6_MJecrlBgdFBfJgSspFg3Q621mgg_Iqcjp8vBfZv9ZF5hi6Qtg11_5s28Uj4tRR_re_wFl8qFjk15VmqROvmylzRJiaac50VioebIzQMpuOSgpuJ53cMy6VoliMg57FZ63edW44xoIgFhIhuaXtnrQW-0zZaa5soj42isYzYJW1z-MZrWs9bQr98ixX8xQORgewSOJlvtJhF4Zzh_4wuaVd69Fz6-SWk4IOgf7jMmnOs0jBO7aeXVZ3ghOQ1giV_ay9eSxyyBWnJuk42xJ30oYb_I","expires_in":3599,"token_type":"Bearer"}
2023/12/26 15:12:46 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/12/26 15:12:46 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/12/26 15:12:46 DEBUG : HTTP REQUEST (req 0xc00050c800)
2023/12/26 15:12:46 DEBUG : GET /storage/v1/b/nd-srv/o?alt=json&delimiter=%2F&maxResults=1000&prefix=&prettyPrint=false HTTP/1.1
Host: storage.googleapis.com
User-Agent: rclone/v1.65.0
Authorization: XXXX
X-Goog-Api-Client: gl-go/1.21.4 gdcl/0.148.0
Accept-Encoding: gzip

2023/12/26 15:12:46 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/12/26 15:12:46 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/12/26 15:12:46 DEBUG : HTTP RESPONSE (req 0xc00050c800)
2023/12/26 15:12:46 DEBUG : HTTP/2.0 200 OK
Content-Length: 52
Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
Cache-Control: private, max-age=0, must-revalidate, no-transform
Content-Type: application/json; charset=UTF-8
Date: Tue, 26 Dec 2023 18:12:46 GMT
Expires: Tue, 26 Dec 2023 18:12:46 GMT
Server: UploadServer
Vary: Origin
Vary: X-Origin
X-Guploader-Uploadid: ABPtcPohtzANCTMajuSN57HDVtrpTleeQaR_IJOxAz6H_qQFT6v7EXBIHuCRmLLuIN0O7djDlF0

{"kind":"storage#objects","prefixes":["data/"]}
2023/12/26 15:12:46 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/12/26 15:12:46 DEBUG : 6 go routines active

I replied on the google issue - this doesn't look like it is fixed yet :frowning:

1 Like

I think Google made the adjustments exclusively for my project. Could you write there your google project name and id?

Here on mine project I no longer have the looping error. But the versioned files I think never appeared.

Ah! I my project number in the issue.

hi @ncw! google has now enabled the feature for yor projerct as well.

https://issuetracker.google.com/issues/312292516

I replied on the google issue, but alas it doesn't seem to be working for me yet.

1 Like

believe now they did. :smiley:

I've updated the issue. It is getting better but not fixed quite yet!

1 Like

just to keep this topic open. they answered again...

https://issuetracker.google.com/issues/312292516

hello @ncw! Google is waiting for your reply... whenever you have a moment to respond.

hi @ncw!
would you mind taking a look, please?

Sorry for the delay - I think this is all good now :slight_smile:

1 Like

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.