New s3 backend - help testing needed

Feature
1

I've updated the AWS SDK from v1 to v2 for the s3 backend.

This is a massive change! There are various performance advantages so it should be worth while (eg use of trailers when uploading to save reading the data twice). The v1 SDK has also just gone end of life (security fixes only).

However over 500 lines of code got changed including all the auth so likely some stuff is broken in configurations I don't have.

Any testing much appreciated! Bug reports here or preferably on the issue.

Thank you

2 Likes
2

Just a thought, it maybe a good idea to pin this post and the Github issue till its merged (or even till its released) to get more eyes on it.

1 Like
3

@darthShadow, thanks much for all the work you do behind the scenes...

not sure what needs to be tested.

i ran the both latest stable and the beta against my backup script, which uses

  • SSE-C
  • temporary session token
  • does not use rclone config file, everything passed as environment variables.

the following debug log runs the same exact command, one after another.
first, v1.67.0 which works as expected
second, the beta which errors out
note: i redacted and removed some extraneous entries.

DEBUG : rclone: Version "v1.68.0-beta.8133.ba28a7e64.fix-4989-s3-aws-sdk-v2" starting with parameters ["\\\\ts-ubuntu01\\agent_en10_ro\\rclone-v1.68.0-beta.8133.ba28a7e64.fix-4989-s3-aws-sdk-v2-windows-amd64" "sync" "c:\\users\\user01\\keepass" "wasabi:en.keepass/falconer/alltest/en10/user01/all/rclone/current" "--backup-dir=wasabi:en.keepass/falconer/alltest/en10/user01/all/rclone/archive/20240805.141733" "--retries=1" "--low-level-retries=1" "--fast-list" "--checkers=10" "--transfers=10" "--stats=1m" "--dry-run=false" "--config=//ts-ubuntu01/agent_en10_rw/doesnotexist.conf" "--log-level=DEBUG" "--log-file=//ts-ubuntu01/agent_en10_rw/backups/all/logs/20240805.141733/rclone.log"]
DEBUG : Creating backend with remote "c:\\users\\user01\\keepass"
NOTICE: Config file "\\\\ts-ubuntu01\\agent_en10_rw\\doesnotexist.conf" not found - using defaults
DEBUG : fs cache: renaming cache item "b:\\falconer\\vss\\all_20240805.134207\\users\\user01\\keepass" to be canonical "//?/b:/falconer/vss/all_20240805.134207/users/user01/keepass"
DEBUG : Creating backend with remote "wasabi:en.keepass/falconer/alltest/en10/user01/all/rclone/current"
DEBUG : Setting type="s3" for "wasabi" from environment variable RCLONE_CONFIG_WASABI_TYPE
DEBUG : Setting provider="Wasabi" for "wasabi" from environment variable RCLONE_CONFIG_WASABI_PROVIDER
DEBUG : Setting access_key_id="P2A6HBN48O7DT39UTTGIS" for "wasabi" from environment variable RCLONE_CONFIG_WASABI_ACCESS_KEY_ID
DEBUG : Setting secret_access_key="YpViSgIWNRmhtLY9C8zbfWqb0E8nvsLUcwd6eew0" for "wasabi" from environment variable RCLONE_CONFIG_WASABI_SECRET_ACCESS_KEY
DEBUG : Setting region="us-east-2" for "wasabi" from environment variable RCLONE_CONFIG_WASABI_REGION
DEBUG : Setting endpoint="https://s3.us-east-2.wasabisys.com" for "wasabi" from environment variable RCLONE_CONFIG_WASABI_ENDPOINT
DEBUG : Setting sse_customer_algorithm="AES256" for "wasabi" from environment variable RCLONE_CONFIG_WASABI_SSE_CUSTOMER_ALGORITHM
DEBUG : Setting sse_customer_key="c2zn8qrbUsT/5y5Hr2i93ImWmIQLCZLOL" for "wasabi" from environment variable RCLONE_CONFIG_WASABI_SSE_CUSTOMER_KEY
DEBUG : Setting session_token="C28aWK_Y49I_7NjZjJYJO7Q7b5sSIeE3no8AgbwuqOeWYGuqt6QKwagPb7iYyhUdeCsDmVM6O46s_H2DC0mBj3gu91LvrzrMWsqQRXp1ytRwW7e7rFnJPR5u-zrXugORQCqHM_T8w1cp7cgqvmkjwkisp-0T-O7wZKovfWlRSgrE6lllqorT_7PNVbuVUa6qis6_NWQn-O3tdNzwBQOeOq-JYcppEcmALrTEQb20fqS307-a0jQO1GrqtoeZPzcY1tSRgejo26feSD3_vXpEfzPUNzgcJYUs9a21WfUfciKhg74dL2LzjEZJUAPSUszz3jsz6zuHjnWvXFRV52U0LWoc3ZdDewRC_pnl92AvMassC9UdK9hr4pk9epG_M2EIM4e7-veStR2k4fKKS0OeMzTkzXOcU7FteAN5IimSjuefw8qhAp7vu-cIfhGXfQT-7FSBJ8qAEoU7KQ_BmezCTvMWHTiL0bGesvW7WJzNFzRqIYQvAkeLO3ainggpzPdGnt-bg9KFFdE5o3eaG5-lA1wJ6S8b1sUezUWbD1e0Atw4ysPHzeBb448KDqL1c2Xf0tDKGl8QCPgDfAv3R7P0yJtPduTPhCmuNvqDK8uweN-7czSl1vzVQqpKmug0M2hbOO2vduomagofSTFbKXgZzmzbOEgEwHsMzg8O646yJSWbjvyfrJO7fyo_uYzInAc8CBJVsi5lwOqS8QILEV6ZrKzpfYdIeYQuXUK1Eqsq7tuetrbjzCpCOqtDLX1Oap137uGZ0KDwAOJzJSVHdV7Dg5GjCGtHzEpnwwY8yFBjIle0U-HwqypS7yLsXjRNXmzmeVKmUg1rFXW4iTwbYoRjAz-6CKZXW1cDUpvlVND_mIbSKPeK2Fe0lYjT4jEBO1Fzrzach45HL2hijnbPXSeoRoL4-LGHIimECj7AmLQ5UmGWz4pBbus8Dz4_5uSgkBnnhWFzKkvpjFI9geKSKI1kXbpRkKvYq2evbzNbHwTzJMV3UuBU4IzUtiJBykH1Hm6t-ufvleKEiPCC4suEDenRrkjLV6-44Un-Rc2wZD76TceQ8W5jr4eQoB1YROJ_HEYjjpNpIDVO1DjtCX1Xq1gT_vctTf36WI7qeFPplVnwUD_HAC6y0azMPNXuVhizJAHNetzOMJKhoa6jubOepC0l2wLVlavs7Ut7XDf0G6MCBAdytejBRmIOfJgOWK7P7FwIi1uydCs_nXjw5KKGvX3eAJaCN5_ezO2RLLa_ejKZdHGzQzYACgEJRFmdJMpJyJksiaUUKPWe5spK9VlfHZoQWsf4LTyvA5cdcE2e1j3YeNekyLPTvLdsi6jdVbCB_LollTGh5-uR7Cr_Pb5B6qzGPT51r38Ph1ZTVI20Tjb6YRdUflHt5S5sLrWTnhmFKpH2VjSpnUzzmJmG4IN711YLZz3drSzUqlfh7rArcqJPBitQh6PXpFvPgSGEVO7SG667VHRSW6RuNRbNhKN3zt9keICMcl4Jt05Kz3PE1JnoTprmlu76AagrdKKdo6mGyc3sMGK8QJeD3TAAC1wRjAykEUe_9z9lZShGp2BQP4wWQo7XzkbAQbANH1I3aoQroCKIUY5C2ceWur5tqjJrmWb-bU-bKJ3HzpVkLcFl8u7ieeVrAI7hmKYm4WXSswPWNf1YW2AeIn0w-230TO-F0Bem2f9tULwMzaYVqNb957PSIBJvWE0aFBsne83fnV7SjP8zIoYgQCeDBOdtnc-uyH1cRBWudqYcCaH7CJHwe7AAjnHmkrkYq4FwwLi6TFtCweJ7fzNYmVXqFJqy3QQT8KAEj736XbD9VgWlKI48HRsETUU8ez7ssr6Nyw312IfRTTmjLMpkzJMOGS1pAzsKhCvNsSk6CVT3umjibmJ2PcUqiaqMco60deU6uGr6RAzvYA6HANk5741RO-_TOKOGO4W-_-DGMsfETizwKiozzu6RdAnAbjr5Y-o6BHSngrhRKmRFhrEHNQK5zdjVZZHzapaCELnBYrIcO65z7-yPWGeEBeGQNuzLEeakgOWZsEQs7om59b6ScFGqXORIsuve4wmXtReKL60ZVZADRgPyYT5f__TV_R0IenOwZW4pPtIKwrFVN6oeFvyYHt9EuTSOp6eTrVr-ziwAA0E4dzNkuTWi1C0WVwWdRgDzZkv21vR5zLqPfCC7b6h9KIe28UvpQiz05VPTvj9M7mT_ZTjlUshkgzT1CLnKsAS7GlFEiJDUeR0JCaPgp_sK8XQ4yrdANzfeNkAH1isDoX0eltvhA83FvrgvluufIAHwOQhZLTXrEZvmoybX4ezszyr_MzzVZNfkWlDEw6XBXR9O7BT4FC91RK5HCFpUNyUu5TarJzCoD72-nI2rjDMAuU4RK-RjWJNsiSWuM1eHWBggCC6c3Rnjz-Ztk2BRBETzhUqfzHJtvrUKfz5wk_4g03arY3Q0fZUI68YuehfIZVgU6il2JFrtK3mAOcWpMJ2Fkqeg1JOhp3TLvXL6MlfEhRMDH9GyJ4jVX3KWNJQTjvu4b9bzhj4JVQsZvFSk61wQ2iOyQPF-mbmZq7chGQeLYHSGei1aOhB6ndDhGuevIedBPDW2sLmuKhzzfou3i65p8D73VMUGDHLPjmaqQw6uCb0Ly_5gdc2wcrTkj0FjwtVVt2GQIQaW707N7oFV5uFcS_JjqbYFptMt4gdcFXHpsjwwiDUYmmgXyCiADZ6WbEhGj6CJHmL-4rLH_UYo27UkPRNys5PThRubwBirOTUGqzahTMd_Fk11EYnGlK3gKlimIk-EWdCg9ztrppIkDUes0pQ_RLZeoJscuVKgt2JUwqGsigsBuSZaUDQ6TgTW33BqnuX3yr6vU-Jw2wCDuC3F-VktVf5ootWqvcOWj_rN31Medu4-nSfEAJ01sXaup0fGtRnFz-annk0qjU6wNqweobESA9RcgEJolTprdbfQv_9mYQuHJcPbvCDBnc09wY0rQlB_ZLeKMazkGivndeMuE-OvpPYM1OdMg7TDvIRXuCRBQpFqHRUbHU225_ZJI5NqpprZ5hzvVcvkjIc8-URdrow9EuoV7FAqVhe55-BLleoajgH1Y6Urzek-3KK3svAEeH2brXsfeTS-bl8WkbIB3KPfwfNbZ09WFFEluocCwiLmq_2tNG8Az0tzjqMlZzeN8j4U4HEs_M7Wp3XzhUzgPQmdZBfYUjMIMu45JEQQEwikekTtGJWFYNTjqOMH5CXzaoSPe__verg37a5_17cXfyiyzz-qb5RZErCvGfTFHH05LPZF51tFfzcMJ5WOilbzMSzUe5lEvNQV_bZIakMa4AeLApTyzUAdzQ1OLnTTV4RJ2VUjtGiKBhVw6ByFnJbgcefGYmBFrAih0BS8teDmQDYqvhk9NSNAigsdct6I3unY-Fywkzu6OmwKHZNV8A0rFT7C7nuhZRXddGnUUo_sVSa8zBS2Ozm1XvnCFboJeNZy3EnTv2OJFaX6zfPUh2IkgO91FMIJ8OX1ADD26eyKr8TlPJ6MQ3WKvCXYeRWQciscQugiK1HIeRougfcbzgnhZX2BPg4lz5E16qCAYREeiHzqBWAVQQCw1N3353hzgsu2WVHzasZ8eEZqO7JNDAe2tsbYY0b5wzagWZ0UZza9ySXKRrJp1RMl2vEvpZ6W4BgLbaUbebw6u_t8cFHzPrvUt4Ne1d0ePbf4eNec4mb9jPL1RyPz5cdCHyIkr40BozAHVZePcfGsRGDN6ya30OBvPjaUz13ZjykcvrtRqire63SPzCfJk40RTh3DtsEbz9PV0ACzXC9AICkROG0yYYBe_oNQLsO2rorRQ0b3A3bNt3YnoVy3Uy4LnkpzDuBy4Ve8h1MAB7L1567aLRwQBWcBqbC1IsBuhcBBYAtFKhoNay6hNe05WZzmwa5fpwer3ThbukqezEZBz0mC9EcVDf-Hpbozw2TCpezp2c0IzUn4NfmK5kVokF-I20F90cJ4HdzbBhrYevwiU6sd84VHQhRAkB2UjuaRoDezs7ceEe3XD-9m3zkqzfiw-hWefNyV9V4pGK8PWzyzYZiew5ZrdB1rngYbKSHWeznf1qOVZuGfEjIdh364kD7Fz" for "wasabi" from environment variable RCLONE_CONFIG_WASABI_SESSION_TOKEN
DEBUG : Setting no_check_bucket="true" for "wasabi" from environment variable RCLONE_CONFIG_WASABI_NO_CHECK_BUCKET
DEBUG : wasabi: detected overridden config - adding "{nU4yv}" suffix to name
DEBUG : Setting provider="Wasabi" for "wasabi" from environment variable RCLONE_CONFIG_WASABI_PROVIDER
DEBUG : Setting access_key_id="P2A6HBN48O7DT39UTTGIS" for "wasabi" from environment variable RCLONE_CONFIG_WASABI_ACCESS_KEY_ID
DEBUG : Setting secret_access_key="YpViSgIWNRmhtLY9C8zbfWqb0E8nvsLUcwd6eew0" for "wasabi" from environment variable RCLONE_CONFIG_WASABI_SECRET_ACCESS_KEY
DEBUG : Setting region="us-east-2" for "wasabi" from environment variable RCLONE_CONFIG_WASABI_REGION
DEBUG : Setting endpoint="https://s3.us-east-2.wasabisys.com" for "wasabi" from environment variable RCLONE_CONFIG_WASABI_ENDPOINT
DEBUG : Setting sse_customer_algorithm="AES256" for "wasabi" from environment variable RCLONE_CONFIG_WASABI_SSE_CUSTOMER_ALGORITHM
DEBUG : Setting sse_customer_key="c2zn8qrbUsT/5y5Hr2i93ImWmIQLCZLOL" for "wasabi" from environment variable RCLONE_CONFIG_WASABI_SSE_CUSTOMER_KEY
DEBUG : Setting session_token="C28aWK_Y49I_7NjZjJYJO7Q7b5sSIeE3no8AgbwuqOeWYGuqt6QKwagPb7iYyhUdeCsDmVM6O46s_H2DC0mBj3gu91LvrzrMWsqQRXp1ytRwW7e7rFnJPR5u-zrXugORQCqHM_T8w1cp7cgqvmkjwkisp-0T-O7wZKovfWlRSgrE6lllqorT_7PNVbuVUa6qis6_NWQn-O3tdNzwBQOeOq-JYcppEcmALrTEQb20fqS307-a0jQO1GrqtoeZPzcY1tSRgejo26feSD3_vXpEfzPUNzgcJYUs9a21WfUfciKhg74dL2LzjEZJUAPSUszz3jsz6zuHjnWvXFRV52U0LWoc3ZdDewRC_pnl92AvMassC9UdK9hr4pk9epG_M2EIM4e7-veStR2k4fKKS0OeMzTkzXOcU7FteAN5IimSjuefw8qhAp7vu-cIfhGXfQT-7FSBJ8qAEoU7KQ_BmezCTvMWHTiL0bGesvW7WJzNFzRqIYQvAkeLO3ainggpzPdGnt-bg9KFFdE5o3eaG5-lA1wJ6S8b1sUezUWbD1e0Atw4ysPHzeBb448KDqL1c2Xf0tDKGl8QCPgDfAv3R7P0yJtPduTPhCmuNvqDK8uweN-7czSl1vzVQqpKmug0M2hbOO2vduomagofSTFbKXgZzmzbOEgEwHsMzg8O646yJSWbjvyfrJO7fyo_uYzInAc8CBJVsi5lwOqS8QILEV6ZrKzpfYdIeYQuXUK1Eqsq7tuetrbjzCpCOqtDLX1Oap137uGZ0KDwAOJzJSVHdV7Dg5GjCGtHzEpnwwY8yFBjIle0U-HwqypS7yLsXjRNXmzmeVKmUg1rFXW4iTwbYoRjAz-6CKZXW1cDUpvlVND_mIbSKPeK2Fe0lYjT4jEBO1Fzrzach45HL2hijnbPXSeoRoL4-LGHIimECj7AmLQ5UmGWz4pBbus8Dz4_5uSgkBnnhWFzKkvpjFI9geKSKI1kXbpRkKvYq2evbzNbHwTzJMV3UuBU4IzUtiJBykH1Hm6t-ufvleKEiPCC4suEDenRrkjLV6-44Un-Rc2wZD76TceQ8W5jr4eQoB1YROJ_HEYjjpNpIDVO1DjtCX1Xq1gT_vctTf36WI7qeFPplVnwUD_HAC6y0azMPNXuVhizJAHNetzOMJKhoa6jubOepC0l2wLVlavs7Ut7XDf0G6MCBAdytejBRmIOfJgOWK7P7FwIi1uydCs_nXjw5KKGvX3eAJaCN5_ezO2RLLa_ejKZdHGzQzYACgEJRFmdJMpJyJksiaUUKPWe5spK9VlfHZoQWsf4LTyvA5cdcE2e1j3YeNekyLPTvLdsi6jdVbCB_LollTGh5-uR7Cr_Pb5B6qzGPT51r38Ph1ZTVI20Tjb6YRdUflHt5S5sLrWTnhmFKpH2VjSpnUzzmJmG4IN711YLZz3drSzUqlfh7rArcqJPBitQh6PXpFvPgSGEVO7SG667VHRSW6RuNRbNhKN3zt9keICMcl4Jt05Kz3PE1JnoTprmlu76AagrdKKdo6mGyc3sMGK8QJeD3TAAC1wRjAykEUe_9z9lZShGp2BQP4wWQo7XzkbAQbANH1I3aoQroCKIUY5C2ceWur5tqjJrmWb-bU-bKJ3HzpVkLcFl8u7ieeVrAI7hmKYm4WXSswPWNf1YW2AeIn0w-230TO-F0Bem2f9tULwMzaYVqNb957PSIBJvWE0aFBsne83fnV7SjP8zIoYgQCeDBOdtnc-uyH1cRBWudqYcCaH7CJHwe7AAjnHmkrkYq4FwwLi6TFtCweJ7fzNYmVXqFJqy3QQT8KAEj736XbD9VgWlKI48HRsETUU8ez7ssr6Nyw312IfRTTmjLMpkzJMOGS1pAzsKhCvNsSk6CVT3umjibmJ2PcUqiaqMco60deU6uGr6RAzvYA6HANk5741RO-_TOKOGO4W-_-DGMsfETizwKiozzu6RdAnAbjr5Y-o6BHSngrhRKmRFhrEHNQK5zdjVZZHzapaCELnBYrIcO65z7-yPWGeEBeGQNuzLEeakgOWZsEQs7om59b6ScFGqXORIsuve4wmXtReKL60ZVZADRgPyYT5f__TV_R0IenOwZW4pPtIKwrFVN6oeFvyYHt9EuTSOp6eTrVr-ziwAA0E4dzNkuTWi1C0WVwWdRgDzZkv21vR5zLqPfCC7b6h9KIe28UvpQiz05VPTvj9M7mT_ZTjlUshkgzT1CLnKsAS7GlFEiJDUeR0JCaPgp_sK8XQ4yrdANzfeNkAH1isDoX0eltvhA83FvrgvluufIAHwOQhZLTXrEZvmoybX4ezszyr_MzzVZNfkWlDEw6XBXR9O7BT4FC91RK5HCFpUNyUu5TarJzCoD72-nI2rjDMAuU4RK-RjWJNsiSWuM1eHWBggCC6c3Rnjz-Ztk2BRBETzhUqfzHJtvrUKfz5wk_4g03arY3Q0fZUI68YuehfIZVgU6il2JFrtK3mAOcWpMJ2Fkqeg1JOhp3TLvXL6MlfEhRMDH9GyJ4jVX3KWNJQTjvu4b9bzhj4JVQsZvFSk61wQ2iOyQPF-mbmZq7chGQeLYHSGei1aOhB6ndDhGuevIedBPDW2sLmuKhzzfou3i65p8D73VMUGDHLPjmaqQw6uCb0Ly_5gdc2wcrTkj0FjwtVVt2GQIQaW707N7oFV5uFcS_JjqbYFptMt4gdcFXHpsjwwiDUYmmgXyCiADZ6WbEhGj6CJHmL-4rLH_UYo27UkPRNys5PThRubwBirOTUGqzahTMd_Fk11EYnGlK3gKlimIk-EWdCg9ztrppIkDUes0pQ_RLZeoJscuVKgt2JUwqGsigsBuSZaUDQ6TgTW33BqnuX3yr6vU-Jw2wCDuC3F-VktVf5ootWqvcOWj_rN31Medu4-nSfEAJ01sXaup0fGtRnFz-annk0qjU6wNqweobESA9RcgEJolTprdbfQv_9mYQuHJcPbvCDBnc09wY0rQlB_ZLeKMazkGivndeMuE-OvpPYM1OdMg7TDvIRXuCRBQpFqHRUbHU225_ZJI5NqpprZ5hzvVcvkjIc8-URdrow9EuoV7FAqVhe55-BLleoajgH1Y6Urzek-3KK3svAEeH2brXsfeTS-bl8WkbIB3KPfwfNbZ09WFFEluocCwiLmq_2tNG8Az0tzjqMlZzeN8j4U4HEs_M7Wp3XzhUzgPQmdZBfYUjMIMu45JEQQEwikekTtGJWFYNTjqOMH5CXzaoSPe__verg37a5_17cXfyiyzz-qb5RZErCvGfTFHH05LPZF51tFfzcMJ5WOilbzMSzUe5lEvNQV_bZIakMa4AeLApTyzUAdzQ1OLnTTV4RJ2VUjtGiKBhVw6ByFnJbgcefGYmBFrAih0BS8teDmQDYqvhk9NSNAigsdct6I3unY-Fywkzu6OmwKHZNV8A0rFT7C7nuhZRXddGnUUo_sVSa8zBS2Ozm1XvnCFboJeNZy3EnTv2OJFaX6zfPUh2IkgO91FMIJ8OX1ADD26eyKr8TlPJ6MQ3WKvCXYeRWQciscQugiK1HIeRougfcbzgnhZX2BPg4lz5E16qCAYREeiHzqBWAVQQCw1N3353hzgsu2WVHzasZ8eEZqO7JNDAe2tsbYY0b5wzagWZ0UZza9ySXKRrJp1RMl2vEvpZ6W4BgLbaUbebw6u_t8cFHzPrvUt4Ne1d0ePbf4eNec4mb9jPL1RyPz5cdCHyIkr40BozAHVZePcfGsRGDN6ya30OBvPjaUz13ZjykcvrtRqire63SPzCfJk40RTh3DtsEbz9PV0ACzXC9AICkROG0yYYBe_oNQLsO2rorRQ0b3A3bNt3YnoVy3Uy4LnkpzDuBy4Ve8h1MAB7L1567aLRwQBWcBqbC1IsBuhcBBYAtFKhoNay6hNe05WZzmwa5fpwer3ThbukqezEZBz0mC9EcVDf-Hpbozw2TCpezp2c0IzUn4NfmK5kVokF-I20F90cJ4HdzbBhrYevwiU6sd84VHQhRAkB2UjuaRoDezs7ceEe3XD-9m3zkqzfiw-hWefNyV9V4pGK8PWzyzYZiew5ZrdB1rngYbKSHWeznf1qOVZuGfEjIdh364kD7Fz" for "wasabi" from environment variable RCLONE_CONFIG_WASABI_SESSION_TOKEN
DEBUG : Setting no_check_bucket="true" for "wasabi" from environment variable RCLONE_CONFIG_WASABI_NO_CHECK_BUCKET
DEBUG : fs cache: renaming cache item "wasabi:en.keepass/falconer/alltest/en10/user01/all/rclone/current" to be canonical "wasabi{nU4yv}:en.keepass/falconer/alltest/en10/user01/all/rclone/current"
DEBUG : Creating backend with remote "wasabi:en.keepass/falconer/alltest/en10/user01/all/rclone/archive/20240805.134207"
DEBUG : Setting type="s3" for "wasabi" from environment variable RCLONE_CONFIG_WASABI_TYPE
DEBUG : Setting provider="Wasabi" for "wasabi" from environment variable RCLONE_CONFIG_WASABI_PROVIDER
DEBUG : Setting access_key_id="P2A6HBN48O7DT39UTTGIS" for "wasabi" from environment variable RCLONE_CONFIG_WASABI_ACCESS_KEY_ID
DEBUG : Setting secret_access_key="YpViSgIWNRmhtLY9C8zbfWqb0E8nvsLUcwd6eew0" for "wasabi" from environment variable RCLONE_CONFIG_WASABI_SECRET_ACCESS_KEY
DEBUG : Setting region="us-east-2" for "wasabi" from environment variable RCLONE_CONFIG_WASABI_REGION
DEBUG : Setting endpoint="https://s3.us-east-2.wasabisys.com" for "wasabi" from environment variable RCLONE_CONFIG_WASABI_ENDPOINT
DEBUG : Setting sse_customer_algorithm="AES256" for "wasabi" from environment variable RCLONE_CONFIG_WASABI_SSE_CUSTOMER_ALGORITHM
DEBUG : Setting sse_customer_key="c2zn8qrbUsT/5y5Hr2i93ImWmIQLCZLOL" for "wasabi" from environment variable RCLONE_CONFIG_WASABI_SSE_CUSTOMER_KEY
DEBUG : Setting session_token="C28aWK_Y49I_7NjZjJYJO7Q7b5sSIeE3no8AgbwuqOeWYGuqt6QKwagPb7iYyhUdeCsDmVM6O46s_H2DC0mBj3gu91LvrzrMWsqQRXp1ytRwW7e7rFnJPR5u-zrXugORQCqHM_T8w1cp7cgqvmkjwkisp-0T-O7wZKovfWlRSgrE6lllqorT_7PNVbuVUa6qis6_NWQn-O3tdNzwBQOeOq-JYcppEcmALrTEQb20fqS307-a0jQO1GrqtoeZPzcY1tSRgejo26feSD3_vXpEfzPUNzgcJYUs9a21WfUfciKhg74dL2LzjEZJUAPSUszz3jsz6zuHjnWvXFRV52U0LWoc3ZdDewRC_pnl92AvMassC9UdK9hr4pk9epG_M2EIM4e7-veStR2k4fKKS0OeMzTkzXOcU7FteAN5IimSjuefw8qhAp7vu-cIfhGXfQT-7FSBJ8qAEoU7KQ_BmezCTvMWHTiL0bGesvW7WJzNFzRqIYQvAkeLO3ainggpzPdGnt-bg9KFFdE5o3eaG5-lA1wJ6S8b1sUezUWbD1e0Atw4ysPHzeBb448KDqL1c2Xf0tDKGl8QCPgDfAv3R7P0yJtPduTPhCmuNvqDK8uweN-7czSl1vzVQqpKmug0M2hbOO2vduomagofSTFbKXgZzmzbOEgEwHsMzg8O646yJSWbjvyfrJO7fyo_uYzInAc8CBJVsi5lwOqS8QILEV6ZrKzpfYdIeYQuXUK1Eqsq7tuetrbjzCpCOqtDLX1Oap137uGZ0KDwAOJzJSVHdV7Dg5GjCGtHzEpnwwY8yFBjIle0U-HwqypS7yLsXjRNXmzmeVKmUg1rFXW4iTwbYoRjAz-6CKZXW1cDUpvlVND_mIbSKPeK2Fe0lYjT4jEBO1Fzrzach45HL2hijnbPXSeoRoL4-LGHIimECj7AmLQ5UmGWz4pBbus8Dz4_5uSgkBnnhWFzKkvpjFI9geKSKI1kXbpRkKvYq2evbzNbHwTzJMV3UuBU4IzUtiJBykH1Hm6t-ufvleKEiPCC4suEDenRrkjLV6-44Un-Rc2wZD76TceQ8W5jr4eQoB1YROJ_HEYjjpNpIDVO1DjtCX1Xq1gT_vctTf36WI7qeFPplVnwUD_HAC6y0azMPNXuVhizJAHNetzOMJKhoa6jubOepC0l2wLVlavs7Ut7XDf0G6MCBAdytejBRmIOfJgOWK7P7FwIi1uydCs_nXjw5KKGvX3eAJaCN5_ezO2RLLa_ejKZdHGzQzYACgEJRFmdJMpJyJksiaUUKPWe5spK9VlfHZoQWsf4LTyvA5cdcE2e1j3YeNekyLPTvLdsi6jdVbCB_LollTGh5-uR7Cr_Pb5B6qzGPT51r38Ph1ZTVI20Tjb6YRdUflHt5S5sLrWTnhmFKpH2VjSpnUzzmJmG4IN711YLZz3drSzUqlfh7rArcqJPBitQh6PXpFvPgSGEVO7SG667VHRSW6RuNRbNhKN3zt9keICMcl4Jt05Kz3PE1JnoTprmlu76AagrdKKdo6mGyc3sMGK8QJeD3TAAC1wRjAykEUe_9z9lZShGp2BQP4wWQo7XzkbAQbANH1I3aoQroCKIUY5C2ceWur5tqjJrmWb-bU-bKJ3HzpVkLcFl8u7ieeVrAI7hmKYm4WXSswPWNf1YW2AeIn0w-230TO-F0Bem2f9tULwMzaYVqNb957PSIBJvWE0aFBsne83fnV7SjP8zIoYgQCeDBOdtnc-uyH1cRBWudqYcCaH7CJHwe7AAjnHmkrkYq4FwwLi6TFtCweJ7fzNYmVXqFJqy3QQT8KAEj736XbD9VgWlKI48HRsETUU8ez7ssr6Nyw312IfRTTmjLMpkzJMOGS1pAzsKhCvNsSk6CVT3umjibmJ2PcUqiaqMco60deU6uGr6RAzvYA6HANk5741RO-_TOKOGO4W-_-DGMsfETizwKiozzu6RdAnAbjr5Y-o6BHSngrhRKmRFhrEHNQK5zdjVZZHzapaCELnBYrIcO65z7-yPWGeEBeGQNuzLEeakgOWZsEQs7om59b6ScFGqXORIsuve4wmXtReKL60ZVZADRgPyYT5f__TV_R0IenOwZW4pPtIKwrFVN6oeFvyYHt9EuTSOp6eTrVr-ziwAA0E4dzNkuTWi1C0WVwWdRgDzZkv21vR5zLqPfCC7b6h9KIe28UvpQiz05VPTvj9M7mT_ZTjlUshkgzT1CLnKsAS7GlFEiJDUeR0JCaPgp_sK8XQ4yrdANzfeNkAH1isDoX0eltvhA83FvrgvluufIAHwOQhZLTXrEZvmoybX4ezszyr_MzzVZNfkWlDEw6XBXR9O7BT4FC91RK5HCFpUNyUu5TarJzCoD72-nI2rjDMAuU4RK-RjWJNsiSWuM1eHWBggCC6c3Rnjz-Ztk2BRBETzhUqfzHJtvrUKfz5wk_4g03arY3Q0fZUI68YuehfIZVgU6il2JFrtK3mAOcWpMJ2Fkqeg1JOhp3TLvXL6MlfEhRMDH9GyJ4jVX3KWNJQTjvu4b9bzhj4JVQsZvFSk61wQ2iOyQPF-mbmZq7chGQeLYHSGei1aOhB6ndDhGuevIedBPDW2sLmuKhzzfou3i65p8D73VMUGDHLPjmaqQw6uCb0Ly_5gdc2wcrTkj0FjwtVVt2GQIQaW707N7oFV5uFcS_JjqbYFptMt4gdcFXHpsjwwiDUYmmgXyCiADZ6WbEhGj6CJHmL-4rLH_UYo27UkPRNys5PThRubwBirOTUGqzahTMd_Fk11EYnGlK3gKlimIk-EWdCg9ztrppIkDUes0pQ_RLZeoJscuVKgt2JUwqGsigsBuSZaUDQ6TgTW33BqnuX3yr6vU-Jw2wCDuC3F-VktVf5ootWqvcOWj_rN31Medu4-nSfEAJ01sXaup0fGtRnFz-annk0qjU6wNqweobESA9RcgEJolTprdbfQv_9mYQuHJcPbvCDBnc09wY0rQlB_ZLeKMazkGivndeMuE-OvpPYM1OdMg7TDvIRXuCRBQpFqHRUbHU225_ZJI5NqpprZ5hzvVcvkjIc8-URdrow9EuoV7FAqVhe55-BLleoajgH1Y6Urzek-3KK3svAEeH2brXsfeTS-bl8WkbIB3KPfwfNbZ09WFFEluocCwiLmq_2tNG8Az0tzjqMlZzeN8j4U4HEs_M7Wp3XzhUzgPQmdZBfYUjMIMu45JEQQEwikekTtGJWFYNTjqOMH5CXzaoSPe__verg37a5_17cXfyiyzz-qb5RZErCvGfTFHH05LPZF51tFfzcMJ5WOilbzMSzUe5lEvNQV_bZIakMa4AeLApTyzUAdzQ1OLnTTV4RJ2VUjtGiKBhVw6ByFnJbgcefGYmBFrAih0BS8teDmQDYqvhk9NSNAigsdct6I3unY-Fywkzu6OmwKHZNV8A0rFT7C7nuhZRXddGnUUo_sVSa8zBS2Ozm1XvnCFboJeNZy3EnTv2OJFaX6zfPUh2IkgO91FMIJ8OX1ADD26eyKr8TlPJ6MQ3WKvCXYeRWQciscQugiK1HIeRougfcbzgnhZX2BPg4lz5E16qCAYREeiHzqBWAVQQCw1N3353hzgsu2WVHzasZ8eEZqO7JNDAe2tsbYY0b5wzagWZ0UZza9ySXKRrJp1RMl2vEvpZ6W4BgLbaUbebw6u_t8cFHzPrvUt4Ne1d0ePbf4eNec4mb9jPL1RyPz5cdCHyIkr40BozAHVZePcfGsRGDN6ya30OBvPjaUz13ZjykcvrtRqire63SPzCfJk40RTh3DtsEbz9PV0ACzXC9AICkROG0yYYBe_oNQLsO2rorRQ0b3A3bNt3YnoVy3Uy4LnkpzDuBy4Ve8h1MAB7L1567aLRwQBWcBqbC1IsBuhcBBYAtFKhoNay6hNe05WZzmwa5fpwer3ThbukqezEZBz0mC9EcVDf-Hpbozw2TCpezp2c0IzUn4NfmK5kVokF-I20F90cJ4HdzbBhrYevwiU6sd84VHQhRAkB2UjuaRoDezs7ceEe3XD-9m3zkqzfiw-hWefNyV9V4pGK8PWzyzYZiew5ZrdB1rngYbKSHWeznf1qOVZuGfEjIdh364kD7Fz" for "wasabi" from environment variable RCLONE_CONFIG_WASABI_SESSION_TOKEN
DEBUG : Setting no_check_bucket="true" for "wasabi" from environment variable RCLONE_CONFIG_WASABI_NO_CHECK_BUCKET
DEBUG : wasabi: detected overridden config - adding "{nU4yv}" suffix to name
DEBUG : Setting provider="Wasabi" for "wasabi" from environment variable RCLONE_CONFIG_WASABI_PROVIDER
DEBUG : Setting access_key_id="P2A6HBN48O7DT39UTTGIS" for "wasabi" from environment variable RCLONE_CONFIG_WASABI_ACCESS_KEY_ID
DEBUG : Setting secret_access_key="YpViSgIWNRmhtLY9C8zbfWqb0E8nvsLUcwd6eew0" for "wasabi" from environment variable RCLONE_CONFIG_WASABI_SECRET_ACCESS_KEY
DEBUG : Setting region="us-east-2" for "wasabi" from environment variable RCLONE_CONFIG_WASABI_REGION
DEBUG : Setting endpoint="https://s3.us-east-2.wasabisys.com" for "wasabi" from environment variable RCLONE_CONFIG_WASABI_ENDPOINT
DEBUG : Setting sse_customer_algorithm="AES256" for "wasabi" from environment variable RCLONE_CONFIG_WASABI_SSE_CUSTOMER_ALGORITHM
DEBUG : Setting sse_customer_key="c2zn8qrbUsT/5y5Hr2i93ImWmIQLCZLOL" for "wasabi" from environment variable RCLONE_CONFIG_WASABI_SSE_CUSTOMER_KEY
DEBUG : Setting session_token="C28aWK_Y49I_7NjZjJYJO7Q7b5sSIeE3no8AgbwuqOeWYGuqt6QKwagPb7iYyhUdeCsDmVM6O46s_H2DC0mBj3gu91LvrzrMWsqQRXp1ytRwW7e7rFnJPR5u-zrXugORQCqHM_T8w1cp7cgqvmkjwkisp-0T-O7wZKovfWlRSgrE6lllqorT_7PNVbuVUa6qis6_NWQn-O3tdNzwBQOeOq-JYcppEcmALrTEQb20fqS307-a0jQO1GrqtoeZPzcY1tSRgejo26feSD3_vXpEfzPUNzgcJYUs9a21WfUfciKhg74dL2LzjEZJUAPSUszz3jsz6zuHjnWvXFRV52U0LWoc3ZdDewRC_pnl92AvMassC9UdK9hr4pk9epG_M2EIM4e7-veStR2k4fKKS0OeMzTkzXOcU7FteAN5IimSjuefw8qhAp7vu-cIfhGXfQT-7FSBJ8qAEoU7KQ_BmezCTvMWHTiL0bGesvW7WJzNFzRqIYQvAkeLO3ainggpzPdGnt-bg9KFFdE5o3eaG5-lA1wJ6S8b1sUezUWbD1e0Atw4ysPHzeBb448KDqL1c2Xf0tDKGl8QCPgDfAv3R7P0yJtPduTPhCmuNvqDK8uweN-7czSl1vzVQqpKmug0M2hbOO2vduomagofSTFbKXgZzmzbOEgEwHsMzg8O646yJSWbjvyfrJO7fyo_uYzInAc8CBJVsi5lwOqS8QILEV6ZrKzpfYdIeYQuXUK1Eqsq7tuetrbjzCpCOqtDLX1Oap137uGZ0KDwAOJzJSVHdV7Dg5GjCGtHzEpnwwY8yFBjIle0U-HwqypS7yLsXjRNXmzmeVKmUg1rFXW4iTwbYoRjAz-6CKZXW1cDUpvlVND_mIbSKPeK2Fe0lYjT4jEBO1Fzrzach45HL2hijnbPXSeoRoL4-LGHIimECj7AmLQ5UmGWz4pBbus8Dz4_5uSgkBnnhWFzKkvpjFI9geKSKI1kXbpRkKvYq2evbzNbHwTzJMV3UuBU4IzUtiJBykH1Hm6t-ufvleKEiPCC4suEDenRrkjLV6-44Un-Rc2wZD76TceQ8W5jr4eQoB1YROJ_HEYjjpNpIDVO1DjtCX1Xq1gT_vctTf36WI7qeFPplVnwUD_HAC6y0azMPNXuVhizJAHNetzOMJKhoa6jubOepC0l2wLVlavs7Ut7XDf0G6MCBAdytejBRmIOfJgOWK7P7FwIi1uydCs_nXjw5KKGvX3eAJaCN5_ezO2RLLa_ejKZdHGzQzYACgEJRFmdJMpJyJksiaUUKPWe5spK9VlfHZoQWsf4LTyvA5cdcE2e1j3YeNekyLPTvLdsi6jdVbCB_LollTGh5-uR7Cr_Pb5B6qzGPT51r38Ph1ZTVI20Tjb6YRdUflHt5S5sLrWTnhmFKpH2VjSpnUzzmJmG4IN711YLZz3drSzUqlfh7rArcqJPBitQh6PXpFvPgSGEVO7SG667VHRSW6RuNRbNhKN3zt9keICMcl4Jt05Kz3PE1JnoTprmlu76AagrdKKdo6mGyc3sMGK8QJeD3TAAC1wRjAykEUe_9z9lZShGp2BQP4wWQo7XzkbAQbANH1I3aoQroCKIUY5C2ceWur5tqjJrmWb-bU-bKJ3HzpVkLcFl8u7ieeVrAI7hmKYm4WXSswPWNf1YW2AeIn0w-230TO-F0Bem2f9tULwMzaYVqNb957PSIBJvWE0aFBsne83fnV7SjP8zIoYgQCeDBOdtnc-uyH1cRBWudqYcCaH7CJHwe7AAjnHmkrkYq4FwwLi6TFtCweJ7fzNYmVXqFJqy3QQT8KAEj736XbD9VgWlKI48HRsETUU8ez7ssr6Nyw312IfRTTmjLMpkzJMOGS1pAzsKhCvNsSk6CVT3umjibmJ2PcUqiaqMco60deU6uGr6RAzvYA6HANk5741RO-_TOKOGO4W-_-DGMsfETizwKiozzu6RdAnAbjr5Y-o6BHSngrhRKmRFhrEHNQK5zdjVZZHzapaCELnBYrIcO65z7-yPWGeEBeGQNuzLEeakgOWZsEQs7om59b6ScFGqXORIsuve4wmXtReKL60ZVZADRgPyYT5f__TV_R0IenOwZW4pPtIKwrFVN6oeFvyYHt9EuTSOp6eTrVr-ziwAA0E4dzNkuTWi1C0WVwWdRgDzZkv21vR5zLqPfCC7b6h9KIe28UvpQiz05VPTvj9M7mT_ZTjlUshkgzT1CLnKsAS7GlFEiJDUeR0JCaPgp_sK8XQ4yrdANzfeNkAH1isDoX0eltvhA83FvrgvluufIAHwOQhZLTXrEZvmoybX4ezszyr_MzzVZNfkWlDEw6XBXR9O7BT4FC91RK5HCFpUNyUu5TarJzCoD72-nI2rjDMAuU4RK-RjWJNsiSWuM1eHWBggCC6c3Rnjz-Ztk2BRBETzhUqfzHJtvrUKfz5wk_4g03arY3Q0fZUI68YuehfIZVgU6il2JFrtK3mAOcWpMJ2Fkqeg1JOhp3TLvXL6MlfEhRMDH9GyJ4jVX3KWNJQTjvu4b9bzhj4JVQsZvFSk61wQ2iOyQPF-mbmZq7chGQeLYHSGei1aOhB6ndDhGuevIedBPDW2sLmuKhzzfou3i65p8D73VMUGDHLPjmaqQw6uCb0Ly_5gdc2wcrTkj0FjwtVVt2GQIQaW707N7oFV5uFcS_JjqbYFptMt4gdcFXHpsjwwiDUYmmgXyCiADZ6WbEhGj6CJHmL-4rLH_UYo27UkPRNys5PThRubwBirOTUGqzahTMd_Fk11EYnGlK3gKlimIk-EWdCg9ztrppIkDUes0pQ_RLZeoJscuVKgt2JUwqGsigsBuSZaUDQ6TgTW33BqnuX3yr6vU-Jw2wCDuC3F-VktVf5ootWqvcOWj_rN31Medu4-nSfEAJ01sXaup0fGtRnFz-annk0qjU6wNqweobESA9RcgEJolTprdbfQv_9mYQuHJcPbvCDBnc09wY0rQlB_ZLeKMazkGivndeMuE-OvpPYM1OdMg7TDvIRXuCRBQpFqHRUbHU225_ZJI5NqpprZ5hzvVcvkjIc8-URdrow9EuoV7FAqVhe55-BLleoajgH1Y6Urzek-3KK3svAEeH2brXsfeTS-bl8WkbIB3KPfwfNbZ09WFFEluocCwiLmq_2tNG8Az0tzjqMlZzeN8j4U4HEs_M7Wp3XzhUzgPQmdZBfYUjMIMu45JEQQEwikekTtGJWFYNTjqOMH5CXzaoSPe__verg37a5_17cXfyiyzz-qb5RZErCvGfTFHH05LPZF51tFfzcMJ5WOilbzMSzUe5lEvNQV_bZIakMa4AeLApTyzUAdzQ1OLnTTV4RJ2VUjtGiKBhVw6ByFnJbgcefGYmBFrAih0BS8teDmQDYqvhk9NSNAigsdct6I3unY-Fywkzu6OmwKHZNV8A0rFT7C7nuhZRXddGnUUo_sVSa8zBS2Ozm1XvnCFboJeNZy3EnTv2OJFaX6zfPUh2IkgO91FMIJ8OX1ADD26eyKr8TlPJ6MQ3WKvCXYeRWQciscQugiK1HIeRougfcbzgnhZX2BPg4lz5E16qCAYREeiHzqBWAVQQCw1N3353hzgsu2WVHzasZ8eEZqO7JNDAe2tsbYY0b5wzagWZ0UZza9ySXKRrJp1RMl2vEvpZ6W4BgLbaUbebw6u_t8cFHzPrvUt4Ne1d0ePbf4eNec4mb9jPL1RyPz5cdCHyIkr40BozAHVZePcfGsRGDN6ya30OBvPjaUz13ZjykcvrtRqire63SPzCfJk40RTh3DtsEbz9PV0ACzXC9AICkROG0yYYBe_oNQLsO2rorRQ0b3A3bNt3YnoVy3Uy4LnkpzDuBy4Ve8h1MAB7L1567aLRwQBWcBqbC1IsBuhcBBYAtFKhoNay6hNe05WZzmwa5fpwer3ThbukqezEZBz0mC9EcVDf-Hpbozw2TCpezp2c0IzUn4NfmK5kVokF-I20F90cJ4HdzbBhrYevwiU6sd84VHQhRAkB2UjuaRoDezs7ceEe3XD-9m3zkqzfiw-hWefNyV9V4pGK8PWzyzYZiew5ZrdB1rngYbKSHWeznf1qOVZuGfEjIdh364kD7Fz" for "wasabi" from environment variable RCLONE_CONFIG_WASABI_SESSION_TOKEN
DEBUG : Setting no_check_bucket="true" for "wasabi" from environment variable RCLONE_CONFIG_WASABI_NO_CHECK_BUCKET
DEBUG : fs cache: renaming cache item "wasabi:en.keepass/falconer/alltest/en10/user01/all/rclone/archive/20240805.134207" to be canonical "wasabi{nU4yv}:en.keepass/falconer/alltest/en10/user01/all/rclone/archive/20240805.134207"
DEBUG : S3 bucket en.keepass path falconer/alltest/en10/user01/all/rclone/current: Waiting for checks to finish
NOTICE: KeePass.exe: Failed to read metadata: operation error S3: HeadObject, https response error StatusCode: 400, RequestID: CD8EA52F755852CE:B, HostID: Wul5KX4Q7b+r5ANep83mLzdRIqGXMSKdUCIFu5jO2OEWnM7qYPSixHBW9Lay/ubtCpbW00B79zWX, api error BadRequest: Bad Request
DEBUG : KeePass.exe: Modification times differ by 16712h52m5.1130063s: 2022-09-09 04:50:22.751 -0400 EDT, 2024-08-05 13:42:27.8640063 -0400 EDT m=+1.363607101
ERROR : KeePass.exe: Failed to calculate dst hash: operation error S3: HeadObject, https response error StatusCode: 400, RequestID: B95DE580426BB22D:B, HostID: J7PY9IZIAX3loxWXMRpEFNRElEpp/H+pR4KbXgafbXR6l1zf6zh478q7PaKnQZUSGtqBMP8HueE5, api error BadRequest: Bad Request
DEBUG : KeePass.exe: md5 differ
ERROR : KeePass.exe: Failed to copy: operation error S3: CopyObject, https response error StatusCode: 400, RequestID: EAB097DB0576122F:A, HostID: J54rSQlEeJgX1k4TLw2s4+iBzxh9lFjcX19CsXVR8n7Sn/jTq66d6ORNLdIpYnu42hqtO2GcuXJY, api error InvalidArgument: The secret key was invalid for the specified algorithm.
ERROR : KeePass.exe: Not deleting source as copy failed: operation error S3: CopyObject, https response error StatusCode: 400, RequestID: EAB097DB0576122F:A, HostID: J54rSQlEeJgX1k4TLw2s4+iBzxh9lFjcX19CsXVR8n7Sn/jTq66d6ORNLdIpYnu42hqtO2GcuXJY, api error InvalidArgument: The secret key was invalid for the specified algorithm.
DEBUG : S3 bucket en.keepass path falconer/alltest/en10/user01/all/rclone/current: Waiting for transfers to finish
ERROR : S3 bucket en.keepass path falconer/alltest/en10/user01/all/rclone/current: not deleting files as there were IO errors
ERROR : S3 bucket en.keepass path falconer/alltest/en10/user01/all/rclone/current: not deleting directories as there were IO errors
ERROR : Attempt 1/1 failed with 2 errors and: operation error S3: CopyObject, https response error StatusCode: 400, RequestID: EAB097DB0576122F:A, HostID: J54rSQlEeJgX1k4TLw2s4+iBzxh9lFjcX19CsXVR8n7Sn/jTq66d6ORNLdIpYnu42hqtO2GcuXJY, api error InvalidArgument: The secret key was invalid for the specified algorithm.
INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Errors:                 2 (retrying may help)
Checks:                 2 / 2, 100%
Elapsed time:         0.5s

2024/08/05 13:42:27 DEBUG : 7 go routines active
2024/08/05 13:42:27 Failed to sync with 2 errors: last error was: operation error S3: CopyObject, https response error StatusCode: 400, RequestID: EAB097DB0576122F:A, HostID: J54rSQlEeJgX1k4TLw2s4+iBzxh9lFjcX19CsXVR8n7Sn/jTq66d6ORNLdIpYnu42hqtO2GcuXJY, api error InvalidArgument: The secret key was invalid for the specified algorithm.
4

Thank you for testing @asdffdsa that is exactly the sort of testing I need!

The integration tests work against Wasabi and the new SDK but just use key/secret auth.

I suspect it will be SSE-C or temporary session token which is causing the problem.

This looks like the root cause of the problem.

I just did a test with a session token on AWS passed without config file and that worked, so the temporary session token is working with AWS at least.

I just tried my sse-c bucket and that fails in the same way

$ rclone lsl s3-sse-c:rclone-sse-c/
2024/08/07 09:52:48 NOTICE: README-2.md: Failed to read metadata: operation error S3: HeadObject, https response error StatusCode: 400, RequestID: G15YBZT6X3R8QW7P, HostID: i9rZYmSiyjQpCVc7iHFw6pVTObfwTgP4o1lu7OTbRWX6U0JXw29k63Yc06QCdunHL4EkFLIjv08=, api error BadRequest: Bad Request
     6042 2024-08-07 09:52:48.006615921 README-2.md
2024/08/07 09:52:48 NOTICE: README-3.md: Failed to read metadata: operation error S3: HeadObject, https response error StatusCode: 400, RequestID: R7RFR6PVK656Y1Z3, HostID: qrRI635y0m/daDA2OkUy9KuEFBIeM8frGAyTSeiqthySSgSWX1NRUdmUtfFRqZHgyvRQ/xAOconz0T3byf1MBg==, api error BadRequest: Bad Request
     6042 2024-08-07 09:52:48.061158349 README-3.md
2024/08/07 09:52:48 NOTICE: README-4.md: Failed to read metadata: operation error S3: HeadObject, https response error StatusCode: 400, RequestID: R7R9CE6PK935WY5Z, HostID: mArjWYvt5SCpTyAvP0nnzdnYMHoWINO0Vb7hoUs8UCZqUdrT9nrYAwVMEPFNLqevO2hO5iwTEao=, api error BadRequest: Bad Request
     6042 2024-08-07 09:52:48.105461572 README-4.md
2024/08/07 09:52:48 NOTICE: README.md: Failed to read metadata: operation error S3: HeadObject, https response error StatusCode: 400, RequestID: R7R676JKATGJ4MBP, HostID: DqBcp0GNaldTl1c9TPV1/Vy4c0SBrXZn79NPvKG4BRbfk2QuB34IZZoO8AL4uQFi9oEp5OHRTK4=, api error BadRequest: Bad Request
     6042 2024-08-07 09:52:48.157800693 README.md

So it looks like SSE-C is the cause of the problem.

A bit of debugging later and I find the new SDK doesn't base64 encode the key for us like the old one did. This isn't documented anywhere I can find!

So please give this a go - this now passes the integration tests with sse-c and with a session token and with wasabi, just haven't tried all 3 together!

v1.68.0-beta.8140.b42191dbf.fix-4989-s3-aws-sdk-v2 on branch fix-4989-s3-aws-sdk-v2 (uploaded in 15-30 mins)

5

yes, that seems correct.

using the latest beta, i did the following testing:

Feature AWS WASABI IDRIVE
SSE-C OK OK OK
Session Token OK OK not supported by provider

going forward with the betas, I will make sure to test on all three providers.

6

Thank you, that is really helpful.

I'm just about ready to merge this change to master so it will go in the regular betas for wider testing. I'm sure there is stuff which won't work - hopefully the pre-release testing will winkle it out!

I'll post when I've merged it to master.

7

I've merged this to master now which means it will be in the latest beta in 15-30 minutes and released in v1.68

Puttting it in the beta should hopefully get more testing before the release.

Any more testing much appreciated!

8

glad to help, do my small part.

the latest beta worked fine, no problems.

1 Like
9

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.