make sure to use latest version of rclone.
have you read? How to sync S3 with millions of files at root