S3 and intermittent 403 errors with file renames and drag and drop operations in Windows Explorer

This might be related to this issue

There is a fix there which you could try.

Can you try to make a sequence of steps I can try so I can reproduce the problem here?

Can you get the problem to happen from CMD or is it related to Windows Explorer only?

That strongly hints it is a timing issue doesn't it?