Fastest way to check for changes in 2.5+ Million files?

Do you use --size-only because of S3's additional API call for modtime? Does it speed anything up if both remotes support it more efficiently?