--size-only is probably what you are looking for.
From the docs:
--size-only Skip based on size only, not mod-time or checksum
Always, make sure to check via --dry-run once to see if the results are what you would expect.