[GCS] Use region-specific endpoints to avoid inter-region transfer fees of $20/TB

Tony_M · November 15, 2024, 12:14am

googlecloudstorage: add example values for endpoint with help on avoiding transfer fees

rclone:master ← tonymet:gcs-regional-endpoints

opened 11:54PM - 14 Nov 24 UTC

#### What is the purpose of this change? For *googlecloudstorage* backend, the default global endpoint `storage.googleapis.com` may lead to significant transfer fees of $10-$100/TB when calling rclone from GCE (Compute Engine VM) , even when both the VM & bucket are in the same region. This should help rclone users who may not be familiar with some of the nuances of GCE region transfer fees. Region-specific endpoints will also improve latency & throughput. This change adds help text to the advanced option `endpoint` , along with example values to allow users to select a region-specific endpoint.  Added example values & help text to endpoint option to simplify setting region-specific endpoint for the users. e.g. ``` Option endpoint. Endpoint for the service. Use a regional endpoint (storage.REGION.rep.googleapis.com) to reduce transfer fees Choose a number from below, or type in your own string value. Press Enter for the default (https://storage.us-west1.rep.googleapis.com/storage/v1/). 1 / europe-west3 : Frankfurt \ (https://storage.europe-west3.rep.googleapis.com/storage/v1/) 2 / europe-west8 : Milan \ (https://storage.europe-west8.rep.googleapis.com/storage/v1/) 3 / europe-west9 : Paris \ (https://storage.europe-west9.rep.googleapis.com/storage/v1/) 4 / me-central2 : Doha \ (https://storage.me-central2.rep.googleapis.com/storage/v1/) 5 / us-central1 : Iowa ``` #### Was the change discussed in an issue or in the forum before? Yes, there seemed to be consensus on the approach. https://forum.rclone.org/t/gcs-use-region-specific-endpoints-to-avoid-inter-region-transfer-fees-of-20-tb/48155  #### Checklist - [ ✅] I have read the [contribution guidelines](https://github.com/rclone/rclone/blob/master/CONTRIBUTING.md#submitting-a-new-feature-or-bug-fix). - [✅ ] I have added tests for all changes in this PR if appropriate. - [✅ ] I have added documentation for the changes if appropriate. - [✅ ] All commit messages are in [house style](https://github.com/rclone/rclone/blob/master/CONTRIBUTING.md#commit-messages). - [ ] I'm done, this Pull Request is ready for review :-)

system · January 14, 2025, 12:15am

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.