# What is the best method to upload many small files?

**URL:** <https://forum.rclone.org/t/what-is-the-best-method-to-upload-many-small-files/7891>\
**Category:** Help and Support\
**Created:** [December 8, 2018, 11:50pm UTC](https://forum.rclone.org/t/what-is-the-best-method-to-upload-many-small-files/7891 "2018-12-08T23:50:18Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![Diniboy](https://forum.rclone.org/user_avatar/forum.rclone.org/diniboy/32/2142_2.png) [@Diniboy](https://forum.rclone.org/u/Diniboy)\
**Post date:** [December 8, 2018, 11:50pm UTC](https://forum.rclone.org/t/what-is-the-best-method-to-upload-many-small-files/7891/1 "2018-12-08T23:50:18Z")

</div>

Hi,

I have about two million, but small files that I don’t have locally so I have to wget them first using a script from another server. Now I directly started downloading them to the mount but I kept getting ratelimit exceeded errors on some files. What is the best way to gain the smallest loss and upload them onto an encrypted storage?

Thanks

---

<div class="post-metadata">

**Author:** ![Animosity022](https://forum.rclone.org/user_avatar/forum.rclone.org/animosity022/32/451_2.png) [@Animosity022](https://forum.rclone.org/u/Animosity022)\
**Post date:** [December 9, 2018, 12:00am UTC](https://forum.rclone.org/t/what-is-the-best-method-to-upload-many-small-files/7891/2 "2018-12-09T00:00:53Z")

</div>

The best way would be to bundle them up before you send them.

At most you can do 10 files per second with current Google API limits so that’s like 55 hours if my math is right.

---

<div class="post-metadata">

**Author:** ![Diniboy](https://forum.rclone.org/user_avatar/forum.rclone.org/diniboy/32/2142_2.png) [@Diniboy](https://forum.rclone.org/u/Diniboy)\
**Post date:** [December 9, 2018, 1:12am UTC](https://forum.rclone.org/t/what-is-the-best-method-to-upload-many-small-files/7891/3 "2018-12-09T01:12:48Z")

</div>

I did 4 per second yet I got the ratelimit exceeded error like once per five minutes.

---

<div class="post-metadata">

**Author:** ![system](https://forum.rclone.org/uploads/default/original/2X/3/39ad3235f6ffec76ccd0c81616bd55697b4c300d.png) [@system](https://forum.rclone.org/u/system)\
**Post date:** [March 4, 2020, 12:49am UTC](https://forum.rclone.org/t/what-is-the-best-method-to-upload-many-small-files/7891/4 "2020-03-04T00:49:43Z")

</div>

Closed on March 4, 2020, 12:49am UTC