I have my files in OneDrive, but I want to backup them. For that I'm using a SFTP account that I have in a cloud provider with unlimited storage (I store my files there after encrypting them with rclone). The problem is that the SFTP has a file number limit: 262.000 files.
As I have tons of files in OneDrive, I have reached the limit in the SFTP (not because of storage, but because of the number of files).
1.- Is it possible to instruct rclone to package folders (or certain folders)? I don't need compression, just reducing the number of files. I would need something like TAR, for example.
I read Compress but it doesn't show an option to compress a folder, just individual files.
If rclone can't do this and I have to create a script with an intermediate step (that downloads the folder to my computer, packages it, and uploads it to SFTP) that would help too.
2.- And if that is possible, is rclone able to later not upload into the SFTP the folders that have been copied already (by recording which are the files already uploaded and not uploading them again)?
Thank you very much in advance!
- os/version: darwin 13.0.1 (64 bit)
- os/kernel: 22.1.0 (arm64)
- os/type: darwin
- os/arch: arm64
- go/version: go1.19.4
- go/linking: dynamic
- go/tags: none
I'm copying from OneDrive into SFTP.
SFTP files are stored encrypted using rclone.