How to disable multipart upload for onedrive?

What is the problem you are having with rclone?

When uploading a big file to OneDrive (Business), rclone gives no error but on OneDrive we find only the first 'chunk' of the file.

I have no idea of the problem, but I suppose it's about multi-chunk upload; I think OneDrive it's taking the file as soon as first write is completed, and some automatism it moving file to another place.

So there are no errors in log file, even when file are modified (once a day).

Please, help me just with the question about flag to use to disable multi upload for single file

I'd like to try monolithic, 'serial', upload of a single file

Run the command 'rclone version' and share the full output of the command.

rclone v1.57.0
- os/version: debian 11.6 (64 bit)
- os/kernel: 5.10.0-21-amd64 (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.17.2
- go/linking: static
- go/tags: none

Which cloud storage system are you using? (eg Google Drive)

OneDrive (Business)

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone sync /var/www/project-name/storage/export-to-onedrive/ OneDrive:/inPiattaforma/  --exclude=".gitignore"

The rclone config contents with secrets removed.

    "OneDrive": {
        "client_id": "...",
        "client_secret": "...",
        "drive_id": "...",
        "drive_type": "business",
        "link_scope": "organization",
        "link_type": "edit",
        "no_versions": "true",
        "region": "global",
        "token": "...",
        "type": "onedrive"
    }

A log from the command with the -vv flag

2023/03/01 10:54:06 DEBUG : rclone: Version "v1.57.0" starting with parameters ["rclone" "sync" "/var/www/project-name/storage/export-to-onedrive/" "OneDrive:/inPiattaforma/" "--exclude=.gitignore" "-vvv"]
2023/03/01 10:54:06 DEBUG : Creating backend with remote "/var/www/project-name/storage/export-to-onedrive/"
2023/03/01 10:54:06 DEBUG : Using config file from "/home/username/.config/rclone/rclone.conf"
2023/03/01 10:54:06 DEBUG : Creating backend with remote "OneDrive:/inPiattaforma/"
2023/03/01 10:54:06 DEBUG : One drive root 'inPiattaforma': Token expired but no uploads in progress - doing nothing
2023/03/01 10:54:06 DEBUG : OneDrive: Loaded invalid token from config file - ignoring
2023/03/01 10:54:06 DEBUG : Saving config "token" in section "OneDrive" of the config file
2023/03/01 10:54:06 DEBUG : OneDrive: Saved new token in config file
2023/03/01 10:54:07 DEBUG : fs cache: renaming cache item "OneDrive:/inPiattaforma/" to be canonical "OneDrive:inPiattaforma"
2023/03/01 10:54:07 DEBUG : .gitignore: Excluded
2023/03/01 10:54:07 DEBUG : .gitignore: Excluded
2023/03/01 10:54:07 DEBUG : fatture.csv: Size and modification time the same (differ by -360.054105ms, within tolerance 1s)
2023/03/01 10:54:07 DEBUG : fatture.csv: Unchanged skipping
2023/03/01 10:54:07 DEBUG : pagamenti_debitori.csv: Size and modification time the same (differ by -979.994664ms, within tolerance 1s)
2023/03/01 10:54:07 DEBUG : reporter.csv: Size and modification time the same (differ by -74.800552ms, within tolerance 1s)
2023/03/01 10:54:07 DEBUG : reporter.csv: Unchanged skipping
2023/03/01 10:54:07 DEBUG : rate.csv: Size and modification time the same (differ by -360.054105ms, within tolerance 1s)
2023/03/01 10:54:07 DEBUG : pagamenti_debitori.csv: Unchanged skipping
2023/03/01 10:54:07 DEBUG : rate.csv: Unchanged skipping
2023/03/01 10:54:07 DEBUG : One drive root 'inPiattaforma': Waiting for checks to finish
2023/03/01 10:54:07 DEBUG : cedenti.csv: Size and modification time the same (differ by -70.800482ms, within tolerance 1s)
2023/03/01 10:54:07 DEBUG : cedenti.csv: Unchanged skipping
2023/03/01 10:54:07 DEBUG : One drive root 'inPiattaforma': Waiting for transfers to finish
2023/03/01 10:54:07 DEBUG : Waiting for deletions to finish
2023/03/01 10:54:07 INFO  : There was nothing to transfer
2023/03/01 10:54:07 INFO  :
Transferred:              0 B / 0 B, -, 0 B/s, ETA -
Checks:                 5 / 5, 100%
Elapsed time:         1.3s

2023/03/01 10:54:07 DEBUG : 5 go routines active

That is bad...

You could try syncing it to a different place then using rclone move to server side move it into the correct place for the automation.

All files are uploaded in chunks on onedrive, but you can control the size of the chunks. Note that these are buffered in memory so don't make them too big.

  --onedrive-chunk-size SizeSuffix        Chunk size to upload files with - must be multiple of 320k (327,680 bytes) (default 10Mi)

I extended succesfully check size to 320M.

1 Like

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.