OneDrive sync on a Linux server

usernamechecksout · July 26, 2020, 6:38am

I configured OneDrive on my Linux server to automatically sync contents of the /backup directory at a specific time everyday. Sharename is 'onedrive'

What is the problem you are having with rclone?

Synced files not visible in OneDrive web-interface through the browser. However, the files and directories are listed in terminal through `rclone ls onedrive'
OneDrive share size is showing incorrect when using rclone about onedrive:

Total: 195.772G
Used: 84.476G
Free: 101.329G

The actual size of the OneDrive account is 1TB.

What is your rclone version (output from `rclone version`)

rclone v1.52.2

os/arch: linux/amd64
go version: go1.14.4

Which OS you are using and how many bits (eg Windows 7, 64 bit)

CentOS RHEL 7.8 x64.

Which cloud storage system are you using? (eg Google Drive)

OneDrive

The command you were trying to run (eg `rclone copy /tmp remote:tmp`)

NA

The rclone config contents with secrets removed.

[onedrive]
type = onedrive
client_id = efe3af92-xxxxxx-c919d
client_secret = 8j.xxxxxxxx.4jj5
token = {"access_token":"xk/ppnx","token_type":"Bearer","refresh_token":"xTbab54$","expiry":"2020-07-24T13:17:01.401684+05:30"}
drive_id = 7c11xxxxxxxdaf8
drive_type = personal

A log from the command with the `-vv` flag

2020/07/26 11:54:56 DEBUG : rclone: Version "v1.52.2" starting with parameters ["rclone" "sync" "/backup" "onedrive" "-vv"]
2020/07/26 11:54:56 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
2020/07/26 11:54:56 DEBUG : fs cache: renaming cache item "onedrive" to be canonical "/root/onedrive"
2020/07/26 11:54:56 DEBUG : transports.db: Size and modification time the same (differ by 0s, within tolerance 1ns)
2020/07/26 11:54:56 DEBUG : transports.db: Unchanged skipping
2020/07/26 11:54:56 DEBUG : .meta/deploymentone.db: Size and modification time the same (differ by 0s, within tolerance 1ns)
2020/07/26 11:54:56 DEBUG : .meta/deploymentone.db: Unchanged skipping
2020/07/26 11:54:56 DEBUG : .meta/deploymenttwo.db: Size and modification time the same (differ by 0s, within tolerance 1ns)
2020/07/26 11:54:56 DEBUG : .meta/deploymenttwo.db: Unchanged skipping
2020/07/26 11:54:56 DEBUG : .meta/helpdeskdeploymentone.db: Size and modification time the same (differ by 0s, within tolerance 1ns)
2020/07/26 11:54:56 DEBUG : .meta/helpdeskdeploymentone.db: Unchanged skipping
2020/07/26 11:54:56 DEBUG : 2020-07-26/system/files/_etc_ips.gz: Unchanged skipping
2020/07/26 11:54:56 DEBUG : 2020-07-26/system/dirs/_var_named.tar.gz: Unchanged skipping
2020/07/26 11:54:56 DEBUG : 2020-07-26/system/files/_etc_ips.remotedns.gz: Size and modification time the same (differ by 0s, within tolerance 1ns)
2020/07/26 11:54:56 DEBUG : 2020-07-26/system/files/_etc_ips.remotedns.gz: Unchanged skipping
2020/07/26 11:54:56 DEBUG : 2020-07-26/system/files/_etc_exim.conf.gz: Unchanged skipping
2020/07/26 11:54:56 DEBUG : 2020-07-26/system/files/_etc_mailips.gz: Size and modification time the same (differ by 0s, within tolerance 1ns)
2020/07/26 11:54:56 DEBUG : 2020-07-26/system/files/_etc_mailips.gz: Unchanged skipping
2020/07/26 11:54:56 DEBUG : 2020-07-26/system/files/_etc_cpanel_exim_system_filter.gz: Size and modification time the same (differ by 0s, within tolerance 1ns)
2020/07/26 11:54:56 DEBUG : 2020-07-26/system/files/_etc_named.conf.gz: Size and modification time the same (differ by 0s, within tolerance 1ns)
2020/07/26 11:54:56 DEBUG : 2020-07-26/system/files/_etc_named.conf.gz: Unchanged skipping
2020/07/26 11:54:56 DEBUG : 2020-07-26/system/files/_etc_cpanel_exim_system_filter.gz: Unchanged skipping
2020/07/26 11:54:56 DEBUG : 2020-07-26/system/files/_etc_my.cnf.gz: Size and modification time the same (differ by 0s, within tolerance 1ns)
2020/07/26 11:54:56 DEBUG : 2020-07-26/system/files/_etc_my.cnf.gz: Unchanged skipping
2020/07/26 11:54:56 DEBUG : 2020-07-26/system/files/_etc_pure-ftpd.conf.gz: Size and modification time the same (differ by 0s, within tolerance 1ns)
2020/07/26 11:54:56 DEBUG : 2020-07-26/system/files/_etc_pure-ftpd.conf.gz: Unchanged skipping
2020/07/26 11:54:56 DEBUG : 2020-07-26/system/files/_etc_senderverifybypasshosts.gz: Size and modification time the same (differby 0s, within tolerance 1ns)
2020/07/26 11:54:56 DEBUG : 2020-07-26/system/files/_etc_senderverifybypasshosts.gz: Unchanged skipping
2020/07/26 11:54:56 DEBUG : 2020-07-26/system/files/_etc_secondarymx.gz: Size and modification time the same (differ by 0s, within tolerance 1ns)
2020/07/26 11:54:56 DEBUG : 2020-07-26/system/files/_etc_passwd.gz: Size and modification time the same (differ by 0s, within tolerance 1ns)
2020/07/26 11:54:56 DEBUG : 2020-07-26/system/files/_etc_spammeripblocks.gz: Size and modification time the same (differ by 0s, within tolerance 1ns)
2020/07/26 11:54:56 DEBUG : 2020-07-26/system/files/_etc_shadow.gz: Size and modification time the same (differ by 0s, within tolerance 1ns)
2020/07/26 11:54:56 DEBUG : 2020-07-26/system/files/_etc_shadow.gz: Unchanged skipping
2020/07/26 11:54:56 DEBUG : 2020-07-26/system/files/_etc_spammers.gz: Size and modification time the same (differ by 0s, within tolerance 1ns)
2020/07/26 11:54:56 DEBUG : 2020-07-26/system/files/_root_.my.cnf.gz: Size and modification time the same (differ by 0s, within tolerance 1ns)
2020/07/26 11:54:56 DEBUG : 2020-07-26/system/files/_root_.my.cnf.gz: Unchanged skipping
2020/07/26 11:54:56 DEBUG : 2020-07-26/system/files/_var_cpanel_greylist_greylist.sqlite.gz: Size and modification time the same(differ by 0s, within tolerance 1ns)
2020/07/26 11:54:56 DEBUG : 2020-07-26/system/files/_var_cpanel_greylist_greylist.sqlite.gz: Unchanged skipping
2020/07/26 11:54:56 DEBUG : 2020-07-26/system/files/_etc_wwwacct.conf.gz: Size and modification time the same (differ by 0s, within tolerance 1ns)
2020/07/26 11:54:56 DEBUG : 2020-07-26/system/files/_etc_wwwacct.conf.gz: Unchanged skipping
2020/07/26 11:54:56 DEBUG : 2020-07-26/system/files/_etc_spammers.gz: Unchanged skipping
2020/07/26 11:54:56 DEBUG : 2020-07-26/system/files/_etc_passwd.gz: Unchanged skipping
2020/07/26 11:54:56 DEBUG : 2020-07-26/system/files/_etc_secondarymx.gz: Unchanged skipping
2020/07/26 11:54:56 DEBUG : 2020-07-26/system/files/_etc_spammeripblocks.gz: Unchanged skipping
2020/07/26 11:54:56 DEBUG : 2020-07-26/system/files/_etc_remotedomains.gz: Size and modification time the same (differ by 0s, within tolerance 1ns)
2020/07/26 11:54:56 DEBUG : 2020-07-26/system/files/_etc_remotedomains.gz: Unchanged skipping
2020/07/26 11:54:56 DEBUG : 2020-07-26/system/files/_etc_localdomains.gz: Size and modification time the same (differ by 0s, within tolerance 1ns)
2020/07/26 11:54:56 DEBUG : 2020-07-26/system/files/_etc_localdomains.gz: Unchanged skipping
2020/07/26 11:54:56 DEBUG : 2020-07-26/system/files/_var_cpanel_mysql_remote_profiles_profiles.json.gz: Size and modification time the same (differ by 0s, within tolerance 1ns)
2020/07/26 11:54:56 DEBUG : 2020-07-26/system/files/_var_cpanel_mysql_remote_profiles_profiles.json.gz: Unchanged skipping
2020/07/26 11:54:56 DEBUG : Local file system at /root/onedrive: Waiting for transfers to finish
2020/07/26 11:54:56 DEBUG : Waiting for deletions to finish
2020/07/26 11:54:56 INFO  : There was nothing to transfer
2020/07/26 11:54:56 INFO  :
Transferred:             0 / 0 Bytes, -, 0 Bytes/s, ETA -
Checks:               209 / 209, 100%
Elapsed time:         0.0s

The above paste shows the files already exist on the remote share 'onedrive'. However, no files are visible in the web-browser as mentioned earlier.

Also, the drive is the same:

drive_id = 7c11xxxxxxxdaf8

Any ideas what I could have missed entirely?

Edit: Just noticed the rclone sync is happening to the Local directory /root/onedrive as evident from the log above, and not the actual OneDrive. Not sure why is that happening.

ncw · July 26, 2020, 9:56am

You haven't shown the command you are using but I can see here that the command was

rclone sync /backup onedrive -vv

That will sync to a local directory called onedrive. To use the remote you've configured you need to add a : so

rclone sync /backup onedrive: --dry-run

Note that this command will wipe everything you already have in the onedrive remote as you are using sync to the root. You probably want

rclone sync /backup onedrive:thiscomputerbackup --dry-run

To sync to a directory called thiscomputerbackup

usernamechecksout · July 26, 2020, 2:29pm

Whoops, that's embarrassing. Adding a : worked. Thanks!

system · July 29, 2020, 2:29pm

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.