Rclone sync not writing to destination - solved

I have been using rclone on Fedora 27 for several months with great success.
Today I installed rclone v1.41 on my newly installed Debian 9.
But rclone sync is not writing to destination and no errors are printed.
Here is a minimal example from HOME:

$ pwd
/home/wolfv
$ echo $HOME
/home/wolfv
$ rclone sync "$HOME/test_rclone_source" "$HOME/test_rclone_dest"  --log-file=$HOME/Documents/pc_maintenance/backup_systems/rclone_wolf/rclone_jobber.log --log-level=INFO --filter-from=$HOME/test_rclone_source/filter_rules --checksum
$ ls test_rclone_source
f2  filter_rules
$ ls test_rclone_dest
$ cat test_rclone_source/filter_rules
+ /test_rclone_source/**
- *

~test_rclone_dest is empty.

From the log file:

2018/05/17 19:54:42 NOTICE: Config file "/home/wolfv/.config/rclone/rclone.conf" not found - using defaults
2018/05/17 19:54:42 INFO  : Local file system at /home/wolfv/test_rclone_dest: Modify window is 1ns
2018/05/17 19:54:42 INFO  : Local file system at /home/wolfv/test_rclone_dest: Waiting for checks to finish
2018/05/17 19:54:42 INFO  : Local file system at /home/wolfv/test_rclone_dest: Waiting for transfers to finish
2018/05/17 19:54:42 INFO  : Waiting for deletions to finish
2018/05/17 19:54:42 INFO  : 
Transferred:      0 Bytes (0 Bytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:          0s

Maybe I just forgot something simple. What am I missing?

This might be related: Rclone sync seems to have stopped working with no errors

Can you show a log with log level DEBUG?

The --log-level=DEBUG log said:

2018/05/20 14:43:49 DEBUG : filter_rules: Excluded from sync (and deletion)
2018/05/20 14:43:49 DEBUG : f2: Excluded from sync (and deletion)

Here is the entire log entry:

2018/05/20 14:43:49 DEBUG : rclone: Version "v1.41" starting with parameters ["rclone" "sync" "/home/wolfv/test_rclone_source" "/home/wolfv/test_rclone_dest" "--log-file=/home/wolfv/Documents/pc_maintenance/backup_systems/rclone_wolf/rclone_jobber.log" "--log-level=DEBUG" "--filter-from=/home/wolfv/test_rclone_source/filter_rules" "--checksum"]
2018/05/20 14:43:49 NOTICE: Config file "/home/wolfv/.config/rclone/rclone.conf" not found - using defaults
2018/05/20 14:43:49 INFO  : Local file system at /home/wolfv/test_rclone_dest: Modify window is 1ns
2018/05/20 14:43:49 DEBUG : filter_rules: Excluded from sync (and deletion)
2018/05/20 14:43:49 DEBUG : f2: Excluded from sync (and deletion)
2018/05/20 14:43:49 INFO  : Local file system at /home/wolfv/test_rclone_dest: Waiting for checks to finish
2018/05/20 14:43:49 INFO  : Local file system at /home/wolfv/test_rclone_dest: Waiting for transfers to finish
2018/05/20 14:43:49 INFO  : Waiting for deletions to finish
2018/05/20 14:43:49 INFO  : 
Transferred:      0 Bytes (0 Bytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:          0s

2018/05/20 14:43:49 DEBUG : 3 go routines active
2018/05/20 14:43:49 DEBUG : rclone: Version "v1.41" finishing with parameters ["rclone" "sync" "/home/wolfv/test_rclone_source" "/home/wolfv/test_rclone_dest" "--log-file=/home/wolfv/Documents/pc_maintenance/backup_systems/rclone_wolf/rclone_jobber.log" "--log-level=DEBUG" "--filter-from=/home/wolfv/test_rclone_source/filter_rules" "--checksum"]

One thing different about my new OS install is the use of a /DATA partition (I should have mentioned this in my original post).
On the previous install, all directories in HOME where in their default locations on the home partition,.
On this new install, the following directories in HOME are really symlinks to the /DATA partition:

  • Documents
  • Pictures
  • scripts
  • cust_configs
  • .fonts

Maybe the symlinks are effecting rclone behavior?

I guess your filter_rules file matches the wrong names.

You try to include anything inside the /test_rclone_source folder, but this is also the folder you are copying.

Applying the include rule to your sync command, it would allow $HOME/test_rclone_source/test_rclone_source/... to be copied. If you are trying to sync the f2 folder, the filter_rules should look like this

+ /f2/**
- *

Hi B4dM4n,

f2 is a file.
Here is a minimal example to backup only the f2 file, from HOME:
$ pwd
/home/wolfv
$ rclone sync “$HOME/test_rclone_source” “$HOME/test_rclone_dest” --log-file=$HOME/Documents/pc_maintenance/backup_systems/rclone_wolf/rclone_jobber.log --log-level=DEBUG --filter-from=$HOME/test_rclone_source/filter_rules2
$ ls test_rclone_source
f2 filter_rules filter_rules2
$ ls test_rclone_dest
$ cat test_rclone_source/filter_rules2
+ test_rclone_source/f2
- *

test_rclone_dest is still empty.

B4dM4n,

Now I see what you’re saying. So I changed source in:

$ rclone sync "$HOME/test_rclone_source" "$HOME/test_rclone_dest"

to this:

$ rclone sync "$HOME" "$HOME/test_rclone_dest"
$ ls test_rclone_dest
f2

and it worked. Because filter_rules2 already has the “/test_rclone_dest” in its path:

$ cat test_rclone_source/filter_rules2
+ test_rclone_source/f2
- *

Thanks for your help.

1 Like