Why rclone output log show "Excluded from sync" using "rclone copy" with a single file?

Help and Support
1

Hello

Why rclone output log show “Excluded from sync” using “rclone copy” with a single file?

I’ve create a script with loop to use rclone copy

Rclone Copy Volumes Pool Diaria (only part from script)

for i in ls Volume-Diario-*; do
echo "date +'%Y/%m/%d %H:%M:%S' “rclone copy $dir_backup/$i wasabi:bacula-backup/ --stats=10m ${debug}”" >> ${log}
$rclone copy ${dir_backup}/${i} wasabi:bacula-backup/ --stats=10m ${debug}
done

And every “rclone copy” show output the volumes excluded.

2018/04/13 08:34:01  ##### Rclone Copy Bacula Volumes to Wasabi S3 Cloud ##### - start
2018/04/13 08:34:01  "rclone copy /mnt/disco01/Volume-Diario-0001 wasabi:bucket-backup/ --stats=10m --log-file /usr/local/bin/wasabi.log --log-level DEBUG"
2018/04/13 08:34:01 DEBUG : rclone: Version "v1.40" starting with parameters ["/usr/local/bin/rclone" "copy" "/mnt/disco01/Volume-Diario-0001" "wasabi:bucket-backup/" "--stats=10m" "--log-file" "/usr/local/bin/wasabi.log" "--log-level" "DEBUG"]
2018/04/13 08:34:01 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
2018/04/13 08:34:01 INFO  : S3 bucket bacula-backup: Modify window is 1ns
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0068: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0038: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Diario-0002: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Semanal-0021: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Diario-0012: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0018: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Diario-0014: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0017: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Semanal-0023: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0062: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0064: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0040: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Semanal-0003: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0008: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0013: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0047: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Semanal-0012: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Diario-0008: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0056: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0069: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0037: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Diario-0009: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0048: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0066: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0002: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0025: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0060: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Semanal-0004: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0027: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Semanal-0016: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0004: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0035: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0030: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0011: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Semanal-0008: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0046: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Semanal-0015: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Semanal-0014: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Semanal-0017: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0042: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0032: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Semanal-0024: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0053: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0051: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0006: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0036: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0063: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0044: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Semanal-0006: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0057: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0012: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Diario-0011: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0015: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0067: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Diario-0004: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Semanal-0025: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Default-0001: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0039: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0045: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Diario-0010: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0033: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Diario-0006: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0034: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0054: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0022: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Diario-0015: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0016: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0052: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Semanal-0001: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0058: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Diario-0003: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Semanal-0020: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0070: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Semanal-0002: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0007: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0023: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Semanal-0009: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0024: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0028: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0049: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0020: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Semanal-0022: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Semanal-0005: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0021: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0061: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0005: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0003: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0055: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0029: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Semanal-0010: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0031: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Semanal-0007: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0043: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0065: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0026: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0059: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0019: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Diario-0013: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0041: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Semanal-0018: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0014: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0009: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Semanal-0019: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Diario-0005: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Semanal-0013: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0050: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Semanal-0011: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Diario-0007: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0001: Excluded from sync (and deletion)
2018/04/13 08:34:01 DEBUG : Volume-Mensal-0010: Excluded from sync (and deletion)
2018/04/13 08:34:02 INFO  : S3 bucket bacula-backup: Waiting for checks to finish
2018/04/13 08:34:02 INFO  : S3 bucket bacula-backup: Waiting for transfers to finish
2018/04/13 08:44:01 INFO  :
Transferred:   1.514 GBytes (2.583 MBytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:       10m0s
Transferring:
 *                            Volume-Diario-0001: 40% /3.725G, 2.726M/s, 13m50s

2018/04/13 08:54:01 INFO  :
Transferred:   3.135 GBytes (2.675 MBytes/s)
Errors:                 0
Checks:                 0
Transferred:            0
Elapsed time:       20m0s
Transferring:
 *                            Volume-Diario-0001: 84% /3.725G, 2.662M/s, 3m47s

2018/04/13 08:57:44 INFO  : Volume-Diario-0001: Copied (new)
2018/04/13 08:57:44 INFO  :
Transferred:   3.725 GBytes (2.682 MBytes/s)
Errors:                 0
Checks:                 0
Transferred:            1
Elapsed time:    23m42.4s
2

That is an unfortunately side effect of the way the copy a single file is implemented - it effectively uses the --files-from flag with a single file!

If you don’t want to see those message use copyto

rclone copyto ${dir_backup}/${i} wasabi:bacula-backup/${i} --stats=10m ${debug}

Note the requirement to name the destination file…

1 Like
3

Thanks @ncw! I will do this!