How to investigate copy errors on log file?

What is the problem you are having with rclone?

So, I regularly run on daily basis a copy rclone command syncronizing one directory from my local filesystem to an encrypted drive mounted on my personal onedrive. The command seems to work relatively fine, except for some errors mentioned on the log file, which i can't really understand for what files/folders they reffers to.
For example, here I have one of the last log files generated by the command pasted on the last post section. By the way, i'm not pasting the entire content, because it's pretty long.

I'm not the guy when it comes to this understand all the backend issues of this kind of task, so i don't know what this last error line is actually saying me, or how can I solve these 81 errors.
Someone could please help me with any suggestion or enlightenment?
Thank you

Run the command 'rclone version' and share the full output of the command.

rclone v1.62.2

  • os/version: Microsoft Windows 10 Home Single Language 22H2 (64 bit)
  • os/kernel: 10.0.19045.3324 Build 19045.3324.3324 (x86_64)
  • os/type: windows
  • os/arch: amd64
  • go/version: go1.20.2
  • go/linking: static
  • go/tags: cmount

Which cloud storage system are you using? (eg Google Drive)

OneDrive Personal account

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone sync "D:\user" ode:Backup/Desktop/user--checksum -P --no-console -vv
--drive-use-trash --create-empty-src-dirs --stats-log-level DEBUG --log-
file=D:/user/Documents/rclone/"log_file_%date:~0,2%-%date:~3,2%-%date:~6,4% 
%time:~0,2%-%time:~3,2%-%time:~6,2%.log"

The rclone config contents with secrets removed.

Don't know what exactly i should do in order to get my rclone config contents.

A log from the command with the -vv flag

These are some of the lines which contain error flags:

2023/08/28 06:31:06 ERROR : full/path/to/file/1: error reading destination directory: couldn't list files: Get "https://graph.microsoft.com/v1.0/drives/_/items/_!_/children?$top=_": dial tcp: lookup graph.microsoft.com: no such host
2023/08/28 06:31:06 ERROR : full/path/to/file/2: Failed to copy: Post "https://graph.microsoft.com/v1.0/drives/_/items/_!_:/_:/createUploadSession": dial tcp: lookup graph.microsoft.com: no such host
2023/08/28 06:31:06 ERROR : full/path/to/file/3: Failed to copy: Post "https://graph.microsoft.com/v1.0/drives/_/items/_!_:/_:/createUploadSession": dial tcp: lookup graph.microsoft.com: no such host
2023/08/28 06:31:06 ERROR : full/path/to/file/4: error reading destination directory: couldn't list files: Get "https://graph.microsoft.com/v1.0/drives/_/items/_!_/children?$top=_": dial tcp: lookup graph.microsoft.com: no such host
2023/08/28 06:31:06 ERROR : full/path/to/file/5: error reading destination directory: couldn't list files: Get "https://graph.microsoft.com/v1.0/drives/_/items/_!_/children?$top=_": dial tcp: lookup graph.microsoft.com: no such host
2023/08/28 06:31:06 ERROR : full/path/to/file/6: error reading destination directory: couldn't list files: Get "https://graph.microsoft.com/v1.0/drives/_/items/_!_/children?$top=_": dial tcp: lookup graph.microsoft.com: no such host
2023/08/28 06:31:06 ERROR : full/path/to/file/7: error reading destination directory: couldn't list files: Get "https://graph.microsoft.com/v1.0/drives/_/items/_!_/children?$top=_": dial tcp: lookup graph.microsoft.com: no such host
2023/08/28 06:31:06 ERROR : full/path/to/file/8: Failed to copy: Post "https://graph.microsoft.com/v1.0/drives/_/items/_!_:/_.Gx:/createUploadSession": dial tcp: lookup graph.microsoft.com: no such host
2023/08/28 06:31:06 ERROR : full/path/to/file/9: error reading destination directory: couldn't list files: Get "https://graph.microsoft.com/v1.0/drives/_/items/_!_/children?$top=_": dial tcp: lookup graph.microsoft.com: no such host
2023/08/28 06:31:06 ERROR : full/path/to/file/10: error reading destination directory: couldn't list files: Get "https://graph.microsoft.com/v1.0/drives/_/items/_!_/children?$top=_": dial tcp: lookup graph.microsoft.com: no such host

And this is the "conclusion" part of the log file.

2023/08/28 06:59:29 DEBUG : 
Transferred:   	   60.833 MiB / 60.833 MiB, 100%, 46.208 KiB/s, ETA 0s
Errors:                81 (retrying may help)
Checks:            109391 / 109391, 100%
Transferred:           99 / 99, 100%
Elapsed time:     28m52.4s

2023/08/28 06:59:29 DEBUG : 6 go routines active
2023/08/28 06:59:29 Failed to sync with 81 errors: last error was: march failed with 80 error(s): first error: couldn't list files: Get "https://graph.microsoft.com/v1.0/drives/_____/items/_______/children?$top=___": dial tcp: lookup graph.microsoft.com: no such host

Those are DNS issues. I'd check your networking/firewall/antivirus/etc.

What does a DNS issue mean in this case? My Windows firewall is deactivated, the only one activated is my antivirus, and it normally notifies me when blocks some kind of network activity (doesn't send any advice when the rclone instance is running).
I don't know how to start an understanding about this problem.

It means your computer is trying to lookup a computer name and failing as it's a local OS issue and not related to rclone per se.

etexter@macmini ~ % host graph.microsoft.com
graph.microsoft.com is an alias for ags.privatelink.msidentity.com.
ags.privatelink.msidentity.com is an alias for www.tm.prd.ags.trafficmanager.net.
www.tm.prd.ags.trafficmanager.net has address 40.126.23.163
www.tm.prd.ags.trafficmanager.net has address 20.190.151.160
www.tm.prd.ags.trafficmanager.net has address 20.190.151.161
www.tm.prd.ags.trafficmanager.net has address 40.126.23.162
www.tm.prd.ags.trafficmanager.net has address 20.190.151.37
www.tm.prd.ags.trafficmanager.net has address 20.190.130.40
www.tm.prd.ags.trafficmanager.net has IPv6 address 2603:1036:3000:128::81
www.tm.prd.ags.trafficmanager.net has IPv6 address 2603:1036:3000:128::80
www.tm.prd.ags.trafficmanager.net has IPv6 address 2603:1036:3000:138::80
www.tm.prd.ags.trafficmanager.net has IPv6 address 2603:1036:3000:138::81
www.tm.prd.ags.trafficmanager.net has IPv6 address 2603:1036:3000:130::81
www.tm.prd.ags.trafficmanager.net has IPv6 address 2603:1036:3000:130::80

and

etexter@macmini ~ % ping graph.microsoft.com
PING www.tm.prd.ags.trafficmanager.net (40.126.23.162): 56 data bytes
64 bytes from 40.126.23.162: icmp_seq=0 ttl=115 time=8.506 ms
64 bytes from 40.126.23.162: icmp_seq=1 ttl=115 time=8.514 ms
64 bytes from 40.126.23.162: icmp_seq=2 ttl=115 time=18.109 ms

So you'd want to find someone to help diagnose that on your local computer.

Thank you for your assistance and the time you kindly put into this question.
Also, if you don't mind, i'd like to ask if there's any rclone command that helps me to specify what files are potentially corrupted or not properly backed up on the encrypted drive?
I can mount locally the encrypted drive and then try manually to "syncronize" those files.
Unfortunately, I can't get any help for this type of diagnose, so it's the only option I have in this case :frowning:

Sorry as I'm not sure what that means? If a file copies, it generally is good as there are checks that happen on completion. You'd have to share a log file or more details of the issue and what the problem is as I'm not following so don't have much advice to offer.

Due to log conclusion part:

2023/08/28 06:59:29 DEBUG : 
Transferred:   	   60.833 MiB / 60.833 MiB, 100%, 46.208 KiB/s, ETA 0s
Errors:                81 (retrying may help)
Checks:            109391 / 109391, 100%
Transferred:           99 / 99, 100%
Elapsed time:     28m52.4s

2023/08/28 06:59:29 DEBUG : 6 go routines active
2023/08/28 06:59:29 Failed to sync with 81 errors: last error was: march failed with 80 error(s): first error: couldn't list files: Get "https://graph.microsoft.com/v1.0/drives/_____/items/_______/children?$top=___": dial tcp: lookup graph.microsoft.com: no such host

I have 81 errors on my rclone instance running, which I assume that there's a bunch of files that are not being properly transfered from my local filesystem to the encrypted drive.
What I want to know is if there's any rclone command that can help me identify which of the files are compromised by these errors, so I can manually copy them from my localfilesystem to mounted encrypted drive.
Did I make my intention clear now?
Thanks

Those are still DNS issues. You really, really want to figure out that and fix that.

You'd run a --log-file /some/log/location/rclone.log --log-level INFO

and you'd check the log for failures.

rclone cryptcheck

I don't know where to start understanding this DNS problem, once I'm not very knowledgeable about this kind of subject and also I don't have anyone on my reach that could help me :frowning:
But anyways I'd like to thank you for your effort on answering my questions.

Thank you, sir.

Not much I can provide as I don't use Windows at all.

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.