Core/stats not showing lasterror or any error with rclone move

Help and Support
1

What is the problem you are having with rclone?

I'm attempting to use core/stats to monitor my uploads rclone move... so that if it reaches 750G or hits userRateLimitExceeded, then it will exit, however despite many attempts to get this to work, for some reason, core/stats will not display the lastError, in fact, core/stats doesn't seem to awknowledge there is an error unless I'm doing something wrong? I've also had a friend test this and they have the same issue where core/stats doesn't show any errors..

Run the command 'rclone version' and share the full output of the command.

rclone v1.58.0
- os/version: ubuntu 20.04 (64 bit)
- os/kernel: 4.18.0-425.3.1.el8.x86_64 (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.17.8
- go/linking: static
- go/tags: none

Which cloud storage system are you using? (eg Google Drive)

Google Drive

The command you were trying to run (eg rclone copy /tmp remote:tmp)

core/stats command

rclone rc core/stats --rc-addr=localhost:5573 --rc-user=user --rc-pass=pass

Just encase it's needed.. here is the move command..

rclone move /path/to/source remote:path --delete-empty-src-dirs --fast-list --max-transfer 750G --min-age 1m --drive-chunk-size 128M --tpslimit 12 --tpslimit-burst 12 --transfers 12 --vv --log-file /media/logs/test.log --rc --rc-addr=localhost:5573 --rc-user=user --rc-pass=pass

A log from the command with the -vv flag

2023/03/01 21:13:59 DEBUG : rc: "core/stats": with parameters map[]
2023/03/01 21:13:59 DEBUG : rc: "core/stats": reply map[bytes:0 checking:[Series/Star Trek - Picard (2020) [tvdb-364093]/Season 03/Star Trek - Picard (2020) - S03E01 - Part One The Next Generation [AMZN WEBDL-1080p Proper][8bit][h264][EAC3 5.1]-NTb.mkv Series/The Rookie (2018) [tvdb-350665]/Season 05/The Rookie (2018) - S05E01 - Double Down [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv Series/The Rookie (2018) [tvdb-350665]/Season 05/The Rookie (2018) - S05E02 - Labor Day [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv Series/The Rookie (2018) [tvdb-350665]/Season 05/The Rookie (2018) - S05E03 - Dye Hard [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv Series/The Rookie (2018) [tvdb-350665]/Season 05/The Rookie (2018) - S05E04 - The Choice [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv Series/The Rookie (2018) [tvdb-350665]/Season 05/The Rookie (2018) - S05E05 - The Fugitive [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv Series/The Rookie (2018) [tvdb-350665]/Season 05/The Rookie (2018) - S05E06 - The Reckoning [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv Series/The Rookie (2018) [tvdb-350665]/Season 05/The Rookie (2018) - S05E07 - Crossfire [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv Series/The Rookie (2018) [tvdb-350665]/Season 05/The Rookie (2018) - S05E08 - The Collar [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv Series/The Rookie (2018) [tvdb-350665]/Season 05/The Rookie (2018) - S05E09 - Take Back [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv Series/The Rookie (2018) [tvdb-350665]/Season 05/The Rookie (2018) - S05E10 - The List [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv Series/The Rookie (2018) [tvdb-350665]/Season 05/The Rookie (2018) - S05E11 - The Naked and the Dead [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv] checks:0 deletedDirs:0 deletes:0 elapsedTime:18.445520574 errors:0 eta:<nil> fatalError:false renames:0 retryError:false speed:0 totalBytes:108557299356 totalChecks:12 totalTransfers:12 transferTime:0 transferring:[map[bytes:0 eta:<nil> group:global_stats name:Series/Star Trek - Picard (2020) [tvdb-364093]/Season 03/Star Trek - Picard (2020) - S03E01 - Part One The Next Generation [AMZN WEBDL-1080p Proper][8bit][h264][EAC3 5.1]-NTb.mkv percentage:0 size:1877563540 speed:0 speedAvg:0] map[bytes:0 eta:<nil> group:global_stats name:Series/The Rookie (2018) [tvdb-350665]/Season 05/The Rookie (2018) - S05E01 - Double Down [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv percentage:0 size:3257426458 speed:0 speedAvg:0] map[bytes:0 eta:<nil> group:global_stats name:Series/The Rookie (2018) [tvdb-350665]/Season 05/The Rookie (2018) - S05E03 - Dye Hard [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv percentage:0 size:3258985155 speed:0 speedAvg:0] map[bytes:0 eta:<nil> group:global_stats name:Series/The Rookie (2018) [tvdb-350665]/Season 05/The Rookie (2018) - S05E02 - Labor Day [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv percentage:0 size:3265731583 speed:0 speedAvg:0] map[bytes:0 eta:<nil> group:global_stats name:Series/The Rookie (2018) [tvdb-350665]/Season 05/The Rookie (2018) - S05E05 - The Fugitive [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv percentage:0 size:3237533200 speed:0 speedAvg:0] map[bytes:0 eta:<nil> group:global_stats name:Series/The Rookie (2018) [tvdb-350665]/Season 05/The Rookie (2018) - S05E04 - The Choice [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv percentage:0 size:2920223184 speed:0 speedAvg:0] map[bytes:0 eta:<nil> group:global_stats name:Series/The Rookie (2018) [tvdb-350665]/Season 05/The Rookie (2018) - S05E07 - Crossfire [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv percentage:0 size:3299802268 speed:0 speedAvg:0] map[bytes:0 eta:<nil> group:global_stats name:Series/The Rookie (2018) [tvdb-350665]/Season 05/The Rookie (2018) - S05E08 - The Collar [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv percentage:0 size:3178276108 speed:0 speedAvg:0] map[bytes:0 eta:<nil> group:global_stats name:Series/The Rookie (2018) [tvdb-350665]/Season 05/The Rookie (2018) - S05E06 - The Reckoning [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv percentage:0 size:3309584086 speed:0 speedAvg:0] map[bytes:0 eta:<nil> group:global_stats name:Series/The Rookie (2018) [tvdb-350665]/Season 05/The Rookie (2018) - S05E09 - Take Back [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv percentage:0 size:3276443003 speed:0 speedAvg:0] map[bytes:0 eta:<nil> group:global_stats name:Series/The Rookie (2018) [tvdb-350665]/Season 05/The Rookie (2018) - S05E10 - The List [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv percentage:0 size:3251656688 speed:0 speedAvg:0] map[bytes:0 eta:<nil> group:global_stats name:Series/The Rookie (2018) [tvdb-350665]/Season 05/The Rookie (2018) - S05E11 - The Naked and the Dead [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv percentage:0 size:3213810787 speed:0 speedAvg:0]] transfers:0]: <nil>
2023/03/01 21:13:59 DEBUG : pacer: low level retry 2/10 (error googleapi: Error 403: User rate limit exceeded., userRateLimitExceeded)
2023/03/01 21:13:59 DEBUG : pacer: Rate limited, increasing sleep to 16.176165077s
2023/03/01 21:13:59 DEBUG : rc: "core/stats": with parameters map[]
2023/03/01 21:13:59 DEBUG : rc: "core/stats": reply map[bytes:0 checking:[Series/Star Trek - Picard (2020) [tvdb-364093]/Season 03/Star Trek - Picard (2020) - S03E01 - Part One The Next Generation [AMZN WEBDL-1080p Proper][8bit][h264][EAC3 5.1]-NTb.mkv Series/The Rookie (2018) [tvdb-350665]/Season 05/The Rookie (2018) - S05E01 - Double Down [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv Series/The Rookie (2018) [tvdb-350665]/Season 05/The Rookie (2018) - S05E02 - Labor Day [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv Series/The Rookie (2018) [tvdb-350665]/Season 05/The Rookie (2018) - S05E03 - Dye Hard [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv Series/The Rookie (2018) [tvdb-350665]/Season 05/The Rookie (2018) - S05E04 - The Choice [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv Series/The Rookie (2018) [tvdb-350665]/Season 05/The Rookie (2018) - S05E05 - The Fugitive [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv Series/The Rookie (2018) [tvdb-350665]/Season 05/The Rookie (2018) - S05E06 - The Reckoning [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv Series/The Rookie (2018) [tvdb-350665]/Season 05/The Rookie (2018) - S05E07 - Crossfire [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv Series/The Rookie (2018) [tvdb-350665]/Season 05/The Rookie (2018) - S05E08 - The Collar [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv Series/The Rookie (2018) [tvdb-350665]/Season 05/The Rookie (2018) - S05E09 - Take Back [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv Series/The Rookie (2018) [tvdb-350665]/Season 05/The Rookie (2018) - S05E10 - The List [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv Series/The Rookie (2018) [tvdb-350665]/Season 05/The Rookie (2018) - S05E11 - The Naked and the Dead [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv] checks:0 deletedDirs:0 deletes:0 elapsedTime:18.698981345 errors:0 eta:<nil> fatalError:false renames:0 retryError:false speed:0 totalBytes:108557299356 totalChecks:12 totalTransfers:12 transferTime:0 transferring:[map[bytes:0 eta:<nil> group:global_stats name:Series/Star Trek - Picard (2020) [tvdb-364093]/Season 03/Star Trek - Picard (2020) - S03E01 - Part One The Next Generation [AMZN WEBDL-1080p Proper][8bit][h264][EAC3 5.1]-NTb.mkv percentage:0 size:1877563540 speed:0 speedAvg:0] map[bytes:0 eta:<nil> group:global_stats name:Series/The Rookie (2018) [tvdb-350665]/Season 05/The Rookie (2018) - S05E01 - Double Down [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv percentage:0 size:3257426458 speed:0 speedAvg:0] map[bytes:0 eta:<nil> group:global_stats name:Series/The Rookie (2018) [tvdb-350665]/Season 05/The Rookie (2018) - S05E03 - Dye Hard [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv percentage:0 size:3258985155 speed:0 speedAvg:0] map[bytes:0 eta:<nil> group:global_stats name:Series/The Rookie (2018) [tvdb-350665]/Season 05/The Rookie (2018) - S05E02 - Labor Day [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv percentage:0 size:3265731583 speed:0 speedAvg:0] map[bytes:0 eta:<nil> group:global_stats name:Series/The Rookie (2018) [tvdb-350665]/Season 05/The Rookie (2018) - S05E05 - The Fugitive [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv percentage:0 size:3237533200 speed:0 speedAvg:0] map[bytes:0 eta:<nil> group:global_stats name:Series/The Rookie (2018) [tvdb-350665]/Season 05/The Rookie (2018) - S05E04 - The Choice [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv percentage:0 size:2920223184 speed:0 speedAvg:0] map[bytes:0 eta:<nil> group:global_stats name:Series/The Rookie (2018) [tvdb-350665]/Season 05/The Rookie (2018) - S05E07 - Crossfire [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv percentage:0 size:3299802268 speed:0 speedAvg:0] map[bytes:0 eta:<nil> group:global_stats name:Series/The Rookie (2018) [tvdb-350665]/Season 05/The Rookie (2018) - S05E08 - The Collar [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv percentage:0 size:3178276108 speed:0 speedAvg:0] map[bytes:0 eta:<nil> group:global_stats name:Series/The Rookie (2018) [tvdb-350665]/Season 05/The Rookie (2018) - S05E06 - The Reckoning [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv percentage:0 size:3309584086 speed:0 speedAvg:0] map[bytes:0 eta:<nil> group:global_stats name:Series/The Rookie (2018) [tvdb-350665]/Season 05/The Rookie (2018) - S05E09 - Take Back [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv percentage:0 size:3276443003 speed:0 speedAvg:0] map[bytes:0 eta:<nil> group:global_stats name:Series/The Rookie (2018) [tvdb-350665]/Season 05/The Rookie (2018) - S05E10 - The List [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv percentage:0 size:3251656688 speed:0 speedAvg:0] map[bytes:0 eta:<nil> group:global_stats name:Series/The Rookie (2018) [tvdb-350665]/Season 05/The Rookie (2018) - S05E11 - The Naked and the Dead [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv percentage:0 size:3213810787 speed:0 speedAvg:0]] transfers:0]: <nil>

I also decide to log the output from core/stats to a seperate file.

	"checks": 0,
	"deletedDirs": 0,
	"deletes": 0,
	"elapsedTime": 41.190900769,
	"errors": 0,
	"eta": null,
	"fatalError": false,
	"renames": 0,
	"retryError": false,
	"speed": 0,
	"totalBytes": 108557299356,
	"totalChecks": 12,
	"totalTransfers": 12,
	"transferTime": 0,
	"transferring": [
		{
			"bytes": 0,
			"eta": null,
			"group": "global_stats",
			"name": "Series/Star Trek - Picard (2020) [tvdb-364093]/Season 03/Star Trek - Picard (2020) - S03E01 - Part One The Next Generation [AMZN WEBDL-1080p Proper][8bit][h264][EAC3 5.1]-NTb.mkv",
			"percentage": 0,
			"size": 1877563540,
			"speed": 0,
			"speedAvg": 0
		},
2

These are not errors that are reported as they are retried 10 times - hence the 2/10 marker. If you see an ERROR in the log then that is when it gets reported in the core/stats.

A few of these are normal with Google Drive - it is how it gets rclone to run at the speed it wants.

1 Like
3

Sorry, thats my bad, in the original log that didn't use -vv, when I hit the upload limit, it produced the following error which didn't show up in core/stats as I had some code that monitored the stats for the lasterror.

Here's that portion of the other log...

2023/03/01 20:47:56 ERROR : Series/The Rookie (2018) [tvdb-350665]/Season 04/The Rookie (2018) - S04E08 - Hit and Run [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv: Failed to copy: googleapi: Error 403: User rate limit exceeded., userRateLimitExceeded
2023/03/01 20:47:56 ERROR : Series/The Rookie (2018) [tvdb-350665]/Season 04/The Rookie (2018) - S04E08 - Hit and Run [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv: Not deleting source as copy failed: googleapi: Error 403: User rate limit exceeded., userRateLimitExceeded
2023/03/01 20:47:56 ERROR : Local file system at /mnt/shared/fusemounts/local/Shows: not deleting directories as there were IO errors
2023/03/01 20:47:56 ERROR : Attempt 1/3 failed with 2 errors and: not deleting directories as there were IO errors
2023/03/01 20:48:02 INFO  : 
Transferred:   	   36.350 GiB / 36.350 GiB, 100%, 0 B/s, ETA 0s
Checks:                 3 / 3, 100%
Deleted:                1 (files), 0 (dirs)
Renamed:                1
Transferred:            1 / 1, 100%
Elapsed time:      28m0.3s

Here is the stats for that incident.

	"bytes": 39030846492,
	"checking": [
		"Series/The Rookie (2018) [tvdb-350665]/Season 04/The Rookie (2018) - S04E03 - In the Line of Fire [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv",
		"Series/The Rookie (2018) [tvdb-350665]/Season 04/The Rookie (2018) - S04E07 - Fire Fight [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv",
		"Series/The Rookie (2018) [tvdb-350665]/Season 04/The Rookie (2018) - S04E08 - Hit and Run [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv",
		"Series/The Rookie (2018) [tvdb-350665]/Season 04/The Rookie (2018) - S04E09 - Breakdown [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv",
		"Series/The Rookie (2018) [tvdb-350665]/Season 04/The Rookie (2018) - S04E10 - Heart Beat [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv",
		"Series/The Rookie (2018) [tvdb-350665]/Season 04/The Rookie (2018) - S04E11 - End Game [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv",
		"Series/The Rookie (2018) [tvdb-350665]/Season 04/The Rookie (2018) - S04E12 - The Knock [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv",
		"Series/The Rookie (2018) [tvdb-350665]/Season 04/The Rookie (2018) - S04E13 - Fight or Flight [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv",
		"Series/The Rookie (2018) [tvdb-350665]/Season 04/The Rookie (2018) - S04E14 - Long Shot [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv",
		"Series/The Rookie (2018) [tvdb-350665]/Season 04/The Rookie (2018) - S04E15 - Hit List [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv",
		"Series/The Rookie (2018) [tvdb-350665]/Season 04/The Rookie (2018) - S04E16 - Real Crime [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv",
		"Series/The Rookie (2018) [tvdb-350665]/Season 04/The Rookie (2018) - S04E17 - Coding [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv"
	],
	"checks": 3,
	"deletedDirs": 0,
	"deletes": 1,
	"elapsedTime": 1735.960605987,
	"errors": 0,
	"eta": -1671681717.4385397,
	"fatalError": false,
	"renames": 1,
	"retryError": false,
	"speed": 0.0019102986173104807,
	"totalBytes": 87868615602,
	"totalChecks": 15,
	"totalTransfers": 13,
	"transferTime": 0,
	"transferring": [
		{
			"bytes": 0,
			"eta": null,
			"group": "global_stats",
			"name": "Series/The Rookie (2018) [tvdb-350665]/Season 04/The Rookie (2018) - S04E08 - Hit and Run [AMZN WEBDL-1080p][8bit][h264][EAC3 5.1]-NTb.mkv",
			"percentage": 0,
			"size": 3238331835,
			"speed": 0,
			"speedAvg": 0
		},

Now I tried to replicate this by starting the upload process again (about 10-20 minutes later) so that I could share it here with -vv enabled and when it hit the pacer I blindly assumed the log I provided was basically the same as it produced the same api error but I was obviously wrong, I rechecked the entire log and not once does it show the same error as above, however it does seem to slow down the upload process and I would like to avoid that by switching to a service account.

I don't exactly know how rclone handles all of this as it did produce an error when it failed to copy due to the 403 api error, but when I tried to run it again to get the debug logs, it instead showes the pacer which seems to bring the entire upload process to a crawl.

I'm curious to know if there is a way around this? As I would prefer to just switch to my SA, which my script is suppose to do when it encounters the api 403 error or reaches 750G, It's rare for me to hit 500G a day never mind 750G and I rarely encounter the 403 error but I would like to use my SA as a fallback for days where this happens.

Any help would be appreciated.

4

We generally don't offer advice on how to abuse/avoid provider's limits by using other methods.

5

I didn't know that using a service account was considered abuse. All I really wanted to do was avoid the errors more than anything, as mentioned I rarely hit the error, most days I'd be lucky to upload 500G.

However, if using an SA to avoid this is abuse then I will try and figure out a way to have my upload script stop uploading for X hours like a cooling off period before uploading again, which I feel would be better than having rclone continuously loop, causing it to hit the api error.

6

You'd want to use stop on upload limit.

7

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.