Statistics log question

Help and Support
1

What is the problem you are having with rclone?

I am curious where the statistics are coming from. They don't appear to use the logging framework that the rest of RClone is using.

Looking below, but first off, I wrapped all writes to StDOUT and STDERR to my logrus file; StdErr tagged ERRO and StdOut INFO.

If you look at lines 2-9, following, you will see that they do not have "duplicate" Logrus tags hence my question as to what is writing to stdout and stderr for these that isn't using your log framework. Nothing here that must be "fixed" but I am curious.

ERRO 2021-05-11 17:52:16 2021/05/11 17:52:16 INFO  :
ERRO 2021-05-11 17:52:16 Transferred:   	  917.925M / 51.382 GBytes, 2%, 1.276 MBytes/s, ETA 11h15m15s
ERRO 2021-05-11 17:52:16 Transferred:           54 / 2540, 2%
ERRO 2021-05-11 17:52:16 Elapsed time:      12m0.4s
ERRO 2021-05-11 17:52:16 Transferring:
ERRO 2021-05-11 17:52:16  * America's 25 Favorite …rtress Is Our God.flac: 92% /11.056M, 336.004k/s, 2s
ERRO 2021-05-11 17:52:16  * America's 25 Favorite …1  - Rock of Ages.flac: 94% /9.083M, 297.213k/s, 1s
ERRO 2021-05-11 17:52:16  * America's 25 Favorite …r Eyes upon Jesus.flac: 86% /11.352M, 423.196k/s, 3s
ERRO 2021-05-11 17:52:16  * America's 25 Favorite …4  - Just as I Am.flac:  8% /13.082M, 382.662k/s, 32s
ERRO 2021-05-11 17:52:16
ERRO 2021-05-11 17:52:19 2021/05/11 17:52:19 INFO  : America's 25 Favorite Hymns/20  - A Mighty Fortress Is Our God.flac: Copied (new)


#### What is your rclone version (output from `rclone version`)
<!-- **STOP and  READ**: Are you on the latest version of rclone? You can validate by checking the version listed here: https://rclone.org/downloads/
 --> 
1.55

#### Which OS you are using and how many bits (eg Windows 7, 64 bit)
OSX Cataling

####  Which cloud storage system are you using? (eg Google Drive)
Wasabi S3


#### The command you were trying to run (eg `rclone copy /tmp remote:tmp`)  
<!--  You should use 3 backticks to begin and end your paste to make it readable.   -->
Rclone sync

Paste command here



#### The rclone config contents with secrets removed.  
<!--  You should use 3 backticks to begin and end your paste to make it readable.   -->

```rclone sync --log-level=INFO /Volumes/dockerprog Wasabi:als-loveboat/dockerprog

Paste config here




#### A log from the command with the `-vv` flag  
<!-- You should use 3 backticks to begin and end your paste to make it readable.  Or use a service such as https://pastebin.com or https://gist.github.com/   -->

Paste log here

2

Those lines are rclone's log emitted on stdout. These are the info logs as specified by --log-level=INFO. You get a stats dump of the transfer every minute by default.

I'm not sure what you mean by duplicate logrus tags though?

3

Nick,
Let me explain “duplicate” tags. Looking at line 10 (the last in my quotedlog).

ERRO 2021-05-11 17:52:19 2021/05/11 17:52:19 INFO : America's 25 Favorite Hymns/20 - A Mighty Fortress Is Our God.flac: Copied (new)

I wrapped all lines to StdErr as “ERRO 2021-05 ….”; what RClone output was “2021/05/11 17:52:19 INFO : A….”

That all makes sense. You clearly were using a logging framework that took strings and appended “2021/05/11 17:52:19 INFO : ”. So now I have my tag “ERRO 2021-05-11” and yours “ “2021/05/11 17:52:19 INFO :” which means there are two redundant tags on the line. That makes sense.

What was confusing was the tags RClone writ to the log directly to StdErr instead of Log.Error. In this case your statistics that come out every minute which I really like. I was surprised you were sending those to StdErr instead of your logging framework ie Log.Error. As such I was wondering if those were coming from AWS S3 provider or your stuff. I think you answered it was coming from RClone.

Make sense. Again great software. I am going to be talking with Wasabi sales about how I am using all this.

Did I answer your question.

Allrn

4

I see.

The stats do go to the log, but they have multiple lines and only the first line has the time etc.

5

Ahh, thanks. I should have thought about the blank line as part of an embedded multi-line message:-)

I continue to be impressed with what RClone has accomplished.

1 Like
6

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.