Make -P show general stats below single stats for larger transfers

Have you ever tried doing rclone copy source: dest: -P --transfers 256? In order to see the general stats:

Transferred:      0118.99M / 988.199 MBytes, 91%, 1.972 MBytes/s, ETA 53s
Checks:               100 / 100, 101%
Transferred:          100 / 100, 105%
Elapsed time:       2m0.8s (note: ignore the numbers, you know what I mean)

you would have to zoom out your terminal and place your eye against the display in order to see anything. This also happens with smaller concurrent transfers (for example 64).

I'd propose to move the general stats to the bottom, so instead of being like

Transferred:      276.127M / 745.077 MBytes, 37%, 5.044 MBytes/s, ETA 1m32s
Transferred:          138 / 252, 55%
Elapsed time:        54.7s
Transferring:
 *               ihate/when/i-have-to/fake-transfers.webm: 17% /316.246M, 1.784M/s, 2m26s
 *            your-average/gimper.xcf:  7% /14.122M, 84.997k/s, 2m3s
 *         did-you-know.png: 33% /11.914M, 314.770k/s, 25s
 *        i-buy/too_many/flowers-for-the/wife.fund 83% /11.914M, 403.654k/s, 4s

Make it:

Transferring:
 *               ihate/when/i-have-to/fake-transfers.webm: 17% /316.246M, 1.784M/s, 2m26s
 *            your-average/gimper.xcf:  7% /14.122M, 84.997k/s, 2m3s
 *         did-you-know.png: 33% /11.914M, 314.770k/s, 25s
 *        i-buy/too_many/flowers-for-the/wife.fund 83% /11.914M, 403.654k/s, 4s
Transferred:      276.127M / 745.077 MBytes, 37%, 5.044 MBytes/s, ETA 1m32s
Transferred:          138 / 252, 55%
Elapsed time:        54.7s

So you could actually see what's happening.

1 Like

Not a bad idea... I like your file names :wink:

You can use --stats-one-line to just see the transferred stats if you don't want to see the file names. Perhaps might be what you want with 256 transfers?

One problem with changing the look of the stats is that whenever i do it I get bug reports/complaints from people who were relying on the old layout in some script or other! I could do this with a flag without consequence...

2 Likes

He is actually right, I had faced this issue couple of times.

That’s better IMO.

1 Like

I know --stats-one-line exists, but that removes the individual transfers.
When mid-transfer something goes wrong, it's much easier to debug, I have used rclone so long that from viewing the -P I can pretty much instantly tell what's wrong.

A feature, what could fix this would be dynamic flags:
mid-transfer add/remove flags such as --transfers (to just get it right, say change from 96 to 128) --checkers, --bwlimit (when you get a message saying 'could you stop using 100% of the 20Gbps') and so on. I also understand this would be hard to implement, there would need to be a way to get the commands to the right instance (maybe take keyboard input, press [r] to change parameters) and the current semi-monolithic structure would need to be split up - when changing transfers from 128 to 96 for example, you'd need to finish up the current ones and then not start any more until below the limit (and what about --delete-empty-src-dirs or more influential commands; as a vision, copy could be changed to move on the fly and also the other way around (would you copy back the already moved files?, have this as an option))...

Sure

:slight_smile:

I could do this via the remote control, and you can do some of this already via the remote control (eg bwlimit).

So off to gh issues?
I don't go much.. So I can just shamelessly present flowers.

Please make an issue about the original request, displaying the Transfers first then the stats and I'll have a think about how best to implement it.

:slight_smile:

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.