What is the problem you are having with rclone?
I copied the file with suffix option
object_a has one file which is 1.txt 10 bytes.
object_b has one file which is 1.txt 15 bytes.
rclone copy object_a:test2 object_b:test2 --suffix=_old
and then
object_b has two files which are 1.txt(10 byte) and 1_old.txt(15 byte)
it means to copy just a file (1.txt 10 bytes)
but transfers count is 2, transfer byte is 25 bytes in the stat of Rclone.
I expect that transfers=1, tranfer bytes=10 byte. but it's not
Run the command 'rclone version' and share the full output of the command.
1.63.1
Which cloud storage system are you using? (eg Google Drive)
custom s3 object storage
It is not a bug. It is by design... which many people do not agree with:)
What is the problem you are having with rclone?
I've been on rclone 1.57.0 because of 2 bugs with --progress. But i'm required to upgrade for filename_encoding base32768 since i'm moving from gdrive to dropbox.
Renamed or moved files are counted as transferred bytes. You can see this issue in the attached screenshot. I've limited rclone to 3Mbytes upload so this speed and amount of transferred data is technically impossible. (Tested on 1.63.0)
[image]
The transfer speed in --progress get …
until one day somebody makes it configurable (to count server side operations or not)
oh. I will check the page.
Thank you.
Looking at PR which added server-side moves into stats:
rclone:master
← olefrost:add-server-side-moves-to-stats
opened 12:37PM - 04 Aug 21 UTC
#### What is the purpose of this change?
To show progress of server-side oper… ations by adding server-side moves to stats.
A server-side move will then show the same stats as a server-side copy of the same file.
A server-side move/rename of a folder will (still) not count in the stats - imagine the stats after an (almost) instant rename of a top-level folder with TBytes of data.
#### Was the change discussed in an issue or in the forum before?
Issue: https://github.com/rclone/rclone/issues/5430
Forum post: https://forum.rclone.org/t/help-with-stats-logging/25023
#### Examples to illustrate the change
These examples illustrates the stats of server-side operations **before** the change:
```
./rclone copy GoogleDrive:testfolder1/testfile1 GoogleDrive:testfolder2 --log-level=INFO --stats=1s
2021/08/04 14:17:50 INFO :
Transferred: 0 / 110.125 MiByte, 0%, 0 Byte/s, ETA -
Transferred: 0 / 1, 0%
Elapsed time: 4.4s
Transferring:
* testfile1: 0% /110.125Mi, 0/s, -
2021/08/04 14:17:50 INFO : testfile1: Copied (server-side copy)
2021/08/04 14:17:50 INFO :
Transferred: 110.125Mi / 110.125 MiByte, 100%, 0 Byte/s, ETA -
Transferred: 1 / 1, 100%
Elapsed time: 5.0s
```
```
./rclone move GoogleDrive:testfolder2/testfile1 GoogleDrive:testfolder3 --log-level=INFO --stats=1s
2021/08/04 14:29:38 INFO :
Transferred: 0 / 0 Bytes, -, 0 Bytes/s, ETA -
Checks: 0 / 1, 0%
Elapsed time: 3.3s
Checking:
* testfile1: checking
2021/08/04 14:29:38 INFO : testfile1: Moved (server-side)
2021/08/04 14:29:38 INFO :
Transferred: 0 / 0 Bytes, -, 0 Bytes/s, ETA -
Checks: 1 / 1, 100%
Renamed: 1
Elapsed time: 4.0s
```
```
./rclone move GoogleDrive:testfolder3 GoogleDrive:testfolder4 --log-level=INFO --stats=1s
2021/08/04 14:25:49 INFO : Google drive root 'testfolder4': Server side directory move succeeded
2021/08/04 14:25:49 INFO :
Transferred: 0 / 0 Byte, -, 0 Byte/s, ETA -
Elapsed time: 2.5s
```
These examples illustrates the stats of server-side operations **after** the change:
```
./rclone copy GoogleDrive:testfolder1/testfile1 GoogleDrive:testfolder2 --log-level=INFO --stats=1s
2021/08/04 14:17:50 INFO :
Transferred: 0 / 110.125 MiByte, 0%, 0 Byte/s, ETA -
Transferred: 0 / 1, 0%
Elapsed time: 4.4s
Transferring:
* testfile1: 0% /110.125Mi, 0/s, -
2021/08/04 14:17:50 INFO : testfile1: Copied (server-side copy)
2021/08/04 14:17:50 INFO :
Transferred: 110.125Mi / 110.125 MiByte, 100%, 0 Byte/s, ETA -
Transferred: 1 / 1, 100%
Elapsed time: 5.0s
```
```
./rclone move GoogleDrive:testfolder2/testfile1 GoogleDrive:testfolder3 --log-level=INFO --stats=1s
2021/08/04 14:22:32 INFO :
Transferred: 0 / 0 Byte, -, 0 Byte/s, ETA -
Checks: 0 / 1, 0%
Elapsed time: 3.5s
Checking:
* testfile1: 0% /110.125Mi, 0/s, -
2021/08/04 14:22:33 INFO : testfile1: Moved (server-side)
2021/08/04 14:22:33 INFO :
Transferred: 110.125Mi / 110.125 MiByte, 100%, 0 Byte/s, ETA -
Checks: 1 / 1, 100%
Renamed: 1
Elapsed time: 4.4s
```
```
./rclone move GoogleDrive:testfolder3 GoogleDrive:testfolder4 --log-level=INFO --stats=1s
2021/08/04 14:25:49 INFO : Google drive root 'testfolder4': Server side directory move succeeded
2021/08/04 14:25:49 INFO :
Transferred: 0 / 0 Byte, -, 0 Byte/s, ETA -
Elapsed time: 2.5s
```
#### Checklist
- [X] I have read the [contribution guidelines](https://github.com/rclone/rclone/blob/master/CONTRIBUTING.md#submitting-a-pull-request).
- [X] I have added tests for all changes in this PR if appropriate.
- [X] I have added documentation for the changes if appropriate.
- [X] All commit messages are in [house style](https://github.com/rclone/rclone/blob/master/CONTRIBUTING.md#commit-messages).
- [X] I'm done, this Pull Request is ready for review :-)
It looks like rather easy thing to add a new flag and make it optional. If it is something you consider important you could give it a go:) and implement.
I will consider about it. Thanks.
system
(system)
Closed
August 25, 2023, 1:40am
7
This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.