Remote Control (rcd cmd) /core/transferred API returns objects with size: -1

Help and Support
1

What is the problem you are having with rclone?

When using the /core/transferred endpoint of an rcd instance, some files are duplicated and have size: -1 or bytes: 0, but no error string.

What is your rclone version (output from rclone version)

1.49.5

Which OS you are using and how many bits (eg Windows 7, 64 bit)

MacOS Sierra 10.12.6

Which cloud storage system are you using? (eg Google Drive)

Google Drive

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone rcd --verbose --rc-no-auth --config=/tmp/rclone.conf --transfers 4 --use-mmap --rc-job-expire-duration 86400s --rc-job-expire-interval 600s

A log from the command with the -vv flag (eg output from rclone -vv copy /tmp remote:tmp)

2019/10/17 20:41:58 INFO : Test Document.docx: Copied (new)
2019/10/17 20:41:58 INFO : Test Document.docx: Copied (Rcat, new)

Response from /core/transferred (JSON)
{
"transferred": [
{
"error": "",
"name": "Test Document.docx",
"size": -1,
"bytes": 0,
"checked": false,
"started_at": "2019-10-17T20:41:56.551645-07:00",
"completed_at": "2019-10-17T20:41:58.459317-07:00"
},
{
"error": "",
"name": "Test Folder/.DS_Store",
"size": 6148,
"bytes": 6148,
"checked": false,
"started_at": "2019-10-17T20:41:56.909726-07:00",
"completed_at": "2019-10-17T20:41:58.119592-07:00"
},
{
"error": "",
"name": "Test Document.docx",
"size": -1,
"bytes": 6102,
"checked": false,
"started_at": "2019-10-17T20:41:57.643529-07:00",
"completed_at": "2019-10-17T20:41:58.459258-07:00"
},
{
"error": "",
"name": "Test Document.docx",
"size": 6102,
"bytes": 6102,
"checked": false,
"started_at": "2019-10-17T20:41:57.645993-07:00",
"completed_at": "2019-10-17T20:41:58.459246-07:00"
},
...
]
}

2

Did you transfer the file more than once? You get one entry for each transfer.

3

This is the log after a single call to /sync/copy, so the file should only be transferred once. It appears at the destination only once.

4

I guess I'm most confused by what is meant by "size": -1 for a transferred file.

5

I am also curious what "Rcat" means in this context.

6

Ah... A size of -1 means the size is unknown so this is uploaded with Rcat (reverse cat, a stream upload). Some backends can't upload files of unknown size. In which case rclone does a transfer to local disk first then uploads in normally. That might explain the multiple transfers.

I expect it is the Rcat double counting the transfers somehow.

If you transfer a non Google Doc do you get that?

7

Sorry for the delayed response! It doesn't seem to be related to any particular type of file.. I've seen this happen for docx and pdf thus far.

8

These are translated google docs and their size is unknown until they are read, hence the -1.

1 Like
9

This topic was automatically closed 90 days after the last reply. New replies are no longer allowed.