Data error (cyclic redundancy check)

Help and Support
1

What is the problem you are having with rclone?

Data error (cyclic redundancy check)

What is your rclone version (output from rclone version)

v1.52.2

Which OS you are using and how many bits (eg Windows 7, 64 bit)

Windows 10 64bit

Which cloud storage system are you using? (eg Google Drive)

Gdrive

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone.exe --config C:/Users/xxx/.config/rclone/rclone.conf copy --update --ignore-existing --verbose --transfers 13 --contimeout 60s --timeout 300s --retries 3 --low-level-retries 10 --drive-chunk-size 128M --stats 1s --stats-file-name-length 0 --fast-list "E:\TV Shows" "gdrive_full_crypt:TV Shows"

The rclone config contents with secrets removed.

[gdrive]
type = drive
client_id = xxxxxxx.apps googleusercontent com
client_secret = xxxxxxxx
scope = drive
token = {"access_token":"xxxxxxxx","token_type":"Bearer","refresh_token":"xxxxxxxx","expiry":"2020-09-22T11:12:52.0980497+03:00"}
root_folder_id = 0AER
stop_on_upload_limit = true
chunk_size = 128M

[gdrive_full_crypt]
type = crypt
remote = gdrive:Plex
filename_encryption = standard
directory_name_encryption = true
password = xxxxxxxxxxx
password2 = xxxxxxxx
stop_on_upload_limit = true
chunk_size = 128M

A log from the command with the -vv flag

2020/09/22 10:50:22 DEBUG : The bla bla/S01/the.xxxxx.mkv: Reopening on read failure after 127922176 bytes: retry 10/10: read \\?\E:\TV Shows\The bla bla/S01/the.xxxxx.mkv.mkv: Data error (cyclic redundancy check).
2020/09/22 10:50:22 DEBUG : The bla bla/S01/the.xxxxx.mkv: Reopen failed after 127922176 bytes read: failed to reopen: too many retries
2020/09/22 10:50:22 ERROR : The bla bla/S01/the.xxxxx.mkv.mkv: Failed to copy: Post "https www googleapis com/upload/drive/v3/files?alt=json&fields=id%2Cname%2Csize%2Cmd5Checksum%2Ctrashed%2CmodifiedTime%2CcreatedTime%2CmimeType%2Cparents%2CwebViewLink%2CshortcutDetails&supportsAllDrives=true&uploadType=resumable&upload_id=ABg5-UywfS_xxxxxx-T6GPxxxxxx: read \\?\E:\TV Shows\The bla bla/S01/the.xxxxx.mkv: Data error (cyclic redundancy check).
2

hello and welcome to the forum,

  • does this happen with that one file?
  • does this happend to that file every time you run rclone?
  • have you run a chkdsk on e:\?
  • the latest rclone is v1.53.1
3

thanks for the reply.
this happens with 3 files and it happened multiple times.
I haven't run chkdsk but I was able to upload hundreds of gigabytes before and after it happend.

4

try to do a local to local copy on those three files, not using rclone.

5

well the copy worked from another mount to the same remote. probably some issue with my hard disk. thanks for the help!

6

yes, based on the error, this is a local issue, not a remote issue.

7

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.