Failed to sync: failed to open source object: open file failed: googleapi: Error 403: This file is too large to be exported., exportSizeLimitExceeded


#1

I am copying data from some users who are on GDRIVE to an Directory on my Desktop For this I’m using --drive-impersonate in the source location “GDRIVE”. But i getting the error:

" Failed to sync: failed to open source object: open file failed: googleapi: Error 403: This file is too large to be exported., exportSizeLimitExceeded"

is there any way to copy these files?

I´m using comand below

rclone -vv --dump headers --dump bodies --drive-impersonate xxx@xxx.com.br --transfers=2 --bwlimit 8M --fast-list --drive-acknowledge-abuse --log-file /home/eder/venancio/logs/gabrielle.ferreira@venancio.com.br.txt sync gdrive2: /home/eder/venancio/contas/xxx@xxx.com.br

and rclone versions is 1.42.

Log:

2018/08/20 15:05:18 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2018/08/20 15:05:19 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2018/08/20 15:05:19 DEBUG : HTTP RESPONSE (req 0xc420921200)
2018/08/20 15:05:19 DEBUG : HTTP/1.1 200 OK
Transfer-Encoding: chunked
Alt-Svc: quic=":443"; ma=2592000; v=“44,43,39,35”
Cache-Control: private, max-age=0, must-revalidate, no-transform
Content-Type: application/json; charset=UTF-8
Date: Mon, 20 Aug 2018 15:05:19 GMT
Expires: Mon, 20 Aug 2018 15:05:19 GMT
Server: GSE
Vary: Origin
Vary: X-Origin
X-Content-Type-Options: nosniff
X-Frame-Options: SAMEORIGIN
X-Xss-Protection: 1; mode=block

167
{
“files”: [
{
“id”: “0B_qWxOzOU9znSW9pSkY0dlZ6ZUU”,
“name”: “Política de Jornada de Trabalho e Horas Extras.doc”,
“mimeType”: “application/msword”,
“trashed”: false,
“createdTime”: “2016-06-21T13:29:26.882Z”,
“modifiedTime”: “2013-07-22T14:35:24.000Z”,
“md5Checksum”: “ca6edc104359fb5514248b3aeb2a7c07”,
“size”: “145408”
}
]
}

0

2018/08/20 15:05:19 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2018/08/20 15:05:19 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2018/08/20 15:05:19 DEBUG : HTTP RESPONSE (req 0xc420921600)
2018/08/20 15:05:19 DEBUG : Inteligência/12 - Material estudo/6.9 - Projetos e processos/Procedimentos e politicas/Politicas/7.4 - Políticas/Gestão de Pessoas/Gerir Ponto Eletroônico/Política de Jornada de Trabalho e Horas Extras.doc: Size and modification time the same (differ by 0s, within tolerance 1ms)
2018/08/20 15:05:19 DEBUG : Inteligência/12 - Material estudo/6.9 - Projetos e processos/Procedimentos e politicas/Politicas/7.4 - Políticas/Gestão de Pessoas/Gerir Ponto Eletroônico/Política de Jornada de Trabalho e Horas Extras.doc: Unchanged skipping
2018/08/20 15:05:19 DEBUG : HTTP/1.1 200 OK
Transfer-Encoding: chunked
Alt-Svc: quic=":443"; ma=2592000; v=“44,43,39,35”
Cache-Control: private, max-age=0, must-revalidate, no-transform
Content-Type: application/json; charset=UTF-8
Date: Mon, 20 Aug 2018 15:05:19 GMT
Expires: Mon, 20 Aug 2018 15:05:19 GMT
Server: GSE
Vary: Origin
Vary: X-Origin
X-Content-Type-Options: nosniff
X-Frame-Options: SAMEORIGIN
X-Xss-Protection: 1; mode=block

602
{
“files”: [
{
“id”: “0B_qWxOzOU9znNEhJYWJwYUdfSVE”,
“name”: “At Público - Controle de Indicadores.xlsx”,
“mimeType”: “application/vnd.openxmlformats-officedocument.spreadsheetml.sheet”,
“trashed”: false,
“createdTime”: “2016-06-21T13:29:34.333Z”,
“modifiedTime”: “2014-07-28T19:26:26.000Z”,
“md5Checksum”: “25f8d2548d49a70e1eba366baa6c7f15”,
“size”: “17489”
},
{
“id”: “0B_qWxOzOU9znbFNvaHIxY2ZFeVk”,
“name”: “KIT_ROP_Venancio_Vendas_Atacado_Publico_23.07.xlsx”,
“mimeType”: “application/vnd.openxmlformats-officedocument.spreadsheetml.sheet”,
“trashed”: false,
“createdTime”: “2016-06-21T13:29:35.260Z”,
“modifiedTime”: “2014-07-25T20:06:44.000Z”,
“md5Checksum”: “ce6a34c1bca822032ab1b3b68d60042c”,
“size”: “4399292”
},
{
“id”: “0B_qWxOzOU9znVlJ6ekRZa1pBUWs”,
“name”: “At Publico_Itens.pptx”,
“mimeType”: “application/vnd.openxmlformats-officedocument.presentationml.presentation”,
“trashed”: false,
“createdTime”: “2016-06-21T13:29:33.860Z”,
“modifiedTime”: “2014-05-16T12:43:44.000Z”,
“md5Checksum”: “e3592a8e165a3af077fd152ba115501e”,
“size”: “2457515”
},
{
“id”: “0B_qWxOzOU9znYTA1YzZyRmM3RkE”,
“name”: “Apresentação_Ganhos e Perdas_12.05.pptx”,
“mimeType”: “application/vnd.openxmlformats-officedocument.presentationml.presentation”,
“trashed”: false,
“createdTime”: “2016-06-21T13:29:32.882Z”,
“modifiedTime”: “2014-05-12T20:24:30.000Z”,
“md5Checksum”: “39b90166878423655310227888e9e407”,
“size”: “2582749”
}
]
}

0

2018/08/20 15:05:19 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2018/08/20 15:05:19 DEBUG : Inteligência/12 - Material estudo/6.9 - Projetos e processos/Procedimentos e politicas/Politicas/7.4 - Políticas/old/Atacado_Público/Apresentação_Ganhos e Perdas_12.05.pptx: Size and modification time the same (differ by 0s, within tolerance 1ms)
2018/08/20 15:05:19 DEBUG : Inteligência/12 - Material estudo/6.9 - Projetos e processos/Procedimentos e politicas/Politicas/7.4 - Políticas/old/Atacado_Público/Apresentação_Ganhos e Perdas_12.05.pptx: Unchanged skipping
2018/08/20 15:05:19 DEBUG : Inteligência/12 - Material estudo/6.9 - Projetos e processos/Procedimentos e politicas/Politicas/7.4 - Políticas/old/Atacado_Público/At Publico_Itens.pptx: Size and modification time the same (differ by 0s, within tolerance 1ms)
2018/08/20 15:05:19 DEBUG : Inteligência/12 - Material estudo/6.9 - Projetos e processos/Procedimentos e politicas/Politicas/7.4 - Políticas/old/Atacado_Público/At Publico_Itens.pptx: Unchanged skipping
2018/08/20 15:05:19 DEBUG : Inteligência/12 - Material estudo/6.9 - Projetos e processos/Procedimentos e politicas/Politicas/7.4 - Políticas/old/Atacado_Público/At Público - Controle de Indicadores.xlsx: Size and modification time the same (differ by 0s, within tolerance 1ms)
2018/08/20 15:05:19 DEBUG : Inteligência/12 - Material estudo/6.9 - Projetos e processos/Procedimentos e politicas/Politicas/7.4 - Políticas/old/Atacado_Público/At Público - Controle de Indicadores.xlsx: Unchanged skipping
2018/08/20 15:05:19 DEBUG : Inteligência/12 - Material estudo/6.9 - Projetos e processos/Procedimentos e politicas/Politicas/7.4 - Políticas/old/Atacado_Público/KIT_ROP_Venancio_Vendas_Atacado_Publico_23.07.xlsx: Size and modification time the same (differ by 0s, within tolerance 1ms)
2018/08/20 15:05:19 DEBUG : Inteligência/12 - Material estudo/6.9 - Projetos e processos/Procedimentos e politicas/Politicas/7.4 - Políticas/old/Atacado_Público/KIT_ROP_Venancio_Vendas_Atacado_Publico_23.07.xlsx: Unchanged skipping
2018/08/20 15:05:19 INFO : Local file system at /home/eder/venancio/contas/gabrielle.ferreira@venancio.com.br: Waiting for checks to finish
2018/08/20 15:05:19 INFO : Local file system at /home/eder/venancio/contas/gabrielle.ferreira@venancio.com.br: Waiting for transfers to finish
2018/08/20 15:05:19 DEBUG : Local file system at /home/eder/venancio/contas/gabrielle.ferreira@venancio.com.br: failed to copy 1 directories
2018/08/20 15:05:19 DEBUG : Local file system at /home/eder/venancio/contas/gabrielle.ferreira@venancio.com.br: copied 35 directories
2018/08/20 15:05:19 ERROR : Local file system at /home/eder/venancio/contas/gabrielle.ferreira@venancio.com.br: not deleting files as there were IO errors
2018/08/20 15:05:19 ERROR : Local file system at /home/eder/venancio/contas/gabrielle.ferreira@venancio.com.br: not deleting directories as there were IO errors
2018/08/20 15:05:19 ERROR : Attempt 3/3 failed with 1 errors and: failed to open source object: open file failed: googleapi: Error 403: This file is too large to be exported., exportSizeLimitExceeded
2018/08/20 15:05:19 Failed to sync: failed to open source object: open file failed: googleapi: Error 403: This file is too large to be exported., exportSizeLimitExceeded

rclone -vv --drive-impersonate xxx@xxxx.com.br --transfers=2 --bwlimit 8M --fast-list --drive-acknowledge-abuse sync gdrive2: ftp:xxx@xxxx.com.br/


#2

Those are google docs. You either want to ignore them with --drive-skip-gdocs or use the alternate export with --drive-alternate-export which will probably work.


#3

Hi,

I just ran into this issue and --drive-alternate-export (which uses API v2 call) sorted it out.

Just FYI:
By accident I just read as of today (4.1.2019) API v3 introduced the “exportLinks” method.
So this issue should now be resolvable also with API v3.

seee this -> https://issuetracker.google.com/issues/36761333


#4

Ah interesting! I made an issue about this - thanks: https://github.com/ncw/rclone/issues/2893