I am trying to transfer my files from Seafile to Google Drive as backup.
Both are setup and mounted and I am able to access the files inside via network drives no problem. But when I'm copying the data it shows the first files but they are stuck on "transferring". At this point I'm just testing eveything with just a few files in the drive.
Run the command 'rclone version' and share the full output of the command.
rclone v1.63.0
os/version: slackware 14.2+ (64 bit)
os/kernel: 5.10.28-Unraid (x86_64)
os/type: linux
os/arch: amd64
go/version: go1.20.5
go/linking: static
go/tags: none
Which cloud storage system are you using? (eg Google Drive)
Seafile and Google Drive
The command you were trying to run (eg rclone copy /tmp remote:tmp)
Thank you!
Right, both Seafile and Gdrive are also mounted using rclone mount. Didn't share that here since that's using a seperate script and isn't what I have issues with, just figured it would clarify that the config of the two is not the issue.
based on that short log snippet, looks like an issue with your seafile server, not gdrive.
might test copying from seafile to local and leave gdrive out of the equation.
2023/07/11 10:59:30 DEBUG : My Library/FoodCoconuts001/FoodCoconuts001_METALNESS_4K_METALNESS.png: Need to transfer - File not found at Destination
2023/07/11 10:59:30 DEBUG : My Library/FoodCoconuts001/FoodCoconuts001_NRM_4K_SOURCE_METALNESS.jpg: Need to transfer - File not found at Destination
2023/07/11 10:59:30 DEBUG : My Library/FoodCoconuts001/FoodCoconuts001_Preview1.png: Need to transfer - File not found at Destination
2023/07/11 10:59:30 DEBUG : My Library/FoodCoconuts001/FoodCoconuts001_ROUGHNESS_4K_METALNESS.jpg: Need to transfer - File not found at Destination
2023/07/11 10:59:30 DEBUG : My Library/FoodCoconuts001/FoodCoconuts001_SSS_4K_METALNESS.jpg: Need to transfer - File not found at Destination
2023/07/11 10:59:31 DEBUG : My Library/FoodCoconuts001/Specular/FoodCoconuts001_AO_4K_SPECULAR.jpg: Need to transfer - File not found at Destination
2023/07/11 10:59:31 DEBUG : My Library/FoodCoconuts001/Specular/FoodCoconuts001_BUMP16_4K_SPECULAR.tif: Need to transfer - File not found at Destination
2023/07/11 10:59:31 DEBUG : My Library/FoodCoconuts001/Specular/FoodCoconuts001_BUMP_4K_SPECULAR.jpg: Need to transfer - File not found at Destination
2023/07/11 10:59:31 DEBUG : My Library/FoodCoconuts001/Specular/FoodCoconuts001_COL_4K_SPECULAR.jpg: Need to transfer - File not found at Destination
2023/07/11 10:59:31 DEBUG : My Library/FoodCoconuts001/Specular/FoodCoconuts001_GLOSS_4K_SPECULAR.jpg: Need to transfer - File not found at Destination
2023/07/11 10:59:31 DEBUG : My Library/FoodCoconuts001/Specular/FoodCoconuts001_NRM_4K_SOURCE_SPECULAR.jpg: Need to transfer - File not found at Destination
2023/07/11 10:59:31 DEBUG : My Library/FoodCoconuts001/Specular/FoodCoconuts001_NRM_4K_SPECULAR.jpg: Need to transfer - File not found at Destination
2023/07/11 10:59:31 DEBUG : My Library/FoodCoconuts001/Specular/FoodCoconuts001_REFL_4K_SPECULAR.jpg: Need to transfer - File not found at Destination
2023/07/11 10:59:31 DEBUG : My Library/FoodCoconuts001/Specular/FoodCoconuts001_SSS_4K_SPECULAR.jpg: Need to transfer - File not found at Destination
2023/07/11 10:59:31 DEBUG : My Library/FoodCoconuts001/LOD/FoodCoconuts001_NRM_4K_LOD0_METALNESS.jpg: Need to transfer - File not found at Destination
2023/07/11 10:59:31 DEBUG : My Library/FoodCoconuts001/LOD/FoodCoconuts001_NRM_4K_LOD0_SPECULAR.jpg: Need to transfer - File not found at Destination
2023/07/11 10:59:31 DEBUG : My Library/FoodCoconuts001/LOD/FoodCoconuts001_NRM_4K_LOD1_METALNESS.jpg: Need to transfer - File not found at Destination
2023/07/11 10:59:31 DEBUG : My Library/FoodCoconuts001/LOD/FoodCoconuts001_NRM_4K_LOD1_SPECULAR.jpg: Need to transfer - File not found at Destination
2023/07/11 10:59:31 DEBUG : My Library/FoodCoconuts001/LOD/FoodCoconuts001_NRM_4K_LOD2_METALNESS.jpg: Need to transfer - File not found at Destination
2023/07/11 10:59:31 DEBUG : My Library/FoodCoconuts001/LOD/FoodCoconuts001_NRM_4K_LOD2_SPECULAR.jpg: Need to transfer - File not found at Destination
2023/07/11 10:59:31 DEBUG : My Library/FoodCoconuts001/LOD/FoodCoconuts001_NRM_4K_LOD3_METALNESS.jpg: Need to transfer - File not found at Destination
2023/07/11 10:59:31 DEBUG : My Library/FoodCoconuts001/LOD/FoodCoconuts001_NRM_4K_LOD3_SPECULAR.jpg: Need to transfer - File not found at Destination
2023/07/11 10:59:31 DEBUG : My Library/FoodCoconuts001/LOD/FoodCoconuts001_NRM_4K_LOD4_METALNESS.jpg: Need to transfer - File not found at Destination
2023/07/11 10:59:31 DEBUG : My Library/FoodCoconuts001/LOD/FoodCoconuts001_NRM_4K_LOD4_SPECULAR.jpg: Need to transfer - File not found at Destination
2023/07/11 10:59:31 DEBUG : Local file system at /mnt/user/Handcrafted Media Server/Test/Seafile: Waiting for checks to finish
2023/07/11 10:59:31 DEBUG : Local file system at /mnt/user/Handcrafted Media Server/Test/Seafile: Waiting for transfers to finish
2023/07/11 10:59:31 DEBUG : pacer: low level retry 1/10 (error Get "https://example.seafile.com/seafhttp/files/94f14083-534c-4a92-83b6-713a693280a8/seafile-tutorial.doc": EOF)
2023/07/11 10:59:31 DEBUG : pacer: Rate limited, increasing sleep to 200ms
2023/07/11 10:59:31 DEBUG : pacer: low level retry 1/10 (error Get "https://example.seafile.com/seafhttp/files/c6da4d04-ae51-4c02-8d01-0240d6760199/TrafficLight_00.plasticity": EOF)
2023/07/11 10:59:31 DEBUG : pacer: Rate limited, increasing sleep to 400ms
2023/07/11 10:59:31 DEBUG : pacer: low level retry 1/10 (error Get "https://example.seafile.com/seafhttp/files/62093943-42a7-4c59-8fec-87ada07c8680/FoodCoconuts001.fbx": EOF)
2023/07/11 10:59:31 DEBUG : pacer: Rate limited, increasing sleep to 800ms
2023/07/11 10:59:32 DEBUG : pacer: low level retry 1/10 (error Get "https://example.seafile.com/seafhttp/files/1059c6dd-e924-4ee9-9897-6bcdf12d945a/FoodCoconuts001_AO_4K_METALNESS.jpg": EOF)
2023/07/11 10:59:32 DEBUG : pacer: Rate limited, increasing sleep to 1.6s
2023/07/11 10:59:32 DEBUG : pacer: low level retry 1/10 (error Get "https://example.seafile.com/seafhttp/files/02a9536f-9545-4a8d-a07e-fcfd0f250c6b/FoodCoconuts001_BUMP16_4K_METALNESS.tif": EOF)
2023/07/11 10:59:32 DEBUG : pacer: Rate limited, increasing sleep to 3.2s
2023/07/11 10:59:32 DEBUG : pacer: low level retry 2/10 (error Get "https://example.seafile.com/seafhttp/files/94f14083-534c-4a92-83b6-713a693280a8/seafile-tutorial.doc": EOF)
2023/07/11 10:59:32 DEBUG : pacer: Rate limited, increasing sleep to 6.4s
2023/07/11 10:59:32 DEBUG : pacer: low level retry 2/10 (error Get "https://example.seafile.com/seafhttp/files/c6da4d04-ae51-4c02-8d01-0240d6760199/TrafficLight_00.plasticity": EOF)
2023/07/11 10:59:32 DEBUG : pacer: Rate limited, increasing sleep to 10s
2023/07/11 10:59:34 DEBUG : pacer: low level retry 2/10 (error Get "https://example.seafile.com/seafhttp/files/62093943-42a7-4c59-8fec-87ada07c8680/FoodCoconuts001.fbx": EOF)
2023/07/11 10:59:34 INFO :
Transferred: 0 B / 507.873 MiB, 0%, 0 B/s, ETA -
Transferred: 0 / 32, 0%
Elapsed time: 52m0.6s
Transferring:
* My Library/TrafficLight_00.plasticity: transferring
* My Library/seafile-tutorial.doc: transferring
* My Library/FoodCoconut…01/FoodCoconuts001.fbx: transferring
* My Library/FoodCoconut…01_AO_4K_METALNESS.jpg: transferring
* My Library/FoodCoconut…UMP16_4K_METALNESS.tif: transferring
2023/07/11 10:59:37 DEBUG : pacer: low level retry 7/10 (error Get "https://example.seafile.com/seafhttp/files/a164e4bd-83bf-4fc9-8572-ddc479c72603/FoodCoconuts001_BUMP16_4K_METALNESS.tif": EOF)
2023/07/11 10:59:39 DEBUG : pacer: low level retry 1/10 (error Get "https://example.seafile.com/seafhttp/files/85233c08-e246-471f-a6f1-032820912142/FoodCoconuts001_BUMP16_4K_METALNESS.tif": EOF)
2023/07/11 10:59:43 INFO :
Transferred: 0 B / 507.873 MiB, 0%, 0 B/s, ETA -
Transferred: 0 / 32, 0%
Elapsed time: 39m0.6s
Transferring:
* My Library/TrafficLight_00.plasticity: transferring
* My Library/seafile-tutorial.doc: transferring
* My Library/FoodCoconut…01/FoodCoconuts001.fbx: transferring
* My Library/FoodCoconut…01_AO_4K_METALNESS.jpg: transferring
* My Library/FoodCoconut…UMP16_4K_METALNESS.tif: transferring
2023/07/11 10:59:44 DEBUG : pacer: low level retry 2/10 (error Get "https://example.seafile.com/seafhttp/files/1059c6dd-e924-4ee9-9897-6bcdf12d945a/FoodCoconuts001_AO_4K_METALNESS.jpg": EOF)
2023/07/11 10:59:47 DEBUG : pacer: low level retry 7/10 (error Get "https://example.seafile.com/seafhttp/files/7415db59-7ae8-415d-bf2e-12eee84c87f2/FoodCoconuts001.fbx": EOF)
2023/07/11 10:59:49 DEBUG : pacer: low level retry 2/10 (error Get "https://example.seafile.com/seafhttp/files/8833bd9d-b332-4fa0-8a57-997889c06650/FoodCoconuts001.fbx": EOF)
2023/07/11 10:59:53 INFO :
Transferred: 0 B / 539.874 MiB, 0%, 0 B/s, ETA -
Transferred: 0 / 32, 0%
Elapsed time: 54m0.8s
Transferring:
* My Library/seafile-tutorial.doc: transferring
* My Library/TrafficLight_00.plasticity: transferring
* My Library/FoodCoconut…01/FoodCoconuts001.fbx: transferring
* My Library/FoodCoconut…01_AO_4K_METALNESS.jpg: transferring
2023/07/11 10:59:54 DEBUG : pacer: low level retry 2/10 (error Get "https://example.seafile.com/seafhttp/files/02a9536f-9545-4a8d-a07e-fcfd0f250c6b/FoodCoconuts001_BUMP16_4K_METALNESS.tif": EOF)
2023/07/11 10:59:57 DEBUG : pacer: low level retry 8/10 (error Get "https://example.seafile.com/seafhttp/files/dfb47283-1415-4dab-9bb4-9fed7eab3448/TrafficLight_00.plasticity": EOF)
2023/07/11 10:59:59 DEBUG : pacer: low level retry 2/10 (error Get "https://example.seafile.com/seafhttp/files/ad14ffed-7092-476f-9f7e-cd695e05a950/FoodCoconuts001_AO_4K_METALNESS.jpg": EOF)
2023/07/11 11:00:04 DEBUG : pacer: low level retry 3/10 (error Get "https://example.seafile.com/seafhttp/files/94f14083-534c-4a92-83b6-713a693280a8/seafile-tutorial.doc": EOF)
2023/07/11 11:00:07 DEBUG : pacer: low level retry 8/10 (error Get "https://example.seafile.com/seafhttp/files/7f04ae08-c4f8-4dc6-ba6d-e9127730d329/FoodCoconuts001_AO_4K_METALNESS.jpg": EOF)
2023/07/11 11:00:09 DEBUG : pacer: low level retry 3/10 (error Get "https://example.seafile.com/seafhttp/files/c596bba8-91bc-4706-b6fc-7c45a58d5a61/TrafficLight_00.plasticity": EOF)
2023/07/11 11:00:13 INFO :
Transferred: 0 B / 507.873 MiB, 0%, 0 B/s, ETA -
Transferred: 0 / 32, 0%
Elapsed time: 36m0.6s
Transferring:
* My Library/TrafficLight_00.plasticity: transferring
* My Library/seafile-tutorial.doc: transferring
* My Library/FoodCoconut…01/FoodCoconuts001.fbx: transferring
* My Library/FoodCoconut…01_AO_4K_METALNESS.jpg: transferring
* My Library/FoodCoconut…UMP16_4K_METALNESS.tif: transferring
2023/07/11 11:00:14 DEBUG : pacer: low level retry 3/10 (error Get "https://example.seafile.com/seafhttp/files/c6da4d04-ae51-4c02-8d01-0240d6760199/TrafficLight_00.plasticity": EOF)
2023/07/11 11:00:17 DEBUG : pacer: low level retry 8/10 (error Get "https://example.seafile.com/seafhttp/files/3f077758-d0b0-44e5-bc95-1722179486be/seafile-tutorial.doc": EOF)
2023/07/11 11:00:19 DEBUG : pacer: low level retry 3/10 (error Get "https://example.seafile.com/seafhttp/files/dc8f90a1-68c1-4a2e-b0d2-7b19b90950ab/seafile-tutorial.doc": EOF)
2023/07/11 11:00:24 DEBUG : pacer: low level retry 3/10 (error Get "https://example.seafile.com/seafhttp/files/62093943-42a7-4c59-8fec-87ada07c8680/FoodCoconuts001.fbx": EOF)
2023/07/11 11:00:27 DEBUG : pacer: low level retry 8/10 (error Get "https://example.seafile.com/seafhttp/files/a164e4bd-83bf-4fc9-8572-ddc479c72603/FoodCoconuts001_BUMP16_4K_METALNESS.tif": EOF)
2023/07/11 11:00:29 DEBUG : pacer: low level retry 2/10 (error Get "https://example.seafile.com/seafhttp/files/85233c08-e246-471f-a6f1-032820912142/FoodCoconuts001_BUMP16_4K_METALNESS.tif": EOF)
2023/07/11 11:00:30 INFO :
Transferred: 0 B / 507.873 MiB, 0%, 0 B/s, ETA -
Transferred: 0 / 32, 0%
Elapsed time: 1m0.1s
Transferring:
* My Library/seafile-tutorial.doc: transferring
* My Library/TrafficLight_00.plasticity: transferring
* My Library/FoodCoconut…01/FoodCoconuts001.fbx: transferring
* My Library/FoodCoconut…01_AO_4K_METALNESS.jpg: transferring
* My Library/FoodCoconut…UMP16_4K_METALNESS.tif: transferring
2023/07/11 11:00:34 DEBUG : pacer: low level retry 3/10 (error Get "https://example.seafile.com/seafhttp/files/1059c6dd-e924-4ee9-9897-6bcdf12d945a/FoodCoconuts001_AO_4K_METALNESS.jpg": EOF)
2023/07/11 11:00:34 INFO :
Transferred: 0 B / 507.873 MiB, 0%, 0 B/s, ETA -
Transferred: 0 / 32, 0%
Elapsed time: 53m0.6s
Transferring:
* My Library/TrafficLight_00.plasticity: transferring
* My Library/seafile-tutorial.doc: transferring
* My Library/FoodCoconut…01/FoodCoconuts001.fbx: transferring
* My Library/FoodCoconut…01_AO_4K_METALNESS.jpg: transferring
* My Library/FoodCoconut…UMP16_4K_METALNESS.tif: transferring
2023/07/11 11:00:37 DEBUG : pacer: low level retry 8/10 (error Get "https://example.seafile.com/seafhttp/files/7415db59-7ae8-415d-bf2e-12eee84c87f2/FoodCoconuts001.fbx": EOF)
Hmm maybe the issue is with my seafile setup after all. Tried downloading a file from the webgui and it's not working either. I think maybe I missed something with the permissions. Thanks for you help!
I will report back if that fixes things!
Aha! Turns out the issue was that I hadn't set the right SERVICE_URL: and FILE_SERVER_ROOT: in seafile.
Everything is working now! Thank you for your help!