Sharefile remote setup getting [AUTH] Invalid Authentication

rclone_notification · October 25, 2024, 11:49pm

What is the problem you are having with rclone?

I keep getting authentication error. I am using linux server to copy data from sharefile to onedrive and I keep getting authentication error after a few run.

I followed the instructions here Remote Setup for remote setup

any guide for how to configure sharefile on remote computer is appreciated

Thank you!

Run the command 'rclone version' and share the full output of the command.

rclone v1.68.0

os/version: ubuntu 24.04 (64 bit)
os/kernel: 6.8.0-45-generic (x86_64)
os/type: linux
os/arch: amd64
go/version: go1.23.1
go/linking: static
go/tags: none

Which cloud storage system are you using? (eg Google Drive)

Sharefile and Onedrive

The command you were trying to run (eg `rclone copy /tmp remote:tmp`)

rclone sync Sharefile: Onedrive:"Citrix Sharefile Backup" --log-file="$LOG_FILE" --stats-log-level NOTICE

Please run 'rclone config redacted' and share the full output. If you get command not found, please make sure to update rclone.

[Onedrive]
type = onedrive
token = XXX
drive_id = XXX
drive_type = business

[Sharefile]
type = sharefile
root_folder_id = XXX
endpoint = https://archergroupcpa.sharefile.com
token = XXX
client_id = XXX
client_secret = XXX

A log from the command that you were trying to run with the `-vv` flag

2024/09/24 10:48:12 NOTICE: Personal Folders/Ekins/Ekins Chico GC.docx: Failed to cancel multipart upload: itemNotFound: The upload session was not found (upload failed due to: <nil>)
2024/09/24 10:48:12 NOTICE: Personal Folders/Ekins/Public Storage unit info.JPG: Failed to cancel multipart upload: itemNotFound: The upload session was not found (upload failed due to: <nil>)
2024/09/24 10:52:28 NOTICE: 
Transferred:   	   58.275 MiB / 7.924 GiB, 1%, 1.124 MiB/s, ETA 1h59m29s
Checks:                54 / 54, 100%
Transferred:           71 / 10083, 1%
Elapsed time:       1m0.3s
Transferring:
 * Personal Folders/Herit…ed receipts (2016).pdf:100% /4.351Mi, 4.349Mi/s, 0s
 * Personal Folders/Herit…'s/2015 1099 Prep.xlsx:100% /209.313Ki, 209.308Ki/s, 0s
 * Personal Folders/Herit…ail receipt (2015).pdf:100% /2.248Mi, 0/s, -
 * Personal Folders/Herit…ail receipt (2017).pdf:100% /1.961Mi, 1.960Mi/s, 0s

2024/09/24 10:53:28 NOTICE: 
Transferred:   	  172.661 MiB / 8.013 GiB, 2%, 1.794 MiB/s, ETA 1h14m37s
Checks:                54 / 54, 100%
Transferred:          150 / 10162, 1%
Elapsed time:       2m0.3s
Transferring:
 * Favorites/PTA/Exp reim…MENT-FILLABLE-FORM.pdf:  0% /107.373Ki, 0/s, -
 * Favorites/PTA/Exp reim…b request 10.12.23.pdf:100% /900.237Ki, 0/s, -
 * Favorites/PTA/Exp reim…b request 10.31.22.pdf:  0% /1.481Mi, 0/s, -
 * Favorites/PTA/Exp reim…22 - add'l receipt.pdf:  0% /73.480Ki, 0/s, -

2024/09/24 10:54:28 NOTICE: 
Transferred:   	  203.023 MiB / 8.101 GiB, 2%, 589.132 KiB/s, ETA 3h54m25s
Checks:                54 / 54, 100%
Transferred:          230 / 10242, 2%
Elapsed time:       3m0.3s
Transferring:
 * Personal Folders/Powel…e ICM 1099 9.23.21.pdf:100% /278.442Ki, 0/s, -
 * Personal Folders/Powel…e ICM 1099 9.27.22.pdf:  0% /365.244Ki, 0/s, -
 * Personal Folders/Powel…zquez 1099 9.26.19.pdf:  0% /694.497Ki, 0/s, -
 * Personal Folders/LOGF/…/1099 Detail 2016.xlsx: transferring

2024/09/24 10:55:28 NOTICE: 
Transferred:   	  318.610 MiB / 8.141 GiB, 4%, 2.286 MiB/s, ETA 58m26s
Checks:                54 / 54, 100%
Transferred:          309 / 10321, 3%
Elapsed time:       4m0.3s
Transferring:
 * Personal Folders/Jeff …Appraisal 12.31.13.pdf: 52% /5.977Mi, 0/s, -
 * Personal Folders/Jeff … purchase 11.19.99.pdf:100% /2.904Mi, 0/s, -
 * Personal Folders/Jeff …on building costs.docx:100% /13.140Ki, 0/s, -
 * Personal Folders/Jeff …tgage stmt 11.4.22.pdf: transferring

2024/09/24 10:56:28 NOTICE: 
Transferred:   	  378.550 MiB / 8.184 GiB, 5%, 2.765 MiB/s, ETA 48m14s
Checks:                54 / 54, 100%
Transferred:          391 / 10403, 4%
Elapsed time:       5m0.3s
Transferring:
 * Personal Folders/LOGF/…14,2016  01 10 PM).QBB:100% /23.230Mi, 9.999Mi/s, 0s
 * Personal Folders/LOGF/…s of Gary Freedman.QBW: 68% /29.254Mi, 9.998Mi/s, 0s
 * Personal Folders/LOGF/…y Freedman.QBW (2).DSN:100% /389, 0/s, -
 * Personal Folders/LOGF/…ry Freedman.QBW (2).ND: transferring

2024/09/24 10:57:28 NOTICE: 
Transferred:   	  469.515 MiB / 8.256 GiB, 6%, 1.937 MiB/s, ETA 1h8m41s
Checks:                54 / 54, 100%
Transferred:          473 / 10485, 5%
Elapsed time:       6m0.3s
Transferring:
 * Personal Folders/Capla…s/2016/2016 1099's.pdf:100% /3.772Mi, 3.771Mi/s, 0s
 * Personal Folders/Capla…ctionListbyVendor.xlsx:100% /18.069Ki, 0/s, -
 * Personal Folders/Parke… Mgr access 3.4.22.pdf:  0% /153.133Ki, 0/s, -
 * Personal Folders/Parke…fo Request 2.4.22.docx: transferring

2024/09/24 10:58:28 NOTICE: 
Transferred:   	  492.667 MiB / 8.306 GiB, 6%, 486.300 KiB/s, ETA 4h41m13s
Checks:                54 / 54, 100%
Transferred:          553 / 10565, 5%
Elapsed time:       7m0.3s
Transferring:
 * Personal Folders/Z - P…r Eng Ltr 5.18.20.docx:  0% /58.897Ki, 0/s, -
 * Personal Folders/Z - P…er Eng Ltr 5.18.20.pdf:  0% /135.580Ki, 0/s, -
 * Personal Folders/Z - P…r Eng Ltr 5.19.20.docx:  0% /58.925Ki, 0/s, -
 * Personal Folders/Z - P…er Eng Ltr 5.19.20.pdf: transferring

2024/09/24 10:59:28 NOTICE: 
Transferred:   	  541.035 MiB / 8.350 GiB, 6%, 1.058 MiB/s, ETA 2h6m12s
Checks:                54 / 54, 100%
Transferred:          632 / 10644, 6%
Elapsed time:       8m0.3s
Transferring:
 * Personal Folders/Ohtan…WP, Inc_1099_936ca.pdf: transferring
 * Personal Folders/Ohtan…cted 1099 to Ippei.pdf: transferring
 * Personal Folders/Ohtan… Information Sheet.pdf: transferring
 * Personal Folders/Ipsei… Eng Ltr 11.26.18.docx: transferring

2024/09/24 11:00:27 ERROR : Personal Folders/LOGF/2018/Email exchange w Jacque at LOGF.pdf: Failed to copy: failed to open source object: open: fetch download specification: [AUTH] Invalid Authentication: Unauthorized: NotAuthenticated
2024/09/24 11:00:27 ERROR : Personal Folders/LOGF/2018/Missing W-9's from LOGF.pdf: Failed to copy: failed to open source object: open: fetch download specification: [AUTH] Invalid Authentication: Unauthorized: NotAuthenticated
2024/09/24 11:00:27 ERROR : Personal Folders/LOGF/2018/QB password  LOGF123.pdf: Failed to copy: failed to open source object: open: fetch download specification: [AUTH] Invalid Authentication: Unauthorized: NotAuthenticated
2024/09/24 11:00:27 ERROR : Shared Folders/jvalliere@archergroupcpa.com/AAG work/2023 1099s/Corrected 2023 1099 - AAG LLP.pdf: Failed to copy: failed to open source object: open: fetch download specification: [AUTH] Invalid Authentication: Unauthorized: NotAuthenticated
2024/09/24 11:00:28 ERROR : Shared Folders/jvalliere@archergroupcpa.com/AAG work/2023 1099s/New 2023 1099 - AAG.pdf: Failed to copy: failed to open source object: open: fetch download specification: [AUTH] Invalid Authentication: Unauthorized: NotAuthenticated
2024/09/24 11:00:28 ERROR : Personal Folders/Shapira/Banking/Chase address update 2.28.21.pdf: Failed to copy: failed to open source object: open: fetch download specification: [AUTH] Invalid Authentication: Unauthorized: NotAuthenticated
2024/09/24 11:00:28 ERROR : Personal Folders/Shapira/Banking/Chat re new joint acct.pdf: Failed to copy: failed to open source object: open: fetch download specification: [AUTH] Invalid Authentication: Unauthorized: NotAuthenticated
2024/09/24 11:00:28 NOTICE: 
Transferred:   	  767.414 MiB / 8.426 GiB, 9%, 4.638 MiB/s, ETA 28m14s
Errors:                 7 (retrying may help)
Checks:                54 / 54, 100%
Transferred:          705 / 10717, 7%
Elapsed time:       9m0.3s
Transferring:
 * Personal Folders/LOGF/…'s (vendor copies).pdf:  0% /9.249Mi, 0/s, -
 * Personal Folders/LOGF/…ified mail receipt.pdf:100% /1.446Mi, 740.098Ki/s, 0s
 * Personal Folders/LOGF/…frain Talavera W-9.pdf:100% /382.003Ki, 0/s, -
 * Personal Folders/Shapi…r's Trust - Schwab.pdf: transferring

2024/09/24 11:00:28 ERROR : Personal Folders/Shapira/Banking/Schwab wire instructions.docx: Failed to copy: failed to open source object: open: fetch download specification: [AUTH] Invalid Authentication: Unauthorized: NotAuthenticated
2024/09/24 11:00:28 ERROR : Personal Folders/Shapira/Banking/Saul's Minor's Trust - Schwab.pdf: Failed to copy: failed to open source object: open: fetch download specification: [AUTH] Invalid Authentication: Unauthorized: NotAuthenticated

There are more to the logs and it's all the same error Invalid Authentication.

asdffdsa · October 26, 2024, 12:01am

welcome to the forum,

should use --log-level=DEBUG for debug output.
can run rclone selfupdate to get the latest version and test again.

rclone_notification · November 7, 2024, 1:18am

What is the problem you are having with rclone?

We keep getting expired token for Citrix Sharefile configuration. Initially it works. then if we check back the next day, we get [AUTH] Invalid Authentication: Unauthorized: NotAuthenticated

We have this setup on a remote linux server.

Run the command 'rclone version' and share the full output of the command.

rclone v1.68.1

os/version: ubuntu 24.04 (64 bit)
os/kernel: 6.8.0-48-generic (x86_64)
os/type: linux
os/arch: amd64
go/version: go1.23.1
go/linking: static
go/tags: none

Which cloud storage system are you using? (eg Google Drive)

Citrix Sharefile

The command you were trying to run (eg `rclone copy /tmp remote:tmp`)

rclone sync Sharefile: Onedrive:"Sharefile Backup" --log-file="$LOG_FILE" --stats-log-level DEBUG

Please run 'rclone config redacted' and share the full output. If you get command not found, please make sure to update rclone.

[Onedrive]
type = onedrive
token = XXX
drive_id = XXX
drive_type = business

[Sharefile]
type = sharefile
client_id = XXX
client_secret = XXX
root_folder_id = XXX
token = XXX
token_url = https://archergroupcpa.sharefile.com/oauth/token
endpoint = https://archergroupcpa.sharefile.com
auth_url = https://secure.sharefile.com/oauth/authorize

We got the URL from how we understand here -> ShareFile API Documentation

A log from the command that you were trying to run with the `-vv` flag

2024/11/06 17:08:33 DEBUG : rclone: Version "v1.68.1" starting with parameters ["rclone" "sync" "Sharefile:" "Onedrive:Sharefile Backup" "--log-file=" "--stats-log-level" "DEBUG" "-vv"]
2024/11/06 17:08:33 DEBUG : Creating backend with remote "Sharefile:"
2024/11/06 17:08:33 DEBUG : Using config file from "/root/.config/rclone/rclone.conf"
2024/11/06 17:08:33 DEBUG : Creating backend with remote "Onedrive:Sharefile Backup"
2024/11/06 17:08:33 ERROR : sharefile root '': error reading source root directory: couldn't list files: [AUTH] Invalid Authentication: Unauthorized: NotAuthenticated
2024/11/06 17:08:33 DEBUG : OneDrive root 'Sharefile Backup': Waiting for checks to finish
2024/11/06 17:08:33 DEBUG : OneDrive root 'Sharefile Backup': Waiting for transfers to finish
2024/11/06 17:08:33 ERROR : OneDrive root 'Sharefile Backup': not deleting files as there were IO errors
2024/11/06 17:08:33 ERROR : OneDrive root 'Sharefile Backup': not deleting directories as there were IO errors
2024/11/06 17:08:33 ERROR : Attempt 1/3 failed with 1 errors and: couldn't list files: [AUTH] Invalid Authentication: Unauthorized: NotAuthenticated
2024/11/06 17:08:33 ERROR : sharefile root '': error reading source root directory: couldn't list files: [AUTH] Invalid Authentication: Unauthorized: NotAuthenticated
2024/11/06 17:08:33 DEBUG : OneDrive root 'Sharefile Backup': Waiting for checks to finish
2024/11/06 17:08:33 DEBUG : OneDrive root 'Sharefile Backup': Waiting for transfers to finish
2024/11/06 17:08:33 ERROR : OneDrive root 'Sharefile Backup': not deleting files as there were IO errors
2024/11/06 17:08:33 ERROR : OneDrive root 'Sharefile Backup': not deleting directories as there were IO errors
2024/11/06 17:08:33 ERROR : Attempt 2/3 failed with 1 errors and: couldn't list files: [AUTH] Invalid Authentication: Unauthorized: NotAuthenticated
2024/11/06 17:08:34 ERROR : sharefile root '': error reading source root directory: couldn't list files: [AUTH] Invalid Authentication: Unauthorized: NotAuthenticated
2024/11/06 17:08:34 DEBUG : OneDrive root 'Sharefile Backup': Waiting for checks to finish
2024/11/06 17:08:34 DEBUG : OneDrive root 'Sharefile Backup': Waiting for transfers to finish
2024/11/06 17:08:34 ERROR : OneDrive root 'Sharefile Backup': not deleting files as there were IO errors
2024/11/06 17:08:34 ERROR : OneDrive root 'Sharefile Backup': not deleting directories as there were IO errors
2024/11/06 17:08:34 ERROR : Attempt 3/3 failed with 1 errors and: couldn't list files: [AUTH] Invalid Authentication: Unauthorized: NotAuthenticated
2024/11/06 17:08:34 DEBUG : 
Transferred:              0 B / 0 B, -, 0 B/s, ETA -
Errors:                 1 (retrying may help)
Elapsed time:         1.0s

2024/11/06 17:08:34 DEBUG : 8 go routines active
2024/11/06 17:08:34 NOTICE: Failed to sync: couldn't list files: [AUTH] Invalid Authentication: Unauthorized: NotAuthenticated

asdffdsa · November 7, 2024, 1:26am

are you sure you need all that url info?

fwiw, better to test just sharefile without onedrive
rclone lsd Sharefile: --retries=1 -vv

and for a deeper look, try --dump flags.

rclone_notification · November 8, 2024, 6:03pm

We do since we don't want to authenticate manually every time we want to run a sync command.

Maybe this is a rclone limitation for remote setup. I don't notice this problem on my local machine. idk

asdffdsa · November 8, 2024, 6:06pm

should not be a difference.

can compare the config files on local and remote.
can copy the config file from local machine to remote machine, instead of remote setup.

rclone_notification · November 8, 2024, 7:18pm

On my local computer, I'm just using the web authentication without using the advance config.

I tried that same process on the remote computer following the instructions here: Remote Setup

it works, but after a couple of hrs, the token expires and have to do it again. that's why we went to use the advance config setup. But can't get it to work automatically without human intervention.

UPDATE:

got it to work now but it's not within rClone. I ended up manually creating a script to get new token and update the config file. we used the password grant API which I don't think rClone have a function for this.

https://api.sharefile.com/gettingstarted/oauth2password

system · December 8, 2024, 7:18pm

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.

Sharefile remote setup getting [AUTH] Invalid Authentication

What is the problem you are having with rclone?

Run the command 'rclone version' and share the full output of the command.

Which cloud storage system are you using? (eg Google Drive)

The command you were trying to run (eg rclone copy /tmp remote:tmp)

Please run 'rclone config redacted' and share the full output. If you get command not found, please make sure to update rclone.

A log from the command that you were trying to run with the -vv flag

What is the problem you are having with rclone?

Run the command 'rclone version' and share the full output of the command.

Which cloud storage system are you using? (eg Google Drive)

The command you were trying to run (eg rclone copy /tmp remote:tmp)

Please run 'rclone config redacted' and share the full output. If you get command not found, please make sure to update rclone.

A log from the command that you were trying to run with the -vv flag

The command you were trying to run (eg `rclone copy /tmp remote:tmp`)

A log from the command that you were trying to run with the `-vv` flag

The command you were trying to run (eg `rclone copy /tmp remote:tmp`)

A log from the command that you were trying to run with the `-vv` flag