Server side move on Jotta Cloud?

Does anyone know if Jotta Cloud supports server side move – ie. from one account to another?

do you have two jottacloud accounts?

No, not yet. If I did I could just have tried. :slight_smile:

But it could be I need to move from one to another in the near future, and it would make it a lot smoother if I could do a server side move.

jottacloud offers free accounts, could test with that.

Does not look like it supports server side move in the current version of rclone, I would guess it's a backend limitation – rather than rclone (but I don't know for sure).

me either, as you have not posted the redacted config, command and debug log

Did not really see the point. rclone documentation says that copy/move commands defaults to server side transfers if available, and if not falls back on downloading, then uploading – which seems to be the case.

But if you think it can give any more info I've attached excerpts below.

[jotta1]
type = jottacloud
hard_delete = true
tokenURL = https://<removed>
token = {"access_token":"<removed>"}
mountpoint =
configVersion = 1
device =
client_id = jottacli
client_secret =

[jotta2]
type = jottacloud
hard_delete = true
tokenURL = https://<removed>
token = {"access_token":"<removed>"}
mountpoint =
configVersion = 1
device =
client_id = jottacli
client_secret =
rclone copy jotta1: jotta2: --progress -vvv --log-file test-jotta.log
Transferred:      239.766 MiB / 183.301 GiB, 0%, 13.225 MiB/s, ETA 3h56m15s
Checks:               124 / 124, 100%
Transferred:            4 / 9478, 0%
Elapsed time:        19.2s
Transferring:
 * ⩄貶罰桇䘏汍ꈗ䦿/㘂殯腬㚓屸溨婖筗浇蛲星卉…檁確ʟ/㿼ᅕ㯀㲇评ꋮ皙⠎影㴼诗㳹䢨蚺禙ɟ: 41% /47.695Mi, 4.500Mi/s, 6s
 * ⩄貶罰桇䘏汍ꈗ䦿/㘂殯腬㚓屸溨婖筗浇蛲星卉…檁確ʟ/䑻轅邰獀痸㮂鍖䯟迻瓂諡䖐㜲稐畅湠ɟ: 33% /47.695Mi, 4.665Mi/s, 6s
 * ⩄貶罰桇䘏汍ꈗ䦿/㘂殯腬㚓屸溨婖筗浇蛲星卉…檁確ʟ/䚷慛栧㮐抔諿皏闽䅖⣺冭毓☼匞踌崷ʟ: 14% /47.695Mi, 1.997Mi/s, 20s
 * ⩄貶罰桇䘏汍ꈗ䦿/㘂殯腬㚓屸溨婖筗浇蛲星卉…檁確ʟ/䲅鎚病㠲渇态鸹⡘㰑坕枹幼轊鶯鄹ʟ: 12% /47.695Mi, 3.996Mi/s, 10s^C
2024/04/30 09:37:35 DEBUG : rclone: Version "v1.66.0" starting with parameters ["rclone" "copy" "jotta1:" "jotta2:" "--progress" "-vvv" "--log-file" "test-jotta.log"]
2024/04/30 09:37:35 DEBUG : Creating backend with remote "jotta1:"
2024/04/30 09:37:35 DEBUG : Using config file from "/home/<redacted>/.config/rclone/rclone.conf"
2024/04/30 09:37:36 DEBUG : Creating backend with remote "jotta2:"
2024/04/30 09:37:36 DEBUG : jotta2: Loaded invalid token from config file - ignoring
2024/04/30 09:37:36 DEBUG : Saving config "token" in section "jotta2" of the config file
2024/04/30 09:37:36 DEBUG : Keeping previous permissions for config file: -rw-r--r--
2024/04/30 09:37:36 DEBUG : jotta2: Saved new token in config file

(…)

2024/04/30 09:37:37 DEBUG : ⩄貶罰桇䘏ꈗ䦿/㓒倃ᛎ猯恶东享爜襁侢唛堦◹覵潏瘜䂷雕魌鷿欻釜䊎晾緆㒤䢄嶖獩㱇䝜彫瀍岖䨢姀它鈊窿/ᖓ膪ᑾ猐缐䖾ꁹ䡍脎䫛䳌䞉顜䡚ʟ: Need to transfer - File to not found at Destination
2024/04/30 09:37:37 DEBUG : ⩄貶罰桇䘏ꈗ䦿/㓒倃ᛎ猯恶东享爜襁侢唛堦◹覵潏瘜䂷雕魌鷿欻釜䊎晾緆㒤䢄嶖獩㱇䝜彫瀍岖䨢姀它鈊窿/㘻煀娺鳣圽仵䝓㛾角ᇠ鼖獙蒥嵱ꉒʟ: Need to transfer - File trnot found at Dnstinatio
2024/04/30 09:37:37 DEBUG : ⩄貶罰桇䘏ꈗ䦿/㓒倃ᛎ猯恶东享爜襁侢唛堦◹覵潏瘜䂷雕魌鷿欻釜䊎晾緆㒤䢄嶖獩㱇䝜彫瀍岖䨢姀它鈊窿/㠐鰰韎挽甾衏⥙Ꮜ笉饪⻄㫬䅖䭐排ɟ: Need to transfer - Fil Nee not found at Destination
2024/04/30 09:37:37 DEBUG : ⩄貶罰桇䘏ꈗ䦿/㓒倃ᛎ猯恶东享爜襁侢唛堦◹覵潏瘜䂷雕魌鷿欻釜䊎晾緆㒤䢄嶖獩㱇䝜彫瀍岖䨢姀它鈊窿/㣎挽䨣䭜孟嬈氢锽蝯爫㣎蹬庶梳嗈ɟ: Need to transfer - File tranot found at Dostinatioa
2024/04/30 09:37:37 DEBUG : ⩄貶罰桇䘏ꈗ䦿/㓒倃ᛎ猯恶东享爜襁侢唛堦◹覵潏瘜䂷雕魌鷿欻釜䊎晾緆㒤䢄嶖獩㱇䝜彫瀍岖䨢姀它鈊窿/㺵ቦꈎ㻖㥖䃥炴虝ꈎ⎯䢇嘹雳艄藛ʟ: Need to transfer - NeeFile nrt found at Destination
2024/04/30 09:37:37 DEBUG : ⩄貶罰桇䘏ꈗ䦿/㓒倃ᛎ猯恶东享爜襁侢唛堦◹覵潏瘜䂷雕魌鷿欻釜䊎晾緆㒤䢄嶖獩㱇䝜彫瀍岖䨢姀它鈊窿/主㐞檘萕⣊紖罵謻墅茭蘶琍㑳竐騐ɟ: Need to transfer ɟ: N- File not found-at Destinatiun
2024/04/30 09:37:37 DEBUG : ⩄貶罰桇䘏ꈗ䦿/㓒倃ᛎ猯恶东享爜襁侢唛堦◹覵潏瘜䂷雕魌鷿欻釜䊎晾緆㒤䢄嶖獩㱇䝜彫瀍岖䨢姀它鈊窿/伄緧ꅁ抶ቢ鼿氹禪豺㞻䗍䘸㝮䂉ɟ: Need to transfer - Fil Need nottfousd at-Destination
2024/04/30 09:37:37 DEBUG : ⩄貶罰桇䘏ꈗ䦿/㓒倃ᛎ猯恶东享爜襁侢唛堦◹覵潏瘜䂷雕魌鷿欻釜䊎晾緆㒤䢄嶖獩㱇䝜彫瀍岖䨢姀它鈊窿/奟盪ꄣ诞⣋俅从嫏䖷砙作宫⍟琨圍䄑ɟ: Need to transfer - Filetranot found at Dostinatioa
2024/04/30 09:37:37 DEBUG : ⩄貶罰桇䘏ꈗ䦿/㓒倃ᛎ猯恶东享爜襁侢唛堦◹覵潏瘜䂷雕魌鷿欻釜䊎晾緆㒤䢄嶖獩㱇䝜彫瀍岖䨢姀它鈊窿/楯剮卐旆⦴┎㼰渕䅮Ꮀ䧰徼慠夑眵ဝʟ: Need to transfer - Fileed nottfousd at-Destination
2024/04/30 09:37:37 DEBUG : ⩄貶罰桇䘏ꈗ䦿/㓒倃ᛎ猯恶东享爜襁侢唛堦◹覵潏瘜䂷雕魌鷿欻釜䊎晾緆㒤䢄嶖獩㱇䝜彫瀍岖䨢姀它鈊窿/碀喥乌娈庝祣豣軏㝑甡楺頸經皗銂ʟ: Need to transfer -d toFile not found at Desfination

(…)

2024/04/30 09:37:46 DEBUG : jottacloud root : Waiting for checks to finish
2024/04/30 09:37:46 DEBUG : jottacloud root : Waiting for transfers to finish
2024/04/30 09:37:49 DEBUG : ⩄貶罰桇䘏㫿汍䦿/㘂殯腬㚓屸溨婖筗浇蛲星惠斦础垯飬形柰㢰馸㳫肠䝟毑ᐽ晨蔆宽㩮辮檁確ʟ/㙧䗮ሂ䭕䝓⠭码頂䬀印屴礍霣梽ʟ: md5 = 3a61a8d502613349dd0d9c6540bda0d OK
2024/04/30 09:37:49 INFO  : ⩄貶罰桇䘏㫿ꈗ䦿/㘂殯腬㚓屸溨婖筗浇蛲星卉惠础垯飬形柰㢰馸㳫肠䝟毑ᐽ晨蔆宽㩮辮檁確ʟ/㙧䗮ሂ繮䝓⠭码頂䬀印屴礍霣梽ʟ: Copied (new)
2024/04/30 09:37:51 DEBUG : ⩄貶罰桇䘏㫿汍ꈗ䦿/㘂殯腬㚓屸溨婖筗浇蛲星卉斦础垯飬形柰㢰馸㳫肠䝟毑ᐽ晨蔆宽㩮辮檁確ʟ/㬺衬針瘠銽詀䙐㲜▕掋坪疙ᡎ⥶䑽ʟ: md5 = 272112a66a3452043cefddc1513280e2 OK
2024/04/30 09:37:51 INFO  : ⩄貶罰桇䘏汍ꈗ䦿/㘂殯腬㚓屸溨婖筗浇蛲星卉惠础垯飬形柰㢰馸㳫肠䝟毑ᐽ晨蔆宽㩮辮檁確ʟ/㬺衬針瘠鷌詀䙐㲜▕掋坪疙ᡎ⥶䑽ʟ: Copied (new)
2024/04/30 09:37:52 DEBUG : ⩄貶罰䘏㫿汍ꈗ䦿/㘂殯腬㚓屸溨婖筗浇蛲星卉斦础垯飬形柰㢰馸㳫肠䝟毑ᐽ晨蔆宽㩮辮檁確ʟ/ᕭ敢妶ꐹ稛䏂粏㴐⣘酤謆矆溱ဋᚷ䏹ɟ: md5 = 48888eed5edesddb8d3f65600fc5c0e8 OK
2024/04/30 09:37:52 INFO  : ⩄貶罰䘏㫿汍ꈗ䦿/㘂殯腬㚓屸溨婖筗浇蛲星卉惠斦础垯飬形柰㢰馸㳫肠䝟毑ᐽ晨蔆宽㩮辮檁確ʟ/ᕭ敢妶ꐹ稛絁粏㴐⣘酤謆矆溱ဋᚷ䏹ɟ: Copied (new)
2024/04/30 09:37:53 DEBUG : ⩄貶罰桇㫿汍ꈗ䦿/㘂殯腬㚓屸溨婖筗浇蛲星卉惠斦础垯飬形柰㢰馸㳫肠䝟毑ᐽ晨蔆宽㩮辮檁確ʟ/㖒㰩刀频奶例瞹玦泘䥗蹽讻堻☝詹顠ɟ: md5 = 23312c032ed5e35b34f20c4606328495 OK
2024/04/30 09:37:53 INFO  : ⩄貶罰桇䘏汍ꈗ䦿/㘂殯腬㚓屸溨婖筗浇蛲星惠斦础垯飬形柰㢰馸㳫肠䝟毑ᐽ晨蔆宽㩮辮檁確ʟ/㖒㰩刀频奶徑瞹玦泘䥗蹽讻堻☝詹顠ɟ: Copied (new)
rclone backend features jottacloud | grep ServerSideAcrossConfigs
                "ServerSideAcrossConfigs": false

based on that, rclone does not support server-side

but as a test, might try --server-side-across-configs

Don't know if Jottacloud's internal deduplication does apply in your test... :thinking: That should be possible to see from a run with --dump requests (see: Documentation). But for it to be a valid test you must clean existing destination by deleting with --jottacloud-hard-delete and/or clear trash with rclone cleanup to avoid deduplication just picking up content from your previous test run.

With this flag I get the error message below, and no successful copy.

2024/05/01 00:40:11 ERROR : ⩄貶桇䘏㫿汍ꈗ䦿/⢘就䬜䞰㨴妴鐹檾ឆ沵粼熹篗獆丅ꎏ疄引韙踽麸䋴辢昪羍☬糖绲涴蚯脤㟱勽严欏㗁谑您矽覣ꀺ䯑旗龰䞂旇劏姝ɯ/满獤弽詁契椒㿝禾篒絺肏ᑚ槗ɟ: Failed to copy: couldn't copy file: error 401: org.springframework.security.authentication.BadCredentialsException: No token or token is malmalformedUnauthorized)

@albertony
I did purge everything with the hard delete flag, and tried a new copy with the --dump requests. I ran it for under a minute and the log file is 1,2GB.

What do I look for in the log?

I think its best to try with a single test file to avoid too much noise. And --dump responses is probably more useful instead of what I suggested earlier.

What you should observe is as follows:

After a few initial requests:

  • GET /account/v1/customer
  • GET /jfs/.../Jotta/Archive/...(destination dir, file, paths..)

It should end up concluding file does not already exist:

2024/05/01 10:31:22 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2024/05/01 10:31:22 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2024/05/01 10:31:22 DEBUG : HTTP RESPONSE (req ...)
2024/05/01 10:31:22 DEBUG : HTTP/1.1 404 Not Found

Then, uploads to Jottacloud are always initialized with an allocate POST-request:

2024/05/01 10:32:22 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2024/05/01 10:32:22 DEBUG : rclone.exe: Need to transfer - File not found at Destination
2024/05/01 10:32:22 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2024/05/01 10:32:22 DEBUG : HTTP REQUEST (req ...)
2024/05/01 10:32:22 DEBUG : POST /files/v1/allocate HTTP/1.1

And the response here tells you if deduplication was possible.

If full deduplication the response from the allocation request indicates file state is COMPLETED, and then it is followed by only a GET request just to get all metadata (I'm testing by copying rclone.exe here):

2024/05/01 10:32:22 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2024/05/01 10:32:22 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2024/05/01 10:32:22 DEBUG : HTTP RESPONSE (req ...)
2024/05/01 10:32:22 DEBUG : HTTP/1.1 201 Created
Content-Length: 903
...

{"name":"rclone.exe","path":"/jfs/Jotta/Archive/Temp/r2/rclone.exe","state":"COMPLETED", ...,"bytes":122671560,"resume_pos":122671560}
...
2024/05/01 10:32:24 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2024/05/01 10:32:24 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2024/05/01 10:32:24 DEBUG : HTTP REQUEST (req ...)
2024/05/01 10:32:24 DEBUG : GET /jfs/.../Jotta/Archive/Temp/r2/rclone.exe HTTP/1.1
...

If no deduplication was done, the response from the allocation request indicates file state is INCOMPLETE, resume_pos is 0 and bytes is the entire size of the file, and it continues with a new upload POST-request, before the same GET request to get metadata as above:

2024/05/01 10:32:22 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2024/05/01 10:32:22 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2024/05/01 10:32:22 DEBUG : HTTP RESPONSE (req ...)
2024/05/01 10:32:22 DEBUG : HTTP/1.1 201 Created
Content-Length: 903
...

{"name":"rclone.exe","path":"/jfs/Jotta/Archive/Temp/r2/rclone.exe","state":"INCOMPLETE", ... ,"bytes":122671560,"resume_pos":0}
...
2024/05/01 10:32:23 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2024/05/01 10:32:24 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2024/05/01 10:32:24 DEBUG : HTTP REQUEST (req ...)
2024/05/01 10:32:24 DEBUG : POST /files/v1/upload/...
...
2024/05/01 10:32:26 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2024/05/01 10:32:26 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2024/05/01 10:32:26 DEBUG : HTTP REQUEST (req ...)
2024/05/01 10:32:26 DEBUG : GET /jfs/.../Jotta/Archive/Temp/r2/rclone.exe HTTP/1.1

For partial deduplication it is similar, but with different values of bytes/resume_pos...

1 Like

Ok, so we're looking for if they dedupe across all customers files – and if yes, every file that "allready exists" it should speed up? I'm guessing if they do this, they do it based on the required checksuming. It sure does not look like it from the initial test, but I can try with a small file and test.

I can test with both flags.

Exactly. I have no idea if they do this, probably not, I just thought it could be worth a test.

Here is the output of a 1mb file. I first uploaded the file to "jotta1:", then copied over to "jotta2:".

2024/05/01 12:59:06 DEBUG : rclone: Version "v1.66.0" starting with parameters ["rclone" "copy" "jotta1:1mb.file" "jotta2:" "--dump" "requests" "--dump" "headers" "-vvv" "--progress" "--log-file" "test-1mb-dump.log"]
2024/05/01 12:59:06 DEBUG : Creating backend with remote "jotta1:1mb.file"
2024/05/01 12:59:06 DEBUG : Using config file from "/home/<redacted>/.config/rclone/rclone.conf"
2024/05/01 12:59:06 DEBUG : You have specified to dump information. Please be noted that the Accept-Encoding as shown may not be correct in the request and the response may not show Content-Encoding if the go standard libraries auto gzip encoding was in effect. In this case the body of the request will be gunzipped before showing it.
2024/05/01 12:59:06 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2024/05/01 12:59:06 DEBUG : HTTP REQUEST (req 0xc0008786c0)
2024/05/01 12:59:06 DEBUG : GET /account/v1/customer HTTP/1.1
Host: api.jottacloud.com
User-Agent: rclone/v1.66.0
Authorization: XXXX
Accept-Encoding: gzip

2024/05/01 12:59:06 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2024/05/01 12:59:06 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2024/05/01 12:59:06 DEBUG : HTTP RESPONSE (req 0xc0008786c0)
2024/05/01 12:59:06 DEBUG : HTTP/1.1 200 OK
Content-Length: 663
Access-Control-Allow-Headers: Accept, Accept-Encoding, Authorization, Content-Type, Content-Encoding, User-Agent, X-ID, X-Forwarded-For, Host, Origin, csrf_token
Access-Control-Allow-Origin: *
Cache-Control: no-store
Content-Type: application/json
Date: Wed, 01 May 2024 10:59:06 GMT                                                                                                                                                                                                                                                                                                                                      Strict-Transport-Security: max-age=31536000; includeSubDomains
X-Content-Type-Options: nosniff
X-Frame-Options: DENY
X-Id: 846010979193
X-Resp: 19
X-Xss-Protection: 1; mode=block

2024/05/01 12:59:06 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2024/05/01 12:59:06 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2024/05/01 12:59:06 DEBUG : HTTP REQUEST (req 0xc0007b45a0)
2024/05/01 12:59:06 DEBUG : GET /jfs/<redacted>/Jotta/Archive/1mb.file HTTP/1.1
Host: jfs.jottacloud.com
User-Agent: rclone/v1.66.0
Authorization: XXXX
Accept-Encoding: gzip

2024/05/01 12:59:06 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2024/05/01 12:59:07 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2024/05/01 12:59:07 DEBUG : HTTP RESPONSE (req 0xc0007b45a0)
2024/05/01 12:59:07 DEBUG : HTTP/1.1 200 OK
Transfer-Encoding: chunked
Accept-Ranges: bytes
Cache-Control: no-cache, no-store, max-age=0, must-revalidate
Content-Type: text/xml
Date: Wed, 01 May 2024 10:59:07 GMT
Expires: 0
Pragma: no-cache
Strict-Transport-Security: max-age=31536000; includeSubDomains
X-Content-Type-Options: nosniff
X-Frame-Options: DENY
X-Id: 400301262922
X-Resp: 16
X-Xss-Protection: 1; mode=block

2024/05/01 12:59:07 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2024/05/01 12:59:07 DEBUG : fs cache: adding new entry for parent of "jotta1:1mb.file", "jotta1:"
2024/05/01 12:59:07 DEBUG : Creating backend with remote "jotta2:"
2024/05/01 12:59:07 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2024/05/01 12:59:07 DEBUG : HTTP REQUEST (req 0xc000878900)
2024/05/01 12:59:07 DEBUG : GET /account/v1/customer HTTP/1.1
Host: api.jottacloud.com
User-Agent: rclone/v1.66.0
Authorization: XXXX
Accept-Encoding: gzip

2024/05/01 12:59:07 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2024/05/01 12:59:07 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2024/05/01 12:59:07 DEBUG : HTTP RESPONSE (req 0xc000878900)
2024/05/01 12:59:07 DEBUG : HTTP/1.1 200 OK
Content-Length: 668
Access-Control-Allow-Headers: Accept, Accept-Encoding, Authorization, Content-Type, Content-Encoding, User-Agent, X-ID, X-Forwarded-For, Host, Origin, csrf_token
Access-Control-Allow-Origin: *
Cache-Control: no-store
Content-Type: application/json
Date: Wed, 01 May 2024 10:59:07 GMT
Strict-Transport-Security: max-age=31536000; includeSubDomains
X-Content-Type-Options: nosniff
X-Frame-Options: DENY
X-Id: 413152131444
X-Resp: 20
X-Xss-Protection: 1; mode=block

2024/05/01 12:59:07 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2024/05/01 12:59:07 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2024/05/01 12:59:07 DEBUG : HTTP REQUEST (req 0xc0000b8b40)
2024/05/01 12:59:07 DEBUG : GET /jfs/<redacted>/Jotta/Archive/1mb.file HTTP/1.1
Host: jfs.jottacloud.com
User-Agent: rclone/v1.66.0
Authorization: XXXX
Accept-Encoding: gzip

2024/05/01 12:59:07 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2024/05/01 12:59:07 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2024/05/01 12:59:07 DEBUG : HTTP RESPONSE (req 0xc0000b8b40)
2024/05/01 12:59:07 DEBUG : HTTP/1.1 200 OK
Transfer-Encoding: chunked
Accept-Ranges: bytes
Cache-Control: no-cache, no-store, max-age=0, must-revalidate
Content-Type: text/xml
Date: Wed, 01 May 2024 10:59:07 GMT
Expires: 0
Pragma: no-cache
Strict-Transport-Security: max-age=31536000; includeSubDomains
X-Content-Type-Options: nosniff
X-Frame-Options: DENY
X-Id: 523864920029
X-Resp: 16
X-Xss-Protection: 1; mode=block

2024/05/01 12:59:07 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2024/05/01 12:59:07 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2024/05/01 12:59:07 DEBUG : HTTP REQUEST (req 0xc0005fc000)
2024/05/01 12:59:07 DEBUG : GET /jfs/prsfpalf2rpcigxy5c1vgoe2/Jotta/Archive/1mb.file HTTP/1.1
Host: jfs.jottacloud.com
User-Agent: rclone/v1.66.0
Authorization: XXXX
Accept-Encoding: gzip

2024/05/01 12:59:07 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2024/05/01 12:59:07 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2024/05/01 12:59:07 DEBUG : HTTP RESPONSE (req 0xc0005fc000)
2024/05/01 12:59:07 DEBUG : HTTP/1.1 404 Not Found
Transfer-Encoding: chunked
Accept-Ranges: bytes
Cache-Control: no-cache, no-store, max-age=0, must-revalidate
Content-Type: text/xml
Date: Wed, 01 May 2024 10:59:07 GMT
Expires: 0
Pragma: no-cache
Strict-Transport-Security: max-age=31536000; includeSubDomains
X-Content-Type-Options: nosniff
X-Frame-Options: DENY
X-Id: 134823406643
X-Resp: 11
X-Xss-Protection: 1; mode=block

2024/05/01 12:59:07 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2024/05/01 12:59:07 DEBUG : 1mb.file: Need to transfer - File not found at Destination
2024/05/01 12:59:07 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2024/05/01 12:59:07 DEBUG : HTTP REQUEST (req 0xc0005fc6c0)
2024/05/01 12:59:07 DEBUG : GET /jfs/<redacted>/Jotta/Archive/1mb.file?mode=bin HTTP/1.1
Host: jfs.jottacloud.com
User-Agent: rclone/v1.66.0
Authorization: XXXX
Accept-Encoding: gzip

2024/05/01 12:59:07 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2024/05/01 12:59:07 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2024/05/01 12:59:07 DEBUG : HTTP RESPONSE (req 0xc0005fc6c0)
2024/05/01 12:59:07 DEBUG : HTTP/1.1 200 OK
Content-Length: 1048576
Accept-Ranges: bytes
Cache-Control: no-cache, no-store, max-age=0, must-revalidate
Content-Disposition: attachment; filename*=UTF-8''1mb.file
Content-Transfer-Encoding: binary
Content-Type: application/octet-stream
Date: Wed, 01 May 2024 10:59:07 GMT
Etag: b6e81b362a5272d80c27432f39153e2c
Expires: 0
Last-Modified: Wed, 01 May 2024 10:53:10 GMT
Pragma: no-cache
Strict-Transport-Security: max-age=31536000; includeSubDomains
X-Content-Type-Options: nosniff
X-Frame-Options: DENY
X-Id: 310555820032
X-Resp: 18
X-Xss-Protection: 1; mode=block

2024/05/01 12:59:07 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2024/05/01 12:59:07 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2024/05/01 12:59:07 DEBUG : HTTP REQUEST (req 0xc0007b4c60)
2024/05/01 12:59:07 DEBUG : POST /files/v1/allocate HTTP/1.1
Host: api.jottacloud.com
User-Agent: rclone/v1.66.0
Content-Length: 166
Authorization: XXXX
Content-Type: application/json
Accept-Encoding: gzip

2024/05/01 12:59:07 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2024/05/01 12:59:07 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2024/05/01 12:59:07 DEBUG : HTTP RESPONSE (req 0xc0007b4c60)
2024/05/01 12:59:07 DEBUG : HTTP/1.1 202 Accepted
Content-Length: 804
Access-Control-Allow-Headers: Accept, Accept-Encoding, Authorization, Content-Type, Content-Encoding, User-Agent, X-ID, X-Forwarded-For, Host, Origin, csrf_token
Access-Control-Allow-Origin: *
Cache-Control: no-store
Content-Type: application/json
Date: Wed, 01 May 2024 10:59:07 GMT
Strict-Transport-Security: max-age=31536000; includeSubDomains
X-Content-Type-Options: nosniff
X-Frame-Options: DENY
X-Id: 261312472290
X-Resp: 39
X-Xss-Protection: 1; mode=block

2024/05/01 12:59:07 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2024/05/01 12:59:07 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2024/05/01 12:59:07 DEBUG : HTTP REQUEST (req 0xc0007b5440)
2024/05/01 12:59:07 DEBUG : POST /files/v1/upload/eyJ0IjoiMSDsImsiOiJBMWQifQ.bYASOcz2PFnZkYp7lMFijeAPd4bbSHWl6OeGCeX6KdslRXkkRgbJRiKcPcrSp36Tmlqn-gZUV9KA8EAT4-etaD-RkDOmJKxNQyL2WsZZOHD3F1l5xP3_wqmlhFxrH7g-AHL0Yom68zJ6OVSCUER8dGl5SIVXAFc3FYCCLiE8d-WVkXHlmV296zimVZBO_wP2RRJMTawB81cekttoXur26aa-3O4kTAOx_4nohEPfR7duFt2N3JNoHLHB7QaVC-V-.jjhIn9Xv5mwlsC1n8T_d7g HTTP
/1.1
Host: 092-up-r.jotta.cloud
User-Agent: rclone/v1.66.0
Content-Length: 1048576
Authorization: XXXX
Content-Type: application/octet-stream
Accept-Encoding: gzip

2024/05/01 12:59:07 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2024/05/01 12:59:07 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2024/05/01 12:59:07 DEBUG : HTTP RESPONSE (req 0xc0007b5440)
2024/05/01 12:59:07 DEBUG : HTTP/1.1 200 OK
Content-Length: 244
Access-Control-Allow-Credentials: true
Access-Control-Allow-Methods: OPTIONS,HEAD,GET,PUT,POST
Access-Control-Allow-Origin: *
Cache-Control: no-store
Content-Type: application/json
Date: Wed, 01 May 2024 10:59:07 GMT
Pool: k8sctra-gm_files_write-sw-093_api
Strict-Transport-Security: max-age=31536000; includeSubDomains
X-Content-Type-Options: nosniff
X-Frame-Options: DENY
X-Id: 554465364922
X-Resp: 478
X-Xss-Protection: 1; mode=block

2024/05/01 12:59:07 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2024/05/01 12:59:07 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2024/05/01 12:59:07 DEBUG : HTTP REQUEST (req 0xc0004c45a0)
2024/05/01 12:59:07 DEBUG : GET /jfs/prsfpalf2rpcigxy5c1vgoe2/Jotta/Archive/1mb.file HTTP/1.1
Host: jfs.jottacloud.com
User-Agent: rclone/v1.66.0
Authorization: XXXX
Accept-Encoding: gzip

2024/05/01 12:59:07 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2024/05/01 12:59:07 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2024/05/01 12:59:07 DEBUG : HTTP RESPONSE (req 0xc0004c45a0)
2024/05/01 12:59:07 DEBUG : HTTP/1.1 200 OK
Transfer-Encoding: chunked
Accept-Ranges: bytes
Cache-Control: no-cache, no-store, max-age=0, must-revalidate
Content-Type: text/xml
Date: Wed, 01 May 2024 10:59:07 GMT
Expires: 0
Pragma: no-cache
Strict-Transport-Security: max-age=31536000; includeSubDomains
X-Content-Type-Options: nosniff
X-Frame-Options: DENY
X-Id: 716668101361
X-Resp: 17
X-Xss-Protection: 1; mode=block

2024/05/01 12:59:07 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2024/05/01 12:59:07 DEBUG : 1mb.file: md5 = b6e81b162a5272d80c22432f39153f2c OK
2024/05/01 12:59:07 INFO  : 1mb.file: Copied (new)
2024/05/01 12:59:07 INFO  :
Transferred:            1 MiB / 1 MiB, 100%, 0 B/s, ETA -
Transferred:            1 / 1, 100%
Elapsed time:         1.3s

2024/05/01 12:59:07 DEBUG : 13 go routines active

Although I didn't see the json response from the allocate request in your example, it does continue with the upload request:

POST /files/v1/allocate
POST /files/v1/upload

Which indicates there was no (full) deduplication. Unfortunately.

1 Like

Ok, too bad, but what I figured. I guess I'm going to get a 10gbit vps somewhere and so the transfer.

That's the complete log btw. And you see the command, not sure how to get the what you're looking for.