Rclone Cookie usage with HTTP

DarKSkuLL · August 12, 2019, 6:20am

What is the problem you are having with rclone?

There is a site which uses Cloud Flare ddos Protection,
when we fetch the site it shows this:

Then sets a cookie-

And redirects to the page which has all the contents that I am trying to access.

What is your rclone version (output from `rclone version`)

rclone v1.48.0-157-ga1263e70-beta

os/arch: windows/amd64
go version: go1.12.3

Which OS you are using and how many bits (eg Windows 7, 64 bit)

Windows 10

Which cloud storage system are you using? (eg Google Drive)

HTTP

The command you were trying to run (eg `rclone copy /tmp remote:tmp`)

rclone ls :http: --http-url https://srv05.erai-ddl.info/2019/Summer/Vinland%20Saga/ --use-cookies -vv

A log from the command with the `-vv` flag (eg output from `rclone -vv copy /tmp remote:tmp`)

2019/08/12 11:53:08 DEBUG : rclone: Version "v1.48.0-157-ga1263e70-beta" starting with parameters > ["rclone" "ls" ":http:" "--http-url" "https://srv05.erai-ddl.info/2019/Summer/Vinland%20Saga/" "--use-cookies" "-vv"]

2019/08/12 11:53:08 DEBUG : Using config file from "/home/rs/.local/bin/rclone.conf"
2019/08/12 11:53:09 ERROR : : error listing: error listing "": failed to readDir: HTTP Error 403: 403 Forbidden
2019/08/12 11:53:09 Failed to ls with 2 errors: last error was: error listing "": failed to readDir: HTTP Error 403: 403 Forbidden

Advice of any form is welcome.
.

.

PS: This is just for Educational purpuses (no harm intended)

ncw · August 12, 2019, 10:42am

I just tried to replicate that and it worked!

$ rclone ls :http: --http-url https://srv05.erai-ddl.info/2019/Summer/Vinland%20Saga/ --use-cookies
885211004 [Erai-raws] Vinland Saga - 01 [1080p][Multiple Subtitle].mkv
407999528 [Erai-raws] Vinland Saga - 01 [720p][Multiple Subtitle].mkv
...

If you can get it to go wrong again can you can you try adding -vv --dump bodies and post that?

DarKSkuLL · August 12, 2019, 10:57am

This is using --dump bodies

2019/08/12 16:25:47 DEBUG : rclone: Version "v1.48.0-157-ga1263e70-beta" starting with parameters ["rclone" "ls" ":http:" "--http-url" "https://srv05.erai-ddl.info/2019/Summer/Vinland%20Saga/" "--use-cookies" "-vv" "--dump" "bodies"]
2019/08/12 16:25:47 DEBUG : Using config file from "C:\\Users\\nishk\\Documents\\DarKSkuLL\\rclone\\rclone.conf"
2019/08/12 16:25:47 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2019/08/12 16:25:47 DEBUG : HTTP REQUEST (req 0xc000099f00)
2019/08/12 16:25:47 DEBUG : GET /2019/Summer/Vinland%20Saga/ HTTP/1.1
Host: srv05.erai-ddl.info
User-Agent: rclone/v1.48.0-157-ga1263e70-beta
Accept-Encoding: gzip

2019/08/12 16:25:47 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2019/08/12 16:26:10 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2019/08/12 16:26:10 DEBUG : HTTP RESPONSE (req 0xc000099f00)
2019/08/12 16:26:10 DEBUG : Error: EOF
2019/08/12 16:26:10 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2019/08/12 16:26:10 ERROR : : error listing: error listing "": failed to readDir: Get https://srv05.erai-ddl.info/2019/Summer/Vinland%20Saga/: EOF
2019/08/12 16:26:10 Failed to ls with 2 errors: last error was: error listing "": failed to readDir: Get https://srv05.erai-ddl.info/2019/Summer/Vinland%20Saga/: EOF

DarKSkuLL · August 12, 2019, 10:58am

using --dump-bodies i get:

2019/08/12 16:25:22 NOTICE: --dump-bodies is obsolete - please use --dump bodies instead
2019/08/12 16:25:22 DEBUG : rclone: Version "v1.48.0-157-ga1263e70-beta" starting with parameters ["rclone" "ls" ":http:" "--http-url" "https://srv05.erai-ddl.info/2019/Summer/Vinland%20Saga/" "--use-cookies" "-vv" "--dump-bodies"]
2019/08/12 16:25:22 DEBUG : Using config file from "C:\\Users\\nishk\\Documents\\DarKSkuLL\\rclone\\rclone.conf"
2019/08/12 16:25:22 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2019/08/12 16:25:22 DEBUG : HTTP REQUEST (req 0xc000344300)
2019/08/12 16:25:22 DEBUG : GET /2019/Summer/Vinland%20Saga/ HTTP/1.1
Host: srv05.erai-ddl.info
User-Agent: rclone/v1.48.0-157-ga1263e70-beta
Accept-Encoding: gzip

2019/08/12 16:25:22 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2019/08/12 16:25:25 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2019/08/12 16:25:25 DEBUG : HTTP RESPONSE (req 0xc000344300)
2019/08/12 16:25:25 DEBUG : HTTP/1.1 403 Forbidden
Transfer-Encoding: chunked
Cache-Control: no-cache, no-store, must-revalidate
Connection: keep-alive
Content-Type: text/html; charset=UTF-8
Date: Mon, 12 Aug 2019 10:55:36 GMT
Keep-Alive: timeout=60
Server: ngjit
Vary: Accept-Encoding

255a
<!DOCTYPE html><html><head><title>DDOS-GUARD</title><meta charset="utf-8"/><meta name="viewport" content="width=device-width,initial-scale=1"><script>var ajax=function(t,e){try{var n="XMLHttpRequest",a=window,o=a[n]?new a[n]:new ActiveXObject("MSXML2.XMLHTTP.3.0");o.open("GET",t,!0),o.withCredentials=!0,o.onreadystatechange=function(){o.readyState>3&&200===o.status&&e&&e(o.responseText,o)},o.send()}catch(t){window.console&&console.log(t)}},base64_encode=function(t){if("function"==typeof btoa)return btoa(t);var e,n,a="ABCDEFGHIJKLMNOPQRSTUVWXYZabcdefghijklmnopqrstuvwxyz0123456789+/",o=function(t,e){var n=t.charCodeAt(e);return n>255?" ".charCodeAt(0):n},c=[],r=(t=""+t).length-t.length%3;if(0===t.length)return t;for(e=0;e<r;e+=3)n=o(t,e)<<16|o(t,e+1)<<8|o(t,e+2),c.push(a.charAt(n>>18)),c.push(a.charAt(n>>12&63)),c.push(a.charAt(n>>6&63)),c.push(a.charAt(63&n));switch(t.length-r){case 1:n=o(t,e)<<16,c.push(a.charAt(n>>18)+a.charAt(n>>12&63)+"==");break;case 2:n=o(t,e)<<16|o(t,e+1)<<8,c.push(a.charAt(n>>18)+a.charAt(n>>12&63)+a.charAt(n>>6&63)+"=")}return c.join("")},DOMReady=function(t){var e=document,n="addEventListener";e[n]?e[n]("DOMContentLoaded",t):window.attachEvent("onload",t)},submit=function(){var t=document.getElementById("frm"),e=window.location;t.h.value=base64_encode(e.protocol+"//"+e.hostname),t.u.value=base64_encode(e.pathname+e.search+e.hash),t.p.value=base64_encode(e.port),t.submit()};DOMReady(function(){ajax(window.location.protocol+"//ddgu.ddos-guard.net/c",function(t){parseInt(t)&&window.setTimeout(submit,500)})}),window.setTimeout(function(){submit()},5e3)</script><style>*{margin:0;padding:0}body,html{font:400 16px clear-sans,sans-serif;height:100%;background:linear-gradient(to top,#e5f3fb,#fff)}.logo{width:120px;margin-bottom:35px}#title{font-size:32px;font-weight:900;margin-bottom:40px}#description{color:#8f9390;margin-bottom:30px}#link-ddg{white-space:nowrap;margin-bottom:30px;font-size:18px}#link-ddg a:focus:active:hover:visited{color:#00adee}#link-ddg a:active{color:#00adee}#link-ddg a:hover{color:#00adee}#link-ddg a:visited{color:#00adee}.container{display:flex;flex-direction:column;justify-content:center;align-items:center;height:100%;text-align:center;background:url(data:image/svg+xml;base64,PHN2ZyBpZD0i0KHQu9C+0LlfMSIgZGF0YS1uYW1lPSLQodC70L7QuSAxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciIHZpZXdCb3g9IjAgMCAxNjYuNzUgNDcuOTciPjxkZWZzPjxzdHlsZT4uY2xzLTF7ZmlsbDojZmZmO308L3N0eWxlPjwvZGVmcz48dGl0bGU+0JzQvtC90YLQsNC20L3QsNGPINC+0LHQu9Cw0YHRgtGMIDE8L3RpdGxlPjxwYXRoIGNsYXNzPSJjbHMtMSIgZD0iTTEzNS41NSwzOS44MmMtLjM4LDAtLjc1LDAtMS4xMywwYTE4LjkxLDE4LjkxLDAsMCwwLTM1LjMzLTQuNTNBMjUuMjYsMjUuMjYsMCwwLDAsNzcuMjEsMjIuN2MtLjgyLDAtMS42MywwLTIuNDMuMTJBMjkuMjYsMjkuMjYsMCwwLDAsMTcsMjkuMjZhMjkuNTksMjkuNTksMCwwLDAsLjE2LDNBMTguNTIsMTguNTIsMCwwLDAsMCw0OEgxNTAuNDNBMTcuNjQsMTcuNjQsMCwwLDAsMTM1LjU1LDM5LjgyWiIvPjxwYXRoIGNsYXNzPSJjbHMtMSIgZD0iTTE1OS40OSw0NS40NUE5LjU4LDkuNTgsMCwwLDAsMTUzLDQ4aDEzQTkuNTgsOS41OCwwLDAsMCwxNTkuNDksNDUuNDVaIi8+PC9zdmc+) center bottom no-repeat}.lds-spin{width:80px;height:80px}@media screen and (max-width:1200px){.logo{width:100px}#title{font-size:29px}#link-ddg{font-size:15px}#link-ddg{font-size:20px}}@media screen and (max-width:770px){.logo{width:70px;margin-bottom:10px}#title{font-size:15px;margin-bottom:10px}#description{margin-bottom:10px;font-size:13px}#link-ddg{margin-bottom:10px;font-size:13px}.lds-spin{width:40px;height:40px}#link-ddg{font-size:18px}}</style></head><body><form id="frm" action="//ddgu.ddos-guard.net/ddgu/" method="POST" style="display:none"><img src="//ddgu.ddos-guard.net/g" style="display:none"><input type="hidden" name="u"/><input type="hidden" name="h"/><input type="hidden" name="p"/></form><div class="container"><div class="logo"><svg id="dl" xmlns="http://www.w3.org/2000/svg" viewBox="0 0 6.62 7.69"><defs><style>.cls-1{isolation:isolate}.cls-2{fill:#00adee}.cls-3{fill:#fff}</style></defs><title>ddos_3</title><g id="_2560" data-name="2560" class="cls-1"><g id="G2" data-name="Gr2"><path class="cls-2" d="M3.3,0A6,6,0,0,1,0,1.91C.13,4.46,1.6,7.49,3.3,7.65,5,7.49,6.47,4.46,6.6,1.91A6,6,0,0,1,3.3,0Z"/><polygon class="cls-3" points="4.55 4.73 4.55 2.74 3.29 1.79 2.03 2.71 2.03 2.91 3.25 2.2 3.25 2.59 2.03 3.16 2.03 3.4 3.25 2.95 3.25 3.26 2.03 3.66 2.03 3.91 3.25 3.66 3.25 4.01 2.03 4.18 2.03 4.43 3.25 4.36 3.25 4.73 1.89 4.73 1.89 5.09 4.71 5.09 4.71 4.73 4.55 4.73"/></g></g></svg></div><div id="title"></div><div id="description"></div><div id="link-ddg"><a href="https://ddos-guard.net" target="_blank" id="link"></a></div><div class="lds"><svg class="lds-spin" width="100px" height="100px" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" viewBox="0 0 100 100" preserveAspectRatio="xMidYMid" style="background:0 0"><g transform="translate(80,50)"><g transform="rotate(0)"><circle cx="0" cy="0" r="10" fill="#00adee" fill-opacity="1" transform="scale(0.7525 0.7525)"><animateTransform attributeName="transform" type="scale" begin="-0.875s" values="0.7 0.7;1 1" keyTimes="0;1" dur="1s" repeatCount="indefinite"></animateTransform><animate attributeName="fill-opacity" keyTimes="0;1" dur="1s" repeatCount="indefinite" values="1;0" begin="-0.875s"></animate></circle></g></g><g transform="translate(71.21320343559643,71.21320343559643)"><g transform="rotate(45)"><circle cx="0" cy="0" r="10" fill="#00adee" fill-opacity="0.875" transform="scale(0.715 0.715)"><animateTransform attributeName="transform" type="scale" begin="-0.75s" values="0.7 0.7;1 1" keyTimes="0;1" dur="1s" repeatCount="indefinite"></animateTransform><animate attributeName="fill-opacity" keyTimes="0;1" dur="1s" repeatCount="indefinite" values="1;0" begin="-0.75s"></animate></circle></g></g><g transform="translate(50,80)"><g transform="rotate(90)"><circle cx="0" cy="0" r="10" fill="#00adee" fill-opacity="0.75" transform="scale(0.9775 0.9775)"><animateTransform attributeName="transform" type="scale" begin="-0.625s" values="0.7 0.7;1 1" keyTimes="0;1" dur="1s" repeatCount="indefinite"></animateTransform><animate attributeName="fill-opacity" keyTimes="0;1" dur="1s" repeatCount="indefinite" values="1;0" begin="-0.625s"></animate></circle></g></g><g transform="translate(28.786796564403577,71.21320343559643)"><g transform="rotate(135)"><circle cx="0" cy="0" r="10" fill="#00adee" fill-opacity="0.625" transform="scale(0.94 0.94)"><animateTransform attributeName="transform" type="scale" begin="-0.5s" values="0.7 0.7;1 1" keyTimes="0;1" dur="1s" repeatCount="indefinite"></animateTransform><animate attributeName="fill-opacity" keyTimes="0;1" dur="1s" repeatCount="indefinite" values="1;0" begin="-0.5s"></animate></circle></g></g><g transform="translate(20,50.00000000000001)"><g transform="rotate(180)"><circle cx="0" cy="0" r="10" fill="#00adee" fill-opacity="0.5" transform="scale(0.9025 0.9025)"><animateTransform attributeName="transform" type="scale" begin="-0.375s" values="0.7 0.7;1 1" keyTimes="0;1" dur="1s" repeatCount="indefinite"></animateTransform><animate attributeName="fill-opacity" keyTimes="0;1" dur="1s" repeatCount="indefinite" values="1;0" begin="-0.375s"></animate></circle></g></g><g transform="translate(28.78679656440357,28.786796564403577)"><g transform="rotate(225)"><circle cx="0" cy="0" r="10" fill="#00adee" fill-opacity="0.375" transform="scale(0.865 0.865)"><animateTransform attributeName="transform" type="scale" begin="-0.25s" values="0.7 0.7;1 1" keyTimes="0;1" dur="1s" repeatCount="indefinite"></animateTransform><animate attributeName="fill-opacity" keyTimes="0;1" dur="1s" repeatCount="indefinite" values="1;0" begin="-0.25s"></animate></circle></g></g><g transform="translate(49.99999999999999,20)"><g transform="rotate(270)"><circle cx="0" cy="0" r="10" fill="#00adee" fill-opacity="0.25" transform="scale(0.8275 0.8275)"><animateTransform attributeName="transform" type="scale" begin="-0.125s" values="0.7 0.7;1 1" keyTimes="0;1" dur="1s" repeatCount="indefinite"></animateTransform><animate attributeName="fill-opacity" keyTimes="0;1" dur="1s" repeatCount="indefinite" values="1;0" begin="-0.125s"></animate></circle></g></g><g transform="translate(71.21320343559643,28.78679656440357)"><g transform="rotate(315)"><circle cx="0" cy="0" r="10" fill="#00adee" fill-opacity="0.125" transform="scale(0.79 0.79)"><animateTransform attributeName="transform" type="scale" begin="0s" values="0.7 0.7;1 1" keyTimes="0;1" dur="1s" repeatCount="indefinite"></animateTransform><animate attributeName="fill-opacity" keyTimes="0;1" dur="1s" repeatCount="indefinite" values="1;0" begin="0s"></animate></circle></g></g></svg></div></div><script type="text/javascript">var lang=navigator.language,host=window.location.hostname;"ru"==lang||"ru-RU"==lang?(document.getElementById("title").innerHTML="Проверка браузера перед переходом на сайт "+host,document.getElementById("description").innerHTML="Это автоматический процесс. Вы будете перенаправлены на запрашиваемый ресурс в ближайшее время.<br>Пожалуйста ожидайте...",document.getElementById("link").innerHTML="Защита от DDoS-атак DDoS-GUARD"):(document.getElementById("title").innerHTML="Checking your browser accessing "+host,document.getElementById("description").innerHTML="This process is automatic. You browser will redirect to your requested content shortly.<br>Please allow up to 5 seconds...",document.getElementById("link").innerHTML="DDoS protection by DDoS-GUARD")</script></body></html>
0

2019/08/12 16:25:25 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2019/08/12 16:25:25 ERROR : : error listing: error listing "": failed to readDir: HTTP Error 403: 403 Forbidden
2019/08/12 16:25:25 Failed to ls with 2 errors: last error was: error listing "": failed to readDir: HTTP Error 403: 403 Forbidden

`

ncw · August 12, 2019, 11:07am

That sent back a 403 Forbidden which rclone will take as an error.

The cookie setting bit is all in javascript so I'm afraid we are out of luck.

--set-cookie works with cookies set in the normal way with browser headers.

If you could work out what cookie we needed then we could probably set it...

DarKSkuLL · August 12, 2019, 11:08am

Is there such a flag?

Yes we could just use the cookie from chrome right?
This one:

Why was 403 sent to me not to you?

ncw · August 12, 2019, 11:14am

Sorry, I meant --use-cookies

There isn't a --set-cookie flag yet, but it might be useful

I would guess your usage has been detected as anomalous and they've sent you a challenge. Try from a different IP?

DarKSkuLL · August 12, 2019, 11:31am

DarKSkuLL:

This is using --dump bodies
2019/08/12 16:25:47 DEBUG : rclone: Version "v1.48.0-157-ga1263e70-beta" starting with parameters ["rclone" "ls" ":http:" "--http-url" "https://srv05.erai-ddl.info/2019/Summer/Vinland%20Saga/" "--use-cookies" "-vv" "--dump" "bodies"]
2019/08/12 16:25:47 DEBUG : Using config file from "C:\Users\nishk\Documents\DarKSkuLL\rclone\rclone.conf"
2019/08/12 16:25:47 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>

This I tried using mobile data,
Different network all together.

Tried this with another:

19CS91R08@cpusrv-xeon-66:~$ rclone ls :http: --http-url https://srv05.erai-ddl.info/2019/Summer/Vinland%20Saga/ --use-cookies -vv --dump bodies
2019/08/12 17:04:31 DEBUG : rclone: Version "v1.48.0-157-ga1263e70-beta" starting with parameters ["rclone" "ls" ":http:" "--http-url" "https://srv05.erai-ddl.info/2019/Summer/Vinland%20Saga/" "--use-cookies" "-vv" "--dump" "bodies"]
2019/08/12 17:04:31 DEBUG : Using config file from "/home/rs/19CS91R08/.local/bin/rclone.conf"
2019/08/12 17:04:31 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2019/08/12 17:04:31 DEBUG : HTTP REQUEST (req 0xc00055eb00)
2019/08/12 17:04:31 DEBUG : GET /2019/Summer/Vinland%20Saga/ HTTP/1.1
Host: srv05.erai-ddl.info
User-Agent: rclone/v1.48.0-157-ga1263e70-beta
Accept-Encoding: gzip

2019/08/12 17:04:31 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2019/08/12 17:04:33 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2019/08/12 17:04:33 DEBUG : HTTP RESPONSE (req 0xc00055eb00)
2019/08/12 17:04:33 DEBUG : HTTP/1.1 403 Forbidden
Transfer-Encoding: chunked
Cache-Control: no-cache, no-store, must-revalidate
Connection: keep-alive
Content-Type: text/html; charset=UTF-8
Date: Mon, 12 Aug 2019 11:30:07 GMT
Keep-Alive: timeout=60
Server: ngjit
Vary: Accept-Encoding

255a
<!DOCTYPE html><html><head><title>DDOS-GUARD</title><meta charset="utf-8"/><meta name="viewport" content="width=device-width,initial-scale=1"><script>var ajax=function(t,e){try{var n="XMLHttpRequest",a=window,o=a[n]?new a[n]:new ActiveXObject("MSXML2.XMLHTTP.3.0");o.open("GET",t,!0),o.withCredentials=!0,o.onreadystatechange=function(){o.readyState>3&&200===o.status&&e&&e(o.responseText,o)},o.send()}catch(t){window.console&&console.log(t)}},base64_encode=function(t){if("function"==typeof btoa)return btoa(t);var e,n,a="ABCDEFGHIJKLMNOPQRSTUVWXYZabcdefghijklmnopqrstuvwxyz0123456789+/",o=function(t,e){var n=t.charCodeAt(e);return n>255?" ".charCodeAt(0):n},c=[],r=(t=""+t).length-t.length%3;if(0===t.length)return t;for(e=0;e<r;e+=3)n=o(t,e)<<16|o(t,e+1)<<8|o(t,e+2),c.push(a.charAt(n>>18)),c.push(a.charAt(n>>12&63)),c.push(a.charAt(n>>6&63)),c.push(a.charAt(63&n));switch(t.length-r){case 1:n=o(t,e)<<16,c.push(a.charAt(n>>18)+a.charAt(n>>12&63)+"==");break;case 2:n=o(t,e)<<16|o(t,e+1)<<8,c.push(a.charAt(n>>18)+a.charAt(n>>12&63)+a.charAt(n>>6&63)+"=")}return c.join("")},DOMReady=function(t){var e=document,n="addEventListener";e[n]?e[n]("DOMContentLoaded",t):window.attachEvent("onload",t)},submit=function(){var t=document.getElementById("frm"),e=window.location;t.h.value=base64_encode(e.protocol+"//"+e.hostname),t.u.value=base64_encode(e.pathname+e.search+e.hash),t.p.value=base64_encode(e.port),t.submit()};DOMReady(function(){ajax(window.location.protocol+"//ddgu.ddos-guard.net/c",function(t){parseInt(t)&&window.setTimeout(submit,500)})}),window.setTimeout(function(){submit()},5e3)</script><style>*{margin:0;padding:0}body,html{font:400 16px clear-sans,sans-serif;height:100%;background:linear-gradient(to top,#e5f3fb,#fff)}.logo{width:120px;margin-bottom:35px}#title{font-size:32px;font-weight:900;margin-bottom:40px}#description{color:#8f9390;margin-bottom:30px}#link-ddg{white-space:nowrap;margin-bottom:30px;font-size:18px}#link-ddg a:focus:active:hover:visited{color:#00adee}#link-ddg a:active{color:#00adee}#link-ddg a:hover{color:#00adee}#link-ddg a:visited{color:#00adee}.container{display:flex;flex-direction:column;justify-content:center;align-items:center;height:100%;text-align:center;background:url(data:image/svg+xml;base64,PHN2ZyBpZD0i0KHQu9C+0LlfMSIgZGF0YS1uYW1lPSLQodC70L7QuSAxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciIHZpZXdCb3g9IjAgMCAxNjYuNzUgNDcuOTciPjxkZWZzPjxzdHlsZT4uY2xzLTF7ZmlsbDojZmZmO308L3N0eWxlPjwvZGVmcz48dGl0bGU+0JzQvtC90YLQsNC20L3QsNGPINC+0LHQu9Cw0YHRgtGMIDE8L3RpdGxlPjxwYXRoIGNsYXNzPSJjbHMtMSIgZD0iTTEzNS41NSwzOS44MmMtLjM4LDAtLjc1LDAtMS4xMywwYTE4LjkxLDE4LjkxLDAsMCwwLTM1LjMzLTQuNTNBMjUuMjYsMjUuMjYsMCwwLDAsNzcuMjEsMjIuN2MtLjgyLDAtMS42MywwLTIuNDMuMTJBMjkuMjYsMjkuMjYsMCwwLDAsMTcsMjkuMjZhMjkuNTksMjkuNTksMCwwLDAsLjE2LDNBMTguNTIsMTguNTIsMCwwLDAsMCw0OEgxNTAuNDNBMTcuNjQsMTcuNjQsMCwwLDAsMTM1LjU1LDM5LjgyWiIvPjxwYXRoIGNsYXNzPSJjbHMtMSIgZD0iTTE1OS40OSw0NS40NUE5LjU4LDkuNTgsMCwwLDAsMTUzLDQ4aDEzQTkuNTgsOS41OCwwLDAsMCwxNTkuNDksNDUuNDVaIi8+PC9zdmc+) center bottom no-repeat}.lds-spin{width:80px;height:80px}@media screen and (max-width:1200px){.logo{width:100px}#title{font-size:29px}#link-ddg{font-size:15px}#link-ddg{font-size:20px}}@media screen and (max-width:770px){.logo{width:70px;margin-bottom:10px}#title{font-size:15px;margin-bottom:10px}#description{margin-bottom:10px;font-size:13px}#link-ddg{margin-bottom:10px;font-size:13px}.lds-spin{width:40px;height:40px}#link-ddg{font-size:18px}}</style></head><body><form id="frm" action="//ddgu.ddos-guard.net/ddgu/" method="POST" style="display:none"><img src="//ddgu.ddos-guard.net/g" style="display:none"><input type="hidden" name="u"/><input type="hidden" name="h"/><input type="hidden" name="p"/></form><div class="container"><div class="logo"><svg id="dl" xmlns="http://www.w3.org/2000/svg" viewBox="0 0 6.62 7.69"><defs><style>.cls-1{isolation:isolate}.cls-2{fill:#00adee}.cls-3{fill:#fff}</style></defs><title>ddos_3</title><g id="_2560" data-name="2560" class="cls-1"><g id="G2" data-name="Gr2"><path class="cls-2" d="M3.3,0A6,6,0,0,1,0,1.91C.13,4.46,1.6,7.49,3.3,7.65,5,7.49,6.47,4.46,6.6,1.91A6,6,0,0,1,3.3,0Z"/><polygon class="cls-3" points="4.55 4.73 4.55 2.74 3.29 1.79 2.03 2.71 2.03 2.91 3.25 2.2 3.25 2.59 2.03 3.16 2.03 3.4 3.25 2.95 3.25 3.26 2.03 3.66 2.03 3.91 3.25 3.66 3.25 4.01 2.03 4.18 2.03 4.43 3.25 4.36 3.25 4.73 1.89 4.73 1.89 5.09 4.71 5.09 4.71 4.73 4.55 4.73"/></g></g></svg></div><div id="title"></div><div id="description"></div><div id="link-ddg"><a href="https://ddos-guard.net" target="_blank" id="link"></a></div><div class="lds"><svg class="lds-spin" width="100px" height="100px" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" viewBox="0 0 100 100" preserveAspectRatio="xMidYMid" style="background:0 0"><g transform="translate(80,50)"><g transform="rotate(0)"><circle cx="0" cy="0" r="10" fill="#00adee" fill-opacity="1" transform="scale(0.7525 0.7525)"><animateTransform attributeName="transform" type="scale" begin="-0.875s" values="0.7 0.7;1 1" keyTimes="0;1" dur="1s" repeatCount="indefinite"></animateTransform><animate attributeName="fill-opacity" keyTimes="0;1" dur="1s" repeatCount="indefinite" values="1;0" begin="-0.875s"></animate></circle></g></g><g transform="translate(71.21320343559643,71.21320343559643)"><g transform="rotate(45)"><circle cx="0" cy="0" r="10" fill="#00adee" fill-opacity="0.875" transform="scale(0.715 0.715)"><animateTransform attributeName="transform" type="scale" begin="-0.75s" values="0.7 0.7;1 1" keyTimes="0;1" dur="1s" repeatCount="indefinite"></animateTransform><animate attributeName="fill-opacity" keyTimes="0;1" dur="1s" repeatCount="indefinite" values="1;0" begin="-0.75s"></animate></circle></g></g><g transform="translate(50,80)"><g transform="rotate(90)"><circle cx="0" cy="0" r="10" fill="#00adee" fill-opacity="0.75" transform="scale(0.9775 0.9775)"><animateTransform attributeName="transform" type="scale" begin="-0.625s" values="0.7 0.7;1 1" keyTimes="0;1" dur="1s" repeatCount="indefinite"></animateTransform><animate attributeName="fill-opacity" keyTimes="0;1" dur="1s" repeatCount="indefinite" values="1;0" begin="-0.625s"></animate></circle></g></g><g transform="translate(28.786796564403577,71.21320343559643)"><g transform="rotate(135)"><circle cx="0" cy="0" r="10" fill="#00adee" fill-opacity="0.625" transform="scale(0.94 0.94)"><animateTransform attributeName="transform" type="scale" begin="-0.5s" values="0.7 0.7;1 1" keyTimes="0;1" dur="1s" repeatCount="indefinite"></animateTransform><animate attributeName="fill-opacity" keyTimes="0;1" dur="1s" repeatCount="indefinite" values="1;0" begin="-0.5s"></animate></circle></g></g><g transform="translate(20,50.00000000000001)"><g transform="rotate(180)"><circle cx="0" cy="0" r="10" fill="#00adee" fill-opacity="0.5" transform="scale(0.9025 0.9025)"><animateTransform attributeName="transform" type="scale" begin="-0.375s" values="0.7 0.7;1 1" keyTimes="0;1" dur="1s" repeatCount="indefinite"></animateTransform><animate attributeName="fill-opacity" keyTimes="0;1" dur="1s" repeatCount="indefinite" values="1;0" begin="-0.375s"></animate></circle></g></g><g transform="translate(28.78679656440357,28.786796564403577)"><g transform="rotate(225)"><circle cx="0" cy="0" r="10" fill="#00adee" fill-opacity="0.375" transform="scale(0.865 0.865)"><animateTransform attributeName="transform" type="scale" begin="-0.25s" values="0.7 0.7;1 1" keyTimes="0;1" dur="1s" repeatCount="indefinite"></animateTransform><animate attributeName="fill-opacity" keyTimes="0;1" dur="1s" repeatCount="indefinite" values="1;0" begin="-0.25s"></animate></circle></g></g><g transform="translate(49.99999999999999,20)"><g transform="rotate(270)"><circle cx="0" cy="0" r="10" fill="#00adee" fill-opacity="0.25" transform="scale(0.8275 0.8275)"><animateTransform attributeName="transform" type="scale" begin="-0.125s" values="0.7 0.7;1 1" keyTimes="0;1" dur="1s" repeatCount="indefinite"></animateTransform><animate attributeName="fill-opacity" keyTimes="0;1" dur="1s" repeatCount="indefinite" values="1;0" begin="-0.125s"></animate></circle></g></g><g transform="translate(71.21320343559643,28.78679656440357)"><g transform="rotate(315)"><circle cx="0" cy="0" r="10" fill="#00adee" fill-opacity="0.125" transform="scale(0.79 0.79)"><animateTransform attributeName="transform" type="scale" begin="0s" values="0.7 0.7;1 1" keyTimes="0;1" dur="1s" repeatCount="indefinite"></animateTransform><animate attributeName="fill-opacity" keyTimes="0;1" dur="1s" repeatCount="indefinite" values="1;0" begin="0s"></animate></circle></g></g></svg></div></div><script type="text/javascript">var lang=navigator.language,host=window.location.hostname;"ru"==lang||"ru-RU"==lang?(document.getElementById("title").innerHTML="Проверка браузера перед переходом на сайт "+host,document.getElementById("description").innerHTML="Это автоматический процесс. Вы будете перенаправлены на запрашиваемый ресурс в ближайшее время.<br>Пожалуйста ожидайте...",document.getElementById("link").innerHTML="Защита от DDoS-атак DDoS-GUARD"):(document.getElementById("title").innerHTML="Checking your browser accessing "+host,document.getElementById("description").innerHTML="This process is automatic. You browser will redirect to your requested content shortly.<br>Please allow up to 5 seconds...",document.getElementById("link").innerHTML="DDoS protection by DDoS-GUARD")</script></body></html>
0

2019/08/12 17:04:33 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2019/08/12 17:04:33 ERROR : : error listing: error listing "": failed to readDir: HTTP Error 403: 403 Forbidden
2019/08/12 17:04:33 Failed to ls with 2 errors: last error was: error listing "": failed to readDir: HTTP Error 403: 403 Forbidden

TL;DR:
Same error...

ncw · August 12, 2019, 2:32pm

OK, try this

https://beta.rclone.org/branch/v1.48.0-158-g1399e947-fix-http-headers-beta/ (uploaded in 15-30 mins)

This has a new flag --http-headers

--http-headers

Set HTTP headers for all transactions

Use this to set additional HTTP headers for all transactions

The input format is comma separated list of key,value pairs. Standard
CSV encoding may be used.

For example to set a Cookie use 'Cookie,name=value', or '"Cookie","name=value"'.

You can set multiple headers, eg '"Cookie","name=value","Authorization","xxx"'.

Config: headers
Env Var: RCLONE_HTTP_HEADERS
Type: CommaSepList
Default:

DarKSkuLL · August 12, 2019, 3:26pm

Wow it really worked.

E:\Downloads\Compressed\rclone-v1.48.0-158-g1399e947-fix-http-headers-beta-windows-amd64\rclone-v1.48.0-158-g1399e947-fix-http-headers-beta-windows-amd64>rclone ls :http: --http-url https://srv05.erai-ddl.info/2019/Summer/Vinland%20Saga/ --use-cookies -vv --http-headers "Cookie","__ddgu=4c4f598570b65a766d2ab5ab328decc2.1720287952"
2019/08/12 20:54:26 DEBUG : rclone: Version "v1.48.0-158-g1399e947-fix-http-headers-beta" starting with parameters ["rclone" "ls" ":http:" "--http-url" "https://srv05.erai-ddl.info/2019/Summer/Vinland%20Saga/" "--use-cookies" "-vv" "--http-headers" "Cookie,__ddgu=4c4f598570b65a766d2ab5ab328decc2.1720287952"]
2019/08/12 20:54:26 NOTICE: Config file "C:\\Users\\nishk\\.config\\rclone\\rclone.conf" not found - using defaults
885211004 [Erai-raws] Vinland Saga - 01 [1080p][Multiple Subtitle].mkv
407999528 [Erai-raws] Vinland Saga - 01 [720p][Multiple Subtitle].mkv
....
2019/08/12 20:54:43 DEBUG : 5 go routines active
2019/08/12 20:54:43 DEBUG : rclone: Version "v1.48.0-158-g1399e947-fix-http-headers-beta" finishing with parameters ["rclone" "ls" ":http:" "--http-url" "https://srv05.erai-ddl.info/2019/Summer/Vinland%20Saga/" "--use-cookies" "-vv" "--http-headers" "Cookie,__ddgu=4c4f598570b65a766d2ab5ab328decc2.1720287952"]

You are truly amazing.
Hats off to you.

ncw · August 12, 2019, 5:05pm

Great!

I've merged this to master now which means it will be in the latest beta in 15-30 mins and released in v1.49

system · August 15, 2019, 5:05pm

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.