Recommendations for ACD->GSuite/Other transfers


#12

are you sure? without any encryption google knows exactly what you upload to them. therefore i recommend encfs.
if you do not need any encryption at all, its fine too.

how are you planning on moving to gdrive?


#13

As a new user, one gets $300 in credit and my instance is estimated at $50 a month so don’t expect it to cost me anything (I’ll shut the instance down and delete once the transfer is done).


#14

how are you planning on doing the transfer?


#15

Can you comment on how/why encfs is better than rclone’s crypt?


#16

since unlimited is not always quite unlimited, i like to be independent of rclone’s crypt. I am still using rclone to upload the data though.

In my opinion it is just a matter of time i have to switch to another unlimited cloud again. e.g. google bans “unlimited”.

using encfs allows me to switch to any cloud I please, without having rclone to support it (yeah i know i could mount it locally via rclone, but where is the point).

Also rclone with 8 simultaneous transfer seems to hog quite some CPU resources, which encfs seems to handle them with way less resources.

rclone crypt is quite under construction, see issues/discussion on github. until this is finalized i feel safer using AES 256.

Why now? Since I have to migrate now, I may also change to crypto on the way. :slight_smile:


#17

Can you describe how you approached this without duplicating data on GCE?

Only thing comes to mind is making an rclone mount for GDrive that backs encfs and then rclone sync from the local crypted copy?


Rclone has been banned from Amazon Drive
#18

change encryption during ACD to GDRIVE transfer

  1. download all rclone-encrypted data to GCE hdd.
  2. create new remote encrypt/decrypt and set “remote:” to the path of your odrive download directory. use the same password/settings as for acd crypt. name it DECRYPT
  3. use rclone mount to mount it via:

rclone mount DECRYPT: /mnt/decrypted

/mnt/decrypted now shows the plain data!
4. use enfs in reverse crypto mode to show data in encfs encrypted form:

encfs --reverse /mnt/decrypted /mnt/encrypted

/mnt/encrypted now shows the data encrypted via encfs
5. use rclone sync to sync encfs encrypted data to gdrive:

rclone sync /mnt/encrypted GDRIVE:

Once transfer is finished. Mount an destination without encryption remote via rclone. e.g. to /mnt/gdrive-encrypted.
Then use encfs to mount it plain:

encfs /mnt/gdrive-encrypted /mnt/gdrive

/mnt/gdrive now shows the plain data.


#19

Ah, that was the bit I was missing, thanks :slight_smile:


#20

When you Register at google Cloud computing He ask me for a company Name. Did you lie?


#21

I have a company. So…


#22

i can not start the agent

root@vpsxxx:~# nohup “$HOME/.odrive-agent/bin/odriveagent” > /dev/null 2>&1 &
[1] 1218

i try this

root@vpsxxx:~# nohup “$HOME/.odrive-agent/bin/odriveagent”
nohup: ignoring input and appending output to ‘nohup.out’
nohup: failed to run command ‘/root/.odrive-agent/bin/odriveagent’: No such file or directory
[1]+ Exit 127 nohup “$HOME/.odrive-agent/bin/odriveagent” > /dev/null 2>&1

is step 2 from the install guide on odrive


#23

Is this a 64bit vps? If so switch to the 64bit tab in the odrive command tab.
if that’s not it what is the content of your /root/.odrive-agent/bin directory?


#24

yeah i test this on my vps ubuntu 16.04 lts x64 and i try with the 64bit tab too. In this directory i have 3 files:

  • odrive
  • odrive.py
  • odriveagent

i have the same issues on the google compute!


#25

try chmod +x on the odriveagent file. if this does not help:

sudo apt-get install strace
strace -f -s 99 $HOME/.odrive-agent/bin/odriveagent
post the log to pastebin and the link here


#26

i split the log its to big

  1. https://pastebin.com/mUUwHucC
  2. https://pastebin.com/badYnwDi

another question which linux distri do you use on google compute???


#27

since you are using root try:

rm -rf /root/.odrive-agent
od="root/.odrive-agent/bin" && curl -L "http://dl.odrive.com/odrive-py" --create-dirs -o "$od/odrive.py" && curl -L "http://dl.odrive.com/odriveagent-lnx-64" | tar -xvzf- -C "$od/" && curl -L "http://dl.odrive.com/odrivecli-lnx-64" | tar -xvzf- -C "$od/"
/root/.odrive-agent/bin/odriveagent"

if this still does not work, please show the output of:
ls -lah /root/.odrive-agent

I use Debian 8 Jessie (i think it was default for my account)


#28

its not working

root@vpsxxx:~# nohup “$HOME/.odrive-agent/bin/odriveagent” > /dev/null 2>&1 &
[9] 2086
root@vpsxxx:~# nohup “root/.odrive-agent/bin/odriveagent” > /dev/null 2>&1 &
[10] 2087
[9] Exit 127 nohup “$HOME/.odrive-agent/bin/odriveagent” > /dev/null 2>&1
root@vpsxxx:~# ls -lah /root/.odrive-agent
total 20K
drwxr-xr-x 4 root root 4.0K May 19 15:10 .
drwx------ 9 root root 4.0K May 19 15:10 …
-rw-r–r-- 1 root root 74 May 19 15:10 .oreg
drwxr-xr-x 4 root root 4.0K May 19 15:10 db
drwxr-xr-x 2 root root 4.0K May 19 15:10 log


#29

do you have curl installed?

what does ‘curl’ return?


#30

withou curl the 1. step not work and curl is installed.

what does ‘curl’ return? i need the input commend from you

root@vpsxxx:~# apt-get install curl
Reading package lists… Done
Building dependency tree
Reading state information… Done
curl is already the newest version (7.47.0-1ubuntu2.2).
0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.
[11]+ Exit 127 nohup “/root/.odrive-agent/bin/odriveagent” > /dev/null 2>&1


#31

Re:

ACD BAN/Alternatives discussion (error HTTP code 429)

Responding to @alneven in this thread:

I’m seeing this every now and then when running that same command but I think because I’m running 4 streams in parallel, there is inevitably some clashing as one stream tries to download a .cloud file that has already been downloaded in another stream.
Once the first full run is finished, I’ll run the command again to see if it picks any of these up again.