How to create a log file that shows what data was purged

Help and Support
1

STOP and READ USE THIS TEMPLATE NO EXCEPTIONS - By not using this, you waste your time, our time and really hate puppies. Please remove these two lines and that will confirm you have read them.

What is the problem you are having with rclone?

I purge some information and then i click cancel , by the looks of it seems to me that all the infomation is there however i would like to generate a log to see what files were deleted and from which archive.

Run the command 'rclone version' and share the full output of the command.

rclone v1.65.0

  • os/version: ubuntu 20.04 (64 bit)

  • os/kernel: 5.4.0-166-generic (x86_64)

  • os/type: linux

  • os/arch: amd64

  • go/version: go1.21.4

  • go/linking: static

  • go/tags: none

Which cloud storage system are you using? (eg Google Drive)

idrive e2

The command you were trying to run (eg rclone copy /tmp remote:tmp)

Paste command here

Please run 'rclone config redacted' and share the full output. If you get command not found, please make sure to update rclone.

Paste config here

A log from the command that you were trying to run with the -vv flag

Paste  log here
2

not sure that is possible unless do already have the list of files that existed before you ran rclone purge

if the remote has trash folder, might be able to get the list from that.

not sure it appies here but might try rclone check --missing-on-dst

3

Hi asdffdsa,

good day,

I was meaning more on the part that rclone shows on a log what deletion was done on that specific path. what files or folders are deleted if any.

Thanks for your help :slight_smile:

regarding your command i could use it like rclone check --missing-on-dst idrive:/romsystem/ ?

Regards.

4

well, at the time, when you ran rclone purge, rclone would log the files that were deleted.
but now, after the fact, there is no log.

that will not work. as that command compares source and dest.

5

Thanks for the kind help :slight_smile:

6

if you ran the rclone command from the terminal, might look into its history.

on linux, tmux saves a history. in the past, i have been able to search that.

7

yeah i did it from the terminal actually , that is correct.

when for example you use purge to delete a bucket it usually starts with the first file on it? Or does it deleted in random order? do you happen to know

Regards

8

no, as i have never used rclone purge

maybe a bit of both, as rclone will delete the first file it is given, but rclone does not control what idrive considers the first file.
and can also depend on what rclone flags were used.

9

rclone purge detailed behaviour depends on the remote. In most cases it utilizes a remote API call to delete all tree from a given point. It does not list all content recursively deleting objects one by one - for that there is another specific command: rclone delete. This is why purge can be many times faster than delete - but it comes at the cost that it can not be granular - you can not use filters to exclude anything from it for example.

Good analogy for local filesystem is rm -rf dir vs. cd dir; rm *. If dir contains a lot of files the former command will be many time faster, but latter allows to delete only specific file e.g. rm *.jpg - at the cost of time taken for listing every single file

10

Hi Kapitainsky

Thanks for your clarification.

Im asking this because i hit rclone purge "some bucket" but it ran like 2 seconds and then i hit control c very fast and from what i notice its that it deleted some files from one archive out of the 5 archives that i have tthere with several information.

i think that the best bet here is either to donwload everything from that bucket once again or either to compare it from the the original source and see if everything its in there.

I also want to understand that any objects that are there that were not deleted are integral since im using a object based storage that is an idrive s3.

Regards.

11

Good thing is that there are no half deleted objects in S3.

If your objective is to restore original state then the best option is to sync it again from the source. You can run rclone check first to asses what has to be re-uploaded.

1 Like
12

Hi Kapitainsky

So i could at least have a breath of fresh air knowing that the bucket is good and the information still there is in good state since "no halft deleted objects in S3" as you stated so im safe there.

Ill sync it from the source for sure i appreciate the help on this. thanks to you and asdffdsa.

good holidays ahead.

THANKS.

1 Like
13

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.