I want to make sure 1.5+ TB of local photos are copied to Google Photos. I add new photos to various loical folders.
That means, everytime rclone does a copy it has to do a full list of the Google Photos remote.
I'm trying to find ways to speed this up by keeping a local list/cache of what was copied on the previous run?
That way, whenever I do a copy, rclone will compare against the local copy/list and then go straight to uploading new files.
I'm open to any suggestions.
             
            
              
            
           
          
            
              
                asdffdsa  
              
                  
                    September 6, 2023,  1:10pm
                   
                  2 
               
             
            
              to reduce the number of checks, might try something like--max-age=24h --no-traverse
             
            
              
            
           
          
            
            
              
That won't work well for me. Sometimes I add new files and their created/modfiied time is very old. Plus, I won't run rclone copy on a schedule. Sometimes it'll happen in a day, sometimes a week.
             
            
              
            
           
          
            
              
                asdffdsa  
              
                  
                    September 6, 2023,  8:52pm
                   
                  4 
               
             
            
              
 imthenachoman:
 
cache backend
 
 
that has been deprecated. bugs that will never get fixed.
https://forum.rclone.org/t/big-syncs-with-millions-of-files/40182 
src = output from previous rundst = output from current run 
             
            
              1 Like 
            
            
           
          
            
            
              
This is fantastic. Thank you!
             
            
              
            
           
          
            
              
                system  
              
                  
                    September 10, 2023,  2:36am
                   
                  6 
               
             
            
              This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.