--size-only not working properly with Google Photos

I'm trying to find flags for rclone to only get the first ten items or so, otherwise the command will take ages.

google photos' API is really limited.

Even if you add a flag it will still need to pul lthe info to sort it btw or exclude. You'd probably need to use the "media/by-day/2020/2020-01-01" tree to limit what it pulls to a day.

I'm running rclone lsjson "gphotos:media/by-day/2020/2020-06-11" --gphotos-read-size --log-file=/home/plex/lsjson.log. There should be less than 10 items but it's taking a bit long...

This is the output:

[
{"Path":"children playing with cat.mp4","Name":"children playing with cat.mp4","Size":-1,"MimeType":"video/mp4","ModTime":"2020-06-12T10:08:18Z","IsDir":false,"ID":"AD6dNpTDG0s8-bk_LzXQBYa78dsWQXfZ5LpaXOcm2fuqlhx-aCzPdhB8_0ka7ueJ84cvpiHJcjUiU_fGWt_U0aA"},
{"Path":"mom and dad visiting.mp4","Name":"mom and dad visiting.mp4","Size":-1,"MimeType":"video/mp4","ModTime":"2020-06-12T10:11:43Z","IsDir":false,"ID":"AD6dNpTvKDi_BAQctabCUkJDJ1lez3ZaecS25G67lAswXK3obf4bHsLpHCVZHISO8etRMmk8UWTCJ59TYma3UXYKBbw"},
{"Path":"running along the coast.mp4","Name":"running along the coast.mp4","Size":-1,"MimeType":"video/mp4","ModTime":"2020-06-12T09:10:14Z","IsDir":false,"ID":"AD6dNpT7DNEYbugNI-HDegSHiAAow3lt51te8JTd-29EAXAsrio92U39Lgz3QKCuvyB2ubPFTMApEEaJnKc9aIA"},
]

EDIT: Without the --gphotos-read-size flag it finishes very quickly, just 3 items but ofc, then size is -1. The one with --gphotos-read-size is still running...

EDIT 2: It finished! It looks like the results are good and showing a file size properly!

[
{"Path":"children playing with cat.mp4","Name":"children playing with cat.mp4","Size":1478779840,"MimeType":"video/mp4","ModTime":"2020-06-12T10:08:18Z","IsDir":false,"ID":"AD6dNpTDG0s8-bk_LzXQBYa78dsWQXfZ5LpaXOcm2fuqlhx-aCzPdhB8_0ka7ueJ84cvpiHJcjUiU_fGWt_U0aA"},
{"Path":"mom and dad visiting.mp4","Name":"mom and dad visiting.mp4","Size":147098926,"MimeType":"video/mp4","ModTime":"2020-06-12T10:11:43Z","IsDir":false,"ID":"AD6dNpTvKDi_BAQctabCUkJDJ1lez3ZaecS25G67lAswXK3obf4bHsLpHCVZHISO8etRMmk8UWTCJ59TYma3UXYKBbw"},
{"Path":"running along the coast.mp4","Name":"running along the coast.mp4","Size":216041572,"MimeType":"video/mp4","ModTime":"2020-06-12T09:10:14Z","IsDir":false,"ID":"AD6dNpT7DNEYbugNI-HDegSHiAAow3lt51te8JTd-29EAXAsrio92U39Lgz3QKCuvyB2ubPFTMApEEaJnKc9aIA"},
]

But then I do not understand why the copy does not detect file size changes... What a head ache... I'm starting to think to empty OneDrive completely and sync again :skull_and_crossbones:

Are you sure you don't have read sizes in your config? It really shouldn't be showing the sizes by default?

I would have thought the access patterns would be pretty similar... I think you just got lucky with the lsjson but maybe not

According to the docs: ls to list size and path of objects only. Is maybe the flag enabled by default when running ls?

Well, I removed around 800 files I was confident they were too small to be 1080p and copying again... But I still think there's something weird going on with Google Photos and --gphotos-read-size.

@ncw Im positive.

 xx@dell-rob:~/test$ rclone config show robgd-photos:
--------------------
[robgd-photos]
type = google photos
client_id = xx-xx.apps.googleusercontent.com
client_secret = xx
token = {"access_token":"xx.xx-xx-xx-xx-xx-vkA","token_type":"Bearer","refresh_token":"1//xx-xx-xx","expiry":"2020-06-12T20:34:48.737292928-04:00"}
--------------------
xx@dell-rob:~/test$ env | grep ^RCLONE
xx@dell-rob:~/test$ cd
xx@dell-rob:~$ rclone lsjson robgs-photos:media/by-day/2020/2020-01-02/ -v 
[
{"Path":"2019/12/DSC_2078.jpg","Name":"2019/12/DSC_2078.jpg","Size":67292,"MimeType":"image/jpeg","ModTime":"2020-01-02T22:44:08Z","IsDir":false,"ID":"AD5QJUKrNnv6JkrHAuBYgzZjkQ1j6m9kRO70q-9LnLUtkp15S_lW_kjWpR_tW5Hyb_jP1ZLM3F8ghIWqCn4tSUQwUScXr1kFYg"},
{"Path":"2019/12/DSC_2081.jpg","Name":"2019/12/DSC_2081.jpg","Size":113396,"MimeType":"image/jpeg","ModTime":"2020-01-02T22:44:09Z","IsDir":false,"ID":"AD5QJUJpsFWHiim54dTnfAz92NiHexftBzCeA_3dAvWRTJCQCd2hhUtjE3GfnLUFK678argTGp8rGFbGI1U9rf1AbuwSHIU8og"},
{"Path":"2019/12/DSC_2098.jpg","Name":"2019/12/DSC_2098.jpg","Size":84352,"MimeType":"image/jpeg","ModTime":"2020-01-02T22:44:11Z","IsDir":false,"ID":"AD5QJUL95MrlHkThI4P646OvfOFLPObSAymuAYOzSicRh28OxRwOLDFr1AwMiQKYkE1LqnYp7kVgQwc5OGmCmBC7-egKm-rlPQ"},
{"Path":"2019/12/DSC_2101.jpg","Name":"2019/12/DSC_2101.jpg","Size":53378,"MimeType":"image/jpeg","ModTime":"2020-01-02T22:44:13Z","IsDir":false,"ID":"AD5QJUJXdZMalEMHmn1SpZO1bL4SvDTUdaOSp3PqPI05dkfiiK5ytYaobumUI8VaR1k0bscu8DhwoJdedwLqdop1iWtDBpwkrw"},
{"Path":"2019/12/DSC_2109.jpg","Name":"2019/12/DSC_2109.jpg","Size":142636,"MimeType":"image/jpeg","ModTime":"2020-01-02T22:44:16Z","IsDir":false,"ID":"AD5QJULv5b12noc_fQiEfO4OnwUi1H9e91g14fY5wzaZepluiO34hnxMghEs76Yx9BEvFU35mVFqBqIC22mEbG8kBxEcVLnzmA"},
{"Path":"2019/12/DSC_2118.jpg","Name":"2019/12/DSC_2118.jpg","Size":96266,"MimeType":"image/jpeg","ModTime":"2020-01-02T22:44:18Z","IsDir":false,"ID":"AD5QJUKLZu6UZZzxagb2NDjrTU9zBxWeZPORJHo_hpSDfpiFQf64ZpWUYUDnrnxFAzbY8tiv6FJpMF2xL9pvV_aTj_HT-slcag"},
{"Path":"2019/12/DSC_2121.jpg","Name":"2019/12/DSC_2121.jpg","Size":134078,"MimeType":"image/jpeg","ModTime":"2020-01-02T22:44:28Z","IsDir":false,"ID":"AD5QJUK2JmOJf-35KSY0dvhD_teVhDWX_yEQ171h551cKwtSr4ENfzfolGCN3SDp0KPPZgVF-LxQnyUKDVRjDKgD8jy9Nip1_w"},
{"Path":"2019/12/FullSizeR_01.jpg","Name":"2019/12/FullSizeR_01.jpg","Size":107893,"MimeType":"image/jpeg","ModTime":"2020-01-02T22:44:33Z","IsDir":false,"ID":"AD5QJUJliScLHaiLduKTRtY-oui00E_dECWflfaL_SJFGuejsn-0xInvv-wG3OzJz904Zh5FR5u41bUuGolMqyzbMEXc2CV3rw"},
{"Path":"2019/12/FullSizeR_02.jpg","Name":"2019/12/FullSizeR_02.jpg","Size":130744,"MimeType":"image/jpeg","ModTime":"2020-01-02T22:44:35Z","IsDir":false,"ID":"AD5QJULAaxGCkmR7x_6ZR9kq_6hoYxKmJvFAA3z42OpGWt450AVWvfxGkPNMb3tXLC99qxvF3PiC0sxhpTwLaQJvzdXc_PpWew"},
{"Path":"2019/12/FullSizeR_03.jpg","Name":"2019/12/FullSizeR_03.jpg","Size":162074,"MimeType":"image/jpeg","ModTime":"2020-01-02T22:44:39Z","IsDir":false,"ID":"AD5QJULE3ktDlpElnVeGYZGH8daZH3Y5DBjAm1dfwx-gJvDTwLZO3Ga7c4d22lagzTE1vcDLFMYV7zz9E4uLjO0cb0gS2k5QiQ"},
{"Path":"2019/12/FullSizeR_04.jpg","Name":"2019/12/FullSizeR_04.jpg","Size":115251,"MimeType":"image/jpeg","ModTime":"2020-01-02T22:44:41Z","IsDir":false,"ID":"AD5QJUIY9iIA2f_lZU6w3-LCxUN3HuKynqMGsuAeN_dnDnFtunNUHXuXbZC1ND6kmyhgVY9oOzihZFzVHdwmR2dbkV4DA1jCIg"},
{"Path":"2019/12/IMG_0212.jpg","Name":"2019/12/IMG_0212.jpg","Size":710144,"MimeType":"image/jpeg","ModTime":"2020-01-02T22:44:42Z","IsDir":false,"ID":"AD5QJUKlq5YgOkp0aUyj-tV9XF0pm2_o2Ew0i6PTCoDaJPklQyHAsM6oH0pMN_NJrWLxt52Y_PntYYcCLBZyyQW4L_aBJU-hYA"},
{"Path":"2019/12/IMG_0454.jpg","Name":"2019/12/IMG_0454.jpg","Size":630228,"MimeType":"image/jpeg","ModTime":"2020-01-02T22:44:44Z","IsDir":false,"ID":"AD5QJULZgVAYwII08966i62wvDsJau9TbPtsa-wDx5mOgm5qt4QKMrDwvU_P4b6-f_nQGtBr7G817lOEkiHW3r44vDgRlZ73XA"},
{"Path":"2019/12/IMG_1171.jpg","Name":"2019/12/IMG_1171.jpg","Size":658769,"MimeType":"image/jpeg","ModTime":"2020-01-02T22:44:45Z","IsDir":false,"ID":"AD5QJUK64Y5qpjqRcheKVA5cI88xeeCZWtQCccXLrD5RLKDyTmpVDGsRpAZDgqLETdddEMjiyvFpKdi1XuHT6ZjCbuE1F-Yfqw"},
{"Path":"2019/12/IMG_1174.jpg","Name":"2019/12/IMG_1174.jpg","Size":420620,"MimeType":"image/jpeg","ModTime":"2020-01-02T22:44:46Z","IsDir":false,"ID":"AD5QJUK-vg-M0KVPcMP6WbN2BJJbpc6JweWjD_HtGr5D6nntXc-Dx7PeSE2IEdQOehtYujXxa2-d5V0x0QAM-oW8JwLU5G_iAA"},
{"Path":"2019/12/IMG_1175.jpg","Name":"2019/12/IMG_1175.jpg","Size":370142,"MimeType":"image/jpeg","ModTime":"2020-01-02T22:44:48Z","IsDir":false,"ID":"AD5QJULHUQOXN6d_Uc50_cnGnLdeDc4PElb6-ichCN5IDUbevlt59A9pRtYeK1Ap2hVvctiWQUwcEq8EK_MgyiR63LtvsEkaJg"},
{"Path":"2019/12/IMG_1205.jpg","Name":"2019/12/IMG_1205.jpg","Size":287723,"MimeType":"image/jpeg","ModTime":"2020-01-02T22:44:49Z","IsDir":false,"ID":"AD5QJUJwRz6dBZ2BGEVdNm-ENZYBLhd5il2UUnWd7eCoEZTv1skpxdq7buO1ThdjzNpWl-A0Vqtk82lb3kHNUS55iFSR7eVLMA"},
{"Path":"2019/12/IMG_1206.jpg","Name":"2019/12/IMG_1206.jpg","Size":382384,"MimeType":"image/jpeg","ModTime":"2020-01-02T22:44:50Z","IsDir":false,"ID":"AD5QJUKntCROhW_O-TIYWKVwS-KU-4mx4T5sc4wN1whqr1azBNaYSZNX-TkPStuitry8RkALEEsG4sMUtXjMGTFMlf3d2JgxHA"},
{"Path":"2019/12/IMG_1209.jpg","Name":"2019/12/IMG_1209.jpg","Size":451136,"MimeType":"image/jpeg","ModTime":"2020-01-02T22:44:52Z","IsDir":false,"ID":"AD5QJULNJ8upgyWMM7biAJP8ivf88eytLOd7liMXTRMCBuEQ9Tj6dXBsSMlT7LNAfMWFwrcvRjd4MTtTUhJpnJr597_Y7RX26g"},
{"Path":"2019/12/IMG_2436.jpg","Name":"2019/12/IMG_2436.jpg","Size":882754,"MimeType":"image/jpeg","ModTime":"2020-01-02T22:56:41Z","IsDir":false,"ID":"AD5QJUKfVGw1JLnBH1T3pbG7vHxclpiQWhp6at-q3qqa9nSK_fWFROI5HOL1QkxTszvUS2CqBSMhzBUByKuXdqkJFzVNjh-mIg"},
{"Path":"2019/12/IMG_2938.jpg","Name":"2019/12/IMG_2938.jpg","Size":553221,"MimeType":"image/jpeg","ModTime":"2020-01-02T22:56:43Z","IsDir":false,"ID":"AD5QJULtrTjpkNu0IvikoK8k6gr6RKPS1ZIl3D1G6BC9cVjfifYkd1i9nL2wjxLT1iDEcIolMyV-YXXMjEjvCSx67BjOIVj1Qg"},
{"Path":"2019/12/IMG_2939.jpg","Name":"2019/12/IMG_2939.jpg","Size":607694,"MimeType":"image/jpeg","ModTime":"2020-01-02T22:56:45Z","IsDir":false,"ID":"AD5QJULlhYXab3Ka5mmWVA6X4BtnLLWZParDYM6-wKf4e-MZACWAJRDC_3PqCX4e6s34HQnSFSVROLFv_RgUzpd2UUjEtsq4Kw"},
{"Path":"2019/12/IMG_5250.jpg","Name":"2019/12/IMG_5250.jpg","Size":324069,"MimeType":"image/jpeg","ModTime":"2020-01-02T22:56:48Z","IsDir":false,"ID":"AD5QJUJHA16pOJ_A0JYZ7aCHqX6i16Bmww6Z13GIgpCZDrA4ud5oDcfzOfCSvAwIi5KqGEA4atopwndln6Ldv_BvYkdGO470iQ"},
{"Path":"2019/12/IMG_5251.jpg","Name":"2019/12/IMG_5251.jpg","Size":303130,"MimeType":"image/jpeg","ModTime":"2020-01-02T22:56:50Z","IsDir":false,"ID":"AD5QJUIwKttoLhv4Yr_O-Q2k_On1bXpOIrWnW1A9mmQCVR5rxtA7PYGmuaCrTtfIqzamB8U0wH8t6kG3XOHWCkD4cuGGPHKVhg"},
{"Path":"2019/12/IMG_5254.jpg","Name":"2019/12/IMG_5254.jpg","Size":297915,"MimeType":"image/jpeg","ModTime":"2020-01-02T22:56:52Z","IsDir":false,"ID":"AD5QJUIV1Lp4_SYd0F4B1JA69yMpA-sKKBAn-mIZpI8eC4HY07qQzqAf0p4WfRSU42bzKl_VXy8VF5-Cvp8kZP7qtQcsHhPE3w"},
{"Path":"2019/12/IMG_6133.jpg","Name":"2019/12/IMG_6133.jpg","Size":384721,"MimeType":"image/jpeg","ModTime":"2020-01-02T22:56:55Z","IsDir":false,"ID":"AD5QJUKQvWatfujBhLNUwGTKkEA4V3K1qgtO9Djz6-_rscjpuFIXfAvlNb3Ia8Irj2dZklrNQ9h7hJ4ZSkaDZRdrQdmQHcOOBA"},
{"Path":"2019/12/IMG_6145.jpg","Name":"2019/12/IMG_6145.jpg","Size":351511,"MimeType":"image/jpeg","ModTime":"2020-01-02T22:56:59Z","IsDir":false,"ID":"AD5QJUJ77t5Pr3BkJoc7TkMCroUpr9umMEelapTHdROnnNHee87Ol5ZJURrVTaGGER0NSXJrCeE6_TcS2MQPDhEy3oVuYiJB0A"},
{"Path":"2019/12/IMG_6152.jpg","Name":"2019/12/IMG_6152.jpg","Size":213401,"MimeType":"image/jpeg","ModTime":"2020-01-02T22:57:02Z","IsDir":false,"ID":"AD5QJULlJUNiW-I_PQBuBeAVl62Wf2MtyF0CHYkF3ToeyRG2jO0Bu5oP5eVYJyBcYeZJMkoP12loFkCMbvsBPxrv3i_Hfo5AOg"},
{"Path":"2019/12/IMG_6656.jpg","Name":"2019/12/IMG_6656.jpg","Size":402728,"MimeType":"image/jpeg","ModTime":"2020-01-02T22:57:05Z","IsDir":false,"ID":"AD5QJUI0AKccjL3QfhFRZVkZ2PYuHtfmvj2op4CcjQxxpSryBO2zlr_slvLqA7LaX81D9LQla3wAvgcEqx5VW55sILsaBhOszw"},
{"Path":"2019/12/IMG_7694.jpg","Name":"2019/12/IMG_7694.jpg","Size":475034,"MimeType":"image/jpeg","ModTime":"2020-01-02T22:57:06Z","IsDir":false,"ID":"AD5QJULzjgR8eBxLHTONnR4kSGN6ssP1V0gZaO4MyEJmxy8m4Qk8BE6E5gfNwzcKhuEd5LXcIBW4MEkRrXXPhRjuMaQgxiEZvw"},
{"Path":"2019/12/IMG_8728.jpg","Name":"2019/12/IMG_8728.jpg","Size":122942,"MimeType":"image/jpeg","ModTime":"2020-01-02T22:57:09Z","IsDir":false,"ID":"AD5QJUI2OaXQqjiB3Xpt33l3q-Q5IwzlbNsEa_qpWyvKrqhPbtfMQCZ9XKjskf6ly5KXh-D1CBDj6METZqAb3emIxDyKGAObjw"},
{"Path":"2019/12/IMG_8729.jpg","Name":"2019/12/IMG_8729.jpg","Size":120036,"MimeType":"image/jpeg","ModTime":"2020-01-02T22:57:12Z","IsDir":false,"ID":"AD5QJUIGbw-oW5EZSgiTkWho_MDlFwlL-AHMQ6o0Tx7gLDT5WXTcLshb-GhBk6h31Wv9aQ6p5eLd7vju2Ot05D5vChJwcx1B9Q"},
{"Path":"2019/12/IMG_8730.jpg","Name":"2019/12/IMG_8730.jpg","Size":84438,"MimeType":"image/jpeg","ModTime":"2020-01-02T22:57:14Z","IsDir":false,"ID":"AD5QJUIeUUeeKTfJT5WTSOBk_zbAWRytkSjJLNp3gOWYBSM5PQ6uMgUUBuca12QH-q2Bys4XpRbponS9ofraMzqpt0l9VdRSqA"},
{"Path":"2019/12/IMG_8733.jpg","Name":"2019/12/IMG_8733.jpg","Size":117872,"MimeType":"image/jpeg","ModTime":"2020-01-02T22:57:16Z","IsDir":false,"ID":"AD5QJULqi-8BZW1rPRTWEumZogV2IsjEBnPxKhAR86glj0WOyMaDj5_PfH4mPd_wkhQOr0M0hoPVdB9dtP7qoL37hQdFMUkcgA"},
{"Path":"2020/01/IMG_20200102_092405.jpg","Name":"2020/01/IMG_20200102_092405.jpg","Size":2866473,"MimeType":"image/jpeg","ModTime":"2020-01-02T14:24:06Z","IsDir":false,"ID":"AD5QJUKgTGjVrbJEawXlP-HAElbm5k3C1aO7oVHIz79VPfjoHxWMWp07j1o-5zEAWxSdBSCIBxlnH16-THo0_SYWUOI8E0KcjQ"},
{"Path":"2020/01/IMG_20200102_092414.jpg","Name":"2020/01/IMG_20200102_092414.jpg","Size":1744711,"MimeType":"image/jpeg","ModTime":"2020-01-02T14:24:14Z","IsDir":false,"ID":"AD5QJULbrtUtUDBR94x41C4EQqa1PCe8KgcaQur6uKHc0vBQqCqn1hNKnJCeKhwxEqDlsODZeTuzE1TeabxGvOKuUSj49mycSw"},
{"Path":"2020/01/IMG_20200102_092415.jpg","Name":"2020/01/IMG_20200102_092415.jpg","Size":1665813,"MimeType":"image/jpeg","ModTime":"2020-01-02T14:24:15Z","IsDir":false,"ID":"AD5QJUJ7Z3dpPo7Cw-TSfl_9aajyXlP_6E84nl1K__1a4p8cXmVrAjNB-zf-kia97L0F7h18EpHe32zwyZ-9ZPpZevvmnFdEiw"},
{"Path":"2020/01/IMG_20200102_092417.jpg","Name":"2020/01/IMG_20200102_092417.jpg","Size":1503844,"MimeType":"image/jpeg","ModTime":"2020-01-02T14:24:17Z","IsDir":false,"ID":"AD5QJUKJsbCr_TqFd4SwaYlJ9cnvm3nyx_Atda0vWWktoXg_wp1g05luW6NQKGiFvjWFmj7NDqCioQ67Wen8mOdqASPImK7BeA"},
{"Path":"2020/01/IMG_20200102_092421.jpg","Name":"2020/01/IMG_20200102_092421.jpg","Size":1155319,"MimeType":"image/jpeg","ModTime":"2020-01-02T14:24:21Z","IsDir":false,"ID":"AD5QJUI-DRcI7JJ2WguYyuRK00h7RJUoInoBdba1cs36mRg6fywuBNzYJuU97q4Lfwd8XGRzAbK99dLgEQxzoKWXFV0PpHkX0A"},
{"Path":"2020/01/IMG_20200102_105744.jpg","Name":"2020/01/IMG_20200102_105744.jpg","Size":2089949,"MimeType":"image/jpeg","ModTime":"2020-01-02T15:57:45Z","IsDir":false,"ID":"AD5QJUIZFiwGUk-sJLUASt-rUcWXqQiII9cw7wR5gHyCAZawpGWE-NtEWE4Xy_-L0-YB0j8NOPN3LmmVx54ojKQV2UGpjvR7AA"},
{"Path":"2020/01/IMG_20200102_112656.jpg","Name":"2020/01/IMG_20200102_112656.jpg","Size":3157958,"MimeType":"image/jpeg","ModTime":"2020-01-02T16:26:56Z","IsDir":false,"ID":"AD5QJUL7f58C6YTen81ogoifhXj93JrMQnVonAiHjvfxEo3XcnrB4_OjMc6GpO5S6D7c6H6aUDVN3Nq9wOPT5Gj4dTfhU7wBTQ"},
{"Path":"2020/01/IMG_20200102_112705.jpg","Name":"2020/01/IMG_20200102_112705.jpg","Size":2197277,"MimeType":"image/jpeg","ModTime":"2020-01-02T16:27:05Z","IsDir":false,"ID":"AD5QJUL9SZktSkDyC-HTNRTHeLMHxKS6OZE-5GrbURyhKggCqL1rpJJdYYhOtz1S6huKem4TlfZcLavq0J1kYnoddsn7Wk798Q"},
{"Path":"2020/01/IMG_20200102_191132.jpg","Name":"2020/01/IMG_20200102_191132.jpg","Size":2117528,"MimeType":"image/jpeg","ModTime":"2020-01-03T00:11:32Z","IsDir":false,"ID":"AD5QJULy-U3Rq8QP37tNGq4Smu9DW2fkgJ05Zc6XcOXbeONwJxcLtCgRbNWMHCLJbeeKrkKfG1edkFCn5vANdg0MxVsvGHkd9g"},
{"Path":"2020/01/IMG_20200102_191147.jpg","Name":"2020/01/IMG_20200102_191147.jpg","Size":2494330,"MimeType":"image/jpeg","ModTime":"2020-01-03T00:11:47Z","IsDir":false,"ID":"AD5QJUIlq8i0ZNj93ZyFMk8_i1aKnt9NwsbSxC_Gudlv76gOILl81VuYw0EN4Rs5A0DsvVW-ZEkxy0podl776l2MAB0XfhAmFA"}

If you run dump-bodies, you can see it doing the heads.

2020/06/12 19:39:40 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2020/06/12 19:39:40 DEBUG : Google Photos path "media/by-day/2020/2020-01-02": >List: err=<nil>
2020/06/12 19:39:40 DEBUG : 2020/01/IMG_20200102_191147.jpg: Size: 
2020/06/12 19:39:40 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2020/06/12 19:39:40 DEBUG : HTTP REQUEST (req 0xc0001c7b00)
2020/06/12 19:39:40 DEBUG : HEAD /lr/AFBm1_ZeLdS-BYVTcBDeSTs5lh0z8vvCeb11Wh_rFxcvu5_H7uL-ZgA0gO4ElrmCzCPG6cPx8RfPBBgUk6VpnmMG6S4k08EstUskMX9tWRMBsbmVF1adh3ITV2YJsEg2O8kGtVp3GqpJdR6FVdE_Of6RRPsRz0KRcrWHYlInlgddD-1icW3goYvMSUSnp1WWx4BSuBi8C9OSs567BNWYUPUKOeFhj2_lpr_gMvPXqS-pVzLQwWwjgt-D11wxb9-QIvDWCx2b9emlYA7_G49kMDb4Kt_ozejvz1o23QCyAgb20_vtrfG4camhx0uOS8nfMnaG2wSaNIHczdE9ek1vkTjOGyR9X5lKBhxN_6UN1UjTZyfPh0pcW50P9AQKjzOLFfNP3L2RrigwwY17bPDNEjKQltO0yfW1fC--DnVWnMigdY-jAT6WjOvQgsO5BAHyq7qLiIFpzvUgiwbmWLmqSuLgneGUks0W0b8eekYECn50bnVSeZtxSXXW-8XgcCbNu4d5-gtYuGlpCVz8UjFRklAN6ONk9mFkjpzmC1FVvDivyktZJViImWUF3oFZ3_DQkT5ODs826Ia4bMatWc_64gt3TVBwV6kald3zwzHkss7v5D1TT1xAgz1QNsW7aJOf388eXAw1THF24ikvy78Hhpu_SisKFWSPmkrWhK5JFZl1nu9v5AqabPd_XD-W7eAPaQdQ0McwVoTfzdD0C1DB7ohC9GsH78Wpu9B-H_k2QDsL92HdlLtfBw7fGk8hXYv6RqeMOpzWsT3KG1g4kaPuMI8tSCaJWUpvrPKpIno4vN2bs8-LmpMigfi_-z36=d HTTP/1.1
Host: lh3.googleusercontent.com
User-Agent: rclone/v1.52.0-001-g1cceadaf-beta
Authorization: XXXX

2020/06/12 19:39:40 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2020/06/12 19:39:41 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2020/06/12 19:39:41 DEBUG : HTTP RESPONSE (req 0xc0001c7b00)
2020/06/12 19:39:41 DEBUG : HTTP/2.0 200 OK
Content-Length: 2494330
Access-Control-Expose-Headers: Content-Length
Alt-Svc: h3-27=":443"; ma=2592000,h3-25=":443"; ma=2592000,h3-T050=":443"; ma=2592000,h3-Q050=":443"; ma=2592000,h3-Q049=":443"; ma=2592000,h3-Q048=":443"; ma=2592000,h3-Q046=":443"; ma=2592000,h3-Q043=":443"; ma=2592000,quic=":443"; ma=2592000; v="46,43"
Cache-Control: private, max-age=86400, no-transform
Content-Disposition: attachment;filename="IMG_20200102_191147.jpg"
Content-Type: image/jpeg
Date: Fri, 12 Jun 2020 23:39:41 GMT
Etag: "va487d"
Expires: Fri, 01 Jan 1990 00:00:00 GMT
Server: fife
Vary: Origin
X-Content-Type-Options: nosniff
X-Xss-Protection: 0

What its run with the virtual albums directory, it doesn't show size while "media" does.

rclone lsjson robgd-photos:album/test/
[
{"Path":"2019","Name":"2019","Size":-1,"MimeType":"inode/directory","ModTime":"2020-06-12T23:11:40-04:00","IsDir":true},
{"Path":"VID_20191231_235947.mp4","Name":"VID_20191231_235947.mp4","Size":-1,"MimeType":"video/mp4","ModTime":"2020-01-02T23:03:10Z","IsDir":false,"ID":"AKps9KE1EnUvpsJobhk7JymDaOHS0vOiMV6fOtnJgXPAl8TtPUp-TTHkWPFygx5jPfyyGTPp29PEkhXB7BWQwfoy3JhQQoUYTw"}

This is the only place in the googlephotos backend we do a HEAD request

So according to that code in order for it to do a HEAD request ReadSize must be true and size < 0

Or I've gone mad!

Can you put a Debugf in the Size() function to see what o.fs.opt.ReadSize and o.bytes are?

When I try the lsjson I don't get Sizes

$ rclone lsjson gphotos:media/by-day/2020/2020-01-02
[
{"Path":"IMG-20200102-WA0000.jpg","Name":"IMG-20200102-WA0000.jpg","Size":-1,"MimeType":"image/jpeg","ModTime":"2020-01-02T22:41:21Z","IsDir":false,"ID":"ABdUxBj6p_y8ADMhjrXr5r2XrvJd94LQauA9Ib8MFjYQoKBkPPNdLryhwnqGcnnnnwARGMMG4t1vEydOFfmTRR-7inReundphQ"},
{"Path":"IMG_20200102_122527.jpg","Name":"IMG_20200102_122527.jpg","Size":-1,"MimeType":"image/jpeg","ModTime":"2020-01-02T12:25:28Z","IsDir":false,"ID":"ABdUxBho6asfqZdVgkMUjrFq-yIuksJqMNoaaJ2Lh5VQvefi60zfGhBklK3CBlAy7ml8tQdvqqySH_UD-Hpn29doPE8bltVLsg"}
]

Same with listing in albums. :confused:

Any ideas?

ugh. I just realized I was shifting between two different remotes!

@dell-rob:~/goproj/src/github.com/rclone/rclone$ rclone config show robgs-photos:  2>&1 | egrep -v "client|token"
--------------------
[robgs-photos]
type = google photos
read_size = true
--------------------
@dell-rob:~/goproj/src/github.com/rclone/rclone$ rclone config show robgd-photos:  2>&1 | egrep -v "client|token"
--------------------
[robgd-photos]
type = google photos
--------------------

bash history messed me up. :cry: :roll_eyes:

Mystery solved! Great :smiley: The alternatives were looking much harder to debug!

1 Like

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.