Thanks. Yes, the Vim question has morphed into a programming question, which is not only 'OT' for this forum, but definitely 'OT' for my skills. I simply need Google Photos to download my photos, imagine computer illiterate people trying this?
I'm stuck on: step: generating a list of md5 values, with their counts of how often they occur (counts >1 indicate duplicates); step: select md5 values with counts >1; step: use grep to find that md5 with its (fileName.jpg?) in the original (TakeoutAlbumYears?) file. Here's where I'm at: ubuntu@ubuntu:~/Documents$ sort |uniq -c|sort -nr fileNamesCutOutOfSum.md5 126a8a51b9d1bbd07fddc65819a542c3 126a8a51b9d1bbd07fddc65819a542c3 3e7705498e8be60520841409ebc69bc1 3bc3be114fb6323adc5b0ad7422d193a d8e8fca2dc0f896fd7cb4cb0031ba249 d8e8fca2dc0f896fd7cb4cb0031ba249 ^C ubuntu@ubuntu:~/Documents$ cat fileNamesCutOutOfSum.md5 3bc3be114fb6323adc5b0ad7422d193a 126a8a51b9d1bbd07fddc65819a542c3 3e7705498e8be60520841409ebc69bc1 d8e8fca2dc0f896fd7cb4cb0031ba249 126a8a51b9d1bbd07fddc65819a542c3 d8e8fca2dc0f896fd7cb4cb0031ba249 ubuntu@ubuntu:~/Documents$ sort |uniq -c|sort -nr fileNamesCutOutOfSum.md5 > fNCOOSSorted.md5 ^C ubuntu@ubuntu:~/Documents$ ls fileNamesCutOutOfSum.md5 fNCOOSSorted.md5 NoMachine sum.md5 test1 test2 ubuntu@ubuntu:~/Documents$ cat fNCOOSSorted.md5 126a8a51b9d1bbd07fddc65819a542c3 126a8a51b9d1bbd07fddc65819a542c3 3e7705498e8be60520841409ebc69bc1 3bc3be114fb6323adc5b0ad7422d193a d8e8fca2dc0f896fd7cb4cb0031ba249 d8e8fca2dc0f896fd7cb4cb0031ba249 On Sunday 7 January 2024 at 03:25:16 UTC+10 jr wrote: > hi, > > (you do realise we're somewhat OT for this forum ? :-)) > > On Sat, 6 Jan 2024 at 15:00, K otgc <[email protected]> wrote: > > Thanks. > > I ran these commands, and I'm up to the final step of using those hash > values to look up all the matching filenames in the original md5 file. > > I'm researching a command for that, as command fdupes seems to be for > files, but I need to match up the md5 hash values? > > ubuntu@ubuntu:~/Documents$ find -H test1/ ! -type d -exec md5sum {} + > > sum.md5 > > ubuntu@ubuntu:~/Documents$ ls > > NoMachine sum.md5 test1 test2 > > ubuntu@ubuntu:~/Documents$ cat sum.md5 > > 3bc3be114fb6323adc5b0ad7422d193a > test1/test1.1/test1.1.1/test1.1.1file2.JPG > > 126a8a51b9d1bbd07fddc65819a542c3 > test1/test1.1/test1.1.1/test1.1.1file1.JPG.json > > 3e7705498e8be60520841409ebc69bc1 > test1/test1.1/test1.1.1/test1.1.1file1.JPG > > d8e8fca2dc0f896fd7cb4cb0031ba249 > test1/test2/test2.2/test2.2.2/test2.2.2file1.JPG > > 126a8a51b9d1bbd07fddc65819a542c3 > test1/test2/test2.2/test2.2.2/test1.1.1file1.JPG.json > > d8e8fca2dc0f896fd7cb4cb0031ba249 > test1/test2/test2.2/test2.2.2/test2.2.2file1.JPG.json > > ubuntu@ubuntu:~/Documents$ sort|uniq -c|sort -nr sum.md5 |cut -d ' ' -f1 > > 126a8a51b9d1bbd07fddc65819a542c3 > > 126a8a51b9d1bbd07fddc65819a542c3 > > 3e7705498e8be60520841409ebc69bc1 > > 3bc3be114fb6323adc5b0ad7422d193a > > d8e8fca2dc0f896fd7cb4cb0031ba249 > > d8e8fca2dc0f896fd7cb4cb0031ba249 > > > ubuntu@ubuntu:~/Documents$ find -H test1/ ! -type d -exec md5sum {} + > > sum.md5 > > why not use '-type f' ? anyway, the following should do what you look for: > > $ find -H test1/ ! -type d -exec md5sum {} + | awk -f kotgc.awk > > the awk code is: > -----<snip>----- > { > if ($1 in arr) > arr[$1] = arr[$1] ", " $2 > else > arr[$1] = $2 > } > > END { > for (m in arr) > if (arr[m] ~ ".*,.*") > print m " " arr[m] > } > -----<snip>----- > > -- > regards, jr. > > You have the right to free speech, as long as you're not dumb enough > to actually try it. > (The Clash 'Know Your Rights') > > this email is intended only for the addressee(s) and may contain > confidential information. if you are not the intended recipient, you > are hereby notified that any use of this email, its dissemination, > distribution, and/or copying without prior written consent is > prohibited. > -- -- You received this message from the "vim_use" maillist. Do not top-post! Type your reply below the text you are replying to. For more information, visit http://www.vim.org/maillist.php --- You received this message because you are subscribed to the Google Groups "vim_use" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/vim_use/ac56ff91-886d-493a-8572-be0c614768ccn%40googlegroups.com.
