https://bugs.kde.org/show_bug.cgi?id=493294

            Bug ID: 493294
           Summary: Extremely slow duplicate search. It takes literally
                    days.
    Classification: Applications
           Product: digikam
           Version: 8.5.0
          Platform: Microsoft Windows
                OS: Other
            Status: REPORTED
          Severity: grave
          Priority: NOR
         Component: Searches-Similarity
          Assignee: digikam-bugs-n...@kde.org
          Reporter: phr...@gmail.com
  Target Milestone: ---

Created attachment 173797
  --> https://bugs.kde.org/attachment.cgi?id=173797&action=edit
Shared Libraries and Components Information report

SUMMARY
I’m new to digiKam. I’m using version 8.5 on windows 11. I’m using the Mysql
Internal database.

My machine is a Ryzen 9 7900X3D with 64 gb ram, Nvidia 4090 and I’m using
Western Digital Black SN850X 2 and 4 tb NVMe drives. The image collection is on
it’s own physical drive.

I have 286,583 images that I need to organize. Some images have many, many
copies. I’m attempting to search for duplicates between 90 and 100 similarity.

The problem I’m having is that it took 20hrs for the duplicate search to get to
4% complete. A duplicate search at 100 to 100 similarity only reached 1% after
an hour.

In the Windows Task Manager, the memory used is under 2 gb, the cpu is under
10% and the disk is under 0.5% while I’m searching for duplicates.

I’ve tried a different computer, different drives, reinstalling, changing the
database type, deleting the database and starting fresh (a few times) and
updating the fingerprints repeatedly.

The odd thing is, when I right click on an image and click “Find Similar” with
the search set from 50 to 100, it only takes a few seconds.

Can you give me some insight about what I'm doing wrong?



STEPS TO REPRODUCE
1.  Open maintenance
2.  Find duplicates at 90 to 100
3.  Start search

OBSERVED RESULT
Extremely slow results. 20 hours to reach 4%

EXPECTED RESULT
Faster results

SOFTWARE/OS VERSIONS
Windows: 11
KDE Frameworks Version:  6.5.0
Qt Version: Version 6.7.2 (built against 6.7.2)

ADDITIONAL INFORMATION
I posted this in the discuss group but I haven't received any replies and only
1 other person has looked at it.

I'm not sure what else to attach, but I've attached the Shared Libraries and
Components Information report.

-- 
You are receiving this mail because:
You are watching all bug changes.

Reply via email to