Export accounts duplicates

Hello,

Unfortunately, there is no built-in way to export all duplicates directly.

However, as a workaround, you can use one of the following approaches:

Option 1: Find duplicates directly in the database

You can identify duplicate records using an SQL query and then export the results manually.

SELECT email, COUNT(*)
FROM users
GROUP BY email
HAVING COUNT(*) > 1;


Option 2: Export data and use Excel to find duplicates

Export the dataset from your system to Excel (or CSV).

In Excel:

• Select the relevant column(s).
• Go to Home → Conditional Formatting → Highlight Cells Rules → Duplicate Values to highlight duplicates.

Hello Halyna,
 the results of duplicates search is complicated to reproduce using sql query.

I used postman and I called the following web service  {{BaseURI}}/0/rest/BulkDeduplicationService/GetGroupsOfDuplicates passing the following json

{
    "entityName": "Contact",
    "columns": [
        "Name",
        "Account
        "CreatedBy"
    ],
    "offset": 0,
    "count": 1000,
    "topDuplicatesPerGroup": 5,
    "filters": "{\"items\":{},\"logicalOperation\":0,\"isEnabled\":true,\"filterType\":6}"
}

If you want to get a rough equivalent using SQL - for example, to find contacts with identical or very similar names - you could try something like:

SELECT 
   Name,
   AccountId,
   CreatedById,
   COUNT(*) AS DuplicateCount
FROM Contact
WHERE Name IS NOT NULL
GROUP BY Name, AccountId, CreatedById
HAVING COUNT(*) > 1
ORDER BY DuplicateCount DESC;

This will show exact duplicates (same Name + Account + CreatedBy).

Hi, 

Duplicate management needs some improvement. Finally,  in 8.3.1 we can manually merge records.  

But we should be able to see total numbers of duplicates based on our duplicate rules etc.. 

Functionality has not evolved much for years (even lacking in Freedom UI for manual merge until now) and customer non-admin end-users are not satisfied with its functionality.

Marketing teams should be able to manage this without having to develop SQL programming knowledge or export excel lists. 

Customer data management is imperative, with contacts changing companies often, and this part is far from be up-to-standards with what Freedom UI offers. 

Simply have a list of duplicates and not even being able to provide some statistics without querying the db directly is something that end-users have a lot of difficulty accepting, considering what exists on the market today.

Damien Collot,

100% agree on this, there needs to be better tooling for handling this on the user end, with any appropriate guardrails that can be put in place via customisation for such actions.