Deduplication

Demonstration of how to remove duplicate entities that are created in a given database.

Keep your database clean without babysitting it - duplicates get caught, merged, and removed automatically, the moment they appear.

Define which fields make two records identical (an email address, a customer number, a product code), and let two automation rules do the rest. When a match is found, the newer record's data is folded into the original, and the duplicate disappears. No manual review queue, no stale entries quietly accumulating in the background.

Works for any database where the same entity might arrive more than once - CRM contacts, product catalogs, support tickets, imported leads, or any other list that gets written to from multiple sources.

Includes:

  • Items database with configurable match criteria (Email + Number by default)

  • Options collection for carrying data across from duplicates to originals

  • Two-rule automation chain: match detection, then merge-and-delete

  • Built-in race condition handling for bulk imports

Connect to your CRM or import pipeline to catch duplicates at the point of entry, or extend the match logic to cover additional fields as your data model grows. 🙌