IdeaJam(tm) : Identify and or filter out duplicates in a view.

Domino Designer / : Identify and or filter out duplicates in a view.

Sun, 14 Feb 2010 22:12:57 +0000

Author: Carl Rizzo
Tags: View duplicates
Idea:

Not sure how possible it is, but I have had many occasions where I would like to identify and delete duplicate documents in a view. Thanks

re: Identify and or filter out duplicates in a view.

Mon, 15 Feb 2010 11:02:02 +0000

Author: Philip Storry
Comment: Define duplicate? Do you mean anything with exactly the same details in a view? Sort of like a "View -> Show -> Duplicates only", to go along with selected and unread?

I'm in two minds about this one. But I'll vote yes, as it could also be useful in the Domino Directory for finding goofs there...

re: Identify and or filter out duplicates in a view.

Mon, 15 Feb 2010 13:57:06 +0000

Author: Carl Rizzo
Comment: Hi Phil,

For what I run into the docs are exact duplicates, but it would be nice if there was a way to compare field values from one doc to another to determine duplicates. Thank you.

re: Identify and or filter out duplicates in a view.

Wed, 17 Feb 2010 10:45:19 +0000

Author: Paul Davies
Comment: if you are filtering out duplicates, then what exactly do you need the duplicate document for?

de-duping a db isn't very difficult. The technique I often use is to use a view which shows the NoteID of the docs, export the view to a CSV, use MS Access Find Duplicates query wizard (followed up with a Select Max() query) to identify the lines you want to delete, export the NoteIds of those lines back to a single or multiple document (depending on how may etc) and then use an agent to loop through and mark those documents with a flag so you can be sure it has identified the correct docs, then if satisfied, delete the docs with the flag

re: Identify and or filter out duplicates in a view.

Wed, 17 Feb 2010 12:50:01 +0000

Author: Carl Rizzo
Comment: Hi Paul,
Wow that is very smart, but also very complicated. I can follow the logic and I am sure it works, but I was looking for something easier. You are correct in that I would never need the duplicate doc. I just wanted it flagged so I can see it and I can delete it. Thanks.

re: Identify and or filter out duplicates in a view.

Wed, 17 Feb 2010 20:46:57 +0000

Author: Paul Davies
Comment: Carl - I suppose only you can define what a duplicate is in your own context. no two notes documents are exactly the same as they will have different IDs and timestamps etc.

Does setting the property 'Force Unique IDs in index for ODBC access' give you what you want? This filters out duplicates in the first (sorted?) column. Its in the last property page for the view

re: Identify and or filter out duplicates in a view.

Wed, 17 Feb 2010 21:18:02 +0000

Author: Carl Rizzo
Comment: Hi Paul,

Yes, I think that would work. I did not know that is how that feature worked. I had no idea. Thanks.

re: Identify and or filter out duplicates in a view.

Thu, 25 Feb 2010 20:36:11 +0000

Author: Bill Malchisky
Comment: Also @Unique works, depending upon your needs.