Systematic Review Resources: Deduplication

Deduplication is the process of removing duplicate records from search results when multiple databases are searched. Duplicate records happen when the search results from the multiple databases are searched are combined into one file. A reference management system, such as Endnote, is used along with a methodology to remove those duplicate records. Deduplication is done prior to screening.

1. Download search results from all databases in RIS or XML format upon the completion of a database search.

2. Select the file format recommended by the reference management tool or screening tool being used (RIS format is the most likely format).

3. Decide on de-duplication method

   1. Use screening tool's built in algorithm (most screening tools will identify duplicates and ask you to screen them). Recommended for lower numbers of results 1-1000.

   2. The McGill Method (an adapted adapted version of an early version of the Bramer Method): Requires the use of Endnote. Recommended for results over 1000 records. 

   3. The Bramer Method. This is a complex method that requires the use of Endnote, it catches most, if not all duplicates and can save time if you have a high number of articles. See these videos for a demonstration of how the method is applied. Recommended for results over 1000 records

4. De-duplicate results with selected method

5. Import de-duplicated results into screening tool (i.e. Covidence, Rayyan, DeStillerDR,...)

6. Record all information into spreadsheet or other tool regarding import of records and deduplication

Databases

1. U Manitoba A-Z Database list 

Reference Management

1. Endnote ($$$)

   • U Manitoba Faculty & Student Purchase and Download

   • Endnote Training Videos (YouTube)

   • U Manitoba Library Endnote Help Page

2.  Mendeley (Free to $$)

   • Mendeley Download and Subscribe 

   • Help Guides / Mendeley How To Videos (YouTube)

   • U Manitoba Library Mendeley Help Page

3. Zotero (Free to $$)

   • Zotero Download and Subscribe 

   • Help Guide / Community Created Help Videos 

   • U Manitoba Library Zotero Help Page

Screening

1. Covidence (Free through University of Manitoba)

   • Contact UM Librarians to setup account

   • Covidence Website

   • Covidence - UM Libraries information

   • Covidence Help Guide and Videos (need to have account)

2. Rayyan (Free to $$)

   • Rayyan Website

   • Rayyan Introduction Video

3. DistillerSR ($$$)

   • DistillerSR Website

De-Duplication Tools

1. Deduplicator by SR-Accelerator

   • Requires Endnote to combine search results, and then several steps to de-duplicate records. 

Document Tools:

How to videos are in production, please check back soon.