Skip to main content

Duplicate Management

PCH-SIG automatically detects potential duplicates between households to ensure registry integrity.

Access

Side menu: Social Registry > Duplicates

Required permission: registre.doublons_view

Types of detected duplicates

The system identifies several types of duplicates:

TypeDescriptionExample
PhoneSame phone number2 households with phone 771234567
Name + LocalitySame name in the same locality"Mamadou Diop" x2 in Thies
Mobile MoneySame Mobile Money number2 households with MM 771234567
GPS coordinatesIdentical geographic positionSame latitude/longitude

Risk level

Each detected duplicate has a risk level:

LevelScoreDescription
High80-100High probability of real duplicate
Medium50-79Possible duplicate, verification needed
Low< 50Similarity detected but probably distinct

The score is calculated based on the number of matching fields and their importance.

Management interface

Overview

The page displays statistics:

  • Detected: Total number of duplicates
  • Untreated: Awaiting action
  • Confirmed: Marked as true duplicates
  • Ignored: Marked as false positives
  • Merged: Merged households

Duplicate list

Each duplicate shows:

  • Duplicate type (icon)
  • The 2 households concerned
  • Similarity score
  • Treatment status
  • Detection date

Filters

FilterOptions
StatusAll, Untreated, Confirmed, Ignored, Merged
TypePhone, Name, Mobile Money, GPS
Risk levelHigh, Medium, Low

Examine a duplicate

Click on a duplicate to see details:

Side-by-side comparison

FieldHousehold AHousehold B
CodeMEN-2024-001MEN-2024-089
HeadMamadou DiopMamadou Diop
Phone771234567771234567
LocalityThiesThies
Size55
Collection date01/15/202403/20/2024

Identical fields are highlighted.

Actions on a duplicate

Ignore

If it is not a real duplicate (false positive):

  1. Click on Ignore
  2. Add an explanatory comment (optional)
  3. Confirm

The duplicate is marked as ignored and no longer appears in the untreated list.

Required permission: registre.doublons_check

Confirm

If it is a real duplicate:

  1. Click on Confirm
  2. Add a comment
  3. The duplicate is marked for merging

Merge

To merge two households into one:

  1. Click on Merge
  2. Choose the main household (which will be kept)
  3. Verify the information that will be merged
  4. Confirm

The merge:

  • Keeps the main household
  • Transfers members from the other household
  • Transfers associated payments and beneficiaries
  • Archives the deleted household

Required permission: registre.doublons_merge

Warning

Merging is irreversible. Verify carefully before confirming.

Manual verification

To launch a duplicate verification:

  1. Click on Check duplicates
  2. The verification runs in the background
  3. Newly detected duplicates appear in the list

Verification can be scheduled automatically by the administrator.

Best practices

Prevent duplicates

  • Check if the household exists before creating it
  • Use phone search
  • Validate GPS data in the field

Treat duplicates

  • Treat high-risk duplicates as a priority
  • Document decisions with comments
  • Contact the field in case of doubt

Merging

  • Always choose the household with the most recent/complete data
  • Check associated payments before merging
  • Inform field teams about the merge