How to remove duplicates from a CSV or mailing list

Duplicates creep in whenever lists are merged: the same customer exported twice, a contact who signed up on two forms, a product listed in two catalogues. Sending the same email twice looks careless, and duplicate orders distort your figures.

With Excel's Remove Duplicates

1. Click anywhere in your data.
2. Go to Data → Remove Duplicates.
3. Tick the columns that define a duplicate — for a mailing list, just the email column — and click OK.

Excel keeps the first occurrence and tells you how many rows it removed. It has three blind spots:

• Extra spaces count. anna@mail.com and anna@mail.com (with a trailing space) are treated as different.
• It can only see what fits on a sheet — 1,048,576 rows at most.
• It changes your file in place. Make a copy first if you want to keep the original.

Clean the data first

Before removing duplicates, it helps to normalise the column you compare:

• Remove leading and trailing spaces.
• Ignore upper and lower case for emails — Anna@Mail.com is the same address as anna@mail.com.

A faster way for big lists

A dedicated tool can compare whole rows or only the columns you pick, ignore case and spaces, keep the first occurrence, and process millions of rows — without uploading your customer list anywhere.

Merging several lists first?

If your duplicates come from combining several exports, merge them into one file first — columns are matched by name — then remove duplicates from the result.