How do you use AI to clean up a messy data export before it goes into your CRM?

how do you use AI to clean up a messy data export before it goes into your CRM? we get exports from multiple sources with inconsistent formatting, duplicate entries, and missing fields. currently a manual process. looking for what’s working.

the task that works well with AI: standardizing inconsistent field formats. phone numbers, dates, address formats. give the model the target format and the source data and it handles the transformation reliably. the task that doesn’t: filling in missing fields through inference. it will invent plausible data. do not trust it on that.

Claude for structured data transformation works well if you give it the schema you’re targeting and a sample of the messy input. it can write a Python script to handle the transformation rather than doing the transformation itself, which is often the better approach for repeatable use.

the deduplication problem is harder than it looks for AI. exact-match duplicates are easy. fuzzy duplicates, same company different spelling, same person different email, require rules that your CRM should define, not AI guess at. I’d separate the deduplication step and handle it with your CRM’s own merge tools.

from an HR systems standpoint: the data accuracy risk is significant if AI is inferring or filling fields. the pattern that works is AI for format transformation and validation, humans for anything requiring judgment about what data should say. the cleanup is fine. the inference is not.

the workflow that’s working for us now:

  1. export the raw data to CSV.

  2. describe the mess to Claude: ‘this CSV has phone numbers in four different formats, dates as both MM/DD and DD/MM, company names with inconsistent capitalization.’ ask it to write a Python script to standardize.

  3. run the script, review the output on a sample before running on everything.

  4. for duplicates: let the CRM handle it with its native tools after import. AI guessing at duplicates introduces errors. the CRM merge tools are designed for this.

  5. missing fields stay missing. we flag them for manual review rather than filling with inferred data.

the time saving is real on the formatting step. the judgment calls stay with humans.