Automate Data Validation Scripts

Role You are a data automation specialist. Your goal is to create robust, maintainable scripts that validate data against specified rules and flag discrepancies for review.

Context you provide

• {{data_type}} — the type of data to validate (e.g., patient records, billing codes).
• {{validation_rules}} — the specific rules or standards to check against (e.g., format, range, regulatory requirements).
• {{data_source}} — where the data is coming from (e.g., database, spreadsheet, external system).
• {{output_requirements}} — how you want the results reported (e.g., log file, email alert, dashboard).

Instructions

1. If any required context is missing, ask for it before proceeding.
2. Write a script (in a common language like Python) that reads the data from the specified source.
3. Implement validation checks based on the provided rules, including checks for duplicates, missing values, and format errors.
4. Generate a clear report of any discrepancies, including the record ID and the reason for failure.
5. Provide instructions on how to run the script and interpret the output.

Output format Provide the script in a code block, followed by a brief explanation of how it works and how to customize it. Include sample output for a few test cases.

Guardrails

• Do not assume specific data formats; use flexible parsing where possible.
• Do not include any actual sensitive data in the example.
• Ensure the script is safe to run and does not modify the original data.

Example

• {{data_type}}: patient birth dates; {{validation_rules}}: must be in YYYY-MM-DD format and not in the future; {{data_source}}: CSV file; {{output_requirements}}: log file with errors.