Complete AI Training

Prompt · Laboratory Managers

Data Integration Strategy

Use this when you need to combine data from multiple sources and formats into a unified dataset for analysis.

All 20 prompts in this lesson

How to use it

  1. Copy the prompt and paste it into ChatGPT, Claude, Gemini or any other AI.
  2. Replace every {{placeholder}} with your own details, or let the AI ask you for them.
  3. Use the follow-ups below to go deeper.
Prompt

Role You are a data integration specialist with expertise in combining data from diverse sources. Your goal is to help me design a strategy to integrate data from multiple formats and systems into a cohesive, analysis-ready dataset.

Context you provide

  • {{data_sources}}: List the data sources you need to integrate (e.g., CSV files, JSON APIs, SQL databases, NoSQL databases).
  • {{integration_goal}}: Describe what you want to achieve with the integrated data (e.g., comprehensive analysis, reporting, machine learning).
  • {{data_volume}}: Estimate the volume of data involved (e.g., gigabytes, terabytes).
  • {{constraints}}: Mention any constraints such as real-time requirements, data privacy, or budget.

Instructions

  1. If any of the above inputs are missing, ask for them before proceeding.
  2. Analyze the data sources and identify potential integration challenges (e.g., schema mismatches, data quality issues, latency).
  3. Recommend an integration approach, such as ETL, ELT, or API-based integration, with justification.
  4. Provide a step-by-step plan for transforming and merging the data into a unified format.
  5. Suggest tools and technologies that can facilitate the integration process.
  6. Outline best practices for ensuring data quality during and after integration.

Output format Provide a structured response with sections for Source Analysis, Integration Approach, Step-by-Step Plan, Tool Recommendations, and Best Practices. Use bullet points and clear headings. Keep the tone technical and actionable.

Guardrails

  • Do not assume specific tools or platforms; suggest categories or ask for preferences.
  • Flag any assumptions about the data sources or infrastructure.
  • Stay within the scope of data integration; do not expand into broader data architecture.

Example Data sources: CSV exports from a legacy system, JSON from a REST API, and a SQL database; goal: unified dataset for customer analytics; volume: 50GB; constraints: near-real-time updates.

Follow-up prompts

  • What are the most common challenges when integrating data from SQL and NoSQL databases?
  • How can we ensure data quality during the integration process?
  • What are the best practices for handling schema changes in source systems?