Course overview
Start hereAI for Data Engineers
START HERE

Priya's Thursday, two ways

8 lessons · 29 prompts

A day in the life of a Data Engineer: what changes with these prompts.

Track progress as a member

Priya, a data engineer on a retail analytics team.

Priya starts Thursday with a failed pipeline. The nightly load from orders_raw stopped after 2:15 AM, and the error log mentions a type mismatch on order_total. She opens ChatGPT and uses the Pipeline Monitoring prompt: she pastes the log lines, explains the source table, and asks for likely causes and a safe fix. It points to a decimal column that arrived as text.

Before lunch, she needs to clean a new returns table. She uses the Data Transformation prompt in Claude, giving column names like return_id, order_date, and reason_code. Claude drafts a small SQL block to trim spaces, cast dates, and drop duplicate rows. Priya tests it on a sample and adjusts one rule.

Then she runs the Data Quality Checks prompt in Gemini. She asks for checks on missing order_id, negative return amounts, and dates in the future. Gemini suggests a query that counts each issue by day. Priya adds two checks to the pipeline and writes a short note for the analysts.

With the pipeline fixed and checks in place, Priya uses the Query Performance Tuning prompt in ChatGPT for a slow analyst query. She pastes the query plan and asks why it scans the full sales table. The suggestion to add a date filter and a composite index helps her cut the wait. She finishes early and uses the time to walk through the data dictionary with a new analyst.

Before

  • Back-to-back pipeline fires
  • Manual log reading late at night
  • Slow queries blocking analysts
  • Documentation always at the bottom

After this course

  • Fewer repeated debugging loops
  • Quality checks catch issues early
  • Queries tuned with clear plans
  • Time for documentation and mentoring

What you'll learn

  • Data Transformation: Ask AI to draft and debug code that cleans raw data into analysis-ready tables.
  • Quality Checks: Design checks that catch missing values, duplicates, and broken rules before analysts see them.
  • Pipeline Design: Plan pipeline steps, choose batch or streaming, and document the architecture with AI help.
  • Pipeline Monitoring: Use AI to read logs, find likely causes, and suggest fixes for failed pipeline runs.
  • Query Tuning: Optimize slow SQL, test indexing ideas, and explain execution plans in plain language.
  • Storage and Schema: Compare storage formats, choose partitioning, and design schemas for your warehouse.
  • Workflow Automation: Write orchestration code and schedule recurring pipeline tasks with AI as a drafting partner.
  • Team Documentation: Explain data models to analysts, write data dictionaries, and draft handoff notes.

How this course works

  1. 8 lessonsOne task of your job each, from data transformation to collaboration & documentation.
  2. Ready-to-paste promptsCopy, fill in the parts in {{brackets}}, paste into ChatGPT, Claude or Gemini.
  3. Tick and completeTick the prompts you tried and mark each lesson complete.
  4. Get certifiedFinish and keep the prompts as your own library.