Leaderboard Ad728 × 90AdSense placeholder — will activate after approval

ETL Pipeline Design for Cloud Data Warehouse

Data Data Engineering advanced 🤖 ChatGPT 👁 2 views

📝 The Prompt

You are a data engineer specializing in cloud data infrastructure. I need to design an ETL/ELT pipeline from source systems to a data warehouse. My setup: Source systems: [list sources: CRM, database, API, files]. Target warehouse: [Snowflake/BigQuery/Redshift/Databricks]. Data volume: [approximate rows/day]. Freshness requirement: [real-time/hourly/daily]. Design the complete pipeline: 1. Architecture decision: ETL vs. ELT for my use case with justification 2. Extraction strategy per source: full load vs. incremental (CDC) with watermark logic 3. Data staging layer design in the warehouse 4. Transformation layer: dbt models structure for my use case 5. Slowly Changing Dimensions (SCD) strategy: Type 1, 2, or 3 6. Data quality checks: row counts, null checks, referential integrity 7. Error handling and recovery: failed runs, partial loads, reprocessing 8. Orchestration with Airflow or Prefect: DAG structure for my pipeline 9. Monitoring: data freshness alerts, pipeline failure notifications 10. Schema evolution handling: adding columns without breaking downstream Write sample dbt models and Airflow DAG for my main use case.

⚙️ Replace 4 placeholders: [list sources: CRM, database, API, files] [Snowflake/BigQuery/Redshift/Databricks] [approximate rows/day] [real-time/hourly/daily]

🎯 What this prompt does

This AI prompt helps you etl pipeline design for cloud data warehouse. Designed for data engineering workflows in the data category, it's a advanced-level prompt you can copy directly into ChatGPT to get instant, production-ready results.

Use it when you need a advanced prompt that produces clear, actionable output without wrestling with trial-and-error wording. Just copy, customize, and run.

In-article Ad #1336 × 280AdSense placeholder — will activate after approval

🚀 How to use this prompt

  1. Copy the prompt using the 📋 button above.
  2. Open ChatGPT (or Claude, Gemini, Perplexity, or your preferred LLM).
  3. Paste the prompt into a new chat. Replace 4 bracketed placeholders ([list sources: CRM, database, API, files] [Snowflake/BigQuery/Redshift/Databricks] [approximate rows/day] ) with your own details.
  4. Run the prompt and review the AI's response. Most outputs are usable immediately.
  5. Iterate if needed — if the tone, length, or structure isn't quite right, reply with "make it shorter", "use bullet points", or "make it more formal" and the AI will refine it.

💡 Tips for better results

  • Replace the bracketed placeholders ([list sources: CRM, database, API, files], [Snowflake/BigQuery/Redshift/Databricks], [approximate rows/day], [real-time/hourly/daily]) with your own specifics before sending.
  • If the first output isn't quite right, ask the AI to refine, rewrite, or add more detail — iteration is key.
  • For long outputs, ask for a section at a time (e.g. 'start with the introduction only') to keep quality high.
  • Combine this with other data prompts to build an end-to-end workflow.
  • Save your favorite variations — small wording tweaks often produce noticeably different results.
In-article Ad #2336 × 280AdSense placeholder — will activate after approval

✨ What you'll get

When you run this prompt, expect ChatGPT to return:

  • A directly usable data engineering output tailored to the details you provided
  • Clear structure (headings, bullets, or numbered sections) that you can drop into your workflow
  • Content that matches your specified tone and context
  • Results in under 30 seconds — no manual drafting required

Need a different angle? Just ask follow-up questions. The AI will adjust without you starting over.

🔄 3 variations to try

1

Make it more formal

Add "Use a formal, professional tone suitable for enterprise clients" at the start of the prompt.

2

Ask for multiple options

Append "Give me 5 alternative versions, each with a different angle or approach." after the main instruction.

3

Request structured output

Add "Return the response as a markdown table (or bullet list, or JSON)" so you can paste the result directly into your docs or code.

🏷 Tags

🔎 Find more prompts like this

Browse 56 more data prompts or search the full library.

End-of-content Ad728 × 90AdSense placeholder — will activate after approval
Mobile Sticky320 × 50AdSense placeholder — will activate after approval