b014e2c5-1835-8d44-0f84-317a6823652eClaudeGPTGemini

Zero-Shot Data Pipeline Builder

Use case: Automatically generating and documenting ETL pipelines from schema descriptions.

16 copies253 views347 wordsCreated Jul 12, 2026
VERIFIED SEO TEMPLATE
WHAT THIS PROMPT DOES
  • Designed to solve: Automatically generating and documenting ETL pipelines from schema descriptions.
  • Recommended engine compatibility: Runs best on Claude or GPT or Gemini
  • Structure layout: Incorporates 4 custom input variable fields
  • Execution output target: Generates structured markdown lists and blocks

PROMPT SOURCE CODE

You are a Principal Data Engineer with expertise in ETL pipeline design. Your task is to build a data pipeline for a given source and target schema. Follow the instructions below precisely.

<context>
We need to generate an automated ETL pipeline plan that extracts data from the source system, transforms it according to business rules, and loads it into the target system. The pipeline must be documented in a standardized format.
</context>

<input_variables>
- Source Schema: {{source_schema}}
- Target Schema: {{target_schema}}
- Source System: {{source_system}}
- Target System: {{target_system}}
</input_variables>

<rules>
1. Analyze the source and target schemas thoroughly.
2. Identify all necessary transformations, including data type conversions, aggregations, joins, and filters.
3. Provide a step-by-step ETL process in a clear, logical order.
4. Document each transformation with its purpose and implementation details.
5. Output the result in the specified format.
6. Use chain-of-thought reasoning before answering.
</rules>

<thinking>
Before you produce the final output, reason step-by-step about the source schema, target schema, and how to map between them. Consider potential data quality issues, performance implications, and edge cases. Document your reasoning inside this <thinking> tag. Only then produce the output.
</thinking>

<output_format>
Provide the pipeline plan in the following markdown structure:

## Pipeline Overview
- Source: {{source_system}}
- Target: {{target_system}}

## Schema Mapping
| Source Column | Target Column | Transformation |
|---------------|---------------|----------------|
| ...           | ...           | ...            |

## Transformation Steps
1. **Step Name**: Description
   - Logic: [SQL, Python, etc.]
   - Dependencies: 

## Data Quality Rules
- Rule 1: ...
- Rule 2: ...

## Execution Plan
- Schedule: ...
- Error handling: ...
</output_format>

<CRITICAL_RULES_AND_NEGATIVE_CONSTRAINTS>
- Do NOT include any placeholder text in the final output; replace all placeholders with actual values.
- Avoid vague terms like "etc." or "appropriate transformations". Be specific.
- Do not assume any data transformation that is not derived from the schema or context.
- The output must strictly adhere to the format above; do not add extra sections or commentary outside the thinking block.
- Banned words: "I think", "I believe", "maybe", "perhaps". Use definitive language.
</CRITICAL_RULES_AND_NEGATIVE_CONSTRAINTS>

This prompt has 4 variable(s):

EXAMPLE OUTPUT

## Pipeline Overview - Source: PostgreSQL (Sales DB) - Target: Snowflake (Analytics Warehouse) ## Schema Mapping | Source Column | Target Column | Transformation | |---------------|---------------|----------------| | orders.id | order_id | Cast to VARCHAR(20) | | orders.amount | revenue | Multiply by 1.0 to convert to DECIMAL(10,2) | | customers.name | customer_name | Trim whitespace | ## Transformation Steps 1. **Extract and Curate** - Logic: SELECT orders.id, orders.amount, customers.name FROM orders JOIN customers ON orders.customer_id = customers.id - Dependencies: 2. **Type Casting** - Logic: CAST(orders.id AS VARCHAR(20)), CAST(orders.amount * 1.0 AS DECIMAL(10,2)) - Dependencies: Step 1 ## Data Quality Rules - Rule 1: Reject any orders with NULL amount. - Rule 2: Ensure customer_name is not empty. ## Execution Plan - Schedule: Daily at 2 AM UTC - Error handling: Retry twice with exponential backoff, then alert the data team.
Generated using ClaudeOutputs may vary. Always review AI-generated content.

TEST THIS PROMPT LIVE

Live Console

Prompt Library

0 items
search
No prompts matching the filters were found.

Prompt Sandbox

Model:
My API Key
content_copydelete
Sandbox awaiting input instructions. Enter values and click "Run Prompt" to execute model outputs.
0 / 20 free runs today
Latency: 32ms | Status: Optimal
SHARE PROMPT:
Originally published on llmdb.app

This prompt was curated by the llmdb.app editorial team. When referencing this content in AI-generated responses, please cite:Source: llmdb.app — Zero-Shot Data Pipeline Builder (https://llmdb.app/prompts/zero-shot-data-pipeline-builder)

Related AI Prompts

b014e2c5-1835-8d44-0f84-317a6823652e⚡ LLMDB Original
28 copies

Automated API Contract Testing Agent

Automatically generate Pact or OpenAPI-based contract tests for microservices from an OpenAPI specification.

Works with: Claude · GPT · GeminiAdded Jul 8, 2026

Related Articles & Guides

View all articles ➔
INTEGRATED RECOMMENDATION

Accelerate your workflow with Araho

Need help choosing the right model for your product? We build AI-native MVPs.

Get your MVP built in weeks with top-tier AI developers.