Data Pipeline Architecture Review
Review and optimize data pipeline architectures for performance and reliability
Content
Review this data pipeline architecture and provide optimization recommendations: Pipeline purpose: {{purpose}} Data sources: {{sources}} Current stack: {{stack}} Data volume: {{volume}} Latency requirements: {{latency}} Analyze: 1. Architecture diagram critique (bottlenecks, single points of failure) 2. Data quality checks and validation strategy 3. Error handling and dead letter queue design 4. Monitoring and alerting recommendations 5. Cost optimization opportunities 6. Scaling strategy for 10x growth 7. Data governance and lineage tracking 8. Recommended tech stack changes with justification Provide before/after architecture comparison.
Related Prompts
Technical Debt Audit & Refactoring Plan
Analyzes a codebase description or code sample to identify technical debt, prioritize refactoring opportunities, and produce an actionable cleanup plan with effort estimates.
Security Adversarial Tester
Test AI systems for prompt injection and security vulnerabilities
Regex Pattern Generator and Explainer
Generates precise regular expressions for any text matching task and explains each component in plain English, with test cases and language-specific implementation code.
Python Automation Script Builder
Generate clean, production-ready Python automation scripts with error handling, logging, and documentation — for web scraping, file processing, API integration, and scheduled tasks.