Data Pipeline Architecture Review
Review and optimize data pipeline architectures for performance and reliability
Content
Review this data pipeline architecture and provide optimization recommendations: Pipeline purpose: {{purpose}} Data sources: {{sources}} Current stack: {{stack}} Data volume: {{volume}} Latency requirements: {{latency}} Analyze: 1. Architecture diagram critique (bottlenecks, single points of failure) 2. Data quality checks and validation strategy 3. Error handling and dead letter queue design 4. Monitoring and alerting recommendations 5. Cost optimization opportunities 6. Scaling strategy for 10x growth 7. Data governance and lineage tracking 8. Recommended tech stack changes with justification Provide before/after architecture comparison.
Related Prompts
API Documentation Generator
Generate comprehensive API documentation including endpoints, parameters, responses, and code examples.
Regex Pattern Generator and Explainer
Generates precise regular expressions for any text matching task and explains each component in plain English, with test cases and language-specific implementation code.
API Test Case Generator
Generate comprehensive test cases for REST APIs
Code Documentation Generator
Generate comprehensive documentation for codebases