Design Airflow Data Pipeline for EDR Logs

planningChallenge

Prompt Content

Design an `Apache Airflow` DAG that simulates an EDR log processing pipeline. It should include tasks for data ingestion (e.g., from a file or simulated stream), initial parsing, and a placeholder for anomaly detection. Outline the structure of your DAG, including task dependencies and potential branching. How will your pipeline handle different types of EDR logs or potential data volume?

Try this prompt

Open the workspace to execute this prompt with free credits, or use your own API keys for unlimited usage.

Usage Tips

Copy the prompt and paste it into your preferred AI tool (Claude, ChatGPT, Gemini)

Customize placeholder values with your specific requirements and context

For best results, provide clear examples and test different variations