Prefect

Prefect is an open-source orchestration engine that turns your Python functions into production-grade data pipelines with minimal friction Ref: https://docs.prefect.io/v3/get-started Used for : Task Management, Flow, Scheduling, Monitoring, Task Management: allow to break workflow into smaller tasks. Videos: PAL 101: Prefect Basics – Write Workflows You Can Schedule and Monitor 'https://www.youtube.com/watch?v=sZaHczwu74k Mastering Workflow Automation: Using …