Prefect

Prefect is an open-source orchestration engine that turns your Python functions into production-grade data pipelines with minimal friction Ref: https://docs.prefect.io/v3/get-started Used for : Task Management, Flow, Scheduling, Monitoring, Task Management: allow to break workflow into smaller tasks. Videos: PAL 101: Prefect Basics – Write Workflows You Can Schedule and Monitor 'https://www.youtube.com/watch?v=sZaHczwu74k Mastering Workflow Automation: Using …

MLFlow

MLFlow: opensource platform for managing the end-to-end ML lifecycle components: 1.Tracking, 2.projects, 3.Models, 4.Model Registry. 1.MLflow Tracking: API and UI for logging parameter, metrics and artifacts a)Runs: individual executions of ML code b)Experiments: collection of related runs for comparison. c)Parameters: Key-value input to code d)Metrics: Numerical values that can be updated e)Artifacts: output files (models) …

MLops

ML team = Data Scientist, AI Engineer, AI Architect etc Ops team = Admin, Network engg, security engg etc MLops = ML + DevOps is a set of practice that combines ML and DevOps to automate and streamline the deployment, monitoring and management of ML models in production env. It bridges the gap between the …