The samples in this project are intended for providing a starting point for building ML solutions with MLOps practices.
They are meant to represent different frameworks such as Tensorflow or Yolo, different scenarios such as model training in the cloud or influencing on the edge, or how certain technologies are used such as mocking Azure ML SDK for unit testing or leveraging observability library to send logs and metrics to different destinations.
Each sample has a README that details what it's meant to demonstrate. Below we provide some classifications to easily identify the samples after three aspects:
- Relation to tools from the common section of this repo
- MLOps / DevOps for Data Science aspects which are covered
- Azure Well Architectured Framework principles which are covered
| Sample | azureml_appinsights_logger | infrastructure | pipeline_monitor/trigger | pytest-fixtures |
|---|---|---|---|---|
| Appendable AML Pipeline Step Template | compatible (not implemented) | prerequisite | compatible | compatible (not implemented) |
| Hyperparameter Tutorial | compatible (not implemented) | prerequisite | compatible | compatible (not implemented) |
| Image classification with Tensorflow and Keras | compatible (not implemented yet) | prerequisite | compatible | compatible (not implemented) |
| Run Kaldi ASR Toolkit in AML Pipelines | compatible (other logger implemented) | prerequisite | compatible | compatible (unit tests differently implemented) |
| Run non-Python code in AML Pipelines | compatible (not implemented yet) | prerequisite | compatible | showcasing |
| Parallel Data Preprocessing in AML Pipelines | compatible (not implemented) | prerequisite | compatible | compatible (not implemented) |
| Wrapping existing ML scripts for AML Pipelines Tutorial | compatible (not implemented) | prerequisite | compatible | compatible (not implemented) |
| MLOps for Azure Custom Question Answering | not compatible | IaC script provided | not compatible | not compatible |
| Sample | CI/CD (AML pipeline) | CI/CD (ML model) | Use of AML pipelines | Model Training |
|---|---|---|---|---|
| Appendable AML Pipeline Step Template | ❌ | ❌ | ✔️ | ✔️ |
| Hyperparameter Tutorial | ❌ | ❌ | ✔️ | ✔️ |
| Image classification with Tensorflow and Keras | ✔️ | ✔️ | ✔️ | ✔️ |
| Run Kaldi ASR Toolkit in AML Pipelines | ✔️ | ❌ | ✔️ | ❌ |
| Run non-Python code in AML Pipelines | ✔️ | ❌ | ✔️ | ❌ |
| Parallel Data Preprocessing in AML Pipelines | ❌ | ❌ | ✔️ | ✔️ |
| Wrapping existing ML scripts for AML Pipelines Tutorial | ❌ | ❌ | ✔️ | ✔️ |
| MLOps for Azure Custom Question Answering | ✔️ | ❌ | ❌ | ❌ |
| Sample | Cost Optimization | Operational Excellence | Performance Efficiency | Reliability | Security |
|---|---|---|---|---|---|
| Appendable AML Pipeline Step Template | Pay for consumption | ||||
| Edge Object Detection | Pay for consumption | Fully automated infrastructure provisioning and code deployment, provides guidance on design, has edge container monitoring built in | Scalable deployment of modules to many devices | Can recover from losing network for for a full day, monitoring and container health built in but would require setup to hook into alerting system | |
| Hyperparameter Tutorial | Pay for consumption | Optimize build and release processes | |||
| Image classification with Tensorflow and Keras | Pay for consumption | Optimize build and release processes, Monitor the system (planned) | Monitor and measure application health (planned) | Use Identity as Primary Access Control | |
| Run Kaldi ASR Toolkit in AML Pipelines | Pay for consumption | Optimize build and release processes | Use Identity as Primary Access Control | ||
| Run non-Python code in AML Pipelines | Pay for consumption | Optimize build and release processes, Monitor the system (planned) | Use Identity as Primary Access Control | ||
| Parallel Data Preprocessing in AML Pipelines | Pay for consumption | Monitor the system (planned) | Monitor and optimize (planned) | ||
| Wrapping existing ML scripts for AML Pipelines Tutorial | Pay for consumption | ||||
| MLOps for Azure Custom Question Answering | Pay for consumption | Fully automated infrastructure provisioning and code deployment |