(This is a placeholder for my exploration of various tools used in the machine learning ecosystem)
As we consider machine learning projects, from end to end fashion, following are some of the phases and based on each phase, we have different toolsets which enable the engineer to perform the data processing in each phase.
Phases in Machine Learning project
- Data ingestion
- Data exploration
- Data analysis
- Data visualization
- Model training
- Model testing
- Model deployment
- Model serving
- Model logging/healthchecks etc
Tools used in each phase
(unordered by its usage)
- Python
- numpy
- Tensorflow
- Apache Spark
- pandas
- R
- SAS
- jupyter notebooks
- kubeflow
Learning continues...