How to Plan and Run Machine Learning Experiments Systematically
Machine learning experiments can take a long time. Hours, days, and even weeks in some cases.
This gives you a lot of time to think and plan for additional experiments to perform.
In addition, the average applied machine learning project may require tens to hundreds of discrete experiments in order to find a data preparation model and model configuration that gives good or great performance.
The drawn-out nature of the experiments means that you need to carefully plan and manage the order and type of experiments that you run.
You need to be systematic.
In this post, you will discover a simple approach to plan and manage your machine learning experiments.
With this approach, you will be able to:
- Stay on top of the most important questions and findings in your project.
- Keep track of what experiments you have completed and would like to run.
- Zoom in on the data preparations, models, and model configurations that give the best performance.
Let’s dive in.