10 Command Line Recipes for Deep Learning on Amazon Web Services
Last Updated on August 19, 2019
Running large deep learning processes on Amazon Web Services EC2 is a cheap and effective way to learn and develop models.
For just a few dollars you can get access to tens of gigabytes of RAM, tens of CPU cores, and multiple GPUs. I highly recommend it.
If you are new to EC2 or the Linux command line, there are a suite of commands that you will find invaluable when running your deep learning scripts in the cloud.
In this tutorial, you will discover my private list of the 10 commands I use every time I use EC2 to fit large deep learning models.
After reading this post, you will know:
- How to copy your data to and from your EC2 instances.
- How to set up your scripts to run for days, weeks, or months safely.
- How to monitor processes, the system, and GPU performance.
Kick-start your project with my new book Deep Learning With Python, including step-by-step tutorials and the Python source code files for all examples.
Let’s get started.
Note: All commands executed from your workstation assume you are running a Linux-type environment (e.g. Linux, OS X or cygwin).