Training deep learning models on AWS and GCP instances
Spotty drastically simplifies training of deep learning models on AWS and GCP:
Requirements:
Use pip to install or upgrade Spotty:
$ pip install -U spotty
Prepare a spotty.yaml
file and put it to the root directory of your project:
Start an instance:
$ spotty start
It will run a Spot Instance, restore snapshots if any, synchronize the project with the running instance and start the Docker container with the environment.
Train a model or run notebooks.
To connect to the running container via SSH, use the following command:
$ spotty sh
It runs a tmux session, so you can always detach this session using
Ctrl + b
, then d
combination of keys. To be attached to that session later, just use the
spotty sh
command again.
Also, you can run your custom scripts inside the Docker container using the spotty run <SCRIPT_NAME>
command. Read more
about custom scripts in the documentation:
Configuration: "scripts" section.
Any feedback or contributions are welcome! Please check out the guidelines.