In an earlier post Deploying a DeepChem Sagemaker Notebook Instance, we introduced how to set up an AWS Sagemaker instance that runs DeepChem. (The installation instructions for today are slightly different since we’re now on DeepChem 2.5+ instead of DeepChem 2.3 but mostly carry over as-is). However, this setup has the major limitation that each time you shutdown/restart your sagemaker instance, you will need to re-install DeepChem. Ideally we’d prefer to have a stable cloud development environment which will continue to have a stable DeepChem installation after shutdown/restart.
AWS provides a tool for setting up Sagemaker environments called “Lifecycle Configurations.” To set up your lifecycle configuration, navigate to your AWS Sagemaker console and go to lifecycle configurations
Next click create lifecycle configuration and go to the “Create Notebook” section in scripts as shown below.
Paste the following script in:
#!/bin/bash set -e # OVERVIEW # This script installs a single pip package in a single SageMaker conda environments. sudo -u ec2-user -i <<'EOF' # PARAMETERS ENVIRONMENT=python3 source /home/ec2-user/anaconda3/bin/activate "$ENVIRONMENT" pip install --pre deepchem[torch] conda install -c conda-forge rdkit source /home/ec2-user/anaconda3/bin/deactivate EOF
Note this configuration installs deepchem[torch]. Modify as needed for your preferred backend. DeepChem will be installed in the built-in python3 conda environment according to this script. You can modify to install in your preferred conda environment as desired. Click “Create Configuration”. Next you will need to create a new Sagemaker notebook instance that uses this Lifecycle Configuration as shown in the image below (note I’ve named my lifecycle configuration “DeepChem-Torch”)
Click “Create Notebook Instance” and wait for your instance to come up. I’ve named my notebook insntance DeepChem-K80 since I set it up to use a K80 GPU. Name your instance as desired. Once the instance is up, launch JupyterLab as shown below
Launch the conda_python3 environment as shown below
And now you should be all set to use DeepChem!
Make sure to shut down your notebook instance after you’re done using it! AWS will keep charging you for instances that are left running overnight. It can be dangerously easy to rack up large AWS expenses. Happy hacking!