AWS Deep Learning Containers (DLCs) are a set of Docker images for training and serving models in TensorFlow, TensorFlow 2, PyTorch, and MXNet.
For details on the complete list of DLCs, please visit the AWS documentation page: https://docs.aws.amazon.com/deep-learning-containers/latest/devguide/deep-learning-containers-images.html
Images Published:
763104351884.dkr.ecr.us-west-2.amazonaws.com/pytorch-training:2.2.0-cpu-py310-ubuntu20.04-sagemaker-v1.5
sha256:1ed59449804fa67fa98af7e9563c563ec8870043698eb701308529785997e078
All tags:
2.2.0-cpu-py310-ubuntu20.04-sagemaker-v1.5
2.2.0-cpu-py310-ubuntu20.04-sagemaker
2.2.0-cpu-py310-ubuntu20.04-sagemaker-v1.5-2024-04-18-18-01-59
2.2-cpu-py310-ubuntu20.04-sagemaker-v1
2.2.0-cpu-py310
2.2-cpu-py310
Important Packages:
pip packages | apt|deb packages |
---|---|
PyYAML==6.0.1 | emacs & emacs-bin-common & emacs-common & emacs-gtk & emacsen-common |
awscli==1.32.85 | emacs & emacs-bin-common & emacs-common & emacs-gtk & emacsen-common |
boto3==1.34.85 | libgcc-9-dev:amd64 & libgcc-s1:amd64 |
botocore==1.34.85 | libgcc-9-dev:amd64 & libgcc-s1:amd64 |
cffi==1.16.0 | libstdc++-9-dev:amd64 & libstdc++6:amd64 |
cloudpickle==2.2.1 | |
Cython==3.0.10 | |
fastai==2.7.14 | |
filelock==3.13.4 | |
h5py==3.11.0 | |
mpi4py==3.1.6 | |
numpy==1.26.4 | |
opencv-python==4.9.0.80 | |
packaging==23.2 | |
pandas==2.2.2 | |
pillow==10.3.0 | |
protobuf==3.20.3 | |
pybind11==2.12.0 | |
requests==2.31.0 | |
s3fs==0.4.2 | |
s3transfer==0.10.1 | |
sagemaker==2.215.0 | |
sagemaker-experiments==0.1.45 | |
sagemaker-pytorch-training==2.8.1 | |
sagemaker-training==4.7.4 | |
scikit-learn==1.4.2 | |
scipy==1.13.0 | |
seaborn==0.13.2 | |
setuptools==68.2.2 | |
smclarify==0.5 | |
smdebug-rulesconfig==1.0.1 | |
spacy==3.7.3 | |
torch==2.2.0 | |
torchaudio==2.2.0 | |
torchvision==0.17.0 |
763104351884.dkr.ecr.us-west-2.amazonaws.com/pytorch-training:2.2.0-gpu-py310-cu121-ubuntu20.04-sagemaker-v1.5
sha256:e71e93e3c3ea1d126819a15befc0aaa66f4dc4055ef62ade652c7aa8c026a3db
All tags:
2.2.0-gpu-py310-cu121-ubuntu20.04-sagemaker-v1.5
2.2.0-gpu-py310
2.2.0-gpu-py310-cu121-ubuntu20.04-sagemaker-v1.5-2024-04-18-18-01-59
2.2-gpu-py310-cu121-ubuntu20.04-sagemaker-v1
2.2-gpu-py310
2.2.0-gpu-py310-cu121-ubuntu20.04-sagemaker
Important Packages:
pip packages | apt|deb packages |
---|---|
PyYAML==6.0.1 | emacs & emacs-bin-common & emacs-common & emacs-gtk & emacsen-common |
absl-py==2.1.0 | emacs & emacs-bin-common & emacs-common & emacs-gtk & emacsen-common |
apex==0.1 | libcudnn8 & libcudnn8-dev |
awscli==1.32.85 | libgcc-9-dev:amd64 & libgcc-s1:amd64 |
boto3==1.34.85 | libgcc-9-dev:amd64 & libgcc-s1:amd64 |
botocore==1.34.85 | libstdc++-9-dev:amd64 & libstdc++6:amd64 |
cffi==1.16.0 | |
cloudpickle==2.2.1 | |
Cython==3.0.10 | |
fastai==2.7.14 | |
filelock==3.13.4 | |
h5py==3.11.0 | |
mpi4py==3.1.6 | |
ninja==1.11.1.1 | |
numpy==1.26.4 | |
opencv-python==4.9.0.80 | |
packaging==23.2 | |
pandas==2.2.2 | |
pillow==10.3.0 | |
protobuf==3.20.3 | |
pybind11==2.12.0 | |
requests==2.31.0 | |
s3fs==0.4.2 | |
s3transfer==0.10.1 | |
sagemaker==2.215.0 | |
sagemaker-experiments==0.1.45 | |
sagemaker-pytorch-training==2.8.1 | |
sagemaker-training==4.7.4 | |
scikit-learn==1.4.2 | |
scipy==1.13.0 | |
seaborn==0.13.2 | |
setuptools==68.2.2 | |
smclarify==0.5 | |
smdebug-rulesconfig==1.0.1 | |
spacy==3.7.3 | |
torch==2.2.0 | |
torchaudio==2.2.0 | |
torchvision==0.17.0 |
For details on the complete list of DLCs, please visit the AWS documentation page: https://docs.aws.amazon.com/deep-learning-containers/latest/devguide/deep-learning-containers-images.html
Images Published:
763104351884.dkr.ecr.us-west-2.amazonaws.com/djl-inference:0.27.0-cpu-full-v1.0
sha256:b1f58683d2b73f1698108c591755740b36809d963aeea6d65857ad8d4fbe03f5
All tags:
0.27.0-cpu-full
0.27.0-cpu-full-v1.0
0.27.0-cpu-full-v1.0-2024-04-18-18-48-47
0.27-cpu-full-v1
Important Packages:
pip packages | apt|deb packages |
---|---|
PyYAML==6.0.1 | libgcc-11-dev:amd64 & libgcc-s1:amd64 |
awscli==1.32.86 | libgcc-11-dev:amd64 & libgcc-s1:amd64 |
botocore==1.34.86 | libstdc++-11-dev:amd64 & libstdc++6:amd64 |
numpy==1.26.4 | |
packaging==24.0 | |
requests==2.31.0 | |
s3transfer==0.10.1 | |
setuptools==59.6.0 |
For details on the complete list of DLCs, please visit the AWS documentation page: https://docs.aws.amazon.com/deep-learning-containers/latest/devguide/deep-learning-containers-images.html
Images Published:
763104351884.dkr.ecr.us-west-2.amazonaws.com/djl-inference:0.27.0-neuronx-sdk2.18.1-v1.1
sha256:74a26aa527265a5a163b36d4939e5f5da71df44ead1addc30e3db1df34afdbfb
All tags:
0.27.0-neuronx-sdk2.18.1-v1.1
0.27-neuronx-sdk2.18.1-v1
0.27.0-neuronx-sdk2.18.1
0.27.0-neuronx-sdk2.18.1-v1.1-2024-04-18-00-31-28
Important Packages:
pip packages | apt|deb packages |
---|---|
PyYAML==6.0.1 | libgcc-9-dev:amd64 & libgcc-s1:amd64 |
absl-py==2.1.0 | libgcc-9-dev:amd64 & libgcc-s1:amd64 |
awscli==1.32.86 | libstdc++-9-dev:amd64 & libstdc++6:amd64 |
boto3==1.34.86 | |
botocore==1.34.86 | |
datasets==2.18.0 | |
filelock==3.13.4 | |
numpy==1.25.2 | |
packaging==24.0 | |
pandas==2.2.2 | |
pillow==10.3.0 | |
protobuf==3.19.6 | |
regex==2024.4.16 | |
requests==2.31.0 | |
s3transfer==0.10.1 | |
scipy==1.11.2 | |
sentencepiece==0.2.0 | |
setuptools==69.5.1 | |
tokenizers==0.15.2 | |
torch==2.1.2 | |
transformers==4.36.2 |
For details on the complete list of DLCs, please visit the AWS documentation page: https://docs.aws.amazon.com/deep-learning-containers/latest/devguide/deep-learning-containers-images.html
Images Published:
763104351884.dkr.ecr.us-west-2.amazonaws.com/djl-inference:0.27.0-neuronx-sdk2.18.1-v1.0
sha256:b5abc5f02415c9a53ea56361ef5c6711106786047ecdb0936241cf7ab6adc832
All tags:
0.27-neuronx-sdk2.18.1-v1
0.27.0-neuronx-sdk2.18.1-v1.0
0.27.0-neuronx-sdk2.18.1
0.27.0-neuronx-sdk2.18.1-v1.0-2024-04-17-21-00-19
Important Packages:
pip packages | apt|deb packages |
---|---|
PyYAML==6.0.1 | libgcc-9-dev:amd64 & libgcc-s1:amd64 |
absl-py==2.1.0 | libgcc-9-dev:amd64 & libgcc-s1:amd64 |
awscli==1.32.85 | libstdc++-9-dev:amd64 & libstdc++6:amd64 |
boto3==1.34.85 | |
botocore==1.34.85 | |
datasets==2.18.0 | |
filelock==3.13.4 | |
numpy==1.25.2 | |
packaging==24.0 | |
pandas==2.2.2 | |
pillow==10.3.0 | |
protobuf==3.19.6 | |
regex==2024.4.16 | |
requests==2.31.0 | |
s3transfer==0.10.1 | |
scipy==1.11.2 | |
sentencepiece==0.2.0 | |
setuptools==69.5.1 | |
tokenizers==0.15.2 | |
torch==2.1.2 | |
transformers==4.36.2 |
For details on the complete list of DLCs, please visit the AWS documentation page: https://docs.aws.amazon.com/deep-learning-containers/latest/devguide/deep-learning-containers-images.html
Images Published:
763104351884.dkr.ecr.us-west-2.amazonaws.com/djl-inference:0.27.0-tensorrtllm0.8.0-cu122-v1.3
sha256:ae806f2f1f2fefdf2784aae40c9cd849c88ca5894518620b9cb25f17a74648f7
All tags:
0.27-tensorrtllm0.8.0-cu122-v1
0.27.0-tensorrtllm0.8.0-cu122-v1.3-2024-04-17-18-40-45
0.27.0-tensorrtllm0.8.0-cu122-v1.3
0.27.0-tensorrtllm0.8.0-cu122
Important Packages:
pip packages | apt|deb packages |
---|---|
PyYAML==6.0.1 | cuda-command-line-tools-12-2 |
awscli==1.32.85 | libcublas-12-2 & libcublas-dev-12-2 |
botocore==1.34.85 | libcudnn8 & libcudnn8-dev |
Cython==3.0.10 | libgcc-11-dev:amd64 & libgcc-s1:amd64 |
datasets==2.18.0 | libgcc-11-dev:amd64 & libgcc-s1:amd64 |
filelock==3.13.4 | libnccl-dev & libnccl2 |
mpi4py==3.1.6 | libnccl-dev |
ninja==1.11.1.1 | libstdc++-11-dev:amd64 & libstdc++6:amd64 |
numpy==1.26.4 | |
packaging==24.0 | |
pandas==2.2.2 | |
pillow==10.3.0 | |
protobuf==5.26.1 | |
regex==2024.4.16 | |
requests==2.31.0 | |
s3transfer==0.10.1 | |
scipy==1.13.0 | |
sentencepiece==0.2.0 | |
setuptools==69.5.1 | |
tokenizers==0.15.2 | |
torch==2.1.2 | |
torchvision==0.16.2 | |
transformers==4.38.1 |
For details on the complete list of DLCs, please visit the AWS documentation page: https://docs.aws.amazon.com/deep-learning-containers/latest/devguide/deep-learning-containers-images.html
Images Published:
763104351884.dkr.ecr.us-west-2.amazonaws.com/pytorch-training:2.2.0-cpu-py310-ubuntu20.04-ec2-v1.6
sha256:37278c1e6a3ab794c47a7a360aea8385ff9b7cba8f7e88f260f89bd52188d653
All tags:
2.2.0-cpu-py310-ec2
2.2.0-cpu-py310-ubuntu20.04-ec2
2.2-cpu-py310-ubuntu20.04-ec2-v1
2.2.0-cpu-py310-ubuntu20.04-ec2-v1.6-2024-04-17-17-15-26
2.2.0-cpu-py310-ubuntu20.04-ec2-v1.6
2.2-cpu-py310-ec2
Important Packages:
pip packages | apt|deb packages |
---|---|
PyYAML==6.0.1 | emacs & emacs-bin-common & emacs-common & emacs-gtk & emacsen-common |
awscli==1.32.85 | emacs & emacs-bin-common & emacs-common & emacs-gtk & emacsen-common |
boto3==1.34.85 | libgcc-9-dev:amd64 & libgcc-s1:amd64 |
botocore==1.34.85 | libgcc-9-dev:amd64 & libgcc-s1:amd64 |
cffi==1.16.0 | libstdc++-9-dev:amd64 & libstdc++6:amd64 |
Cython==3.0.10 | |
fastai==2.7.14 | |
filelock==3.13.4 | |
h5py==3.11.0 | |
mpi4py==3.1.6 | |
numpy==1.26.4 | |
opencv-python==4.9.0.80 | |
packaging==23.2 | |
pandas==2.2.2 | |
pillow==10.3.0 | |
pybind11==2.12.0 | |
requests==2.31.0 | |
s3transfer==0.10.1 | |
scikit-learn==1.4.2 | |
scipy==1.13.0 | |
setuptools==68.2.2 | |
spacy==3.7.3 | |
torch==2.2.0 | |
torchaudio==2.2.0 | |
torchvision==0.17.0 |
763104351884.dkr.ecr.us-west-2.amazonaws.com/pytorch-training:2.2.0-gpu-py310-cu121-ubuntu20.04-ec2-v1.6
sha256:ecabaad6fba5f05dd4ea9d1e68ebd358b5e552d170e478b8978f743ff6fa30c4
All tags:
2.2-gpu-py310-ec2
2.2.0-gpu-py310-cu121-ubuntu20.04-ec2-v1.6-2024-04-17-17-15-24
2.2-gpu-py310-cu121-ubuntu20.04-ec2-v1
2.2.0-gpu-py310-cu121-ubuntu20.04-ec2-v1.6
2.2.0-gpu-py310-cu121-ubuntu20.04-ec2
2.2.0-gpu-py310-ec2
Important Packages:
pip packages | apt|deb packages |
---|---|
PyYAML==6.0.1 | emacs & emacs-bin-common & emacs-common & emacs-gtk & emacsen-common |
absl-py==2.1.0 | emacs & emacs-bin-common & emacs-common & emacs-gtk & emacsen-common |
apex==0.1 | libcudnn8 & libcudnn8-dev |
awscli==1.32.85 | libgcc-9-dev:amd64 & libgcc-s1:amd64 |
boto3==1.34.85 | libgcc-9-dev:amd64 & libgcc-s1:amd64 |
botocore==1.34.85 | libstdc++-9-dev:amd64 & libstdc++6:amd64 |
cffi==1.16.0 | |
Cython==3.0.10 | |
fastai==2.7.14 | |
filelock==3.13.4 | |
h5py==3.11.0 | |
mpi4py==3.1.6 | |
ninja==1.11.1.1 | |
numpy==1.26.4 | |
opencv-python==4.9.0.80 | |
packaging==23.2 | |
pandas==2.2.2 | |
pillow==10.3.0 | |
protobuf==5.26.1 | |
pybind11==2.12.0 | |
requests==2.31.0 | |
s3transfer==0.10.1 | |
scikit-learn==1.4.2 | |
scipy==1.13.0 | |
setuptools==68.2.2 | |
spacy==3.7.3 | |
torch==2.2.0 | |
torchaudio==2.2.0 | |
torchvision==0.17.0 |
For details on the complete list of DLCs, please visit the AWS documentation page: https://docs.aws.amazon.com/deep-learning-containers/latest/devguide/deep-learning-containers-images.html
Images Published:
763104351884.dkr.ecr.us-west-2.amazonaws.com/djl-inference:0.27.0-tensorrtllm0.8.0-cu122-v1.2
sha256:a07fc07e181e42db44f3fd7378aef9ea97f41635804e5402f9b783b3dd50effd
All tags:
0.27.0-tensorrtllm0.8.0-cu122
0.27.0-tensorrtllm0.8.0-cu122-v1.2
0.27-tensorrtllm0.8.0-cu122-v1
0.27.0-tensorrtllm0.8.0-cu122-v1.2-2024-04-16-21-10-51
Important Packages:
pip packages | apt|deb packages |
---|---|
PyYAML==6.0.1 | cuda-command-line-tools-12-2 |
awscli==1.32.84 | libcublas-12-2 & libcublas-dev-12-2 |
botocore==1.34.84 | libcudnn8 & libcudnn8-dev |
Cython==3.0.10 | libgcc-11-dev:amd64 & libgcc-s1:amd64 |
datasets==2.18.0 | libgcc-11-dev:amd64 & libgcc-s1:amd64 |
filelock==3.13.4 | libnccl-dev & libnccl2 |
mpi4py==3.1.6 | libnccl-dev |
ninja==1.11.1.1 | libstdc++-11-dev:amd64 & libstdc++6:amd64 |
numpy==1.26.4 | |
packaging==24.0 | |
pandas==2.2.2 | |
pillow==10.3.0 | |
protobuf==5.26.1 | |
regex==2023.12.25 | |
requests==2.31.0 | |
s3transfer==0.10.1 | |
scipy==1.13.0 | |
sentencepiece==0.2.0 | |
setuptools==69.5.1 | |
tokenizers==0.15.2 | |
torch==2.1.2 | |
torchvision==0.16.2 | |
transformers==4.38.1 |
For details on the complete list of DLCs, please visit the AWS documentation page: https://docs.aws.amazon.com/deep-learning-containers/latest/devguide/deep-learning-containers-images.html
These images are built to be used only on AWS SageMaker
Images Published:
763104351884.dkr.ecr.us-west-2.amazonaws.com/huggingface-pytorch-tgi-inference:2.1.1-tgi2.0.0-gpu-py310-cu121-ubuntu22.04-v2.0
sha256:8d284ed4fa31c1761e5851fbd58795a879d80b32744892fce714927faa0c68d9
All tags:
2.1-tgi2.0-gpu-py310-cu121-ubuntu22.04-v2
2.1.1-tgi2.0.0-gpu-py310-cu121-ubuntu22.04
2.1.1-gpu-py310-cu121-ubuntu22.04
2.1.1-tgi2.0.0-gpu-py310-cu121-ubuntu22.04-v2.0-2024-04-16-17-30-36
2.1.1-tgi2.0.0-gpu-py310-cu121-ubuntu22.04-v2.0
2.1-gpu-py310-cu121-ubuntu22.04-v2
2.1-tgi2.0-gpu-py310-cu121-ubuntu22.04
Important Packages:
pip packages | apt|deb packages |
---|---|
PyYAML==6.0.1 | libgcc-11-dev:amd64 & libgcc-s1:amd64 |
cffi==1.16.0 | libgcc-11-dev:amd64 & libgcc-s1:amd64 |
cloudpickle==3.0.0 | libstdc++-11-dev:amd64 & libstdc++6:amd64 |
datasets==2.18.0 | |
filelock==3.13.3 | |
numpy==1.26.4 | |
packaging==24.0 | |
pandas==2.2.2 | |
pillow==10.3.0 | |
protobuf==4.25.3 | |
regex==2023.12.25 | |
requests==2.31.0 | |
scipy==1.13.0 | |
sentencepiece==0.1.99 | |
setuptools==69.2.0 | |
tokenizers==0.15.2 | |
torch==2.1.1 | |
transformers==4.39.3 | |
wrapt==1.16.0 |
For details on the complete list of DLCs, please visit the AWS documentation page: https://docs.aws.amazon.com/deep-learning-containers/latest/devguide/deep-learning-containers-images.html
Images Published:
763104351884.dkr.ecr.us-west-2.amazonaws.com/djl-inference:0.27.0-deepspeed0.12.6-cu121-v1.3
sha256:4f78a1fd139b46653a76063a3e580c0f64e0bb3a126b0014f571bc8527cac37d
All tags:
0.27-deepspeed0.12.6-cu121-v1
0.27.0-deepspeed0.12.6-cu121-v1.3
0.27.0-deepspeed0.12.6-cu121-v1.3-2024-04-16-16-14-10
0.27.0-deepspeed0.12.6-cu121
Important Packages:
pip packages | apt|deb packages |
---|---|
PyYAML==6.0.1 | cuda-command-line-tools-12-1 |
awscli==1.32.84 | libcublas-12-1 & libcublas-dev-12-1 |
botocore==1.34.84 | libcudnn8 & libcudnn8-dev |
cloudpickle==3.0.0 | libgcc-11-dev:amd64 & libgcc-s1:amd64 |
datasets==2.17.1 | libgcc-11-dev:amd64 & libgcc-s1:amd64 |
filelock==3.13.4 | libnccl-dev & libnccl2 |
mpi4py==3.1.6 | libnccl-dev |
ninja==1.11.1.1 | libstdc++-11-dev:amd64 & libstdc++6:amd64 |
numpy==1.26.4 | |
packaging==24.0 | |
pandas==2.2.2 | |
pillow==10.3.0 | |
protobuf==3.20.3 | |
py-cpuinfo==9.0.0 | |
regex==2023.12.25 | |
requests==2.31.0 | |
s3transfer==0.10.1 | |
scipy==1.13.0 | |
sentencepiece==0.2.0 | |
setuptools==69.5.1 | |
tokenizers==0.15.2 | |
torch==2.1.2+cu121 | |
torchvision==0.16.2+cu121 | |
transformers==4.39.0 |
For details on the complete list of DLCs, please visit the AWS documentation page: https://docs.aws.amazon.com/deep-learning-containers/latest/devguide/deep-learning-containers-images.html
Images Published:
763104351884.dkr.ecr.us-west-2.amazonaws.com/pytorch-inference-graviton:2.2.1-cpu-py310-ubuntu20.04-sagemaker-v1.0
sha256:82fe8622a8d5a3ac6aa6f6325236c10d6a0c49f538ca68159482b8d63d1b9c81
All tags:
2.2-cpu-py310-ubuntu20.04-sagemaker-v1
2.2-cpu-py310
2.2.1-cpu-py310-ubuntu20.04-sagemaker-v1.0-2024-04-16-17-17-50
2.2.1-cpu-py310-ubuntu20.04-sagemaker-v1.0
2.2.1-cpu-py310-ubuntu20.04-sagemaker
2.2.1-cpu-py310
Important Packages:
pip packages | apt|deb packages |
---|---|
PyYAML==6.0 | emacs & emacs-bin-common & emacs-common & emacs-gtk & emacsen-common |
awscli==1.32.81 | emacs & emacs-bin-common & emacs-common & emacs-gtk & emacsen-common |
boto3==1.34.81 | libgcc-10-dev:arm64 & libgcc-9-dev:arm64 & libgcc-s1:arm64 |
botocore==1.34.81 | libgcc-10-dev:arm64 & libgcc-9-dev:arm64 & libgcc-s1:arm64 |
cffi==1.16.0 | libstdc++-10-dev:arm64 & libstdc++-9-dev:arm64 & libstdc++6:arm64 |
Cython==3.0.10 | |
filelock==3.13.4 | |
ninja==1.11.1.1 | |
numpy==1.26.4 | |
opencv-python==4.9.0.80 | |
packaging==23.2 | |
pandas==2.2.1 | |
pillow==10.3.0 | |
requests==2.31.0 | |
s3transfer==0.10.1 | |
sagemaker-pytorch-inference==2.0.22 | |
scikit-learn==1.4.1.post1 | |
scipy==1.13.0 | |
setuptools==68.2.2 | |
torch==2.2.1+cpu | |
torch-model-archiver==0.10.0 | |
torchaudio==2.2.1+cpu | |
torchserve==0.10.0 | |
torchvision==0.17.1+cpu |