Batch Shipyard Versions Save

Simplify HPC and Batch workloads on Azure

3.9.1

4 years ago

Please see the Change Log for a full list of changes for each release.

3.9.0

4 years ago

Notable features in 3.9.0

  • Support for Encrypted Singularity Containers
  • Enhanced support for autogenerated task id schemas (#324)
  • SR-IOV IB/RDMA support for Ubuntu-based images
  • Support for CentOS/CentOS-HPC 7.7
  • Ubuntu 16.04 SR-IOV IB/RDMA Packer script

Breaking changes

  • The singularity_images property in the global configuration has been modified to accommodate encrypted container images. Please see the global configuration doc for more information.
  • Non-native pools using STANDARD_NC24rs_v3 will now default to using SR-IOV IB/RDMA settings. native pools using this VM size will rely on the Azure Batch runtime to bind the correct container settings. Please see the Azure Batch Guidance issue for more information.
  • Dropped support for CentOS 7.5, CentOS-HPC 7.1/7.3, and WindowsServerSemiAnnual Datacenter-Core-1709-with-Containers-smalldisk/Datacenter-Core-1803-with-Containers-smalldisk

Please see the Change Log for a full list of changes for each release.

3.8.2

4 years ago

Please see the Change Log for a full list of changes for each release.

3.8.1

4 years ago

Please see the Change Log for a full list of changes for each release.

3.8.0

4 years ago

Notable features in 3.8.0

  • Revamped Singularity support, including support for Singularity 3, SIF images, and pull support from ACR registries for SIF images via ORAS (#146), thanks @vincentlabonte
  • New MPI interface in jobs configuration for seamless multi-instance task executions with automatic configuration for SR-IOV RDMA VM sizes with support for popular MPI runtimes including OpenMPI, MPICH, Intel MPI, and MVAPICH (#287), thanks @vincentlabonte
  • Support for Hb/Hc SR-IOV RDMA VM sizes (#277)
  • Support for NC/NV/H Promo VM sizes
  • Support for user-specified job preparation and release tasks on the host (#202)
  • Support for conditional output data (#230)
  • Support for bring your own public IP addresses on Batch pools
  • Support for Shared Image Gallery for custom images
  • Batch Shipyard images have been migrated to the Microsoft Container Registry (#278)

Breaking changes

  • Jobs submitted with 3.8.0 or later cannot be submitted against pre-3.8.0 pools. Pools must be re-created with 3.8.0 or later.
  • The singularity_images property in the global configuration has been modified to accommodate Singularity 3 support. Please see the global configuration doc for more information. (#146)
  • The gpu property in the jobs configuration has been changed to gpus to accommodate the new native GPU execution support in Docker 19.03. Please see the jobs configuration doc for more information. (#293)
  • Peer-to-peer image distribution support has been removed

Please see the Change Log for a full list of changes for each release.

3.7.1

4 years ago

Please see the Change Log for a full list of changes for each release.

3.7.0

5 years ago

It is recommended to upgrade to this release which addresses the runc CVE-2019-5736.

Notable features in 3.7.0

  • Slurm on Batch support: provision Slurm clusters with elastic cloud bursting on Azure Batch pools
  • Batch Insights integration (#259)
  • Support environment variables on additional node prep commands (#253), thanks @jackpimbert
  • Support CentOS 7.6
  • Performance improvements to speed up job submission with large task factories or large amount of tasks

Breaking changes

  • The additional_node_prep_commands property has been migrated under the new additional_node_prep property as commands (#252)

Please see the Change Log for a full list of changes for each release.

3.6.1

5 years ago

Please see the Change Log for a full list of changes for each release.

3.6.0

5 years ago

Notable features in 3.6.0

  • Federation support
  • Kata containers support: run containers on Linux compute nodes with a higher level of isolation through lightweight VMs
  • Per-job distributed scratch space support: create on-demand scratch space shared between tasks of a job
  • Allow installation and selection of multiple container runtimes along with a default container runtime for Docker invocations
  • Support for Standard SSD and Ultra SSD managed disks for RemoteFS clusters
  • Task and node count commands: jobs tasks counts and pool nodes counts
  • Pre-built binary for the CLI for MacOS
  • CUDA 10 support for NC/ND series VMs
  • Support for Ubuntu 18.04 and CentOS 7.5
  • Batch Shipyard site extension on nuget.org has been restored

Breaking changes

  • Debian 8 host OS support dropped
  • The premium property under remote_fs:managed_disks has been replaced with sku
  • The Singularity container runtime is no longer installed by default

Please see the Change Log for a full list of changes for each release.

3.6.0b1

5 years ago

This is a preview release of upcoming changes for 3.6.0.

Please see the Change Log for a full list of changes for each release.