0.18.1

On-prem servers

Now you can add your own servers as pool instances:

dstack pool add-ssh -i ~/.ssh/id_rsa ubuntu@54.73.155.119

Note

The server should be pre-installed with CUDA 12.1 and NVIDIA Docker.

Configuration

All .dstack/profiles.yml properties now can be specified via run configurations:

type: dev-environment

ide: vscode

spot_policy: auto
backends: ["aws"]

regions: ["eu-west-1", "eu-west-2"]

instance_types: ["p3.8xlarge", "p3.16xlarge"]
max_price: 2.0

max_duration: 1d

New examples 🔥🔥

Thanks to the contribution from @deep-diver, we got two new examples:

• Alignment Handbook
• Axolotl

Other

• Configuring VPCs using their IDs (via vpc_ids in server/config.yml)
• Support for global profiles (via ~/.dstack/profiles.yml)
• Updated the default environment variables (DSTACK_RUN_NAME, DSTACK_GPUS_NUM, DSTACK_NODES_NUM, DSTACK_NODE_RANK, and DSTACK_MASTER_NODE_IP)
• It’s now possible to use NVIDIA A10 GPU on Azure
• More granular permissions for Azure

What's changed

• Fix server freeze on terminate instance by @jvstme in #1132
• Support profile params in run configurations by @r4victor in #1131
• Support global .dstack/profiles.yml by @r4victor in #1134
• Fix No such profile: None when missing .dstack/profiles.yml by @r4victor in #1135
• Make Azure permissions more granular by @r4victor in #1139
• Validate min disk size by @r4victor in #1146
• Fix unexpected error if system Python version is unknown by @r4victor in #1147
• Add request timeouts to prevent code freezes by @jvstme in #1140
• Refactor backends to wait for instance IP address outside run_job/create_instance by @r4victor in #1149
• Fix provisioning Azure instances with A10 GPU by @jvstme in #1150
• [Internal] Move packer -> scripts/packer by @jvstme in #1153
• Added the ability of adding own instances by @TheBits in #1115
• An issue with the executor_error check being falsely positive by @TheBits in #1160
• Make user project quota configurable by @r4victor in #1161
• Configure CORS headers on gateway by @r4victor in #1166
• Allow to configure AWS vpc_ids by @r4victor in #1170
• [Internal] Show dstack version in Sentry issues by @jvstme in #1167
• Fix KeyError: 'IpPermissions' when using AWS by @jvstme in #1169
• Create public ssh key is it not exist in dstack pool add-ssh by @TheBits in #1173
• Fixed is the environment file upload by @TheBits in #1175
• Updated shim status processing by @TheBits in #1174
• Fix bugs in dstack pool add-ssh by @TheBits in #1178
• Fix Cudo Create VM response error by @Bihan in #1179
• Implement API for configuring backends via yaml by @r4victor in #1181
• Allow running gated models with HUGGING_FACE_HUB_TOKEN by @r4victor in #1184
• Pass all dstack runner envs as DSTACK_* by @r4victor in #1185
• Improve the retries in the get_host_info and get_shim_healthcheck by @TheBits in #1183
• Example/h4alignment handbook by @deep-diver in #1180
• The deploy is launched in ThreadPoolExecutor by @TheBits in #1186

Full Changelog: 0.18.0...0.18.1rc2