Metadata-Version: 2.1
Name: dstack
Version: 0.18.40
Summary: dstack is an open-source orchestration engine for running AI workloads on any cloud or on-premises.
Home-page: https://dstack.ai
Author: Andrey Cheptsov
Author-email: andrey@dstack.ai
Project-URL: Source, https://github.com/dstackai/dstack
Project-URL: Docs, https://dstack.ai/docs
Project-URL: Issues, https://github.com/dstackai/dstack/issues
Project-URL: Changelog, https://github.com/dstackai/dstack/releases
Project-URL: Discord, https://discord.gg/u8SmfwPpMd
Classifier: Development Status :: 4 - Beta
Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
Classifier: License :: OSI Approved :: Mozilla Public License 2.0 (MPL 2.0)
Classifier: Programming Language :: Python :: 3
Requires-Python: >=3.9
Description-Content-Type: text/markdown
License-File: LICENSE.md
Requires-Dist: pyyaml
Requires-Dist: requests
Requires-Dist: typing-extensions>=4.0.0
Requires-Dist: cryptography
Requires-Dist: packaging
Requires-Dist: python-dateutil
Requires-Dist: gitpython
Requires-Dist: jsonschema
Requires-Dist: paramiko>=3.2.0
Requires-Dist: cursor
Requires-Dist: rich
Requires-Dist: rich-argparse
Requires-Dist: tqdm
Requires-Dist: simple-term-menu
Requires-Dist: pydantic<2.0.0,>=1.10.10
Requires-Dist: pydantic-duality>=1.2.4
Requires-Dist: websocket-client
Requires-Dist: python-multipart>=0.0.16
Requires-Dist: filelock
Requires-Dist: psutil
Requires-Dist: gpuhunt<0.1.0,>=0.0.19
Provides-Extra: all
Requires-Dist: fastapi; extra == "all"
Requires-Dist: starlette>=0.26.0; extra == "all"
Requires-Dist: uvicorn; extra == "all"
Requires-Dist: aiorwlock; extra == "all"
Requires-Dist: aiocache; extra == "all"
Requires-Dist: httpx; extra == "all"
Requires-Dist: jinja2; extra == "all"
Requires-Dist: watchfiles; extra == "all"
Requires-Dist: sqlalchemy[asyncio]>=2.0.0; extra == "all"
Requires-Dist: sqlalchemy-utils>=0.40.0; extra == "all"
Requires-Dist: alembic>=1.10.2; extra == "all"
Requires-Dist: apscheduler<4; extra == "all"
Requires-Dist: aiosqlite; extra == "all"
Requires-Dist: docker>=6.0.0; extra == "all"
Requires-Dist: python-dxf==12.1.0; extra == "all"
Requires-Dist: sentry-sdk[fastapi]; extra == "all"
Requires-Dist: alembic-postgresql-enum; extra == "all"
Requires-Dist: asyncpg; extra == "all"
Requires-Dist: cachetools; extra == "all"
Requires-Dist: python-json-logger>=3.1.0; extra == "all"
Requires-Dist: grpcio>=1.50; extra == "all"
Requires-Dist: boto3; extra == "all"
Requires-Dist: botocore; extra == "all"
Requires-Dist: azure-identity>=1.12.0; extra == "all"
Requires-Dist: azure-mgmt-subscription>=3.1.1; extra == "all"
Requires-Dist: azure-mgmt-compute>=29.1.0; extra == "all"
Requires-Dist: azure-mgmt-network<28.0.0,>=23.0.0; extra == "all"
Requires-Dist: azure-mgmt-resource>=22.0.0; extra == "all"
Requires-Dist: azure-mgmt-authorization>=3.0.0; extra == "all"
Requires-Dist: google-auth>=2.3.0; extra == "all"
Requires-Dist: google-cloud-storage>=2.0.0; extra == "all"
Requires-Dist: google-cloud-compute>=1.5.0; extra == "all"
Requires-Dist: google-cloud-logging>=2.0.0; extra == "all"
Requires-Dist: google-api-python-client>=2.80.0; extra == "all"
Requires-Dist: google-cloud-billing>=1.11.0; extra == "all"
Requires-Dist: google-cloud-tpu>=1.18.3; extra == "all"
Requires-Dist: datacrunch; extra == "all"
Requires-Dist: kubernetes; extra == "all"
Requires-Dist: oci; extra == "all"
Provides-Extra: aws
Requires-Dist: fastapi; extra == "aws"
Requires-Dist: starlette>=0.26.0; extra == "aws"
Requires-Dist: uvicorn; extra == "aws"
Requires-Dist: aiorwlock; extra == "aws"
Requires-Dist: aiocache; extra == "aws"
Requires-Dist: httpx; extra == "aws"
Requires-Dist: jinja2; extra == "aws"
Requires-Dist: watchfiles; extra == "aws"
Requires-Dist: sqlalchemy[asyncio]>=2.0.0; extra == "aws"
Requires-Dist: sqlalchemy-utils>=0.40.0; extra == "aws"
Requires-Dist: alembic>=1.10.2; extra == "aws"
Requires-Dist: apscheduler<4; extra == "aws"
Requires-Dist: aiosqlite; extra == "aws"
Requires-Dist: docker>=6.0.0; extra == "aws"
Requires-Dist: python-dxf==12.1.0; extra == "aws"
Requires-Dist: sentry-sdk[fastapi]; extra == "aws"
Requires-Dist: alembic-postgresql-enum; extra == "aws"
Requires-Dist: asyncpg; extra == "aws"
Requires-Dist: cachetools; extra == "aws"
Requires-Dist: python-json-logger>=3.1.0; extra == "aws"
Requires-Dist: grpcio>=1.50; extra == "aws"
Requires-Dist: boto3; extra == "aws"
Requires-Dist: botocore; extra == "aws"
Provides-Extra: azure
Requires-Dist: fastapi; extra == "azure"
Requires-Dist: starlette>=0.26.0; extra == "azure"
Requires-Dist: uvicorn; extra == "azure"
Requires-Dist: aiorwlock; extra == "azure"
Requires-Dist: aiocache; extra == "azure"
Requires-Dist: httpx; extra == "azure"
Requires-Dist: jinja2; extra == "azure"
Requires-Dist: watchfiles; extra == "azure"
Requires-Dist: sqlalchemy[asyncio]>=2.0.0; extra == "azure"
Requires-Dist: sqlalchemy-utils>=0.40.0; extra == "azure"
Requires-Dist: alembic>=1.10.2; extra == "azure"
Requires-Dist: apscheduler<4; extra == "azure"
Requires-Dist: aiosqlite; extra == "azure"
Requires-Dist: docker>=6.0.0; extra == "azure"
Requires-Dist: python-dxf==12.1.0; extra == "azure"
Requires-Dist: sentry-sdk[fastapi]; extra == "azure"
Requires-Dist: alembic-postgresql-enum; extra == "azure"
Requires-Dist: asyncpg; extra == "azure"
Requires-Dist: cachetools; extra == "azure"
Requires-Dist: python-json-logger>=3.1.0; extra == "azure"
Requires-Dist: grpcio>=1.50; extra == "azure"
Requires-Dist: azure-identity>=1.12.0; extra == "azure"
Requires-Dist: azure-mgmt-subscription>=3.1.1; extra == "azure"
Requires-Dist: azure-mgmt-compute>=29.1.0; extra == "azure"
Requires-Dist: azure-mgmt-network<28.0.0,>=23.0.0; extra == "azure"
Requires-Dist: azure-mgmt-resource>=22.0.0; extra == "azure"
Requires-Dist: azure-mgmt-authorization>=3.0.0; extra == "azure"
Provides-Extra: datacrunch
Requires-Dist: fastapi; extra == "datacrunch"
Requires-Dist: starlette>=0.26.0; extra == "datacrunch"
Requires-Dist: uvicorn; extra == "datacrunch"
Requires-Dist: aiorwlock; extra == "datacrunch"
Requires-Dist: aiocache; extra == "datacrunch"
Requires-Dist: httpx; extra == "datacrunch"
Requires-Dist: jinja2; extra == "datacrunch"
Requires-Dist: watchfiles; extra == "datacrunch"
Requires-Dist: sqlalchemy[asyncio]>=2.0.0; extra == "datacrunch"
Requires-Dist: sqlalchemy-utils>=0.40.0; extra == "datacrunch"
Requires-Dist: alembic>=1.10.2; extra == "datacrunch"
Requires-Dist: apscheduler<4; extra == "datacrunch"
Requires-Dist: aiosqlite; extra == "datacrunch"
Requires-Dist: docker>=6.0.0; extra == "datacrunch"
Requires-Dist: python-dxf==12.1.0; extra == "datacrunch"
Requires-Dist: sentry-sdk[fastapi]; extra == "datacrunch"
Requires-Dist: alembic-postgresql-enum; extra == "datacrunch"
Requires-Dist: asyncpg; extra == "datacrunch"
Requires-Dist: cachetools; extra == "datacrunch"
Requires-Dist: python-json-logger>=3.1.0; extra == "datacrunch"
Requires-Dist: grpcio>=1.50; extra == "datacrunch"
Requires-Dist: datacrunch; extra == "datacrunch"
Provides-Extra: gateway
Requires-Dist: fastapi; extra == "gateway"
Requires-Dist: starlette>=0.26.0; extra == "gateway"
Requires-Dist: uvicorn; extra == "gateway"
Requires-Dist: aiorwlock; extra == "gateway"
Requires-Dist: aiocache; extra == "gateway"
Requires-Dist: httpx; extra == "gateway"
Requires-Dist: jinja2; extra == "gateway"
Provides-Extra: gcp
Requires-Dist: fastapi; extra == "gcp"
Requires-Dist: starlette>=0.26.0; extra == "gcp"
Requires-Dist: uvicorn; extra == "gcp"
Requires-Dist: aiorwlock; extra == "gcp"
Requires-Dist: aiocache; extra == "gcp"
Requires-Dist: httpx; extra == "gcp"
Requires-Dist: jinja2; extra == "gcp"
Requires-Dist: watchfiles; extra == "gcp"
Requires-Dist: sqlalchemy[asyncio]>=2.0.0; extra == "gcp"
Requires-Dist: sqlalchemy-utils>=0.40.0; extra == "gcp"
Requires-Dist: alembic>=1.10.2; extra == "gcp"
Requires-Dist: apscheduler<4; extra == "gcp"
Requires-Dist: aiosqlite; extra == "gcp"
Requires-Dist: docker>=6.0.0; extra == "gcp"
Requires-Dist: python-dxf==12.1.0; extra == "gcp"
Requires-Dist: sentry-sdk[fastapi]; extra == "gcp"
Requires-Dist: alembic-postgresql-enum; extra == "gcp"
Requires-Dist: asyncpg; extra == "gcp"
Requires-Dist: cachetools; extra == "gcp"
Requires-Dist: python-json-logger>=3.1.0; extra == "gcp"
Requires-Dist: grpcio>=1.50; extra == "gcp"
Requires-Dist: google-auth>=2.3.0; extra == "gcp"
Requires-Dist: google-cloud-storage>=2.0.0; extra == "gcp"
Requires-Dist: google-cloud-compute>=1.5.0; extra == "gcp"
Requires-Dist: google-cloud-logging>=2.0.0; extra == "gcp"
Requires-Dist: google-api-python-client>=2.80.0; extra == "gcp"
Requires-Dist: google-cloud-billing>=1.11.0; extra == "gcp"
Requires-Dist: google-cloud-tpu>=1.18.3; extra == "gcp"
Provides-Extra: kubernetes
Requires-Dist: fastapi; extra == "kubernetes"
Requires-Dist: starlette>=0.26.0; extra == "kubernetes"
Requires-Dist: uvicorn; extra == "kubernetes"
Requires-Dist: aiorwlock; extra == "kubernetes"
Requires-Dist: aiocache; extra == "kubernetes"
Requires-Dist: httpx; extra == "kubernetes"
Requires-Dist: jinja2; extra == "kubernetes"
Requires-Dist: watchfiles; extra == "kubernetes"
Requires-Dist: sqlalchemy[asyncio]>=2.0.0; extra == "kubernetes"
Requires-Dist: sqlalchemy-utils>=0.40.0; extra == "kubernetes"
Requires-Dist: alembic>=1.10.2; extra == "kubernetes"
Requires-Dist: apscheduler<4; extra == "kubernetes"
Requires-Dist: aiosqlite; extra == "kubernetes"
Requires-Dist: docker>=6.0.0; extra == "kubernetes"
Requires-Dist: python-dxf==12.1.0; extra == "kubernetes"
Requires-Dist: sentry-sdk[fastapi]; extra == "kubernetes"
Requires-Dist: alembic-postgresql-enum; extra == "kubernetes"
Requires-Dist: asyncpg; extra == "kubernetes"
Requires-Dist: cachetools; extra == "kubernetes"
Requires-Dist: python-json-logger>=3.1.0; extra == "kubernetes"
Requires-Dist: grpcio>=1.50; extra == "kubernetes"
Requires-Dist: kubernetes; extra == "kubernetes"
Provides-Extra: lambda
Requires-Dist: fastapi; extra == "lambda"
Requires-Dist: starlette>=0.26.0; extra == "lambda"
Requires-Dist: uvicorn; extra == "lambda"
Requires-Dist: aiorwlock; extra == "lambda"
Requires-Dist: aiocache; extra == "lambda"
Requires-Dist: httpx; extra == "lambda"
Requires-Dist: jinja2; extra == "lambda"
Requires-Dist: watchfiles; extra == "lambda"
Requires-Dist: sqlalchemy[asyncio]>=2.0.0; extra == "lambda"
Requires-Dist: sqlalchemy-utils>=0.40.0; extra == "lambda"
Requires-Dist: alembic>=1.10.2; extra == "lambda"
Requires-Dist: apscheduler<4; extra == "lambda"
Requires-Dist: aiosqlite; extra == "lambda"
Requires-Dist: docker>=6.0.0; extra == "lambda"
Requires-Dist: python-dxf==12.1.0; extra == "lambda"
Requires-Dist: sentry-sdk[fastapi]; extra == "lambda"
Requires-Dist: alembic-postgresql-enum; extra == "lambda"
Requires-Dist: asyncpg; extra == "lambda"
Requires-Dist: cachetools; extra == "lambda"
Requires-Dist: python-json-logger>=3.1.0; extra == "lambda"
Requires-Dist: grpcio>=1.50; extra == "lambda"
Requires-Dist: boto3; extra == "lambda"
Requires-Dist: botocore; extra == "lambda"
Provides-Extra: oci
Requires-Dist: fastapi; extra == "oci"
Requires-Dist: starlette>=0.26.0; extra == "oci"
Requires-Dist: uvicorn; extra == "oci"
Requires-Dist: aiorwlock; extra == "oci"
Requires-Dist: aiocache; extra == "oci"
Requires-Dist: httpx; extra == "oci"
Requires-Dist: jinja2; extra == "oci"
Requires-Dist: watchfiles; extra == "oci"
Requires-Dist: sqlalchemy[asyncio]>=2.0.0; extra == "oci"
Requires-Dist: sqlalchemy-utils>=0.40.0; extra == "oci"
Requires-Dist: alembic>=1.10.2; extra == "oci"
Requires-Dist: apscheduler<4; extra == "oci"
Requires-Dist: aiosqlite; extra == "oci"
Requires-Dist: docker>=6.0.0; extra == "oci"
Requires-Dist: python-dxf==12.1.0; extra == "oci"
Requires-Dist: sentry-sdk[fastapi]; extra == "oci"
Requires-Dist: alembic-postgresql-enum; extra == "oci"
Requires-Dist: asyncpg; extra == "oci"
Requires-Dist: cachetools; extra == "oci"
Requires-Dist: python-json-logger>=3.1.0; extra == "oci"
Requires-Dist: grpcio>=1.50; extra == "oci"
Requires-Dist: oci; extra == "oci"
Provides-Extra: server
Requires-Dist: fastapi; extra == "server"
Requires-Dist: starlette>=0.26.0; extra == "server"
Requires-Dist: uvicorn; extra == "server"
Requires-Dist: aiorwlock; extra == "server"
Requires-Dist: aiocache; extra == "server"
Requires-Dist: httpx; extra == "server"
Requires-Dist: jinja2; extra == "server"
Requires-Dist: watchfiles; extra == "server"
Requires-Dist: sqlalchemy[asyncio]>=2.0.0; extra == "server"
Requires-Dist: sqlalchemy-utils>=0.40.0; extra == "server"
Requires-Dist: alembic>=1.10.2; extra == "server"
Requires-Dist: apscheduler<4; extra == "server"
Requires-Dist: aiosqlite; extra == "server"
Requires-Dist: docker>=6.0.0; extra == "server"
Requires-Dist: python-dxf==12.1.0; extra == "server"
Requires-Dist: sentry-sdk[fastapi]; extra == "server"
Requires-Dist: alembic-postgresql-enum; extra == "server"
Requires-Dist: asyncpg; extra == "server"
Requires-Dist: cachetools; extra == "server"
Requires-Dist: python-json-logger>=3.1.0; extra == "server"
Requires-Dist: grpcio>=1.50; extra == "server"

<div style="text-align: center;">
<h2>
  <a target="_blank" href="https://dstack.ai">
    <img alt="dstack" src="https://raw.githubusercontent.com/dstackai/dstack/master/docs/assets/images/dstack-logo.svg" width="350px"/>
  </a>
</h2>

[![Last commit](https://img.shields.io/github/last-commit/dstackai/dstack?style=flat-square)](https://github.com/dstackai/dstack/commits/)
[![PyPI - License](https://img.shields.io/pypi/l/dstack?style=flat-square&color=blue)](https://github.com/dstackai/dstack/blob/master/LICENSE.md)
[![Discord](https://img.shields.io/discord/1106906313969123368?style=flat-square)](https://discord.gg/u8SmfwPpMd)

</div>

`dstack` is a streamlined alternative to Kubernetes and Slurm, specifically designed for AI. It simplifies container orchestration
for AI workloads both in the cloud and on-prem, speeding up the development, training, and deployment of AI models.

`dstack` is easy to use with any cloud provider as well as on-prem servers.

#### Accelerators

`dstack` supports `NVIDIA`, `AMD`, `Google TPU`, and `Intel Gaudi` accelerators out of the box.

## Major news ✨

- [2025/01] [dstack 0.18.38: Intel Gaudi](https://github.com/dstackai/dstack/releases/tag/0.18.38)
- [2025/01] [dstack 0.18.35: Vultr](https://github.com/dstackai/dstack/releases/tag/0.18.35)
- [2024/12] [dstack 0.18.32: TPU v6e](https://github.com/dstackai/dstack/releases/tag/0.18.32)
- [2024/12] [dstack 0.18.30: AWS Capacity Reservations and Capacity Blocks](https://github.com/dstackai/dstack/releases/tag/0.18.30)
- [2024/10] [dstack 0.18.21: Instance volumes](https://github.com/dstackai/dstack/releases/tag/0.18.21)
- [2024/10] [dstack 0.18.18: Hardware metrics monitoring](https://github.com/dstackai/dstack/releases/tag/0.18.18)

## Installation

> Before using `dstack` through CLI or API, set up a `dstack` server. If you already have a running `dstack` server, you only need to [set up the CLI](#set-up-the-cli).

### (Optional) Configure backends

To use `dstack` with cloud providers, configure [backends](https://dstack.ai/docs/concepts/backends).

For using `dstack` with on-prem servers, create [SSH fleets](https://dstack.ai/docs/concepts/fleets#ssh) instead.

### Start the server

Once the backends are configured, proceed to start the server:

<div class="termy">

```shell
$ pip install "dstack[all]" -U
$ dstack server

Applying ~/.dstack/server/config.yml...

The admin token is "bbae0f28-d3dd-4820-bf61-8f4bb40815da"
The server is running at http://127.0.0.1:3000/
```

</div>

For more details on server configuration options, see the
[server deployment guide](https://dstack.ai/docs/guides/server-deployment).

### Set up the CLI

To point the CLI to the `dstack` server, configure it
with the server address, user token, and project name:

```shell
$ pip install dstack
$ dstack config --url http://127.0.0.1:3000 \
    --project main \
    --token bbae0f28-d3dd-4820-bf61-8f4bb40815da
    
Configuration is updated at ~/.dstack/config.yml
```

## How does it work?

### 1. Define configurations

`dstack` supports the following configurations:
   
* [Dev environments](https://dstack.ai/docs/dev-environments) &mdash; for interactive development using a desktop IDE
* [Tasks](https://dstack.ai/docs/tasks) &mdash; for scheduling jobs (incl. distributed jobs) or running web apps
* [Services](https://dstack.ai/docs/services) &mdash; for deployment of models and web apps (with auto-scaling and authorization)
* [Fleets](https://dstack.ai/docs/fleets) &mdash; for managing cloud and on-prem clusters
* [Volumes](https://dstack.ai/docs/concepts/volumes) &mdash; for managing persisted volumes
* [Gateways](https://dstack.ai/docs/concepts/gateways) &mdash; for configuring the ingress traffic and public endpoints

Configuration can be defined as YAML files within your repo.

### 2. Apply configurations

Apply the configuration either via the `dstack apply` CLI command or through a programmatic API.

`dstack` automatically manages provisioning, job queuing, auto-scaling, networking, volumes, run failures,
out-of-capacity errors, port-forwarding, and more &mdash; across clouds and on-prem clusters.

## More information

For additional information and examples, see the following links:

* [Docs](https://dstack.ai/docs)
* [Examples](https://dstack.ai/examples)
* [Providers](https://dstack.ai/providers)
* [Discord](https://discord.gg/u8SmfwPpMd)

## Contributing

You're very welcome to contribute to `dstack`. 
Learn more about how to contribute to the project at [CONTRIBUTING.md](CONTRIBUTING.md).

## License

[Mozilla Public License 2.0](LICENSE.md)
