开源雷达
返回全部项目

skypilot

训练框架与 MLOps

skypilot-org/skypilot

The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build custom intelligence faster.

cloud-computingcloud-managementcost-optimizationdeep-learningdistributed-traininggpuhyperparameter-tuningjob-queuejob-schedulerllm-servingllm-trainingmachine-learning

复现步骤

按顺序执行即可在本地跑起来;具体参数以项目 README 为准。

  1. 1

    克隆仓库到本地

    git clone --depth 1 https://github.com/skypilot-org/skypilot.git
    cd skypilot
  2. 2

    用 Docker 一键起环境,无需本机装依赖。仓库里没有 compose 文件时,改用 docker build -t app . 再 docker run --rm -it app

    docker compose up -d
  3. 3

    创建虚拟环境并安装 Python 依赖。只有 pyproject.toml / setup.py 而没有 requirements.txt 时,改用 pip install -e .

    python -m venv .venv && source .venv/bin/activate
    pip install -r requirements.txt

为什么这个项目容易复现

100
开箱即用
  • README 有明确的安装/快速开始章节
  • 提供 Docker / Compose,开箱即用
  • 有明确的依赖清单,环境可还原
  • 带示例 / demo 目录
  • 有独立文档目录
  • 有测试,质量更有保障
  • Apache-2.0 许可证,可放心使用
  • 有正式 Release 版本
  • 两周内仍在活跃更新

项目 README

SkyPilot is a system to run, manage, and scale AI workloads on any AI infrastructure.

SkyPilot gives AI teams a simple interface to run jobs on any infra. Infra teams get a unified control plane to manage any AI compute — with advanced scheduling, scaling, and orchestration.


:fire: News :fire:

  • [Aug 2026] RL is bottlenecked by inference: scale it independently with SkyPilot: blog
  • [Jul 2026] Serving Kimi K3 on your own GPUs with SkyPilot: blog
  • [Jul 2026] SkyPilot v0.13.0 released: Hugging Face storage, batch inference abstractions, lifecycle hooks, governance & robustness on API server: Release notes
  • [Jun 2026] SkyPilot Endpoints: production-ready inference on every cluster you own: blog
  • [Jun 2026] Announcing SkyPilot Sandboxes: run untrusted, LLM-generated code on the Kubernetes clusters you already own. Learn more, join early access
  • [May 2026] How Multiverse doubled their GPU utilization with SkyPilot: case study
  • [Apr 2026] Introducing GPU Compass: One dashboard to browse, compare pricing, and launch across every GPU cloud. Try it at gpus.skypilot.co.
  • [Apr 2026] Research-Driven Agents: Agents read arxiv papers before coding, landed 5 llama.cpp kernel fusions and +15% faster flash attention in ~3 hours for ~$29: blog, HackerNews
  • [Mar 2026] Scaling Karpathy's Autoresearch: Autoresearch runs 1 experiment at a time. We gave it 16 GPUs and let it run in parallel: blog, HackerNews
  • [Mar 2026] How H Company Unlocked Online RL and Unified their AI Platform: case study

Overview

SkyPilot is easy to use for AI users:

  • Quickly spin up compute on your own infra
  • Environment and job as code — simple and portable
  • Easy job management: queue, run, and auto-recover many jobs

SkyPilot makes Kubernetes easy for AI & Infra teams:

  • Slurm-like ease of use, cloud-native robustness
  • Local dev experience on K8s: SSH into pods, sync code, or connect IDE
  • Turbocharge your clusters: gang scheduling, multi-cluster, and scaling

SkyPilot unifies multiple clusters, clouds, and hardware:

  • One interface to use reserved GPUs, Kubernetes clusters, Slurm clusters, or 20+ clouds
  • Flexible provisioning of GPUs, TPUs, CPUs, with smart failover
  • Team deployment and resource sharing

SkyPilot maximizes GPU fleet utilization:

  • Autostop: automatic cleanup of idle resources
  • Binpacking: workload binpacking on shared clusters
  • Intelligent scheduler: automatically schedule on the most available infra

SkyPilot supports your existing GPU, TPU, and CPU workloads, with no code changes.

Install with uv (also supported: pip, nightly, from source)

# Choose your clouds:
uv pip install "skypilot[kubernetes,aws,gcp,azure,oci,nebius,lambda,runpod,fluidstack,paperspace,cudo,ibm,scp,seeweb,shadeform,verda]"

To use SkyPilot directly with your agent (Claude Code, Codex, etc.), install the SkyPilot Skill. Tell your agent:

Fetch and follow https://github.com/skypilot-org/skypilot/blob/HEAD/agent/INSTALL.md to install the skypilot skill

Current supported infra: Kubernetes, Slurm, AWS, GCP, Azure, OCI, CoreWeave, Nebius, Lambda Cloud, RunPod, Fluidstack, Cudo, Digital Ocean, Paperspace, Cloudflare, Samsung, IBM, Vast.ai, VMware vSphere, Seeweb, Prime Intellect, Shadeform, Verda Cloud, VastData, Crusoe.

Getting started

Install SkyPilot in 1 minute. Then, launch your first cluster in 2 minutes in Quickstart.

SkyPilot is BYOC: Everything is launched within your cloud accounts, VPCs, and clusters.

Benefits of SkyPilot on Kubernetes

SkyPilot makes Kubernetes AI-native.

It turbocharges your existing Kubernetes clusters by accelerating AI/ML velocity:

  • AI-friendly interface to launch jobs and deployments
  • Much simplified interactive dev for K8s (SSH / sync code / connect IDE to pods)

...and optimizing GPU scheduling, utilization, and scaling:

  • Advanced scheduling: Gang scheduling, multi-node jobs, and queueing
  • Multi-cluster support: Bring all your clusters under one control plane
  • Multi-cloud support: One consistent interface to manage many providers

See SkyPilot vs Vanilla Kubernetes and this blog post for more details.

SkyPilot in 1 minute

A SkyPilot task specifies: resource requirements, data to be synced, setup commands, and the task commands.

Once written in this unified interface (YAML or Python API), the task can be launched on any available infra (Kubernetes, Slurm, cloud, etc.). This avoids vendor lock-in, and allows easily moving jobs to a different provider.

Paste the following into a file my_task.yaml:

resources:
  accelerators: A100:8  # 8x NVIDIA A100 GPU

num_nodes: 1  # Number of VMs to launch

# Working directory (optional) containing the project codebase.
# Its contents are synced to ~/sky_workdir/ on the cluster.
workdir: ~/torch_examples

# Commands to be run before executing the job.
# Typical use: pip install -r requirements.txt, git clone, etc.
setup: |
  cd mnist
  pip install -r requirements.txt

# Commands to run as a job.
# Typical use: launch the main program.
run: |
  cd mnist
  python main.py --epochs 1

Prepare the workdir by cloning:

git clone https://github.com/pytorch/examples.git ~/torch_examples

Launch with sky launch (note: access to GPU instances is needed for this example):

sky launch my_task.yaml

SkyPilot then performs the heavy-lifting for you, including:

  1. Find the cheapest & available infra across your clusters or clouds
  2. Provision the GPUs (pods or VMs), with auto-failover if the infra returned capacity errors
  3. Sync your local workdir to the provisioned cluster
  4. Auto-install dependencies by running the task's setup commands
  5. Run the task's run commands, and stream logs

See Quickstart to get started with SkyPilot.

Runnable examples

See SkyPilot examples that cover: development, training, serving, LLM models, AI apps, and common frameworks.

Latest featured examples:

Source files can be found in llm/ and examples/.

Learn more

To learn more, see SkyPilot Overview, SkyPilot docs, and SkyPilot blog.

SkyPilot adopters: Testimonials and Case Studies

Follow updates:

Questions and feedback

We are excited to hear your feedback:

For general discussions, join us on the SkyPilot Slack.

Contributing

We welcome all contributions to the project! See CONTRIBUTING for how to get involved.

同方向的其他项目

训练框架与 MLOps

Workflow Engine for Kubernetes

DockerGo示例代码文档+2
17k155GoApache-2.01 天前
开箱即用
axolotl

axolotl-ai-cloud

训练框架与 MLOps

Go ahead and axolotl questions

DockerPython 依赖示例代码文档+1
12k304PythonApache-2.03 天前
开箱即用
训练框架与 MLOps

The world's simplest facial recognition api for Python and the command line

DockerPython 依赖示例代码文档+2
57k492PythonMIT1 个月前
开箱即用