Logo
Agent Skills Guide

llm-deploy

published 2026/03/13

Deploys ML and LLM models on TrueFoundry with GPU inference servers (vLLM, TGI, NVIDIA NIM). Uses YAML manifests with `tfy apply`. Use when serving language models, deploying Hugging Face models, or hosting GPU-accelerated inference endpoints.

📦 Install Skill

Command line install

Install directly with the `skills` CLI.

npx skills add truefoundry/tfy-agent-skills/skills/llm-deploy

Local download

Download only this skill directory.

Download llm-deploy only
File Explorer
0 files
No file selected
readonly

Select a file to view its content