Claude-NIM

Anthropic-compatible gateway for Claude Code backed by NVIDIA hosted NIM.

Configure Claude Code with:

{
  "env": {
    "ANTHROPIC_BASE_URL": "https://your-app.koyeb.app",
    "ANTHROPIC_AUTH_TOKEN": "nvapi-...",
    "ANTHROPIC_DEFAULT_HAIKU_MODEL": "meta/llama-3.1-8b-instruct",
    "ANTHROPIC_DEFAULT_SONNET_MODEL": "meta/llama-3.1-70b-instruct",
    "ANTHROPIC_DEFAULT_OPUS_MODEL": "meta/llama-3.1-405b-instruct"
  }
}

Supported endpoints: /v1/messages, /v1/messages/count_tokens, /v1/models, /v1/models/{model_id}, /v1/files.

Files are stored on this instance for 24 hours. Image files become NIM vision inputs; PDF files are rendered to page images when safe and fall back to extracted text when too large.