Metadata-Version: 2.3
Name: alcf-ai
Version: 0.2.1
Summary: ALCF Inference Gateway SDK
Author: Misha Salim
Author-email: Misha Salim <msalim@anl.gov>
Requires-Dist: httpx
Requires-Dist: numpy
Requires-Dist: rich
Requires-Dist: typer
Requires-Dist: globus-sdk>=3.65.0,<4
Requires-Dist: openai
Requires-Dist: matplotlib
Requires-Dist: pillow
Requires-Dist: tifffile
Requires-Dist: smart-open
Requires-Python: >=3.12
Description-Content-Type: text/markdown

# ALCF AI Inference Services SDK

This package provides Python client and CLI tools to facilitate usage of the ALCF AI Inference services.

Usage:

```bash
# Log in with Globus:
uvx alcf-ai auth login

# Then use the SDK programmatically:
uv run --with alcf-ai python

# Or from the command line:
uvx alcf-ai ls-jobs sophia
```

## SDK Usage

```python
from alcf_ai import InferenceClient
from rich import print

# Automatically uses cached refresh tokens from previous login:
client = InferenceClient()

# Programmatically discover endpoints:
print(client.list_endpoints()["clusters"]["sophia"])

# Get an OpenAI API client for an ALCF cluster:
oai = client.clusters("sophia").openai
print(
    oai.chat.completions.create(
        model="openai/gpt-oss-120b",
        messages=[{"role": "user", "content": "Hello there!"}],
    )
)
```
