OpenAI compatible
Point the OpenAI SDK at one base URL. Chat completions, streaming, models, tool calls, and standard error shapes work as expected.
Run OpenAI-compatible inference against models hosted by OpenSoftware on GCP, with confidential-compute routing when privacy has to be enforced.
Point the OpenAI SDK at one base URL. Chat completions, streaming, models, tool calls, and standard error shapes work as expected.
Create scoped credentials, set an expiration date and hard spend ceiling, inspect usage, and revoke access instantly.
Require a TEE backend per request. If confidential compute is unavailable, the gateway fails closed instead of silently downgrading.
from openai import OpenAI
client = OpenAI(
api_key="sk-os-…",
base_url="https://api.opensoftware.co/v1",
)
response = client.chat.completions.create(
model="qwen2.5-0.5b-instruct",
messages=[{"role": "user", "content": "Hello"}],
)