Arize

Observability-first integration for AI workloads

Arize auto-instrumentation works with TheRouter.ai because TheRouter.ai is OpenAI-compatible. You keep your existing tracing pipelines and only change endpoint configuration.

Overview

Use the TheRouter API endpoint and a model ID from the current model catalog. Framework capabilities and configuration differ; test your integration before production.

Installation

Install the required SDKs and keep your TheRouter.ai key in environment variables.

install.sh

pip install arize-otel openai openinference-instrumentation-openai

Configuration

Configure the TheRouter API base URL and keep your API key on a trusted server.

TypeScript

import OpenAI from "openai";

const client = new OpenAI({ baseURL: "https://api.therouter.ai/v1", apiKey: process.env.THEROUTER_API_KEY });

The client configuration below connects to TheRouter, but does not by itself enable tracing. Configure and verify instrumentation separately with your observability provider.

Caveats

Integration note

Tracing can capture request metadata and prompts depending on your instrumentation settings; review redaction policy before enabling in regulated environments.

For production rollouts, pin SDK versions and validate model compatibility in staging before broad rollout.

Effect AI SDK

LangChain