Weave

Weave is Weights & Biases' tracing and evaluation toolkit. It patches the typesafe-sdk client with patch_typesafe(), and Drex answers that client's requests, so a patched client that points at Drex traces Drex calls. See Questions and Reading answers.

SetupCopy Anchor Link

pip install weave typesafe-sdk
export TYPESAFE_API_KEY=nace_sk_...

Create the key as shown in Authentication. Set TYPESAFE_BASE_URL to https://console.nace.ai (the host, without /v1); the sample reads it. For Drex on your own infrastructure, use that deployment's URL.

Trace a requestCopy Anchor Link

Call patch_typesafe() before you make requests, and set the model on every call. The SDK's default model, jev-latest, is refused by Drex with a 422 (unknown model).

import os
from weave.integrations.patch import patch_typesafe

patch_typesafe()

from typesafe_sdk import Noul, TypeSafeClient

client = TypeSafeClient(
    api_key=os.environ["TYPESAFE_API_KEY"],
    base_url=os.environ["TYPESAFE_BASE_URL"],
    timeout=60,
)

result = client.system_one(
    "I was charged twice and want a refund.",
    {"refund": Noul(instructions="Is the customer asking for a refund?")},
    model="drex-max",
)
result.answers["refund"].noul   # probability of yes

To send the spans to a Weave project, initialize Weave with weave.init("<project>") as its documentation describes. That call was not part of the test.

timeout=60 is in seconds: the SDK's default of 10 seconds is shorter than Drex can take on a large request. See Migrate from TypeSafe.

What works and what doesn'tCopy Anchor Link

• noul and choice questions, and the models drex-max, drex-v2.0 and drex-max-v1.1, worked through the SDK. The async client, AsyncTypeSafeClient, also worked against Drex, without Weave. See Models.
• box questions aren't supported by Drex, which answers 422 and says so.
• A score question has not been tried through Weave. Drex used to return its legend as a list of level labels, which typesafe-sdk 0.7.5 rejects when used directly (it validates an object keyed by level), and Weave wraps that client. Drex now sends the TypeSafe SDK an object keyed by level, recognized by its X-TypeSafe-SDK header, and X-Nace-Legend: array or object overrides it; see Reading answers. That is available once the change is deployed. An object legend validates against the real typesafe-sdk ScoreAnswer model offline, but a live score call through Weave against a deployment has not been run yet. Until you have tested one, ask score questions with the Python or TypeScript Nace SDK, or over HTTP.

Drex enforces its own request limits; see Limits. A failed request raises the SDK's error, never a low score; see Errors and retries.