FruxonDocs
ApiEvaluation runs

Replaces the model the agent's evaluations run on.

`provider` names a provider, a model and, optionally, which of the workspace's configs for that provider to call it through (`tenantConfigId`; the workspace's default config otherwise). It is resolved now, the way a run will resolve it, so a model the workspace cannot call — no published config, an inference-residency rule — is refused with the reason. Only the provider, the model and the config are kept. Send no `provider` to go back to the agent's own model. Takes effect on the next run; a run already started keeps the model it resolved. Evaluation calls are made with the workspace's own credentials and charged like the agent's test runs. Agent admins only.

PUT
/v1/tenants/{tenant}/agents/{agent}/evaluationSettings

Authorization

Bearer
AuthorizationBearer <token>

JWT Authorization header using the Bearer scheme. Enter 'Bearer' [space] and then your token.

In: header

Path Parameters

agent*string

The agent ID.

tenant*string

The tenant identifier

Request Body

The model, or none for the agent's own.

provider?

The model to evaluate on: a provider, a model and, optionally, which of the workspace's configs for that provider to call it through. Null goes back to the agent's own model.

[key: string]?never

Response Body

curl -X PUT "https://api.fruxon.com/v1/tenants/string/agents/string/evaluationSettings" \  -H "Content-Type: application/json" \  -d '{}'
{
  "provider": {
    "providerId": "string",
    "model": "string",
    "parameters": {},
    "fallbacks": [
      {
        "providerId": "string",
        "model": "string",
        "tenantConfigId": null
      }
    ],
    "builtInTools": [
      {
        "toolKey": null,
        "integrationConfigId": null,
        "integrationConfig": null,
        "humanApproval": null,
        "repeatGuard": null,
        "durableEffect": null,
        "pinnedParameters": null
      }
    ],
    "tenantConfigId": "00000000-0000-0000-0000-000000000000"
  },
  "agentProvider": {
    "providerId": "string",
    "model": "string",
    "parameters": {},
    "fallbacks": [
      {
        "providerId": "string",
        "model": "string",
        "tenantConfigId": null
      }
    ],
    "builtInTools": [
      {
        "toolKey": null,
        "integrationConfigId": null,
        "integrationConfig": null,
        "humanApproval": null,
        "repeatGuard": null,
        "durableEffect": null,
        "pinnedParameters": null
      }
    ],
    "tenantConfigId": "00000000-0000-0000-0000-000000000000"
  }
}
{
  "type": "string",
  "title": "string",
  "status": 0,
  "detail": "string",
  "instance": "string",
  "property1": null,
  "property2": null
}
Empty
{
  "type": "string",
  "title": "string",
  "status": 0,
  "detail": "string",
  "instance": "string",
  "property1": null,
  "property2": null
}
{
  "type": "string",
  "title": "string",
  "status": 0,
  "detail": "string",
  "instance": "string",
  "property1": null,
  "property2": null
}
{
  "type": "string",
  "title": "string",
  "status": 0,
  "detail": "string",
  "instance": "string",
  "property1": null,
  "property2": null
}