ModelSwitch Lab

Put a model to the test.

Known answers. Measured performance. Inspectable evidence.

Hosted Otari
Discovering hosted models and tools…
Scenario
Models to evaluate

Models appear after hosted discovery.

At most 1 requests. No automatic retries.

Test cases

Synthetic / v1
inv-01Standard invoice

Supplier: Alder Studio. Invoice AS-1042. Issued 2026-10-02. Due 2026-11-01. Total due: USD 1,250.00. Payment reference: ALDER1042.

Expected output

{
  "supplier": "Alder Studio",
  "invoiceNumber": "AS-1042",
  "date": "2026-10-02",
  "amount": 1250,
  "currency": "USD",
  "paymentReference": "ALDER1042"
}
inv-02European decimal

Invoice NB/007 from Northbank Books. Invoice date: 3 October 2026. Total payable: 89,50 EUR (European decimal notation). Reference NB007.

Expected output

{
  "supplier": "Northbank Books",
  "invoiceNumber": "NB/007",
  "date": "2026-10-03",
  "amount": 89.5,
  "currency": "EUR",
  "paymentReference": "NB007"
}
inv-03Missing reference

Cedar Components | Invoice CC-0008 | 2026-09-30 | Total GBP 0.00. No payment reference has been assigned.

Expected output

{
  "supplier": "Cedar Components",
  "invoiceNumber": "CC-0008",
  "date": "2026-09-30",
  "amount": 0,
  "currency": "GBP",
  "paymentReference": null
}

How this is measured

Normalized exact field matches. Strict JSON schema. Missing fields lose credit.

Evaluator executes the task. Analyst interprets verified metrics.Recent run stays in this browser.

Latest run

This browser only

No run is saved in this browser yet.