Versalist Assurance
Compare the current and proposed skill revisions on the same test cases and model. Review available scores and record a release decision.
Plus models from OpenAI, Anthropic and Google.
The problem
An average score can hide a lower score on a test case. A release review puts the available results side by side.
How it works
Turn a real workflow into fixed test cases and a scoring rubric your team agrees on.
Run both versions on the same cases and model. Compare the available case and dimension scores.
The review owner records ship, hold or needs work and can export the review.
Features
A release review shows available scores for both versions, with the decision history.
Compare available case and dimension scores. Reviews include up to 500 case rows and 100 dimensions per run.
A comparable dimension score that drops is marked as a regression.
Versalist checks matching challenge, skill, rubric and case identifiers. Missing model identifiers do not prove a model match.
Ship, hold or needs work, saved with the evidence and a full decision history.
Print a review or export it to Markdown for your release notes and sign-off.
Share a review with your organization, or create a public link for eligible reviews.
Built for engineers
Versalist checks the challenge, skill, rubric and case identifiers before creating a review. Model identifiers are compared when present. Missing model identifiers do not prove a model match.
| Field | Baseline | Candidate | Match |
|---|---|---|---|
| challenge_id | 3f9a… | 3f9a… | same |
| skill_bundle_id | 8c21… | 8c21… | same |
| challenge_content_hash | e4d0… | e4d0… | same |
| rubric_content_hash | b07c… | b07c… | same |
| cases_content_hash | 91fa… | 91fa… | same |
| model_contract_hash | 6e2b… | 6e2b… | same |
| agent_model_id | model-a | model-a | same |
skill_version2 to 3
the change under review (not part of the key)
| Field | Baseline | Candidate | Match |
|---|---|---|---|
| challenge_id | 3f9a… | 3f9a… | same |
| skill_bundle_id | 8c21… | 8c21… | same |
| challenge_content_hash | e4d0… | e4d0… | same |
| rubric_content_hash | b07c… | 5d93… | differs |
| cases_content_hash | 91fa… | 91fa… | same |
| model_contract_hash | 6e2b… | 6e2b… | same |
| agent_model_id | model-a | model-a | same |
Select two completed episodes with the same challenge, skill, rubric, cases, and model contract.
Why Versalist
See when an available dimension score decreases.
Keep the decision with the evidence used to make it.
Compare candidates with a baseline on the same cases to track changes in available scores.
Versalist works before release, alongside the observability you already run in production.
The platform
Use Assurance on its own, or with the rest of Versalist. Challenges hold the cases. Skills hold the versions. Assurance compares them.
A private registry for your team's agent skills. Publish a version once and everyone pulls the same one. Roles and review policy decide who can publish, and every rollback is recorded with a reason.
revision · file digests · rollback reason
Challenge programs on your team's real workflows. Each challenge fixes the task, the cases, the rubric and the execution policy, which is what lets two runs be compared.
cases · rubric · execution policy
A free directory of tool contracts. See what a tool can do and what access it needs before your agent calls it, and verify contract exports in your browser.
Security
Reviews start private. Owners control how they are shared.
Reviews start private. Owners can share with an organization or create a public link for eligible reviews.
Model-provider keys are stored per user in Google Secret Manager.
Give each integration only the access it needs, and revoke it at any time.
Trace capture stores prompts as hashes, never as text, and never records model reasoning.
The evidence behind a review can’t be edited, and decisions are added, never overwritten.
Versalist never operates your production agent.
Get started
Our team works with yours to scope one workflow and review the results.
Pick the workflow and agree on what good looks like.
Prepare your agent’s skill and model, and turn real cases into a test suite.
Score every candidate version against the one you run today.
Make the release call and share the results with leadership.
Need to make the case internally? Build your business case