Skip to main content

Quality Assurance

The QA module lets supervisors, QA leads, and quality analysts evaluate agent interactions, calibrate scoring across the team, and track quality trends over time. Agents see their own results in a dedicated self-view.

Open it from the sidebar under Quality → QA. The QA section has five top-level tabs:

TabWhat's there
DashboardAt-a-glance KPIs, daily activity, top agents, recent submissions, deep links into reports
ScorecardsThe evaluation templates — sections, questions, scoring rules, lifecycle (draft → published → archived)
EvaluationsThe list of evaluations across the tenant, with filters by status and LOB
CalibrationsGroup-scoring sessions used to align evaluator standards
My evaluationsAn agent's own evaluations — review scores, acknowledge, dispute

QA dashboard

Roles

QA features are gated by permission strings under the qa.* namespace:

PermissionTypical roleLets the user…
qa.scorecard.create / .update / .archiveQA leadAuthor and lifecycle scorecards
qa.evaluation.createQA evaluator, supervisorStart a new evaluation
qa.evaluation.readQA team, managerSee all evaluations in scope
qa.evaluation.read.ownAgentSee only their own evaluations
qa.evaluation.acknowledgeAgentAcknowledge a submitted evaluation
qa.evaluation.disputeAgentDispute an evaluation within the dispute window
qa.evaluation.resolveQA leadResolve a disputed evaluation
qa.evaluation.voidQA leadVoid an evaluation (terminal state)
qa.calibration.manageQA leadCreate and run calibration sessions
qa.calibration.participateQA teamScore in a calibration session
qa.report.readQA team, managerOpen the QA reports

The QA tabs render for everyone, but actions and data scope are enforced server-side — agents who reach /qa/evaluations will see only what they're permitted to see.