curl -X POST http://localhost:3000/verifier \
-H "Content-Type: application/json" \
-d '{
"sessionId": "test-session",
"checks": [
{
"id": "check-event-created",
"type": "state",
"table": "events",
"asserts": [
{
"comparator": "eq",
"function": "object_contains",
"function_args": ["_result[*]", {"title": "Team Meeting"}],
"value": true
}
]
}
]
}'
curl -X POST http://localhost:3000/verifier \
-H "Content-Type: application/json" \
-d '{
"sessionId": "test-session",
"checks": [
{
"id": "check-button-clicked",
"type": "log",
"asserts": [
{
"comparator": "eq",
"function": "object_contains",
"function_args": ["_result[*]", {
"eventType": "click",
"clickId": "submit-button"
}],
"value": true
}
]
}
]
}'
curl -X POST http://localhost:3000/verifier \
-H "Content-Type: application/json" \
-d '{
"sessionId": "test-session",
"checks": [
{
"id": "check-events-on-day",
"type": "manual",
"function": "find_events_on_day",
"function_args": ["2024-11-20"],
"asserts": [
{
"comparator": "gt",
"function": "count",
"function_args": ["_result"],
"value": 0
}
]
}
]
}'
{
"session_id": "test-session",
"success": true,
"verifiers": [
{
"id": "check-event-created",
"operator": "state_comparison",
"success": true,
"asserts": [
{
"actual_value": true,
"expected_value": true,
"comparator": "eq",
"success": true,
"matching_results": [
{
"id": 1,
"title": "Team Meeting",
"startTime": "2024-11-20T14:00:00Z"
}
]
}
]
}
]
}
{
"session_id": "test-session",
"success": false,
"verifiers": [
{
"id": "check-event-created",
"operator": "state_comparison",
"success": false,
"asserts": [
{
"actual_value": false,
"expected_value": true,
"comparator": "eq",
"success": false
}
],
"all_results": []
}
]
}
{
"session_id": "test-session",
"success": "PENDING",
"verifiers": [
{
"id": "rubric-check",
"success": "PENDING"
}
]
}
Website Environments
Verifier
Run verification checks against the current session state
POST
/
verifier
curl -X POST http://localhost:3000/verifier \
-H "Content-Type: application/json" \
-d '{
"sessionId": "test-session",
"checks": [
{
"id": "check-event-created",
"type": "state",
"table": "events",
"asserts": [
{
"comparator": "eq",
"function": "object_contains",
"function_args": ["_result[*]", {"title": "Team Meeting"}],
"value": true
}
]
}
]
}'
curl -X POST http://localhost:3000/verifier \
-H "Content-Type: application/json" \
-d '{
"sessionId": "test-session",
"checks": [
{
"id": "check-button-clicked",
"type": "log",
"asserts": [
{
"comparator": "eq",
"function": "object_contains",
"function_args": ["_result[*]", {
"eventType": "click",
"clickId": "submit-button"
}],
"value": true
}
]
}
]
}'
curl -X POST http://localhost:3000/verifier \
-H "Content-Type: application/json" \
-d '{
"sessionId": "test-session",
"checks": [
{
"id": "check-events-on-day",
"type": "manual",
"function": "find_events_on_day",
"function_args": ["2024-11-20"],
"asserts": [
{
"comparator": "gt",
"function": "count",
"function_args": ["_result"],
"value": 0
}
]
}
]
}'
{
"session_id": "test-session",
"success": true,
"verifiers": [
{
"id": "check-event-created",
"operator": "state_comparison",
"success": true,
"asserts": [
{
"actual_value": true,
"expected_value": true,
"comparator": "eq",
"success": true,
"matching_results": [
{
"id": 1,
"title": "Team Meeting",
"startTime": "2024-11-20T14:00:00Z"
}
]
}
]
}
]
}
{
"session_id": "test-session",
"success": false,
"verifiers": [
{
"id": "check-event-created",
"operator": "state_comparison",
"success": false,
"asserts": [
{
"actual_value": false,
"expected_value": true,
"comparator": "eq",
"success": false
}
],
"all_results": []
}
]
}
{
"session_id": "test-session",
"success": "PENDING",
"verifiers": [
{
"id": "rubric-check",
"success": "PENDING"
}
]
}
Run verification checks to validate agent actions. The verifier checks both database state (what changed) and interaction logs (what was done) to provide comprehensive verification.
Request Body
string
required
Session identifier for the test
array
required
Array of verification checks to perform
Show Check Object
Show Check Object
string
required
Unique identifier for the check
string
required
Check type:
state, log, rubric, sequential, or manualstring
Database table to query (for
state checks)string
Custom function to execute (for
manual checks)array
Arguments for the function (for
manual checks)array
required
Array of assertion objects
Assertion Object
string
required
Comparison operator:
eq, neq, gt, gte, lt, lte, in, contains, regex, deep_equalstring
Utility function to call (e.g.,
object_contains, count)array
Arguments for the utility function. Use
_result[*] to iterate through array results.any
required
Expected value for comparison
Response
string
Session identifier
boolean | string
Overall result:
true (all passed), false (at least one failed), or 'PENDING' (rubric checks pending)array
curl -X POST http://localhost:3000/verifier \
-H "Content-Type: application/json" \
-d '{
"sessionId": "test-session",
"checks": [
{
"id": "check-event-created",
"type": "state",
"table": "events",
"asserts": [
{
"comparator": "eq",
"function": "object_contains",
"function_args": ["_result[*]", {"title": "Team Meeting"}],
"value": true
}
]
}
]
}'
curl -X POST http://localhost:3000/verifier \
-H "Content-Type: application/json" \
-d '{
"sessionId": "test-session",
"checks": [
{
"id": "check-button-clicked",
"type": "log",
"asserts": [
{
"comparator": "eq",
"function": "object_contains",
"function_args": ["_result[*]", {
"eventType": "click",
"clickId": "submit-button"
}],
"value": true
}
]
}
]
}'
curl -X POST http://localhost:3000/verifier \
-H "Content-Type: application/json" \
-d '{
"sessionId": "test-session",
"checks": [
{
"id": "check-events-on-day",
"type": "manual",
"function": "find_events_on_day",
"function_args": ["2024-11-20"],
"asserts": [
{
"comparator": "gt",
"function": "count",
"function_args": ["_result"],
"value": 0
}
]
}
]
}'
{
"session_id": "test-session",
"success": true,
"verifiers": [
{
"id": "check-event-created",
"operator": "state_comparison",
"success": true,
"asserts": [
{
"actual_value": true,
"expected_value": true,
"comparator": "eq",
"success": true,
"matching_results": [
{
"id": 1,
"title": "Team Meeting",
"startTime": "2024-11-20T14:00:00Z"
}
]
}
]
}
]
}
{
"session_id": "test-session",
"success": false,
"verifiers": [
{
"id": "check-event-created",
"operator": "state_comparison",
"success": false,
"asserts": [
{
"actual_value": false,
"expected_value": true,
"comparator": "eq",
"success": false
}
],
"all_results": []
}
]
}
{
"session_id": "test-session",
"success": "PENDING",
"verifiers": [
{
"id": "rubric-check",
"success": "PENDING"
}
]
}
⌘I