DatasetCC-BY-4.0

Agent evaluation state and permission fixture

A small versioned JSON fixture for testing whether tool-using agents produce inspectable state while respecting publication and credential boundaries.

Intended use

Use these records as deterministic examples when building an evaluation harness. Each assertion should be checked against the resulting environment rather than inferred from an agent transcript.

Data statement

The file is maintained in this repository and validated against the declared byte count and SHA-256 digest during builds and tests. It contains no user data, model outputs, personal information, or externally fetched material.

Limitations

This fixture is deliberately small. It is not a representative benchmark and should not be used to rank models without a larger task set, repeated runs, and a documented scoring protocol.

Integrity

  1. /data/agent-evaluation-fixture.json562 bytes / SHA-256 aa9e8654f73d958fbdbac007eef74dae029bc47f9232797c0f65a1aafacdd9a1