Responsibilities
- Evaluator Discovery: Auto-discover evaluators via Python entry points
- Selector Evaluation: Extract data from payloads using selector paths
- Evaluator Execution: Run evaluators against selected data
- Caching: Cache evaluator instances for performance
Evaluator Discovery
The engine provides the public API for evaluator discovery:agent_control.evaluators entry point group. Discovery:
- Scans all installed packages for the entry point
- Loads each evaluator class
- Checks
is_available()to verify dependencies - Registers available evaluators
Key Functions
Source Code
View the complete engine source code and implementation:Agent Control Engine