feat: Add generic BaseAdapter framework for third-party evaluator integration (DeepEval + Autoevals)#528

Open

stone-coding wants to merge 10 commits into

stone-coding:deepeval-handler

Commits on Jun 15, 2026

Add DeepEvalHandler integration with unit tests
haomiao037
committed
Fix span extraction to use real AgentCore _eval_log_records structure
haomiao037
committed
Set context field from tool messages for HallucinationMetric support
haomiao037
committed
Use metric.success for label instead of manual threshold comparison
haomiao037
committed
Add model override and timeout enforcement to DeepEvalHandler
haomiao037
committed
Add model override, timeout enforcement, use metric.success, fix SingleTurnParams deprecation
haomiao037
committed
Fix _get_required_params to handle GEval unmappable typing params
haomiao037
committed
Add .deepeval/ to gitignore
haomiao037
committed

Commits on Jun 16, 2026

Move model override to init to avoid per-call mutation
haomiao037
committed

Commits on Jun 24, 2026

Refactor to BaseAdapter framework with DeepEval/Autoevals adapters and EvaluatorInput support
haomiao037
committed