NVIDIA/SkillEvaluator
NVIDIA/SkillEvaluator: Framework for AI Agent Skill Evaluation
Multi-tier framework for evaluating AI agent skills with quality gates, semantic overlap detection, synthetic evaluation dataset generation, and live agent evaluation that measures how skills affect agent behavior.
AI-generated summary
NVIDIA's SkillEvaluator is a multi-tier framework designed to rigorously assess the capabilities of AI agents. It employs quality gates, semantic overlap detection, and synthetic dataset generation to measure how agent skills influence overall behavior and task performance. The framework supports various integration methods, including direct CLI usage, CI integration, and direct wiring into skill-aware agents.
Language: Python