Agent Eval

Competitive and collaborative multi-agent simulation framework evaluating autonomous agents in strategic multi-turn environments.

Multi-tier framework for evaluating AI agent skills with quality gates, semantic overlap detection, synthetic evaluation dataset generation, and live agent evaluation that measures how skills affect agent behavior.

GitHub Copilot and AI Agent skill that parses job descriptions, mirrors exact technical terminology, quantifies impact metrics, and evaluates engineering compensation packages.

Create new skills, modify and improve existing skills, and measure skill performance. Use when users want to create a skill from scratch, edit, or optimize an existing skill, run evals to test a skill, benchmark skill performance with variance analysis, or optimize a skill's description for better triggering accuracy.

The open-source app everyone uses to manage agents at work

Comprehensive developer guide covering prompt engineering, agent orchestration, LLM application architecture, and evaluation formulas.

The job search that runs on your machine. AI job application framework built on Claude Code: evaluate postings, tailor CVs, write cover letters, prep interviews. Fork it and own it.

Open-source AI-native canvas and agent workspace unifying multi-threaded chat, knowledge retrieval, and document co-creation.

Iterative, graph-based autonomous research agent with reflection, web search verification, and structured report compilation.

Milvus & Zilliz-powered Claude Desktop and Cursor MCP server for long-term agent memory, doc retrieval, and code knowledge graph querying.

Autonomous coding workflow that generates implementations, runs unit test executions, and self-corrects runtime stack traces.

Harness self-evolution: update targets, theory, evaluation, and reported evidence. Bilingual reading list and project website.

达尔文.skill —— 一个让你的Skill无限进化的系统：评估→改进→测试→保留或回滚 | Autoresearch-inspired autonomous skill optimization for Claude Code. Evaluate, improve, test, keep or revert.

Open-source AI job search: scan job portals, evaluate listings into a structured A-H report with a global 1-5 score, tailor your CV, track applications — runs locally in your AI coding CLI (Claude Code, Codex, OpenCode, Antigravity…)

Persistent project intelligence and memory plugin for DSH: architecture analysis, cross-session context, TODOs, and optional hybrid retrieval

A structural code search engine for Al agents.

An MCP server that autonomously evaluates web applications.

A Large-Scale Knowledge Graph for Automated Scientific Research

OrcaReplay — Time travel for AI agents. Record, replay, fork, and debug any agent run with any model. Built by the OrcaRouter.ai team.

🛡️AutoControl Arena: Synthesizing Executable Test Environments for Frontier AI Risk Evaluation

Learn AI Agents step by step, from scratch - from function calling to agent loops to multi-agent systems, orchestration, and evaluation.

Full-market stock discovery for AI agents: A-shares plus US/HK/JP/KR/TW/IN, auditable YAML strategies, optional LLM ranking, sector-diversified picks, and true T+N evaluation vs. benchmark. AI选股

Build tested agent skills and govern their lifecycle through a user-defined marketplace: evidence, discovery, updates, rollback, quarantine, and 17-platform distribution.

Encrypted, fully offline agentic memory. One click install, GUI w/ memory map, all OS and agents. Superior memory creation, storage and retrieval.

The operational superset of Pi Coding Agent — everything Pi, plus observability, governance, recovery, evaluation and multi-agent orchestration. Pi Coding Agent 的运维超集——完整继承 Pi 的核心能力，并进一步扩展可观测性、治理、故障恢复、评估和多 Agent 编排。