agent-reliability

Observability and enforcement for AI agent harnesses. Capture every run and runtime reliability with policy enforcement.

Open-source governed, local-first memory control plane for AI agents and teams. arXiv:2608.08253

Auditing AI agents: a curated list of papers, tools, datasets, benchmarks, and standards covering reliability, monitoring, failure attribution, and decision records.

Agent Reliability Analyzer: deterministic scanner that finds and fixes AI agent reliability failures

The runtime reliability layer for AI agents.

Deterministic agent reliability detection rules for the Trustabl Analyzer

🔁 Build reliable recurring AI-agent systems: 1022 resources, 22 operational patterns, 22 loop contracts, 8 runtime starters, an interactive atlas, and a structured dataset.

Agent Reliability Analyzer for AWS CodePipeline and CodeCatalyst: find agent reliability issues

Scan agents and auto-remediate agent reliability issues in GitHub Actions

Qualixar OS: The Universal OS for AI Agents. Claw-compatible. 12 topologies, Forge AI team designer, 24-tab dashboard, skill marketplace. PAPER: https://arxiv.org/abs/2604.06392

Lint rules for your AI agent's discipline, not its code

Agent dashboard runs reliability scans, skills, and network access probes.

Your coding agent says done. Show the receipt. Evidence-first workflows, practical skills, and plugins for Claude Code and Codex.

Stop overpaying to run your agents. Kalibr routes every request to lower-cost model and tool paths without degrading performance.

Audit any agent decision across its past, present, and future, on one typed graph.

Catch AI agents that say "done" when the task isn't. Checks agent-trace/v1 traces with claim-evidence rules, LLM judges and a trained classifier, returns verified / false_success / unverifiable with calibrated confidence, and ships a 300-trace labelled benchmark.

Pre-merge behavioral regression gate for AI agents. Check agent changes, inspect regressions, and block broken behavior before merge. Local-first.

ThumbGate Pre-Action Checks self-improve from ranked lessons and repeated failures, hard-block detected secret leaks, and block matches in strict mode.

Python SDK for accurate and verifiable agent tool use. Agents verify that answers came from the right source and were not changed. Downstream agents detect 100% of errors and retry to achieve a 50% jump in answer accuracy.

Open-source agent reliability platform for discovering, investigating, and fixing production agent failures