MCP Hub
Back to servers

ai-dev-analytics

AI development observability platform. It silently captures structured data from vibe coding sessions via MCP and codifies deviation patterns into project rules to make AI write better code. 100% local and zero runtime dependencies.

glama
Stars
2
Updated
Mar 25, 2026
Validated
Mar 27, 2026

AIDA

Make Vibe Coding Measurable.

Every vibe coding session generates massive insights — deviations, patterns, quality signals.
But you close the terminal, and all of it vanishes. Next session, you start blind again.
AIDA captures structured data at every development checkpoint, visualizes it in a live dashboard, and distills deviation patterns into rules that make your AI write better code — every single run.

One line to integrate. Zero workflow changes.

{ "mcpServers": { "aida": { "command": "npx", "args": ["-y", "ai-dev-analytics", "mcp"] } } }

npm version license node tests Live Demo ai-dev-analytics MCP server

ai-dev-analytics MCP server

One-Line Setup · Data-Driven Loop · Dashboard · SOP Workflow · Data for Reports · 中文文档


The Insight

Vibe coding is powerful. But it's a black box.

You tell Claude to build a feature. It writes code. You ship it. But you have zero visibility into what actually happened:

  • How many tasks did AI complete? How long did each take?
  • Where did AI deviate from your project conventions? Why?
  • Which deviations keep recurring? What rules would prevent them?
  • What's the bug rate? Which phases produce the most bugs?

Without data, you can't improve. You're just vibing — over and over, with the same blind spots.

AIDA makes the invisible visible. It collects structured data from every vibe coding session, renders it in a real-time dashboard, and turns deviation patterns into project rules. Your AI doesn't just code — it learns your project.


🔄 The Data-Driven Loop

This is the core of AIDA — data in, rules out, better code next time.

Vibe Coding Session
        ↓
   AIDA silently collects structured data
   (tasks, deviations, bugs, reviews, files, timeline)
        ↓
   Dashboard visualizes patterns
   "9 deviations → 56% hallucination, 44% rule-missing"
        ↓
   Deviation patterns identified → AI suggests rules → user confirms → sedimented
   .aidevos/rules/ ← your AI's growing knowledge base
        ↓
   AI reads rules next session → same mistakes eliminated
        ↓
   Repeat — each cycle, AI output gets closer to your expectations

Real data from a production project:

RunDeviationsWhat happenedRules sedimented
#123 deviations across 47 tasksAI misused components, wrong layouts, incorrect API patterns6 project-specific rules
#20 repeat deviationsAI read the rules. Same patterns — zero errors.

Step 1: See why AI deviates — Root cause breakdown reveals whether issues stem from hallucination, missing rules, or insufficient context.

Deviation Root Cause

Step 2: See where AI deviates — Category distribution pinpoints the exact areas: UI spacing, layout, component usage, API patterns.

Deviation Category Distribution

Step 3: Watch rules compound — As rules accumulate (green line), the same deviation patterns stop recurring.

Deviation & Rule Trend

The .aidevos/rules/ directory is your project-specific AI knowledge base. It grows with every run. The more you use AI, the smarter it gets at your project.


📊 The Dashboard

Your entire vibe coding process — structured, visualized, actionable.

Dashboard

Live Demo → Real anonymized project data. No install needed.

AIDA captures every dimension of AI-assisted development and turns it into interactive charts:

What you seeWhy it matters
Deviation root cause breakdownKnow why AI fails — rule-missing? hallucination? context gap?
Deviation category distributionKnow where AI fails — layout? components? API?
Deviation & rule trend over timeWatch deviations drop as rules accumulate
Bug severity distributionTrack quality — which phases produce critical bugs?
Self-review pass rate trendIs AI code getting better or worse over time?
Task completion by phaseSee progress across the full development lifecycle
File modification hotspotsWhich files keep getting changed? Where are the pain points?
Rules table with source mappingEvery rule links back to the deviation that created it
Full development timelineEvery task, bug, review, deviation — chronologically
Project overview (team view)Cross-branch stats, developer comparison, requirement status

Every KPI card is clickable — drill down into task details, deviation root causes, review reports, and file changes.

Run npx ai-dev-analytics dashboard to see your own project's data in seconds.

🔒 100% Local. Zero External Requests.

AIDA writes JSON files to .aidevos/ in your project directory. The codebase contains zero HTTP calls to external services — no telemetry, no cloud sync, no analytics, no tracking. Zero runtime dependencies. Your code and data never leave your machine. Period.


⚡ 30-Second Setup

One line in .mcp.json — that's the entire integration.

{ "mcpServers": { "aida": { "command": "npx", "args": ["-y", "ai-dev-analytics", "mcp"] } } }

No SDK. No wrapper. No code changes. Add this to your project root .mcp.json, and AIDA starts collecting data the next time your AI writes code. It works silently — zero workflow changes.

Tip: If npx is slow, install globally first: npm install -g ai-dev-analytics, then change the command to "aida". Global install also gives you the aida CLI command (e.g. aida dashboard, aida init).

Cursor / VS Code Copilot / Windsurf / Lingma

Cursor .cursor/mcp.json:

{
  "mcpServers": {
    "aida": {
      "command": "npx",
      "args": ["-y", "ai-dev-analytics", "mcp"]
    }
  }
}

VS Code Copilot .vscode/mcp.json:

{
  "servers": {
    "aida": {
      "command": "npx",
      "args": ["-y", "ai-dev-analytics", "mcp"]
    }
  }
}

Windsurf ~/.codeium/windsurf/mcp_config.json:

{
  "mcpServers": {
    "aida": {
      "command": "npx",
      "args": ["-y", "ai-dev-analytics", "mcp"]
    }
  }
}

Lingma (通义灵码) .lingma/mcp.json:

{
  "mcpServers": {
    "aida": {
      "command": "npx",
      "args": ["-y", "ai-dev-analytics", "mcp"]
    }
  }
}

See your data

npx ai-dev-analytics dashboard

Open http://localhost:2375 — real-time updates via SSE, Chinese/English toggle built in.


🤔 Why Data Changes Everything

Without data, every vibe coding session starts from zero. With data, each one builds on the last.

Vibing blindVibing with data
"AI keeps getting layouts wrong"Dashboard shows: 9 layout deviations, root cause 56% hallucination + 44% rule-missing. 4 rules sedimented → zero repeats next run
"I corrected this three times already"AIDA recorded the deviation pattern. AI detected rule-missing, suggested a rule, you confirmed — AI reads it every session, you never correct it again
"That feature had a lot of bugs"5 bugs, 3 critical — all concentrated in one phase. Now you know where to add guardrails
"What did I even do this quarter?"47 tasks, 23 deviations fixed, 6 rules sedimented, 4064 lines. Export → H1 performance review done

Vibe coding without data is just vibing. Add data, and it becomes a compounding system.


🎯 Use Cases

Vibe Coder — "I want my AI to actually learn my project"

You've been using Claude Code for a week. AIDA's dashboard shows: 23 deviations, concentrated in component-usage and layout categories, root cause mostly rule-missing. AI detects the patterns and suggests rules — you confirm, 6 project rules sedimented. Next week, those categories show zero deviations. Your AI now knows your project conventions.

Tech Lead — "I need to see what AI is actually doing across the team"

Team of 4 uses Claude Code daily. Open the project overview: Developer A has 2 deviations + 5 sedimented rules (AI is learning). Developer B has 15 deviations + 0 rules (AI is not learning). The data tells you exactly where to intervene.

Senior Engineer — "Show me the data for my performance review"

End of H1. Open the dashboard: 150 tasks across 3 features, 89% first-pass review rate, 12 rules sedimented that now benefit the entire team. All structured data — export it, attach it to your review doc. Data beats "I think I did a lot."

Team adopting vibe coding — "How do we go from chaotic to systematic?"

Start collecting data. After 2 weeks, the dashboard shows clear patterns: which types of tasks AI handles well, where it consistently deviates, what rules are needed. You go from "AI sometimes works" to "AI works predictably because we've taught it our conventions."


📁 Data Sedimentation & Performance Reports

AIDA doesn't just visualize — it sediments. Every run accumulates structured data that compounds over time.

Week 1:  47 tasks, 23 deviations, 5 bugs, 6 rules, 4064 lines
Week 4:  180+ tasks, deviation rate dropping, 15 rules, full quality history
Quarter: Complete development record — exportable, analyzable, presentable

What you can do with sedimented data:

ScenarioWhat you get
H1 / H2 Performance ReviewTasks completed, quality metrics (pass rate, bug rate), code volume, rules contributed — all with numbers, not feelings
Annual SummaryCross-project trends, deviation patterns over time, rule growth curve, total output
Sprint RetrospectiveWhat went wrong, what rules were added, which phases improved, measurable quality delta
Team Leader ReportPer-developer stats, deviation hotspots, which modules need better rules, team-wide AI maturity
Project HandoverFull development history — someone new can see exactly what happened, what rules exist, and why

All data is structured JSON in .aidevos/. No vendor lock-in. Export it, query it, pipe it into any reporting tool. Run aida report to generate a summary at any time.


⚙️ How It Works

flowchart LR
    A["Your AI Tool\nClaude Code / Cursor"] -->|Vibe Coding| B{"AIDA MCP Server\n10 Tools"}
    B -->|Silent Data Collection| C[".aidevos/run.json"]
    C -->|Visualization| D["Dashboard\nlocalhost:2375"]
    C -->|Pattern Analysis| E[".aidevos/rules/"]
    E -->|AI Reads Rules| A

Your AI tool calls AIDA's MCP tools automatically as it works. You don't invoke them manually. No prompts to write, no scripts to run — just vibe code as usual.

📋 10 MCP Tools (auto-collected)
ToolWhat it captures
aida_task_startTask begins — ID, title, stage, PRD phase
aida_task_doneTask completed — duration auto-calculated
aida_log_bugBug found — severity, title, related files
aida_bug_fixBug fixed — links fix to original bug
aida_log_reviewCode self-review — pass/fail, issue list
aida_log_deviationAI output ≠ expectation — root cause, category
aida_log_filesFile changes — auto-scans git diff, zero args needed
aida_highlightNotable achievement worth recording
aida_statusCurrent run status snapshot
aida_log_ruleSediment project rule — user confirms, then AI calls this tool

Data Model

All data is local JSON. No database, no cloud.

LevelFileWhat it contains
Run.aidevos/runs/{branch}/{dev}/run.jsonEvery task, bug, deviation, review, file change
Branch.aidevos/runs/{branch}/requirement.jsonAggregated stats per requirement
Project.aidevos/index.jsonCross-branch overview for team leads
Rules.aidevos/rules/Sedimented project rules — your AI's growing knowledge base

All structured JSON — ready for export, analysis, or feeding into reports.


🚀 Standardized AI Development Workflow

Beyond data collection, AIDA provides a complete SOP for AI-assisted development — a standardized workflow that turns chaotic vibe coding into a repeatable, measurable process.

aida init    # Select "Full workflow"
aida start   # Create a development run

This enables 14 AI Skills orchestrated as a full development pipeline:

PRD Ingestion → Requirement Analysis → Task Decomposition
        ↓
Code Generation → Self-Review → Bug Fix → Deviation Fix
        ↓
Data Collection → Pattern Analysis → Rule Sedimentation
        ↓
Next Run: AI reads rules → better output → fewer deviations
PhaseWhat AI doesWhat AIDA records
RequirementParses PRD, extracts modules and phasesPRD phases, scope
Task SplitBreaks requirements into atomic tasksTask list, stages, estimates
Code GenGenerates code per taskFiles changed, lines added, duration
Self-ReviewReviews its own output against conventionsPass/fail, issue list, quality score
Bug FixFixes bugs found during reviewBug severity, fix details, related files
Deviation FixCorrects output that doesn't match expectationsRoot cause, category, new rule (when root cause is rule-missing)

Every step produces structured data. Every deviation can become a rule. The SOP ensures nothing falls through the cracks — and the data makes the whole process visible and improvable.


🖥 CLI Reference
aida init              # Interactive project setup
aida start             # Create a new development run
aida status            # Show current run status
aida dashboard         # Launch dashboard (default port 2375)
aida dashboard --port 3000 # Custom port
aida mcp               # Start MCP server (for AI tool config)
aida log <subcommand>  # Write structured data (task, bug, review, etc.)
aida reindex           # Rebuild project-level index
aida report            # Generate performance report
aida rules build       # Generate rule view files from registry
aida rules dedupe      # Find and remove near-duplicate rules
aida rules merge       # Merge rules from parallel branches
aida update            # Update skills to latest version
aida migrate           # Migrate old data to current schema
🔌 MCP Integration Details

AIDA uses Model Context Protocol — the standard way for AI tools to interact with external systems. The MCP server runs over stdio with zero dependencies.

What happens when you add the config:

  1. Your AI tool discovers AIDA's 10 tools via MCP
  2. As the AI works, it naturally calls aida_task_start, aida_log_files, etc.
  3. Data flows into run.json silently
  4. Deviation patterns emerge → AI suggests rules → user confirms → sedimented
  5. AI reads rules next session → output quality improves

No prompts to write. No scripts to run. No workflow to learn.


Roadmap

  • Export reports as PDF / HTML (H1/H2 performance reviews)
  • Historical trend analysis — deviation reduction curves over time
  • Team dashboard with multi-project aggregation
  • VS Code extension for inline deviation alerts
  • Cross-project rule sharing — team-wide AI knowledge base

Tech Stack

RuntimeNode.js + TypeScript, zero dependencies
DashboardReact 19 + ECharts + Tailwind CSS 4
ProtocolMCP over stdio (JSON-RPC 2.0)
DataLocal JSON files, no database
Real-timeServer-Sent Events (SSE)
i18nChinese / English, switchable in dashboard

Testing

npm test    # 82 tests across 29 suites

Contributing

Issues, feature requests, and PRs are welcome.

git clone https://github.com/LWTlong/ai-dev-analytics.git
cd ai-dev-analytics
npm install
npm test

License

MIT


Vibe coding without data is just vibing.
Add data, and your AI gets smarter every run.

Get Started in 30 Seconds →

Reviews

No reviews yet

Sign in to write a review