live-audio-intelligence-mcp

Institutional-grade MCP server for live financial webcast transcription and vocal stress analysis.

Turns any live webcast URL (earnings calls, CNBC, investor days) into a real-time pipeline that feeds an LLM two things simultaneously:

A rolling transcript via faster-whisper (CPU, int8).
A vocal stress score (0–100) derived from F0 pitch jitter, hesitation ratio, and voiced-frame fraction — prosodic features correlated with executive nervousness, evasion, and guidance risk.

Built on the Model Context Protocol. Exposes 4 tools over stdio; drop it into Claude Desktop, Claude Code, or any MCP client.

Why this exists

Sell-side analysts and hedge-fund PMs don't just want to read the earnings transcript after the fact — they want a real-time signal about how confident the CFO sounds when asked about Q4 guidance. This server wires a Whisper pipeline and a pYIN-based prosody analyzer directly into an LLM's tool loop, so the model can ask "what did the CEO just say about China?" and "how stressed did they sound saying it?" in the same conversation.

Install

Requires Python ≥ 3.10 and ffmpeg on your PATH.

pip install live-audio-intelligence-mcp

Verify ffmpeg:

ffmpeg -version

The first run will download the faster-whisper base.en model (~140 MB).

Run it

Stdio MCP server:

live-audio-intelligence-mcp

Or equivalently:

python -m live_audio_intelligence_mcp

Claude Desktop

Add to claude_desktop_config.json:

{
  "mcpServers": {
    "live-audio-intelligence": {
      "command": "live-audio-intelligence-mcp"
    }
  }
}

Claude Code

claude mcp add live-audio-intelligence -- live-audio-intelligence-mcp

Tools

Tool	Purpose
`monitor_live_stream(url, disable_vad=False)`	Resolve the audio URL, spawn ffmpeg, start chunking + transcription. Returns a `stream_id`.
`get_rolling_transcript(stream_id, minutes_back=10)`	Get the last N minutes of concatenated transcript text.
`analyze_speaker_stress(stream_id, time_window_seconds=60)`	Run prosody analysis over the last N seconds of audio. Returns stress score, pitch jitter, hesitation ratio, pause stats, and a human-readable interpretation.
`stop_monitor(stream_id)`	Kill ffmpeg, clean up temp files, drop the transcript buffer.

The stress score

Score	Interpretation
0–20	Confident, fluent delivery
20–45	Normal variation
45–75	Elevated stress — worth monitoring
75–100	High stress — potential market-moving signal

Composite of:

Pitch jitter (coefficient of variation of F0) — 50% weight
Hesitation ratio (fraction of audio in pauses > 400 ms) — 35% weight
Unvoiced fraction (speaker trailing off) — 15% weight

Low-SNR mode

For speakerphone audio (most earnings Q&A), pass disable_vad=true to monitor_live_stream. Silero VAD tends to aggressively classify muddy conference-call speech as silence; disabling it preserves more of the speech at the cost of transcribing a bit more ambient noise.

Architecture

                 ┌──────────────────┐
    URL  ─────▶  │  yt-dlp resolve  │
                 └────────┬─────────┘
                          │ audio URL
                          ▼
                 ┌──────────────────┐      ┌────────────────┐
                 │  ffmpeg (bg)     │ ───▶ │  15s WAV chunk │
                 │  16kHz mono PCM  │      │  queue         │
                 └──────────────────┘      └───────┬────────┘
                                                   │
                                ┌──────────────────┴────────────────┐
                                ▼                                   ▼
                       ┌──────────────────┐              ┌──────────────────┐
                       │ faster-whisper   │              │  librosa.pyin    │
                       │ (int8 / CPU)     │              │  + pause detect  │
                       └────────┬─────────┘              └────────┬─────────┘
                                │ rolling transcript              │ stress score
                                ▼                                 ▼
                            ┌────────────── MCP stdio ───────────────┐
                            │    LLM (Claude) — calls tools freely   │
                            └────────────────────────────────────────┘

All blocking work (Whisper inference, ffmpeg I/O, librosa DSP) is dispatched to threads via asyncio.to_thread so the MCP event loop stays responsive.

Development

git clone https://github.com/live-audio-intelligence/live-audio-intelligence-mcp
cd live-audio-intelligence-mcp
python -m venv .venv
source .venv/bin/activate  # Windows: .venv\Scripts\activate
pip install -e .
live-audio-intelligence-mcp

License

MIT — see LICENSE.

Live Audio Intelligence

Quick Install