Back to skills

dd-llmo-eval-trace-rca

ai-tools

Performs root cause analysis on production LLM application traces by using eval judge verdicts as diagnostic signal. It walks the trace tree to find where failures actually originate, not just where t

Setup & Installation

npx skills add https://github.com/datadog-labs/dd-llmo-eval-trace-rca --skill dd-llmo-eval-trace-rca
or paste the link and ask your coding assistant to install it
https://github.com/datadog-labs/dd-llmo-eval-trace-rca
View on GitHub

What This Skill Does

Performs root cause analysis on production LLM application traces by using eval judge verdicts as diagnostic signal. It walks the trace tree to find where failures actually originate, not just where they were detected, then produces a structured report with concrete fix recommendations. Instead of manually clicking through dozens of failing traces in Datadog to guess at patterns, this runs a structured open-coding-to-axial-coding analysis and pinpoints root causes in specific spans with before/after fix suggestions.

When to use it

  • Working with dd llmo eval trace rca functionality
  • Implementing dd llmo eval trace rca features
  • Debugging dd llmo eval trace rca related issues