Setup & Installation
What This Skill Does
Performs root cause analysis on production LLM application traces by using eval judge verdicts as diagnostic signal. It walks the trace tree to find where failures actually originate, not just where they were detected, then produces a structured report with concrete fix recommendations. Instead of manually clicking through dozens of failing traces in Datadog to guess at patterns, this runs a structured open-coding-to-axial-coding analysis and pinpoints root causes in specific spans with before/after fix suggestions.
When to use it
- Working with dd llmo eval trace rca functionality
- Implementing dd llmo eval trace rca features
- Debugging dd llmo eval trace rca related issues
