Skip to content

feat: add trace analysis advisor skill for intelligent AIRT recommendations#4

Merged
rdheekonda merged 3 commits intomainfrom
feat/trace-analysis-advisor
May 4, 2026
Merged

feat: add trace analysis advisor skill for intelligent AIRT recommendations#4
rdheekonda merged 3 commits intomainfrom
feat/trace-analysis-advisor

Conversation

@rdheekonda
Copy link
Copy Markdown
Contributor

@rdheekonda rdheekonda commented May 4, 2026

Summary

Adds skill specification for trace analysis functionality in the AI red teaming agent.

What this adds

  • Skill definition for analyzing historical attack data from ClickHouse
  • Tool specifications for attack effectiveness analysis and transform recommendations
  • API endpoint mapping for existing platform analytics endpoints

API Endpoints

  • GET /assessments/{id}/analytics
  • GET /assessments/{id}/traces/attacks
  • GET /assessments/{id}/traces/trials
  • GET /assessments/{id}/projects/{project}/summary

Tool Functions Specified

  • analyze_attack_effectiveness - Query historical ASR by attack type
  • suggest_optimal_transforms - Recommend transforms based on historical data
  • predict_attack_success - Estimate success probability from historical patterns
  • identify_vulnerability_patterns - Pattern matching from target responses
  • get_historical_metrics - Trending and coverage analysis

Implementation

This is a skill specification only. Actual tool implementation would be separate work.

Testing

No tests required - this is documentation/specification only.

@github-advanced-security
Copy link
Copy Markdown

You are seeing this message because GitHub Code Scanning has recently been set up for this repository, or this pull request contains the workflow file for the Code Scanning tool.

What Enabling Code Scanning Means:

  • The 'Security' tab will display more code scanning analysis results (e.g., for the default branch).
  • Depending on your configuration and choice of analysis tool, future pull requests will be annotated with code scanning analysis results.
  • You will be able to see the analysis results for the pull request's branch on this overview once the scans have completed and the checks have passed.

For more information about GitHub Code Scanning, check out the documentation.

@rdheekonda rdheekonda force-pushed the feat/trace-analysis-advisor branch from 83568f9 to 80b5da2 Compare May 4, 2026 23:10
@rdheekonda rdheekonda merged commit 5d1f162 into main May 4, 2026
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants