Skip to content

Add automated AI-generated issue detection system#9513

Draft
Copilot wants to merge 4 commits intomainfrom
copilot/detect-ai-generated-issues
Draft

Add automated AI-generated issue detection system#9513
Copilot wants to merge 4 commits intomainfrom
copilot/detect-ai-generated-issues

Conversation

Copy link

Copilot AI commented Feb 2, 2026

Summary

Implements automated detection of potentially AI-generated issues using 8 pattern matchers (future dates, excessive formatting, generic AI phrases, etc.). Issues scoring ≥3/8 patterns are flagged with potential-ai-generated label and receive educational comment linking to contribution guidelines.

Implementation

GitHub Actions Workflow (.github/workflows/ai-issue-detector.yml)

  • Triggers on issues: [opened, edited]
  • Analyzes issue body for AI-generation patterns:
    • Future dates/versions (2026+, K8s 1.33+)
    • Structural markers (5+ tables, 8+ headers)
    • AI phraseology ("Root Cause Analysis", "Operational Impact", etc.)
    • Generic section headers ("Critical Problem", "Expected Permanent Solution")
    • Perfect formatting patterns
  • Adds labels and posts verification request when threshold met

AI Contribution Policy (site/content/docs/main/code-standards.md)

  • Defines acceptable vs. unacceptable AI usage
  • Requires verification of AI-assisted content (version numbers, error messages, configurations)
  • Welcomes AI assistance when properly validated

Documentation

  • .github/AI-DETECTION-README.md - System overview
  • .github/MAINTAINER-AI-DETECTION-GUIDE.md - Triage procedures, engagement templates, threshold tuning
  • .github/AI-DETECTION-EXAMPLES.md - Annotated examples showing detection triggers

Configuration

  • Added potential-ai-generated to .github/labels.yaml

Educational approach: flags for verification, doesn't block contributions.

Checklist

  • Accepted the DCO
  • Created a changelog file or commented /kind changelog-not-required
  • Updated documentation in site/content/docs/main

💬 We'd love your input! Share your thoughts on Copilot coding agent in our 2 minute survey.

Copilot AI changed the title [WIP] Add functionality to detect AI-generated issues Add automated AI-generated issue detection system Feb 2, 2026
Copilot AI requested a review from blackpiglet February 2, 2026 03:30
@Lyndon-Li Lyndon-Li mentioned this pull request Feb 3, 2026
2 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants