Files
claude-cookbooks/.github/workflows/claude-model-check.yml
Alex Notov 7938498146 refactor: simplify model validation to use Claude AI
Major simplification of CI/CD:
- Remove complex Python model validation scripts (400+ lines)
- Let Claude handle model validation intelligently via GitHub Actions
- Claude fetches latest models from docs.anthropic.com/en/docs/about-claude/models/overview.md
- Add comprehensive notebook validation script for local testing
  - Interactive dashboard with progress tracking
  - Auto-fix for deprecated models
  - GitHub issue export format
  - Idempotent with state persistence
- Simplify CI to use single Python version (3.11)
- Update workflows to use Claude for all intelligent validation

Benefits:
- No more hardcoded model lists to maintain
- Claude understands context (e.g., educational examples)
- 50% faster CI (removed matrix strategy)
- Single source of truth for models (docs site)
2025-09-07 17:27:34 -06:00

43 lines
1.3 KiB
YAML

name: Claude Model Check
on:
pull_request:
types: [opened, synchronize]
paths:
- 'skills/**/*.ipynb'
- '**.py'
- '**.md'
permissions:
contents: read
pull-requests: write
jobs:
model-check:
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v4
with:
fetch-depth: 0
- name: Claude Model Validation
uses: anthropics/claude-code-action@beta
with:
use_sticky_comment: true
anthropic_api_key: ${{ secrets.ANTHROPIC_API_KEY }}
github_token: ${{ secrets.GITHUB_TOKEN }}
timeout_minutes: "5"
direct_prompt: |
Review the changed files for Claude model usage.
First, fetch the current list of allowed models from:
https://docs.anthropic.com/en/docs/about-claude/models/overview.md
Then check:
1. All model references are from the current public models list
2. Flag any deprecated models (older Sonnet 3.5, Opus 3 versions)
3. Flag any internal/non-public model names
4. Suggest using aliases ending in -latest for better maintainability
Provide clear, actionable feedback on any issues found.