- Implement circuit breaker pattern for GPU health checks
- Prevents repeated failures with configurable thresholds
- Three states: CLOSED, OPEN, HALF_OPEN
- Integrated into GPU health monitoring
- Add comprehensive input validation and path sanitization
- Path traversal attack prevention
- Whitelist-based validation for models, devices, formats
- Error message sanitization to prevent information leakage
- File size limits and security checks
- Centralize startup logic across servers
- Extract common startup procedures to utils/startup.py
- Deduplicate GPU health checks and initialization code
- Simplify both MCP and API server startup sequences
- Add proper Python package structure
- Add __init__.py files to all modules
- Improve package organization
- Add circuit breaker status API endpoints
- GET /health/circuit-breaker - View circuit breaker stats
- POST /health/circuit-breaker/reset - Reset circuit breaker
- Reorganize test files into tests/ directory
- Rename and restructure test files for better organization
