1292f0f09b
Major features: - GPU auto-reset on CUDA errors with cooldown protection (handles sleep/wake) - Async job queue system for long-running transcriptions - Comprehensive GPU health monitoring with real model tests - Phase 1 component testing with detailed logging New modules: - src/core/gpu_reset.py: GPU driver reset with 5-min cooldown - src/core/gpu_health.py: Real GPU health checks using model inference - src/core/job_queue.py: FIFO queue with background worker and persistence - src/utils/test_audio_generator.py: Test audio generation for GPU checks - test_phase1.py: Component tests with logging - reset_gpu.sh: GPU driver reset script Updates: - CLAUDE.md: Added GPU auto-reset docs and passwordless sudo setup - requirements.txt: Updated to PyTorch CUDA 12.4 - Model manager: Integrated GPU health check with reset - Both servers: Added startup GPU validation with auto-reset - Startup scripts: Added GPU_RESET_COOLDOWN_MINUTES env var
37 lines
1.2 KiB
Plaintext
37 lines
1.2 KiB
Plaintext
# uv pip install -r ./requirements.txt --index-url https://download.pytorch.org/whl/cu124
|
|
faster-whisper
|
|
torch #==2.6.0+cu124
|
|
torchaudio #==2.6.0+cu124
|
|
|
|
# uv pip install torch==2.6.0 torchvision==0.21.0 torchaudio==2.6.0 --index-url https://download.pytorch.org/whl/cu124
|
|
# pip install faster-whisper>=0.9.0
|
|
# pip install mcp[cli]>=1.2.0
|
|
mcp[cli]
|
|
|
|
# REST API dependencies
|
|
fastapi>=0.115.0
|
|
uvicorn[standard]>=0.32.0
|
|
python-multipart>=0.0.9
|
|
|
|
# Test audio generation dependencies
|
|
gTTS>=2.3.0
|
|
pyttsx3>=2.90
|
|
scipy>=1.10.0
|
|
numpy>=1.24.0
|
|
|
|
# PyTorch Installation Guide:
|
|
# Please install the appropriate version of PyTorch based on your CUDA version:
|
|
#
|
|
# • CUDA 12.6:
|
|
# pip install torch==2.6.0 torchvision==0.21.0 torchaudio==2.6.0 --index-url https://download.pytorch.org/whl/cu126
|
|
#
|
|
# • CUDA 12.4:
|
|
# pip install torch==2.6.0 torchvision==0.21.0 torchaudio==2.6.0 --index-url https://download.pytorch.org/whl/cu124
|
|
#
|
|
# • CUDA 12.1:
|
|
# pip install torch==2.5.1 torchvision==0.20.1 torchaudio==2.5.1 --index-url https://download.pytorch.org/whl/cu121
|
|
#
|
|
# • CPU version:
|
|
# pip install torch==2.6.0 torchvision==0.21.0 torchaudio==2.6.0 --index-url https://download.pytorch.org/whl/cpu
|
|
#
|