Sage A1 5 Q4 K M Gguf
No PawBench serving benchmark yet
This model hasn't been benchmarked with PawBench on any hardware. Be the first to contribute!
How to contribute
- 1.
pip install servingcard - 2.
servingcard benchmark --model sage-a1-5-q4-k-m-gguf --hardware your-gpu - 3. Submit a PR to the registry
Discussion
Know something about serving this model? Share your experience.