Saiga Llama3 8b
No PawBench serving benchmark yet
This model hasn't been benchmarked with PawBench on any hardware. Be the first to contribute!
How to contribute
- 1.
pip install servingcard - 2.
servingcard benchmark --model saiga-llama3-8b --hardware your-gpu - 3. Submit a PR to the registry
Discussion
Know something about serving this model? Share your experience.