Qwen1 5 Moe A2 7b
No PawBench serving benchmark yet
This model hasn't been benchmarked with PawBench on any hardware. Be the first to contribute!
How to contribute
- 1.
pip install servingcard - 2.
servingcard benchmark --model qwen1-5-moe-a2-7b --hardware your-gpu - 3. Submit a PR to the registry
Discussion
Know something about serving this model? Share your experience.