Glm 4 7 Flash Fp8 Dynamic
No PawBench serving benchmark yet
This model hasn't been benchmarked with PawBench on any hardware. Be the first to contribute!
How to contribute
- 1.
pip install servingcard - 2.
servingcard benchmark --model glm-4-7-flash-fp8-dynamic --hardware your-gpu - 3. Submit a PR to the registry
Discussion
Know something about serving this model? Share your experience.