Hardware Configuration

Name: ServingCard
Author: Zen Labs

GPU Model

Quantization

Batch Size

ServingCard

Built by Zen Labs. The missing layer between model weights and production inference.

ServingCard is open source. View on GitHub