Hardware leaderboard

Tesla V100

Compare approved local LLM inference runs for this hardware across models, engines, contexts, and quantizations.

Hardware profile

Community leaderboard

Speed test results

Find the fastest model and runtime combinations measured on this hardware.

Observed performance

Current results after the filters below are applied.

Fastest run

Median speed

Memory ceiling

Slowest run

Measured runs