IkhtisarModelPapan peringkatHardwareMarketplaceEvaluasiTrainSewaProDokumen API
Bahasa
Lucebox Hub campaign banner

Model

114 model groups · 404 total

Qwen3.6-27B

Qwen / Qwen3.6-27B

28B
Qwenimage-text-to-text318 benchmarks total
transformerssafetensorsqwen3_5image-text-to-text
Terbaik255 tok/s
Median42.4 tok/s
Min1.6 tok/s
Lihat benchmark →

Qwen3.6-35B-A3B

Qwen / Qwen3.6-35B-A3B

MoE3B active / 36B total
Qwenimage-text-to-text208 benchmarks total
transformerssafetensorsqwen3_5_moeimage-text-to-text
Terbaik391 tok/s
Median71.3 tok/s
Min6.4 tok/s
Lihat benchmark →

MiniMax-M2.7

MiniMaxAI / MiniMax-M2.7

MoE229B
Minimaxtext-generation117 benchmarks total
transformerssafetensorsminimax_m2text-generation
Terbaik496 tok/s
Median32.2 tok/s
Min0.5 tok/s
Lihat benchmark →

gemma-4-26B-A4B

google / gemma-4-26B-A4B

MoE4B active / 27B total
Gemmaimage-text-to-text86 benchmarks total
transformerssafetensorsgemma4image-text-to-text
Lihat benchmark →

Qwen3.5-9B-Base

Qwen / Qwen3.5-9B-Base

10B
Qwenimage-text-to-text63 benchmarks total
transformerssafetensorsqwen3_5image-text-to-text
Lihat benchmark →

Qwen3.5-27B

Qwen / Qwen3.5-27B

28B
Qwenimage-text-to-text63 benchmarks total
transformerssafetensorsqwen3_5image-text-to-text
Terbaik287 tok/s
Median30.9 tok/s
Min2.2 tok/s
Lihat benchmark →

gemma-4-E4B

google / gemma-4-E4B

8B
Gemmaany-to-any41 benchmarks total
transformerssafetensorsgemma4image-text-to-text
Terbaik70.5 tok/s
Median70.5 tok/s
Min70.5 tok/s
Lihat benchmark →

gemma-4-31B

google / gemma-4-31B

33B
Gemmaimage-text-to-text37 benchmarks total
transformerssafetensorsgemma4image-text-to-text
Lihat benchmark →

Ornstein3.6-27B-MTP-NSC-ACE-SABER

GestaltLabs / Ornstein3.6-27B-MTP-NSC-ACE-SABER

27B
Qwenimage-text-to-text37 benchmarks total
transformerssafetensorsqwen3_5image-text-to-text
Lihat benchmark →

Qwen3.5-35B-A3B-Base

Qwen / Qwen3.5-35B-A3B-Base

MoE3B active / 36B total
Qwenimage-text-to-text35 benchmarks total
transformerssafetensorsqwen3_5_moeimage-text-to-text
Lihat benchmark →

Meta-Llama-3-8B-Instruct

meta-llama / Meta-Llama-3-8B-Instruct

8B
Llamatext-generation31 benchmarks total
transformerssafetensorsllamatext-generation
Terbaik148 tok/s
Median48.4 tok/s
Min13.6 tok/s
Lihat benchmark →

Qwen3-Coder-30B-A3B-Instruct

Qwen / Qwen3-Coder-30B-A3B-Instruct

MoE3B active / 31B total
Qwentext-generation31 benchmarks total
transformerssafetensorsqwen3_moetext-generation
Terbaik101 tok/s
Median84.2 tok/s
Min75.9 tok/s
Lihat benchmark →

DeepSeek-V4-Flash

deepseek-ai / DeepSeek-V4-Flash

MoE158B
Deepseektext-generation30 benchmarks total
transformerssafetensorsdeepseek_v4text-generation
Terbaik262 tok/s
Median33.0 tok/s
Min18.6 tok/s
Lihat benchmark →

gemma-4-12B

google / gemma-4-12B

12B
Gemmaany-to-any25 benchmarks total
transformerssafetensorsgemma4_unifiedimage-text-to-text
Terbaik25.8 tok/s
Median25.8 tok/s
Min25.8 tok/s
Lihat benchmark →

Qwen3.5-122B-A10B

Qwen / Qwen3.5-122B-A10B

MoE10B active / 125B total
Qwenimage-text-to-text25 benchmarks total
transformerssafetensorsqwen3_5_moeimage-text-to-text
Terbaik27.3 tok/s
Median25.4 tok/s
Min3.2 tok/s
Lihat benchmark →

gpt-oss-20b

openai / gpt-oss-20b

MoE22B
Gpttext-generation24 benchmarks total
transformerssafetensorsgpt_osstext-generation
Terbaik991 tok/s
Median80.3 tok/s
Min12.0 tok/s
Lihat benchmark →

Qwen2.5-14B

Qwen / Qwen2.5-14B

15B
Qwentext-generation22 benchmarks total
safetensorsqwen2text-generationconversational
Lihat benchmark →

LFM2.5-8B-A1B-Base

LiquidAI / LFM2.5-8B-A1B-Base

MoE1B active / 8B total
text-generation21 benchmarks total
transformerssafetensorslfm2_moetext-generation
Lihat benchmark →

Qwen3.5-4B-Base

Qwen / Qwen3.5-4B-Base

5B
Qwenimage-text-to-text18 benchmarks total
transformerssafetensorsqwen3_5image-text-to-text
Lihat benchmark →

Qwen3-Coder-Next

Qwen / Qwen3-Coder-Next

80B
Qwentext-generation18 benchmarks total
transformerssafetensorsqwen3_nexttext-generation
Terbaik80.8 tok/s
Median55.8 tok/s
Min48.2 tok/s
Lihat benchmark →

gemma-4-E2B

google / gemma-4-E2B

5B
Gemmaany-to-any16 benchmarks total
transformerssafetensorsgemma4image-text-to-text
Lihat benchmark →

Llama-3.1-8B

meta-llama / Llama-3.1-8B

8B
Llamatext-generation15 benchmarks total
transformerssafetensorsllamatext-generation
Lihat benchmark →

Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16

nvidia / Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16

MoE3B active / 33B total
any-to-any13 benchmarks total
transformerssafetensorsNemotronH_Nano_Omni_Reasoning_V3feature-extraction
Terbaik107 tok/s
Median90.6 tok/s
Min57.9 tok/s
Eval score· 1 eval
100.0%
Lihat benchmark →

Mistral-Medium-3.5-128B

mistralai / Mistral-Medium-3.5-128B

128B
Mistral13 benchmarks total
safetensorsmistral3vLLMen
Terbaik7.4 tok/s
Median6.5 tok/s
Min6.2 tok/s
Lihat benchmark →

gpt-oss-120b

openai / gpt-oss-120b

MoE120B
Gpttext-generation13 benchmarks total
transformerssafetensorsgpt_osstext-generation
Terbaik223 tok/s
Median70.0 tok/s
Min59.2 tok/s
Lihat benchmark →

Qwen2.5-7B

Qwen / Qwen2.5-7B

8B
Qwentext-generation12 benchmarks total
transformerssafetensorsqwen2text-generation
Terbaik1.4k tok/s
Median1.4k tok/s
Min1.4k tok/s
Lihat benchmark →

Qwen3-30B-A3B-Base

Qwen / Qwen3-30B-A3B-Base

MoE3B active / 31B total
Qwentext-generation11 benchmarks total
transformerssafetensorsqwen3_moetext-generation
Lihat benchmark →

GLM-4.7-Flash

zai-org / GLM-4.7-Flash

MoE31B
text-generation11 benchmarks total
transformerssafetensorsglm4_moe_litetext-generation
Terbaik212 tok/s
Median176 tok/s
Min92.9 tok/s
Lihat benchmark →

Nemotron-Cascade-2-30B-A3B

nvidia / Nemotron-Cascade-2-30B-A3B

MoE3B active / 32B total
text-generation11 benchmarks total
transformerssafetensorsnemotron_htext-generation
Terbaik141 tok/s
Median95.4 tok/s
Min89.8 tok/s
Lihat benchmark →

gemma-3-12b-pt

google / gemma-3-12b-pt

12B
Gemmaimage-text-to-text10 benchmarks total
transformerssafetensorsgemma3image-text-to-text
Lihat benchmark →

Qwen3.6-27B-DFlash

z-lab / Qwen3.6-27B-DFlash

2B
Qwentext-generation10 benchmarks total
transformerssafetensorsqwen3feature-extraction
Terbaik215 tok/s
Median39.2 tok/s
Min26.9 tok/s
Lihat benchmark →

Ornith-1.0-35B-GGUF

deepreinforce-ai / Ornith-1.0-35B-GGUF

35B
text-generation9 benchmarks total
transformersgguftext-generationlicense:mit
Terbaik253 tok/s
Median64.4 tok/s
Min27.8 tok/s
Lihat benchmark →

Nex-N2-mini

nex-agi / Nex-N2-mini

MoE35B
Qwentext-generation9 benchmarks total
transformerssafetensorsqwen3_5_moeimage-text-to-text
Terbaik107 tok/s
Median104 tok/s
Min40.5 tok/s
Lihat benchmark →

GLM-5.2

zai-org / GLM-5.2

MoE753B
text-generation8 benchmarks total
transformerssafetensorsglm_moe_dsatext-generation
Lihat benchmark →

Qwen3.5-0.8B-Base

Qwen / Qwen3.5-0.8B-Base

1B
Qwenimage-text-to-text8 benchmarks total
transformerssafetensorsqwen3_5image-text-to-text
Terbaik2.7k tok/s
Median2.7k tok/s
Min2.7k tok/s
Lihat benchmark →

DeepSeek-R1-Distill-Qwen-7B

deepseek-ai / DeepSeek-R1-Distill-Qwen-7B

8B
Deepseek-R1text-generation8 benchmarks total
transformerssafetensorsqwen2text-generation
Terbaik144 tok/s
Median69.0 tok/s
Min38.1 tok/s
Lihat benchmark →

Ling-2.6-flash

inclusionAI / Ling-2.6-flash

MoE107B
text-generation8 benchmarks total
safetensorsbailing_hybridtext-generationconversational
Terbaik94.9 tok/s
Median86.2 tok/s
Min82.3 tok/s
Lihat benchmark →

Qwen2.5-72B

Qwen / Qwen2.5-72B

73B
Qwentext-generation8 benchmarks total
transformerssafetensorsqwen2text-generation
Lihat benchmark →

LFM2.5-1.2B-Base

LiquidAI / LFM2.5-1.2B-Base

1B
text-generation7 benchmarks total
transformerssafetensorslfm2text-generation
Lihat benchmark →

Ornith-1.0-9B

deepreinforce-ai / Ornith-1.0-9B

0M
Qwentext-generation6 benchmarks total
transformerssafetensorsqwen3_5image-text-to-text
Terbaik77.5 tok/s
Median25.7 tok/s
Min24.7 tok/s
Lihat benchmark →

Qwen3-8B-Base

Qwen / Qwen3-8B-Base

8B
Qwentext-generation6 benchmarks total
transformerssafetensorsqwen3text-generation
Lihat benchmark →

DeepSeek-Coder-V2-Lite-Instruct

deepseek-ai / DeepSeek-Coder-V2-Lite-Instruct

MoE16B
Deepseek-Codertext-generation6 benchmarks total
transformerssafetensorsdeepseek_v2text-generation
Terbaik150 tok/s
Median87.0 tok/s
Min39.0 tok/s
Lihat benchmark →

Llama-2-7b-hf

meta-llama / Llama-2-7b-hf

7B
Llamatext-generation5 benchmarks total
transformerspytorchsafetensorsllama
Terbaik202 tok/s
Median50.4 tok/s
Min19.1 tok/s
Lihat benchmark →

Llama-3.2-1B-Instruct

meta-llama / Llama-3.2-1B-Instruct

1B
Llamatext-generation5 benchmarks total
transformerssafetensorsllamatext-generation
Terbaik448 tok/s
Median195 tok/s
Min184 tok/s
Lihat benchmark →

granite-4.0-h-micro

ibm-granite / granite-4.0-h-micro

MoE3B
text-generation5 benchmarks total
transformerssafetensorsgranitemoehybridtext-generation
Terbaik141 tok/s
Median45.3 tok/s
Min45.0 tok/s
Lihat benchmark →

LFM2-8B-A1B

LiquidAI / LFM2-8B-A1B

MoE1B active / 8B total
text-generation5 benchmarks total
transformerssafetensorslfm2_moetext-generation
Terbaik18.3 tok/s
Median18.3 tok/s
Min9.9 tok/s
Lihat benchmark →

NVIDIA-Nemotron-3-Nano-30B-A3B-BF16

nvidia / NVIDIA-Nemotron-3-Nano-30B-A3B-BF16

MoE3B active / 32B total
text-generation5 benchmarks total
transformerssafetensorsnemotron_htext-generation
Terbaik313 tok/s
Median286 tok/s
Min117 tok/s
Lihat benchmark →

Qwen3-14B-Base

Qwen / Qwen3-14B-Base

15B
Qwentext-generation5 benchmarks total
transformerssafetensorsqwen3text-generation
Lihat benchmark →

Mistral-Small-3.1-24B-Base-2503

mistralai / Mistral-Small-3.1-24B-Base-2503

24B
Mistral5 benchmarks total
vllmsafetensorsmistral3mistral-common
Lihat benchmark →

gemma-3-1b-pt

google / gemma-3-1b-pt

1B
Gemmatext-generation5 benchmarks total
transformerssafetensorsgemma3_texttext-generation
Lihat benchmark →

Qwen3.5-2B-Base

Qwen / Qwen3.5-2B-Base

2B
Qwenimage-text-to-text5 benchmarks total
transformerssafetensorsqwen3_5image-text-to-text
Lihat benchmark →

Qwen2.5-1.5B

Qwen / Qwen2.5-1.5B

2B
Qwentext-generation5 benchmarks total
transformerssafetensorsqwen2text-generation
Lihat benchmark →

NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4

nvidia / NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4

MoE12B active / 67B total
Opttext-generation5 benchmarks total
transformerssafetensorsnemotron_htext-generation
Terbaik262 tok/s
Median175 tok/s
Min49.6 tok/s
Lihat benchmark →

DeepSeek-R1-Distill-Qwen-14B

deepseek-ai / DeepSeek-R1-Distill-Qwen-14B

15B
Deepseek-R1text-generation4 benchmarks total
transformerssafetensorsarxiv:2501.12948license:mit
Terbaik24.4 tok/s
Median24.4 tok/s
Min24.4 tok/s
Lihat benchmark →

gemma-3n-E4B

google / gemma-3n-E4B

8B
Gemmaimage-text-to-text4 benchmarks total
transformerssafetensorsgemma3nimage-text-to-text
Lihat benchmark →

MiniMax-M2

MiniMaxAI / MiniMax-M2

229B
Minimaxtext-generation4 benchmarks total
transformerssafetensorsminimax_m2text-generation
Terbaik493 tok/s
Median398 tok/s
Min303 tok/s
Lihat benchmark →

GLM-5.1

zai-org / GLM-5.1

MoE754B
text-generation4 benchmarks total
transformerssafetensorsglm_moe_dsatext-generation
Lihat benchmark →

Qwen3-32B

Qwen / Qwen3-32B

33B
Qwentext-generation4 benchmarks total
transformerssafetensorsqwen3text-generation
Terbaik79.3 tok/s
Median22.8 tok/s
Min3.2 tok/s
Lihat benchmark →

granite-4.1-30b

ibm-granite / granite-4.1-30b

29B
text-generation4 benchmarks total
transformerssafetensorsgranitetext-generation
Terbaik17.9 tok/s
Median16.4 tok/s
Min15.6 tok/s
Lihat benchmark →

Gemopus-4-26B-A4B-it

Jackrong / Gemopus-4-26B-A4B-it

MoE4B active / 27B total
Gemmatext-generation4 benchmarks total
safetensorsgemma4gemmainstruction-tuned
Terbaik64.3 tok/s
Median55.0 tok/s
Min45.7 tok/s
Lihat benchmark →

Qwen3-VL-8B-Instruct

Qwen / Qwen3-VL-8B-Instruct

9B
Qwenimage-text-to-text3 benchmarks total
transformerssafetensorsqwen3_vlimage-text-to-text
Terbaik95.9 tok/s
Median95.9 tok/s
Min95.9 tok/s
Lihat benchmark →

Ornith-1.0-35B

deepreinforce-ai / Ornith-1.0-35B

MoE0M
Qwentext-generation3 benchmarks total
transformerssafetensorsqwen3_5_moeimage-text-to-text
Terbaik89.1 tok/s
Median78.4 tok/s
Min67.8 tok/s
Lihat benchmark →

gemma-3-4b-pt

google / gemma-3-4b-pt

4B
Gemmaimage-text-to-text3 benchmarks total
transformerssafetensorsgemma3image-text-to-text
Lihat benchmark →

Step-3.7-Flash

stepfun-ai / Step-3.7-Flash

MoE201B
image-text-to-text3 benchmarks total
transformerssafetensorsstep3p7text-generation
Lihat benchmark →

phi-4

microsoft / phi-4

15B
Phitext-generation3 benchmarks total
transformerssafetensorsphi3text-generation
Terbaik77.0 tok/s
Median36.0 tok/s
Min36.0 tok/s
Lihat benchmark →

Qwen3-4B-Base

Qwen / Qwen3-4B-Base

4B
Qwentext-generation3 benchmarks total
transformerssafetensorsqwen3text-generation
Lihat benchmark →

NVIDIA-Nemotron-3-Super-120B-A12B-BF16

nvidia / NVIDIA-Nemotron-3-Super-120B-A12B-BF16

MoE12B active / 124B total
text-generation3 benchmarks total
transformerssafetensorsnemotron_htext-generation
Lihat benchmark →

MiniMax-M2.5

MiniMaxAI / MiniMax-M2.5

MoE229B
Minimaxtext-generation3 benchmarks total
transformerssafetensorsminimax_m2text-generation
Terbaik504 tok/s
Median419 tok/s
Min334 tok/s
Lihat benchmark →

DeepSeek-V4-Flash-DSpark

deepseek-ai / DeepSeek-V4-Flash-DSpark

MoE165B
Deepseektext-generation2 benchmarks total
transformerssafetensorsdeepseek_v4text-generation
Terbaik262 tok/s
Median262 tok/s
Min262 tok/s
Lihat benchmark →

Qwen2.5-VL-7B-Instruct

Qwen / Qwen2.5-VL-7B-Instruct

8B
Qwenimage-text-to-text2 benchmarks total
transformerssafetensorsqwen2_5_vlimage-text-to-text
Lihat benchmark →

Ornith-1.0-9B-GGUF

deepreinforce-ai / Ornith-1.0-9B-GGUF

9B
text-generation2 benchmarks total
transformersgguftext-generationlicense:mit
Terbaik32.0 tok/s
Median31.9 tok/s
Min31.8 tok/s
Lihat benchmark →

diffusiongemma-26B-A4B-it

google / diffusiongemma-26B-A4B-it

MoE4B active / 26B total
Gemmaimage-text-to-text2 benchmarks total
transformerssafetensorsdiffusion_gemmaimage-text-to-text
Lihat benchmark →

Qwen2.5-0.5B

Qwen / Qwen2.5-0.5B

0M
Qwentext-generation2 benchmarks total
transformerssafetensorsqwen2text-generation
Lihat benchmark →

NVIDIA-Nemotron-Nano-12B-v2-Base

nvidia / NVIDIA-Nemotron-Nano-12B-v2-Base

12B
text-generation2 benchmarks total
transformerssafetensorsnvidiapytorch
Lihat benchmark →

Kimi-K2.5

moonshotai / Kimi-K2.5

1.1T
image-text-to-text2 benchmarks total
transformerssafetensorskimi_k25feature-extraction
Terbaik74.0 tok/s
Median74.0 tok/s
Min74.0 tok/s
Lihat benchmark →

Llama-3.2-3B-Instruct

meta-llama / Llama-3.2-3B-Instruct

3B
Llamatext-generation2 benchmarks total
transformerssafetensorsllamatext-generation
Terbaik79.9 tok/s
Median65.4 tok/s
Min50.9 tok/s
Lihat benchmark →

MiniMax-M2.1

MiniMaxAI / MiniMax-M2.1

229B
Minimaxtext-generation2 benchmarks total
transformerssafetensorsminimax_m2text-generation
Terbaik499 tok/s
Median416 tok/s
Min333 tok/s
Lihat benchmark →

Qwen3.5-35B-A3B-4bit

mlx-community / Qwen3.5-35B-A3B-4bit

MoE3B active / 6B total
Qwenimage-text-to-text2 benchmarks total
transformerssafetensorsqwen3_5_moeimage-text-to-text
Terbaik140 tok/s
Median122 tok/s
Min105 tok/s
Lihat benchmark →

Qwen3-VL-30B-A3B-Instruct

Qwen / Qwen3-VL-30B-A3B-Instruct

31B
Qwenimage-text-to-text2 benchmarks total
transformerssafetensorsqwen3_vl_moeimage-text-to-text
Terbaik56.6 tok/s
Median52.2 tok/s
Min47.7 tok/s
Lihat benchmark →

Ministral-3-3B-Base-2512

mistralai / Ministral-3-3B-Base-2512

4B
Mistral2 benchmarks total
vllmsafetensorsmistral3mistral-common
Lihat benchmark →

Llama-3.1-70B

meta-llama / Llama-3.1-70B

71B
Llamatext-generation2 benchmarks total
transformerssafetensorsllamatext-generation
Lihat benchmark →

Ornith-1.0-397B

deepreinforce-ai / Ornith-1.0-397B

MoE397B
Qwentext-generation1 benchmarks total
transformerssafetensorsqwen3_5_moeimage-text-to-text
Lihat benchmark →

MiniMax-M3

MiniMaxAI / MiniMax-M3

MoE427B
Minimaximage-text-to-text1 benchmarks total
transformerssafetensorsminimax_m3_vlimage-text-to-text
Lihat benchmark →

Unlimited-OCR

baidu / Unlimited-OCR

MoE3B
image-text-to-text1 benchmarks total
transformerssafetensorsunlimited-ocrfeature-extraction
Terbaik365 tok/s
Median365 tok/s
Min365 tok/s
Lihat benchmark →

Qwen3-1.7B-Base

Qwen / Qwen3-1.7B-Base

2B
Qwentext-generation1 benchmarks total
transformerssafetensorsqwen3text-generation
Lihat benchmark →

gemma-4-26B-A4B-it-QAT-MLX-4bit

lmstudio-community / gemma-4-26B-A4B-it-QAT-MLX-4bit

MoE4B active / 5B total
Gemmaimage-text-to-text1 benchmarks total
transformerssafetensorsgemma4image-text-to-text
Terbaik65.3 tok/s
Median65.3 tok/s
Min65.3 tok/s
Lihat benchmark →

granite-4.1-8b

ibm-granite / granite-4.1-8b

9B
1 benchmarks total
transformerssafetensorslanguagegranite-4.1
Lihat benchmark →

Step-3.7-Flash-NVFP4

stepfun-ai / Step-3.7-Flash-NVFP4

MoE104B
Optimage-text-to-text1 benchmarks total
transformerssafetensorsstep3p7text-generation
Terbaik27.4 tok/s
Median27.4 tok/s
Min27.4 tok/s
Lihat benchmark →

Qwable-3.6-35b

Mia-AiLab / Qwable-3.6-35b

35B
Qwen1 benchmarks total
transformersggufqwenqwen3
Terbaik54.1 tok/s
Median54.1 tok/s
Min54.1 tok/s
Lihat benchmark →

Qwen2.5-3B

Qwen / Qwen2.5-3B

3B
Qwentext-generation1 benchmarks total
safetensorsqwen2text-generationconversational
Lihat benchmark →

GPT-OSS-20B-Uncensored-HauhauCS-Aggressive

HauhauCS / GPT-OSS-20B-Uncensored-HauhauCS-Aggressive

20B
Gpt1 benchmarks total
ggufuncensoredabliteratedmxfp4
Terbaik66.8 tok/s
Median66.8 tok/s
Min66.8 tok/s
Lihat benchmark →

UncensoredLM-DeepSeek-R1-Distill-Qwen-14B

uncensoredai / UncensoredLM-DeepSeek-R1-Distill-Qwen-14B

14B
Deepseek-R11 benchmarks total
safetensorsqwen2license:apache-2.0region:us
Terbaik27.0 tok/s
Median27.0 tok/s
Min27.0 tok/s
Lihat benchmark →

Qwen3.5-9B-Red_Team

LuisPPB16 / Qwen3.5-9B-Red_Team

9B
Qwen1 benchmarks total
ggufqwen3_5llama.cppunsloth
Terbaik35.9 tok/s
Median35.9 tok/s
Min35.9 tok/s
Lihat benchmark →

rwkv-7-world

BlinkDL / rwkv-7-world

Starcodertext-generation1 benchmarks total
pytorchtext-generationcausal-lmrwkv
Lihat benchmark →

LFM2.5-350M-Base

LiquidAI / LFM2.5-350M-Base

0M
text-generation1 benchmarks total
transformerssafetensorslfm2text-generation
Lihat benchmark →

MiniCPM3-4B

openbmb / MiniCPM3-4B

4B
text-generation1 benchmarks total
transformerspytorchminicpm3text-generation
Terbaik6.1 tok/s
Median6.1 tok/s
Min6.1 tok/s
Lihat benchmark →

North-Mini-Code-1.0

CohereLabs / North-Mini-Code-1.0

30B
Coheretext-generation1 benchmarks total
transformerssafetensorscohere2_moetext-generation
Terbaik258 tok/s
Median258 tok/s
Min258 tok/s
Lihat benchmark →

Qwen3.5-0.8B-Q8_0.gguf

Manojb / Qwen3.5-0.8B-Q8_0.gguf

1B
Qwen1 benchmarks total
ggufendpoints_compatibleregion:usconversational
Terbaik346 tok/s
Median346 tok/s
Min346 tok/s
Lihat benchmark →

MiniCPM5-1B-GGUF

openbmb / MiniCPM5-1B-GGUF

1B
Llamatext-generation1 benchmarks total
transformersggufminicpmminicpm5
Terbaik126 tok/s
Median126 tok/s
Min126 tok/s
Lihat benchmark →

Qwen3.6-35B-A3B-4bit-DWQ

mlx-community / Qwen3.6-35B-A3B-4bit-DWQ

35B
Qwentext-generation1 benchmarks total
mlxsafetensorsqwen3_5_moetext-generation
Terbaik78.9 tok/s
Median78.9 tok/s
Min78.9 tok/s
Lihat benchmark →

MiMo-V2.5

XiaomiMiMo / MiMo-V2.5

311B
1 benchmarks total
safetensorsmimo_v2multimodalvision-language
Lihat benchmark →

Qwen3.5-122B-A10B-GPTQ-Int4

Qwen / Qwen3.5-122B-A10B-GPTQ-Int4

125B
Qwenimage-text-to-text1 benchmarks total
transformerssafetensorsqwen3_5_moeimage-text-to-text
Terbaik49.1 tok/s
Median49.1 tok/s
Min49.1 tok/s
Lihat benchmark →

Llama-2-7b

meta-llama / Llama-2-7b

7B
Llamatext-generation1 benchmarks total
facebookmetapytorchllama
Terbaik110 tok/s
Median110 tok/s
Min110 tok/s
Lihat benchmark →

Qwen2.5-32B

Qwen / Qwen2.5-32B

33B
Qwentext-generation1 benchmarks total
safetensorsqwen2text-generationconversational
Lihat benchmark →

Ternary-Bonsai-8B-unpacked

prism-ml / Ternary-Bonsai-8B-unpacked

8B
Qwen1 benchmarks total
safetensorsqwen3prismmlbonsai
Lihat benchmark →

GLM-5

zai-org / GLM-5

MoE754B
text-generation1 benchmarks total
transformerssafetensorsglm_moe_dsatext-generation
Lihat benchmark →

LFM2-24B-A2B

LiquidAI / LFM2-24B-A2B

24B
text-generation1 benchmarks total
transformerssafetensorsliquidlfm2
Terbaik161 tok/s
Median161 tok/s
Min161 tok/s
Lihat benchmark →

DeepSeek-V4-Flash-2bit-DQ

mlx-community / DeepSeek-V4-Flash-2bit-DQ

284B
Deepseektext-generation1 benchmarks total
mlxsafetensorstext-generationen
Terbaik17.0 tok/s
Median17.0 tok/s
Min17.0 tok/s
Lihat benchmark →

Qwen3-VL-2B-Instruct

Qwen / Qwen3-VL-2B-Instruct

2B
Qwenimage-text-to-text1 benchmarks total
transformerssafetensorsqwen3_vlimage-text-to-text
Terbaik27.9 tok/s
Median27.9 tok/s
Min27.9 tok/s
Lihat benchmark →

Qwen3-30B-A3B-Instruct-2507

Qwen / Qwen3-30B-A3B-Instruct-2507

31B
Qwentext-generation1 benchmarks total
transformerssafetensorsqwen3_moetext-generation
Lihat benchmark →

Gemopus-4-26B-A4B-it-GGUF

Jackrong / Gemopus-4-26B-A4B-it-GGUF

26B
Gemmatext-generation1 benchmarks total
ggufgemma4gemmainstruction-tuned
Terbaik94.5 tok/s
Median94.5 tok/s
Min94.5 tok/s
Lihat benchmark →

Qwen2-VL-7B

Qwen / Qwen2-VL-7B

8B
Qwenimage-text-to-text
transformerssafetensorsqwen2_vlimage-text-to-text
Lihat benchmark →

Qwen3.5-9B-NSC-ACE-SABER-GGUF

GestaltLabs / Qwen3.5-9B-NSC-ACE-SABER-GGUF

9B
Qwen
ggufqwen3_5nsc-acesaber
Lihat benchmark →

LFM2-24B-A2B-GGUF

lmstudio-community / LFM2-24B-A2B-GGUF

24B
ggufendpoints_compatibleregion:usconversational
Lihat benchmark →