モデル

Qwenimage-text-to-text253 件の速度テスト

Qwen3.6-35B-A3B

Qwen / Qwen3.6-35B-A3B

MoE3B アクティブ / 35B 合計qwen3_5_moeconversational

最高6.0k tok/s

中央値80.1 tok/s

最小6.4 tok/s

Eval score· 2 evalsBF16+

91.6%

Qwenimage-text-to-text223 件の速度テスト

Qwen3.6-27B

Qwen / Qwen3.6-27B

27Bqwen3_5conversational

Qwen3.8-Flash-Next

Qwen / Qwen3.8-Flash-Next

Qwenimage-text-to-text91 件の速度テスト

180Bqwen4_expconversational

最高205 tok/s

中央値59.9 tok/s

最小7.7 tok/s

Eval score· 2 evalsW4B

85.7%

gemma-4-26B-A4B

google / gemma-4-26B-A4B

MoE4B アクティブ / 26B 合計gemma4

Qwentext-generation26 件の速度テスト

Ornith-1.5-35B-A3B

ornith-ai / Ornith-1.5-35B-A3B

MoE3B アクティブ / 35B 合計qwen3_5_moeimage-text-to-textconversational

Qwen3.5-9B-Base

Qwen / Qwen3.5-9B-Base

9Bqwen3_5conversational

Qwenimage-text-to-text236 件の速度テスト

Qwen3.8-27B-MTP-GGUF

Jackrong / Qwen3.8-27B-MTP-GGUF

27Bllama.cppvisionmultimodal

NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16

nvidia / NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16

text-generation25 件の速度テスト

MoE3B アクティブ / 30B 合計nemotron_hnvidianemotron-3.5

GLM-5.3-Flash

zai-org / GLM-5.3-Flash

image-text-to-text68 件の速度テスト

321Bglm5_nextconversationalen

最高1.5k tok/s

中央値76.4 tok/s

最小5.8 tok/s

Eval score· 8 evalsexl3+

73.4%

12Bgemma4_unifiedimage-text-to-text

gemma-4-12B

google / gemma-4-12B

Gemmaany-to-any1 件の速度テスト

MiniMax-M2.7

MiniMaxAI / MiniMax-M2.7

Minimaxtext-generation40 件の速度テスト

text-generation129 件の速度テスト

Ornith-1.5-35B-A3B-GGUF

ornith-ai / Ornith-1.5-35B-A3B-GGUF

MoE3B アクティブ / 35B 合計conversational

DeepSeek-V4-Flash-0731

deepseek-ai / DeepSeek-V4-Flash-0731

Deepseektext-generation85 件の速度テスト

MoE304Bdeepseek_v48-bitfp8

最高404 tok/s

中央値52.0 tok/s

最小5.9 tok/s

Eval score· 5 evalsFP8

90.4%

Qwen3.5-35B-A3B-Base

Qwen / Qwen3.5-35B-A3B-Base

MoE3B アクティブ / 35B 合計qwen3_5_moeconversational

NVIDIA-Nemotron-Nano-12B-v2-Base

nvidia / NVIDIA-Nemotron-Nano-12B-v2-Base

12Bnvidiaenes

4Bgemma4image-text-to-text

gemma-4-E4B

google / gemma-4-E4B

Gemmaany-to-any3 件の速度テスト

gemma-4-31B

google / gemma-4-31B

31Bgemma4

granite-4.1-30b-base

ibm-granite / granite-4.1-30b-base

30Bgranitelanguagegranite-4.1

Qwentext-generation108 件の速度テスト

Ornith-1.5-9B

ornith-ai / Ornith-1.5-9B

9Bqwen3_5image-text-to-textconversational

最高3.8k tok/s

中央値75.3 tok/s

最小9.2 tok/s

Eval score· 1 evalBF16

81.7%

Deepseekimage-text-to-text100 件の速度テスト

DeepSeek-V4.1-Flash-1017

deepseek-ai / DeepSeek-V4.1-Flash-1017

763Bdeepseek_v41text-generation8-bit

Ornith-1.0-35B

ornith-ai / Ornith-1.0-35B

Qwentext-generation14 件の速度テスト

MoE35Bqwen3_5_moeimage-text-to-textconversational

gpt-oss-20b

openai / gpt-oss-20b

Gpttext-generation82 件の速度テスト

MoE20Bgpt_ossvllmconversational

Qwen3-8B-Base

Qwen / Qwen3-8B-Base

8Bqwen3conversational

LFM2.5-8B-A1B-Base

LiquidAI / LFM2.5-8B-A1B-Base

MoE1B アクティブ / 8B 合計lfm2_moeliquidlfm2.5

Qwenimage-text-to-text19 件の速度テスト

Qwen3.5-27B

Qwen / Qwen3.5-27B

27Bqwen3_5conversational

GLM-5.2

zai-org / GLM-5.2

MoE753Bglm_moe_dsaconversationalen

Deepseektext-generation38 件の速度テスト

DeepSeek-V4-Flash

deepseek-ai / DeepSeek-V4-Flash

MoE291Bdeepseek_v48-bitfp8

最高262 tok/s

中央値28.5 tok/s

最小7.0 tok/s

Eval score· 1 evalIQ3_XXS

94.8%

text-generation47 件の速度テスト

Laguna-S-2.1

poolside / Laguna-S-2.1

MoE118Blagunalaguna-s-2.1vllm

Muse-Glimmer-30B

meta-models / Muse-Glimmer-30B

image-text-to-text49 件の速度テスト

30Bmuse_glimmerconversational

Qwen2.5-7B

Qwen / Qwen2.5-7B

Qwentext-generation2 件の速度テスト

7Bqwen2conversationalen

Qwen3.5-4B-Base

Qwen / Qwen3.5-4B-Base

4Bqwen3_5conversational

0.3Bintern_vit_6bfeature-extraction

InternViT-300M-448px

OpenGVLab / InternViT-300M-448px

image-feature-extraction

Phitext-generation17 件の速度テスト

Phi-4-mini-reasoning

microsoft / Phi-4-mini-reasoning

Qwen3.5-122B-A10B

Qwen / Qwen3.5-122B-A10B

Qwenimage-text-to-text44 件の速度テスト

MoE10B アクティブ / 122B 合計qwen3_5_moeconversational

Qwen3-0.6B-Base

Qwen / Qwen3-0.6B-Base

0.6Bqwen3conversational

Llamatext-generation50 件の速度テスト

Llama-3.2-3B-Instruct

meta-llama / Llama-3.2-3B-Instruct

3Bfacebookmetallama-3

Ornith-1.5-9B-GGUF

ornith-ai / Ornith-1.5-9B-GGUF

text-generation54 件の速度テスト

LFM2.5-1.2B-Base

LiquidAI / LFM2.5-1.2B-Base

1.2Blfm2liquidlfm2.5

text-generation39 件の速度テスト

LFM2-350M

LiquidAI / LFM2-350M

Qwen3-Coder-30B-A3B-Instruct

Qwen / Qwen3-Coder-30B-A3B-Instruct

Qwentext-generation29 件の速度テスト

最高136 tok/s

中央値80.5 tok/s

最小14.4 tok/s

Eval score· 1 evalQ4_K_M

92.1%

2Bgemma4image-text-to-text

gemma-4-E2B

google / gemma-4-E2B

Gemmaany-to-any

Gpttext-generation45 件の速度テスト

gpt-oss-120b

openai / gpt-oss-120b

MoE120Bgpt_ossvllmconversational

最高2.8k tok/s

中央値131 tok/s

最小34.4 tok/s

Eval score· 2 evalsMXFP4

78.4%

Qwentext-generation42 件の速度テスト

Qwen3-Coder-Next

Qwen / Qwen3-Coder-Next

MoE80Bqwen3_nextconversational

Ornith-1.0-9B

ornith-ai / Ornith-1.0-9B

Qwentext-generation44 件の速度テスト

9Bqwen3_5image-text-to-textconversational

最高77.5 tok/s

中央値25.7 tok/s

最小3.8 tok/s

Eval score· 3 evalsQ4_K_M

56.0%

Qwen3-14B-Base

Qwen / Qwen3-14B-Base

14Bqwen3conversational

MoE33Blagunalaguna-xs-2.1vllm

Laguna-XS-2.1

poolside / Laguna-XS-2.1

text-generation6 件の速度テスト

gemma-3-12b-pt

google / gemma-3-12b-pt

12Bgemma3

Llamatext-generation40 件の速度テスト

MiniCPM5-1B-GGUF

openbmb / MiniCPM5-1B-GGUF

1Bminicpmminicpm5long-context

Qwen3-1.7B-Base

Qwen / Qwen3-1.7B-Base

1.7Bqwen3conversational

Ministral-3-3B-Base-2512

mistralai / Ministral-3-3B-Base-2512

3Bvllmmistral3mistral-common

Deepseek-R1text-generation28 件の速度テスト

DeepSeek-R1-Distill-Qwen-7B

deepseek-ai / DeepSeek-R1-Distill-Qwen-7B

7Bqwen2conversational

Ornstein3.6-27B-MTP-NSC-ACE-SABER

GestaltLabs / Ornstein3.6-27B-MTP-NSC-ACE-SABER

27Bqwen3_5qwen3.6mtp

text-generation13 件の速度テスト

GLM-4.7-Flash

zai-org / GLM-4.7-Flash

MoE31Bglm4_moe_liteconversationalen

AceReason-Nemotron-1.1-7B

nvidia / AceReason-Nemotron-1.1-7B

Qwentext-generation28 件の速度テスト

7Bqwen2nvidiareasoning

LFM2-8B-A1B

LiquidAI / LFM2-8B-A1B

text-generation24 件の速度テスト

MoE1B アクティブ / 8B 合計lfm2_moeliquidlfm2

phi-4

microsoft / phi-4

Phitext-generation3 件の速度テスト

Nex-N2-mini

nex-agi / Nex-N2-mini

Qwentext-generation9 件の速度テスト

MoE35Bqwen3_5_moeimage-text-to-textconversational

Mistral-Small-24B-Base-2501

mistralai / Mistral-Small-24B-Base-2501

24Bvllmmistral-commonen

Deepseek-R1text-generation10 件の速度テスト

DeepSeek-R1-Distill-Qwen-14B

deepseek-ai / DeepSeek-R1-Distill-Qwen-14B

14Bqwen2conversational

Ornith-1.0-9B-GGUF

ornith-ai / Ornith-1.0-9B-GGUF

text-generation33 件の速度テスト

LFM2.5-350M-Base

LiquidAI / LFM2.5-350M-Base

350Mlfm2liquidlfm2.5

Deepseekimage-text-to-text30 件の速度テスト

DeepSeek-V4.1-Flash

deepseek-ai / DeepSeek-V4.1-Flash

763Bdeepseek_v41text-generationconversational

Nemotron-Cascade-2-30B-A3B

nvidia / Nemotron-Cascade-2-30B-A3B

text-generation16 件の速度テスト

MoE3B アクティブ / 30B 合計nemotron_hnvidianemotron-cascade-2

Meta-Llama-3-8B-Instruct

meta-llama / Meta-Llama-3-8B-Instruct

Llamatext-generation31 件の速度テスト

8Bfacebookmetallama-3

Ornith-1.0-35B-GGUF

ornith-ai / Ornith-1.0-35B-GGUF

text-generation31 件の速度テスト

Qwen3-4B-Base

Qwen / Qwen3-4B-Base

4Bqwen3conversational

Qwen2.5-32B

Qwen / Qwen2.5-32B

32Bqwen2conversationalen

Qwen2.5-3B

Qwen / Qwen2.5-3B

3Bqwen2conversationalen

GLM-5.3

zai-org / GLM-5.3

MoE753Bglm_moe_dsaconversationalen

Qwentext-generation12 件の速度テスト

Agents-A1

InternScience / Agents-A1

MoE35Bqwen3_5_moeimage-text-to-textmoe

Qwen3.5-0.8B-Base

Qwen / Qwen3.5-0.8B-Base

Qwenimage-text-to-text1 件の速度テスト

0.8Bqwen3_5conversational

LFM2.5-230M-Base

LiquidAI / LFM2.5-230M-Base

230Mlfm2liquidlfm2.5

Trinity-Mini-Base-Pre-Anneal

arcee-ai / Trinity-Mini-Base-Pre-Anneal

Arceetext-generation

MoE26Bafmoeenes

MoE3B アクティブ / 30B 合計conversational

NVIDIA-Nemotron-3.5-Lightning-30B-A3B-GGUF

lmstudio-community / NVIDIA-Nemotron-3.5-Lightning-30B-A3B-GGUF

26 件の速度テスト

GLM-4.5-Air

zai-org / GLM-4.5-Air

text-generation9 件の速度テスト

MoE110Bglm4_moeconversationalen

Qwen2.5-14B

Qwen / Qwen2.5-14B

14Bqwen2conversationalen

Llamatext-generation23 件の速度テスト

MiniCPM5-1B

openbmb / MiniCPM5-1B

1Bminicpmminicpm5long-context

reka-flash-3

RekaAI / reka-flash-3

GLM-5.3-Flash-BF16

zai-org / GLM-5.3-Flash-BF16

321Bglm5_nextconversationalen

MoE17B アクティブ / 109B 合計llama4facebookmeta

Llama-4-Scout-17B-16E

meta-llama / Llama-4-Scout-17B-16E

Llamaimage-text-to-text

BTL-4

badtheorylabs / BTL-4

MoE35Bqwen3_5_moeimage-text-to-textagentic

7Bhunyuan_v1_densetext-generationzh

Hy-MT2-7B

tencent / Hy-MT2-7B

translation7 件の速度テスト

NVIDIA-Nemotron-3.5-Lightning-30B-A3B-NVFP4

nvidia / NVIDIA-Nemotron-3.5-Lightning-30B-A3B-NVFP4

Opttext-generation20 件の速度テスト

MoE3B アクティブ / 30B 合計nemotron_hnvidianemotron-3.5

最高6.7k tok/s

中央値293 tok/s

最小77.1 tok/s

Eval score· 3 evalsNVFP4

74.8%

Deepseek-R1text-generation4 件の速度テスト

DeepSeek-R1-Distill-Qwen-32B

deepseek-ai / DeepSeek-R1-Distill-Qwen-32B

32Bqwen2conversational

Ling-3.0-tiny

inclusionAI / Ling-3.0-tiny

text-generation16 件の速度テスト

MoE8Bbailing_hybridconversational

Nemotron-Cascade-14B-Thinking

nvidia / Nemotron-Cascade-14B-Thinking

Qwentext-generation18 件の速度テスト

14Bqwen3nvidianemotron-cascade

Olmo-3-1125-32B

allenai / Olmo-3-1125-32B

32Bolmo3en

text-generation17 件の速度テスト

GLM-Z1-32B-0414

zai-org / GLM-Z1-32B-0414

32Bglm4conversationalzh

Mellum2-12B-A2.5B-Instruct

JetBrains / Mellum2-12B-A2.5B-Instruct

MoE2.5B アクティブ / 12B 合計mellumconversationalen

North-Mini-Code-1.0

CohereLabs / North-Mini-Code-1.0

Coheretext-generation17 件の速度テスト

MoE30Bcohere2_moeconversationalchat

Qwen3.5-122B-A10B-GPTQ-Int4

Qwen / Qwen3.5-122B-A10B-GPTQ-Int4

Qwenimage-text-to-text17 件の速度テスト

MoE10B アクティブ / 122B 合計qwen3_5_moeconversational4-bit

Nanbeige4.3-33B-Base

Nanbeige / Nanbeige4.3-33B-Base

33Bllmnanbeigeconversational

Qwen3.5-2B-Base

Qwen / Qwen3.5-2B-Base

2Bqwen3_5conversational

Llama-3.1-8B

meta-llama / Llama-3.1-8B

8Bfacebookmetallama-3

image-text-to-text5 件の速度テスト

Step-3.7-Flash

stepfun-ai / Step-3.7-Flash

MoE201Bstep3p7vision-languagemultimodal

gemma-3-1b-pt

google / gemma-3-1b-pt

Gemmatext-generation

1Bgemma3_text

MoE3B アクティブ / 30B 合計NemotronH_Nano_Omni_Reasoning_V3feature-extractionnvidia

Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16

nvidia / Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16

any-to-any5 件の速度テスト

Agents-A1-4B

InternScience / Agents-A1-4B

4Bqwen3_5image-text-to-textvlm

QUEST-30B-RL

osunlp / QUEST-30B-RL

MoE30Bqwen3_moequestconversational

Qwen2.5-72B

Qwen / Qwen2.5-72B

72Bqwen2conversationalen

6Bintern_vit_6bfeature-extraction

InternViT-6B-224px

OpenGVLab / InternViT-6B-224px

image-feature-extraction

Qwen3-30B-A3B-Base

Qwen / Qwen3-30B-A3B-Base

Qwentext-generation5 件の速度テスト

Qwen3-32B

Qwen / Qwen3-32B

32Bqwen3conversational

Qwen3-30B-A3B-Instruct-2507

Qwen / Qwen3-30B-A3B-Instruct-2507

KAT-Coder-V2.5-Dev

Kwaipilot / KAT-Coder-V2.5-Dev

MoE35Bqwen3_5_moeimage-text-to-textcode

Qwen3-Coder-30B-A3B-Instruct-FP8

Qwen / Qwen3-Coder-30B-A3B-Instruct-FP8

Qwentext-generation13 件の速度テスト

MoE3B アクティブ / 30B 合計qwen3_moeconversationalfp8

Mistral-Medium-3.5-128B

mistralai / Mistral-Medium-3.5-128B

LFM2.5-2.6B-Base

LiquidAI / LFM2.5-2.6B-Base

2.6Blfm2liquidlfm2.5

MoE3B アクティブ / 35B 合計qwen3_5_moe

Tess-4-35B-A3B

migtissera / Tess-4-35B-A3B

Qwen12 件の速度テスト

granite-4.0-h-micro

ibm-granite / granite-4.0-h-micro

text-generation12 件の速度テスト

MoE3Bgranitemoehybridlanguagegranite-4.0

最高141 tok/s

中央値41.9 tok/s

最小7.9 tok/s

Eval score· 3 evalsQ4_K_M

53.3%

Llama-3.1-70B

meta-llama / Llama-3.1-70B

70Bfacebookmetallama-3

SmolLM2-135M

HuggingFaceTB / SmolLM2-135M

135Men

text-generation11 件の速度テスト

GLM-Z1-Rumination-32B-0414

zai-org / GLM-Z1-Rumination-32B-0414

32Bglm4conversationalzh

MiniMax-M2.5

MiniMaxAI / MiniMax-M2.5

Minimaxtext-generation2 件の速度テスト

Llamatext-generation7 件の速度テスト

Llama-3.2-1B-Instruct

meta-llama / Llama-3.2-1B-Instruct

1Bfacebookmetallama-3

SmolLM2-360M

HuggingFaceTB / SmolLM2-360M

360Men

Mistral-Small-3.1-24B-Base-2503

mistralai / Mistral-Small-3.1-24B-Base-2503

24Bvllmmistral3mistral-common

Seed-OSS-36B-Instruct

ByteDance-Seed / Seed-OSS-36B-Instruct

36Bseed_ossvllmconversational

Qwentext-generation10 件の速度テスト

Qwen3.6-27B-DFlash

z-lab / Qwen3.6-27B-DFlash

27Bqwen3feature-extractiondflash

Spark-X2.5-4B-Base

XHToken / Spark-X2.5-4B-Base

4Bspark2_5llmsparkx2_5

NVIDIA-Nemotron-3-Nano-30B-A3B-BF16

nvidia / NVIDIA-Nemotron-3-Nano-30B-A3B-BF16

MoE3B アクティブ / 30B 合計nemotron_hnvidiaconversational

Ling-3.0-flash

inclusionAI / Ling-3.0-flash

text-generation9 件の速度テスト

MoE127Bbailing_hybridconversational

Hunyuan-MT-7B

tencent / Hunyuan-MT-7B

translation9 件の速度テスト

7Bhunyuan_v1_densetext-generation

MiMo-V2.5

XiaomiMiMo / MiMo-V2.5

text-generation5 件の速度テスト

MoE311Bmimo_v2multimodalvision-language

GLM-4.6V

zai-org / GLM-4.6V

image-text-to-text8 件の速度テスト

MoE108Bglm4v_moeconversationalzh

NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16

nvidia / NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16

MoE12B アクティブ / 120B 合計nemotron_h_omninvidianemotron-3.5

Qwen2.5-0.5B

Qwen / Qwen2.5-0.5B

0.5Bqwen2conversationalen

MoE3B アクティブ / 30B 合計hy_v3text-generationzh

Hy-MT2-30B-A3B

tencent / Hy-MT2-30B-A3B

translation

8Binternlm3conversational

internlm3-8b-instruct

internlm / internlm3-8b-instruct

Internlmtext-generation

Nemotron-Cascade-8B

nvidia / Nemotron-Cascade-8B

8Bqwen3nvidiaNemotron-Cascade

UI-TARS-7B-DPO

ByteDance-Seed / UI-TARS-7B-DPO

7Bqwen2_vlmultimodalgui

7.8Bexaonelg-aiexaone-3.5

EXAONE-3.5-7.8B-Instruct

LGAI-EXAONE / EXAONE-3.5-7.8B-Instruct

text-generation8 件の速度テスト

Ling-2.6-flash

inclusionAI / Ling-2.6-flash

text-generation8 件の速度テスト

MoE107Bbailing_hybridconversationalen

MiMo-V2.6-Flash-RL

XiaomiMiMo / MiMo-V2.6-Flash-RL

text-generation7 件の速度テスト

MoE311Bmimo_v2multimodalvision-language

Tinystories-gpt-0.1-3m

segestic / Tinystories-gpt-0.1-3m

Gpttext-generation5 件の速度テスト

Kimi-Linear-48B-A3B-Instruct

moonshotai / Kimi-Linear-48B-A3B-Instruct

text-generation7 件の速度テスト

MoE3B アクティブ / 48B 合計kimi_linearconversational

rwkv-7-world

BlinkDL / rwkv-7-world

Starcodertext-generation

rwkvcausal-lmen

Llamatext-generation6 件の速度テスト

Meta-Llama-3.1-70B-Instruct-AWQ-INT4

hugging-quants / Meta-Llama-3.1-70B-Instruct-AWQ-INT4

70Bllama-3.1metaautoawq

Sage-A1.5

InternScience / Sage-A1.5

MoE36Bqwen3_5_moeimage-text-to-textmoe

NVIDIA-Nemotron-3-Super-120B-A12B-BF16

nvidia / NVIDIA-Nemotron-3-Super-120B-A12B-BF16

MoE12B アクティブ / 120B 合計nemotron_hnvidianemotron-3

Hy3

tencent / Hy3

MoE299Bhy_v3hunyuanhy3

Deepseek-Codertext-generation6 件の速度テスト

DeepSeek-Coder-V2-Lite-Instruct

deepseek-ai / DeepSeek-Coder-V2-Lite-Instruct

MoE16Bdeepseek_v2conversational

Kimi-K2.6

moonshotai / Kimi-K2.6

1Tkimi_k25feature-extractioncompressed-tensors

Llamatext-generation4 件の速度テスト

MiniCPM5-2B

openbmb / MiniCPM5-2B

2Bminicpmminicpm5long-context

glm-4-9b-chat

zai-org / glm-4-9b-chat

Chatglm

9Bglmthudmzh

Qwentext-generation5 件の速度テスト

Qwen3-Coder-Next-FP8

Qwen / Qwen3-Coder-Next-FP8

MoE80Bqwen3_nextconversationalfp8

Llama-2-7b-hf

meta-llama / Llama-2-7b-hf

Llamatext-generation5 件の速度テスト

7Bfacebookmetallama-2

Qwen3-VL-8B-Instruct

Qwen / Qwen3-VL-8B-Instruct

Qwenimage-text-to-text3 件の速度テスト

8Bqwen3_vlconversational

Qwen2.5-1.5B

Qwen / Qwen2.5-1.5B

1.5Bqwen2conversationalen

Opttext-generation5 件の速度テスト

NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4

nvidia / NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4

MoE12B アクティブ / 120B 合計nemotron_hnvidianemotron-3

Qwen3.5-397B-A17B

Qwen / Qwen3.5-397B-A17B

MoE17B アクティブ / 397B 合計qwen3_5_moeconversational

gemma-3n-E4B

google / gemma-3n-E4B

4Bgemma3nautomatic-speech-recognitionautomatic-speech-translation

Spark-X2.6-4B-Base

XHToken / Spark-X2.6-4B-Base

4Bspark2_5llmsparkx2_5

Qwen3-235B-A22B

Qwen / Qwen3-235B-A22B

MoE22B アクティブ / 235B 合計qwen3_moeconversational

Spark-X2.5-1.7B-Base

XHToken / Spark-X2.5-1.7B-Base

1.7Bspark2_5llmsparkx2_5

Qwen3-235B-A22B-Thinking-2507

Qwen / Qwen3-235B-A22B-Thinking-2507

MoE22B アクティブ / 235B 合計qwen3_moeconversational

granite-4.1-8b-base

ibm-granite / granite-4.1-8b-base

8Bgranitelanguagegranite-4.1

Qwen2.5-VL-7B-Instruct

Qwen / Qwen2.5-VL-7B-Instruct

7Bqwen2_5_vlmultimodalconversational

NVIDIA-Nemotron-3-Nano-4B-FP8

nvidia / NVIDIA-Nemotron-3-Nano-4B-FP8

4Bnemotron_hnvidiaconversational

Deepseektext-generation4 件の速度テスト

DeepSeek-V4-Flash-DSpark

deepseek-ai / DeepSeek-V4-Flash-DSpark

MoE165Bdeepseek_v48-bitfp8

gemma-3-4b-pt

google / gemma-3-4b-pt

4Bgemma3

Minimaxtext-generation2 件の速度テスト

MiniMax-M2

MiniMaxAI / MiniMax-M2

GLM-5.1

zai-org / GLM-5.1

MoE754Bglm_moe_dsaconversationalen

30Bgranitelanguagegranite-4.1

granite-4.1-30b

ibm-granite / granite-4.1-30b

text-generation4 件の速度テスト

Gemopus-4-26B-A4B-it

Jackrong / Gemopus-4-26B-A4B-it

Gemmatext-generation4 件の速度テスト

MoE4B アクティブ / 26B 合計gemma4instruction-tunedreasoning

MiniCPM5-2B-GGUF

openbmb / MiniCPM5-2B-GGUF

Llamatext-generation3 件の速度テスト

2Bminicpmminicpm5long-context

gemma-3-27b-pt

google / gemma-3-27b-pt

27Bgemma3

Nex-N2.5-mini

nex-agi / Nex-N2.5-mini

MoE35Bqwen3_5_moeimage-text-to-textconversational

Qwenimage-text-to-text2 件の速度テスト

Qwen3-VL-30B-A3B-Instruct

Qwen / Qwen3-VL-30B-A3B-Instruct

MoE3B アクティブ / 30B 合計qwen3_vl_moeconversational

Falcon-H1-0.5B-Base

tiiuae / Falcon-H1-0.5B-Base

Falcontext-generation

0.5Bfalcon_h1en

Gemmatext-generation3 件の速度テスト

functiongemma-270m-it

google / functiongemma-270m-it

270Mgemma3_textgemma3google

Falcon-H1-Tiny-90M-Instruct

tiiuae / Falcon-H1-Tiny-90M-Instruct

Falcontext-generation3 件の速度テスト

90Mfalcon_h1edgeconversational

gemma-3-270m

google / gemma-3-270m

Gemmatext-generation

270Mgemma3_textgemma3google

EXAONE-3.5-7.8B-Instruct-GGUF

LGAI-EXAONE / EXAONE-3.5-7.8B-Instruct-GGUF

7.8Blg-aiexaoneexaone-3.5

Ornith-1.0-397B

ornith-ai / Ornith-1.0-397B

MoE397Bqwen3_5_moeimage-text-to-textconversational

Mellum2-12B-A2.5B-Thinking

JetBrains / Mellum2-12B-A2.5B-Thinking

MoE2.5B アクティブ / 12B 合計mellumconversationalen

Gemmaimage-text-to-text1 件の速度テスト

diffusiongemma-26B-A4B-it

google / diffusiongemma-26B-A4B-it

MoE4B アクティブ / 26B 合計diffusion_gemmaconversational

MiniCPM3-4B

openbmb / MiniCPM3-4B

4Bminicpm3conversationalzh

Kimi-K2.5

moonshotai / Kimi-K2.5

image-text-to-text1 件の速度テスト

1Tkimi_k25feature-extractioncompressed-tensors

Mistral-7B-Instruct-v0.3-GGUF

bartowski / Mistral-7B-Instruct-v0.3-GGUF

Mistraltext-generation2 件の速度テスト

flint

RecursiveSI / flint

MoE40Bflintconversational

Minimaximage-text-to-text2 件の速度テスト

MiniMax-M3.1-Flash

MiniMaxAI / MiniMax-M3.1-Flash

MoE220Bminimax_m3_vlmultimodalmoe

Qwen3-235B-A22B-Instruct-2507

Qwen / Qwen3-235B-A22B-Instruct-2507

Qwentext-generation2 件の速度テスト

MoE22B アクティブ / 235B 合計qwen3_moeconversational

SmolLM2-1.7B

HuggingFaceTB / SmolLM2-1.7B

1.7Ben

Qwen3-4B-Thinking-2507

Qwen / Qwen3-4B-Thinking-2507

4Bqwen3conversational

TinyLlama-1.1B-Chat-v1.0

TinyLlama / TinyLlama-1.1B-Chat-v1.0

Ternary-Bonsai-8B-unpacked

prism-ml / Ternary-Bonsai-8B-unpacked

8Bqwen3prismmlbonsai

Deepseekimage-text-to-text1 件の速度テスト

DeepSeek-V4-Flash-Vision-Exp

deepseek-ai / DeepSeek-V4-Flash-Vision-Exp

MoE305Bdeepseek_v4text-generation8-bit

Qwen3.8-27B-Uncensored-int4-AutoRound

johannrplaster / Qwen3.8-27B-Uncensored-int4-AutoRound

Qwenimage-text-to-text2 件の速度テスト

27Bqwen3_5vllmintel-xpu

stories-llama2-50k

delphi-suite / stories-llama2-50k

LFM2-24B-A2B

LiquidAI / LFM2-24B-A2B

MoE2B アクティブ / 24B 合計lfm2_moeliquidlfm2

models-moved

ggml-org / models-moved

Qwen3.6-27b-ROCmFP4-CIRU-CHAOS-SPEED

jcbtc / Qwen3.6-27b-ROCmFP4-CIRU-CHAOS-SPEED

Qwentext-generation2 件の速度テスト

Eval score· 1 evalROCmFP4

90.5%

350Mmobilellmfacebookmeta

MobileLLM-350M

facebook / MobileLLM-350M

text-generation2 件の速度テスト

MobileLLM-125M

facebook / MobileLLM-125M

text-generation2 件の速度テスト

125Mmobilellmfacebookmeta

OLMo-2-0425-1B

allenai / OLMo-2-0425-1B

1Bolmo2en

Llamatext-generation2 件の速度テスト

LFM2-700M

LiquidAI / LFM2-700M

text-generation2 件の速度テスト

h2o-danube3-500m-chat

h2oai / h2o-danube3-500m-chat

0.5Bgptllmlarge language model

granite-4.0-1b-base

ibm-granite / granite-4.0-1b-base

MoE1Bgranitemoehybridlanguagegranite-4.0

Phi-4-mini-instruct

microsoft / Phi-4-mini-instruct

Phitext-generation

4Bphi3nlpcode

Minimaxtext-generation2 件の速度テスト

MiniMax-M2.1

MiniMaxAI / MiniMax-M2.1

Qwenimage-text-to-text2 件の速度テスト

Qwen3.5-35B-A3B-4bit

mlx-community / Qwen3.5-35B-A3B-4bit

MoE3B アクティブ / 35B 合計qwen3_5_moemlxconversational

MiniMax-M3

MiniMaxAI / MiniMax-M3

Minimaximage-text-to-text

MoE427Bminimax_m3_vlmultimodalmoe

Qwen3-4B-Instruct-2507

Qwen / Qwen3-4B-Instruct-2507

4Bqwen3conversational

VertaLily-1.2-1B-GGUF

VLTX / VertaLily-1.2-1B-GGUF

Optimage-text-to-text1 件の速度テスト

1Bvltxsovereigntechina-x

gpt-5.6-sol

oroboros-labs / gpt-5.6-sol

Comet_60B_A12B_NVFP4

MultiverseComputingCAI / Comet_60B_A12B_NVFP4

60Bnemotron_h_omniconversationalen

granite-4.0-350m-base

ibm-granite / granite-4.0-350m-base

MoE350Mgranitemoehybridlanguagegranite-4.0

LaMini-GPT-774M

MBZUAI / LaMini-GPT-774M

Gpttext-generation

774Mgpt2en

granite-docling-258M

ibm-granite / granite-docling-258M

258Midefics3text-generationdocuments

Qwentext-to-speech1 件の速度テスト

bge-base-en-v1.5-gguf

CompendiumLabs / bge-base-en-v1.5-gguf

VieNeu-TTS-0.3B

pnnbao-ump / VieNeu-TTS-0.3B

TIPO-100M

KBlueLeaf / TIPO-100M

SmolLM2-135M-GGUF

QuantFactory / SmolLM2-135M-GGUF

harrier-oss-v1-0.6b

calculatortamer / harrier-oss-v1-0.6b

0.6Bsentence-transformersqwen3mteb

Phitext-to-speech1 件の速度テスト

VieNeu-TTS-v2-Turbo-GGUF

pnnbao-ump / VieNeu-TTS-v2-Turbo-GGUF

ttsvietnamesebilingual

test-gguf

rarad / test-gguf

TinyStories-656K

raincandy-u / TinyStories-656K

llama2tinyllamasvalidation

tiny1m

shibatch / tiny1m

Llama1 件の速度テスト

SmolLM-135M

HuggingFaceTB / SmolLM-135M

135Men

MiniLM-L12-H384-uncased

microsoft / MiniLM-L12-H384-uncased

text-classification

bert

30Msentence-transformersbertsentence-similarity

bge-small-en-v1.5

BAAI / bge-small-en-v1.5

feature-extraction

1Bultravoxfeature-extractionar

SmolLM2-360M-GGUF

QuantFactory / SmolLM2-360M-GGUF

ultravox-v0_5-llama-3_2-1b

fixie-ai / ultravox-v0_5-llama-3_2-1b

Llamaaudio-text-to-text

Qwentext-generation1 件の速度テスト

Qwen3.5-2B-Claude-4.6-Opus-Reasoning-Distilled-GGUF

Jackrong / Qwen3.5-2B-Claude-4.6-Opus-Reasoning-Distilled-GGUF

2Bqwen3_5unslothqwen3.5-2B

Qwen2-0.5B

Qwen / Qwen2-0.5B

0.5Bqwen2pretrainedconversational

Hare-1.1B-base-0.5v-GGUF

mradermacher / Hare-1.1B-base-0.5v-GGUF

MiniCPM5-2B-LocalAI

weareapexcreators / MiniCPM5-2B-LocalAI

LFM2.5-230M-LocalAI

weareapexcreators / LFM2.5-230M-LocalAI

Qwen3.5-4B-MTP-LocalAI

weareapexcreators / Qwen3.5-4B-MTP-LocalAI

0.6Bpii_maskingpiiprivacy

4Bimatrixconversational

PII-Tracer

perplexity-ai / PII-Tracer

Qwentoken-classification

Granite-4.1-3B-LocalAI

weareapexcreators / Granite-4.1-3B-LocalAI

1 件の速度テスト

3Bimatrixconversational

Qwen3.5-2B-MTP-LocalAI

weareapexcreators / Qwen3.5-2B-MTP-LocalAI

2Bimatrixconversational

Ornith-1.0-9B-MTP-LocalAI

weareapexcreators / Ornith-1.0-9B-MTP-LocalAI

LFM2.5-350M-LocalAI

weareapexcreators / LFM2.5-350M-LocalAI

Qwen3.5-0.8B-LocalAI

weareapexcreators / Qwen3.5-0.8B-LocalAI

0.8Bimatrixconversational

LFM2.5-1.2B-Instruct-LocalAI

weareapexcreators / LFM2.5-1.2B-Instruct-LocalAI

Gemma4-12B-Uncensored-LocalAI

weareapexcreators / Gemma4-12B-Uncensored-LocalAI

Qwen3.5-4B-Uncensored-LocalAI

weareapexcreators / Qwen3.5-4B-Uncensored-LocalAI

TinyMistral-248M-v2

Locutusque / TinyMistral-248M-v2

Mistraltext-generation

248Men

Qwentext-to-speech1 件の速度テスト

VieNeu-TTS-v2

pnnbao-ump / VieNeu-TTS-v2

290Mqwen3podcastcode-switching

TinyLlama-1.1B-Chat-v0.3

TinyLlama / TinyLlama-1.1B-Chat-v0.3

1.1Ben

sentence-similarity1 件の速度テスト

sentence-bert-swedish-cased

KBLab / sentence-bert-swedish-cased

120Msentence-transformersbertfeature-extraction

Bonsai-27B-unpacked

prism-ml / Bonsai-27B-unpacked

27Bqwen3_5conversationalprismml

Bonsai-1.7B-unpacked

prism-ml / Bonsai-1.7B-unpacked

1.7Bqwen3prismmlbonsai

feature-extraction1 件の速度テスト

bge-small-en-v1.5-GGUF

unsloth / bge-small-en-v1.5-GGUF

sentence-transformerssentence-similaritymteb

Kolibri-1-BF16

Aleph-Alpha / Kolibri-1-BF16

MoE78Bkolibri1reasoningmoe

Ling-3.0-tiny-GGUF

inclusionAI / Ling-3.0-tiny-GGUF

qwen-3.8-27b-abliterated

heterodoxin / qwen-3.8-27b-abliterated

Ternary-Bonsai-1.7B-unpacked

prism-ml / Ternary-Bonsai-1.7B-unpacked

1.7Bqwen3prismmlbonsai

Ternary-Bonsai-2-27B-DFlash2-vllm

fraserprice / Ternary-Bonsai-2-27B-DFlash2-vllm

GLM-5.3-BF16

zai-org / GLM-5.3-BF16

MoE753Bglm_moe_dsaconversationalen

Ling-3.0-flash-int4

inclusionAI / Ling-3.0-flash-int4

MoE127Bbailing_hybridconversationalcompressed-tensors

Falcon3-7B-Base

tiiuae / Falcon3-7B-Base

7Bfalcon3enfr

Qwentext-generation1 件の速度テスト

Ornith-1.5-35B-A3B-NVFP4

ornith-ai / Ornith-1.5-35B-A3B-NVFP4

MoE3B アクティブ / 35B 合計qwen3_5_moeimage-text-to-textconversational

最高259 tok/s

中央値259 tok/s

最小259 tok/s

Eval score· 3 evalsNVFP4

70.9%

Qwen3-30B-A3B-Thinking-2507

Qwen / Qwen3-30B-A3B-Thinking-2507

bitnet-b1.58-2B-4T-bf16

microsoft / bitnet-b1.58-2B-4T-bf16

2Bbitnetchatlarge-language-model

Ministral-3-14B-Base-2512

mistralai / Ministral-3-14B-Base-2512

14Bvllmmistral3mistral-common

rnj-1-instruct-GGUF

EssentialAI / rnj-1-instruct-GGUF

GLM-4.6V-Flash

zai-org / GLM-4.6V-Flash

10Bglm4vconversationalzh

Deepseek-R1text-generation

gemma-3n-E4B-it-text-GGUF

lmstudio-community / gemma-3n-E4B-it-text-GGUF

DeepSeek-R1-0528-Qwen3-8B

deepseek-ai / DeepSeek-R1-0528-Qwen3-8B

8Bqwen3conversational

Deepseek-Codertext-generation1 件の速度テスト

DeepSeek-Coder-V2-Lite-Instruct-FP8

RedHatAI / DeepSeek-Coder-V2-Lite-Instruct-FP8

MoE16Bdeepseek_v2fp8vllm

Qwen3-Next-80B-A3B-Instruct

Qwen / Qwen3-Next-80B-A3B-Instruct

MoE3B アクティブ / 80B 合計qwen3_nextconversational

Kimi-K3

moonshotai / Kimi-K3

2.8Tkimi_k3feature-extractioncompressed-tensors

Inkling-Small

thinkingmachines / Inkling-Small

MoE266Binkling_mm_modelconversationalaudio-text-to-text

Qwen3.5-4B-Uncensored-HauhauCS-Aggressive

HauhauCS / Qwen3.5-4B-Uncensored-HauhauCS-Aggressive

4Buncensoredqwen3.5en

Harmonic-Hermes-9B-GGUF

DJLougen / Harmonic-Hermes-9B-GGUF

9Bhermesqwen3_5reasoning

Qwen3.5-27B-Uncensored-HauhauCS-Aggressive

HauhauCS / Qwen3.5-27B-Uncensored-HauhauCS-Aggressive

Eval score· 5 evalsQ4_K_M

27Buncensoredqwen3.5en

最高30.8 tok/s

中央値30.8 tok/s

最小30.8 tok/s

91.5%

Mistral-Nemo-Base-2407

mistralai / Mistral-Nemo-Base-2407

12Bvllmmistral-commonen

Falcontext-generation1 件の速度テスト

Falcon-H1-Tiny-Tool-Calling-90M

tiiuae / Falcon-H1-Tiny-Tool-Calling-90M

90Mfalcon_h1edgeconversational

Falcon-H1-Tiny-Coder-90M

tiiuae / Falcon-H1-Tiny-Coder-90M

Falcontext-generation1 件の速度テスト

TinyStories-33M

roneneldan / TinyStories-33M

Gpttext-generation1 件の速度テスト

tinystories-lay4-hs128-hd2-1M

ivnle / tinystories-lay4-hs128-hd2-1M

12Bgemma-4gemmablereasoning

qwen-3-14b-instruct-gguf

lm-kit / qwen-3-14b-instruct-gguf

Gemmable-4-12B-MTP-GGUF

Mia-AiLab / Gemmable-4-12B-MTP-GGUF

Gemma1 件の速度テスト

DeepSeek-Coder-V2-Lite-Instruct-GGUF

bartowski / DeepSeek-Coder-V2-Lite-Instruct-GGUF

Deepseek-Codertext-generation1 件の速度テスト

imatrixconversational

gemma-4-31B-v2-MLX-4bit

jdfelo / gemma-4-31B-v2-MLX-4bit

Gemmaimage-text-to-text1 件の速度テスト

Unlimited-OCR

baidu / Unlimited-OCR

image-text-to-text1 件の速度テスト

MoE3Bunlimited_ocrfeature-extractionbaidu

gemma-4-26B-A4B-it-QAT-MLX-4bit

lmstudio-community / gemma-4-26B-A4B-it-QAT-MLX-4bit

Gemmaimage-text-to-text1 件の速度テスト

MoE4B アクティブ / 26B 合計gemma4mlxconversational

granite-4.1-8b

ibm-granite / granite-4.1-8b

8Bgranitelanguagegranite-4.1

Optimage-text-to-text1 件の速度テスト

Step-3.7-Flash-NVFP4

stepfun-ai / Step-3.7-Flash-NVFP4

MoE104Bstep3p7vision-languagemultimodal

Qwable-3.6-35b

Mia-AiLab / Qwable-3.6-35b

GPT-OSS-20B-Uncensored-HauhauCS-Aggressive

HauhauCS / GPT-OSS-20B-Uncensored-HauhauCS-Aggressive

Gpt1 件の速度テスト

20Buncensoredabliteratedmxfp4

UncensoredLM-DeepSeek-R1-Distill-Qwen-14B

uncensoredai / UncensoredLM-DeepSeek-R1-Distill-Qwen-14B

Qwen3.5-9B-Red_Team

LuisPPB16 / Qwen3.5-9B-Red_Team

9Bqwen3_5llama.cppunsloth

Qwen3.5-0.8B-Q8_0.gguf

Manojb / Qwen3.5-0.8B-Q8_0.gguf

Qwen3.6-35B-A3B-4bit-DWQ

mlx-community / Qwen3.6-35B-A3B-4bit-DWQ

Qwentext-generation1 件の速度テスト

MoE3B アクティブ / 35B 合計mlxqwen3_5_moeconversational

Llama-2-7b

meta-llama / Llama-2-7b

7Bfacebookmetallama-2

GLM-5

zai-org / GLM-5

MoE754Bglm_moe_dsaconversationalen

Deepseektext-generation1 件の速度テスト

DeepSeek-V4-Flash-2bit-DQ

mlx-community / DeepSeek-V4-Flash-2bit-DQ

MoE284Bmlxdeepseek_v4conversational

Qwen3-VL-2B-Instruct

Qwen / Qwen3-VL-2B-Instruct

Qwenimage-text-to-text1 件の速度テスト

2Bqwen3_vlconversational

Gemopus-4-26B-A4B-it-GGUF

Jackrong / Gemopus-4-26B-A4B-it-GGUF

Llamaimage-text-to-text1 件の速度テスト

MoE4B アクティブ / 26B 合計gemma4llama.cppvision

ZAYA1-74B-preview-legacy

Zyphra / ZAYA1-74B-preview-legacy

MoE74Bzaya

ZAYA1-base

Zyphra / ZAYA1-base

9Bzayaconversational

MiMo-V2.6-Pro-RL

XiaomiMiMo / MiMo-V2.6-Pro-RL

MoE1Tmimo_v2multimodalvision-language

Inkling

thinkingmachines / Inkling

MoE952Binkling_mm_modelconversationalaudio-text-to-text

Hy4-preview-FP8

tencent / Hy4-preview-FP8

Opttext-generation

MoE804Bhy_v4hunyuanhy4

Step-3.5-Flash

stepfun-ai / Step-3.5-Flash

199Bstep3p5conversational

Step-3.7-Flash-FP8

stepfun-ai / Step-3.7-Flash-FP8

MoE201Bstep3p7vision-languagemultimodal

GLM-5.3-Flash

RedHatAI / GLM-5.3-Flash

321Bglm5_nextconversationalen

GLM-5.3-Flash-BF16

RedHatAI / GLM-5.3-Flash-BF16

321Bglm5_nextimage-text-to-textconversational

Qwen3.6-35B-A3B

RedHatAI / Qwen3.6-35B-A3B

MoE3B アクティブ / 35B 合計qwen3_5_moevllmconversational

Muse-Glimmer-30B

RedHatAI / Muse-Glimmer-30B

30Bmuse_glimmerconversational

Qwen3.5-27B-GPTQ-Int4

Qwen / Qwen3.5-27B-GPTQ-Int4

27Bqwen3_5conversational4-bit

GLM-4.5-Air-Base

zai-org / GLM-4.5-Air-Base

MoE110Bglm4_moeenzh

INTELLECT-2

PrimeIntellect / INTELLECT-2

33Bqwen2

Laguna-XS.2

poolside / Laguna-XS.2

MoE33Blagunalaguna-xs.2vllm

Laguna-M.1

poolside / Laguna-M.1

MoE226Bvllmlagunalaguna-m.1

limite-1b-violetto

paradigma-inc / limite-1b-violetto

1Blimitemathematicsreasoning

limite-1b-base

paradigma-inc / limite-1b-base

1Blimitemathematicsreasoning

limite-1b-base-soup

paradigma-inc / limite-1b-base-soup

1Blimitemathematicsreasoning

MoE55B アクティブ / 550B 合計nemotron_hnvidianemotron-3

NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4

nvidia / NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4

Opttext-generation

Kimi-K2.7-Code

moonshotai / Kimi-K2.7-Code

1Tkimi_k25feature-extractioncompressed-tensors

MoE12B アクティブ / 120B 合計nemotron_hnvidianemotron-3

NVIDIA-Nemotron-3-Super-120B-A12B-FP8

nvidia / NVIDIA-Nemotron-3-Super-120B-A12B-FP8

Opttext-generation

Nanbeige4.2-3B-Base

Nanbeige / Nanbeige4.2-3B-Base

3Bnanbeigellmconversational

Mistral-Small-4-119B-2603

mistralai / Mistral-Small-4-119B-2603

119Bmistral3vLLMen

Ministral-3-8B-Base-2512

mistralai / Ministral-3-8B-Base-2512

8Bvllmmistral3mistral-common

MoE8Bbailing_hybridcompressed-tensors

Ling-3.0-tiny-int4

inclusionAI / Ling-3.0-tiny-int4

Ling-3.0-tiny-fp8

inclusionAI / Ling-3.0-tiny-fp8

MoE8Bbailing_hybridfp8

Ling-3.0-tiny-base

inclusionAI / Ling-3.0-tiny-base

MoE8Bbailing_hybrid

Ling-3.0-tiny-base-midtrain

inclusionAI / Ling-3.0-tiny-base-midtrain

MoE8Bbailing_hybrid

Ling-3.0-flash-fp8

inclusionAI / Ling-3.0-flash-fp8

MoE127Bbailing_hybridconversationalfp8

Ling-3.0-flash-fp4

inclusionAI / Ling-3.0-flash-fp4

MoE66Bbailing_hybridconversational8-bit

MoE104Bbailing_hybridencompressed-tensors

Ling-2.6-flash-int4

inclusionAI / Ling-2.6-flash-int4

MoE107Bbailing_hybridenfp8

Ling-2.6-flash-fp8

inclusionAI / Ling-2.6-flash-fp8

Ling-2.6-flash-base

inclusionAI / Ling-2.6-flash-base

MoE107Bbailing_hybridconversationalfp8

granite-4.1-3b-base

ibm-granite / granite-4.1-3b-base

3Bgranitelanguagegranite-4.1

dots3-note-prev-fp8

dots-studio / dots3-note-prev-fp8

MoE288Bdots3_notetext-generationdots3

lift

datalab-to / lift

10Bqwen3_5pdfextraction

219Bcohere2_visionconversationalchat

command-a-plus-05-2026-bf16

CohereLabs / command-a-plus-05-2026-bf16

Cohereimage-text-to-text

Trinity-Nano-Base-Pre-Anneal

arcee-ai / Trinity-Nano-Base-Pre-Anneal

Arceetext-generation

MoE6Bafmoeenes

MoE399Bafmoeconversationalen

Trinity-Large-TrueBase

arcee-ai / Trinity-Large-TrueBase

Arceetext-generation

Olmo-3-1025-7B

allenai / Olmo-3-1025-7B

7Bolmo3en

LFM2.5-24B-A2B-Base

LiquidAI / LFM2.5-24B-A2B-Base

MoE2B アクティブ / 24B 合計lfm2_moeliquidlfm2.5

MiMo-V2.6-Flash-MOPD

XiaomiMiMo / MiMo-V2.6-Flash-MOPD

MoE311Bmimo_v2multimodalvision-language

Devstral-2-123B-Instruct-2512

mistralai / Devstral-2-123B-Instruct-2512

123Bvllmministral3mistral-common

Qwen2-VL-7B

Qwen / Qwen2-VL-7B

7Bqwen2_vlmultimodalconversational

Qwen3.5-9B-NSC-ACE-SABER-GGUF

GestaltLabs / Qwen3.5-9B-NSC-ACE-SABER-GGUF

9Bqwen3_5nsc-acesaber

MoE2B アクティブ / 24B 合計conversational

LFM2-24B-A2B-GGUF

lmstudio-community / LFM2-24B-A2B-GGUF