模型排行榜模型Marketplace評測訓練租用API文件
Language
Your Ad Here

Hardware

58 hardware groups · 79 total

RTX 3090

discrete gpu

108 benchmarks total19 users
Best241 tok/s
Median40.9 tok/s
Min5.5 tok/s
View benchmarks →
8x variant5 runs
Best49.1 tok/s
Median26.1 tok/s
Min5.5 tok/s
4x variant7 runs
Best67.1 tok/s
Median51.3 tok/s
Min48.5 tok/s
2x variant46 runs
Best241 tok/s
Median59.0 tok/s
Min14.4 tok/s

RTX 5090

discrete gpu

27 benchmarks total8 users
Best286 tok/s
Median138 tok/s
Min54.6 tok/s
View benchmarks →
2x variant2 runs
Best138 tok/s
Median108 tok/s
Min78.0 tok/s

GB10 Grace Blackwell

unified

51 benchmarks total7 users
Best102 tok/s
Median30.0 tok/s
Min4.7 tok/s
View benchmarks →

RX 7900 XTX

discrete gpu

47 benchmarks total6 users
Best577 tok/s
Median94.3 tok/s
Min1.6 tok/s
View benchmarks →

RTX PRO 6000 Blackwell

discrete gpu

35 benchmarks total6 users
Best1.0k tok/s
Median86.2 tok/s
Min14.7 tok/s
View benchmarks →
8x variant2 runs
Best74.5 tok/s
Median74.3 tok/s
Min74.0 tok/s

RTX 4090

discrete gpu

16 benchmarks total6 users
Best214 tok/s
Median74.2 tok/s
Min41.8 tok/s
View benchmarks →

Ryzen AI Max 395

unified

174 benchmarks total5 users
Best107 tok/s
Median46.1 tok/s
Min3.8 tok/s
View benchmarks →

Radeon AI Pro R9700

discrete gpu

113 benchmarks total5 users
Best1.4k tok/s
Median67.5 tok/s
Min6.2 tok/s
View benchmarks →
3x variant93 runs
Best223 tok/s
Median67.4 tok/s
Min6.2 tok/s
2x variant10 runs
Best991 tok/s
Median70.6 tok/s
Min22.9 tok/s

Intel Arc Pro B70

discrete gpu

165 benchmarks total4 users
Best94.5 tok/s
Median41.1 tok/s
Min0.5 tok/s
View benchmarks →
4x variant112 runs
Best94.5 tok/s
Median40.7 tok/s
Min0.5 tok/s
3x variant22 runs
Best50.9 tok/s
Median45.8 tok/s
Min38.4 tok/s
2x variant11 runs
Best49.1 tok/s
Median38.6 tok/s
Min20.1 tok/s

M4 Max

unified

13 benchmarks total3 users
Best135 tok/s
Median22.0 tok/s
Min13.0 tok/s
View benchmarks →

M5 Max

unified

12 benchmarks total3 users
Best122 tok/s
Median53.0 tok/s
Min17.8 tok/s
View benchmarks →

RTX 5070 Ti

discrete gpu

3 benchmarks total3 users
Best141 tok/s
Median133 tok/s
Min124 tok/s
View benchmarks →
2x variant1 runs
Best141 tok/s
Median141 tok/s
Min141 tok/s

RTX 3060

discrete gpu

48 benchmarks total2 users
Best161 tok/s
Median74.0 tok/s
Min35.0 tok/s
View benchmarks →

RTX 3080

discrete gpu

37 benchmarks total2 users
Best149 tok/s
Median74.0 tok/s
Min10.0 tok/s
View benchmarks →

RTX 3090 Ti

discrete gpu

9 benchmarks total2 users
Best156 tok/s
Median119 tok/s
Min32.6 tok/s
View benchmarks →
2x variant2 runs
Best132 tok/s
Median101 tok/s
Min70.3 tok/s

RTX 5060 Ti

discrete gpu

4 benchmarks total2 users
Best158 tok/s
Median85.0 tok/s
Min32.1 tok/s
View benchmarks →
2x variant2 runs
Best60.9 tok/s
Median46.5 tok/s
Min32.1 tok/s

RTX 4060 Ti

discrete gpu

2 benchmarks total2 users
Best62.0 tok/s
Median61.1 tok/s
Min60.2 tok/s
View benchmarks →
2x variant1 runs
Best62.0 tok/s
Median62.0 tok/s
Min62.0 tok/s

GTX 1080 Ti

discrete gpu

26 benchmarks total1 user
Best94.9 tok/s
Median30.9 tok/s
Min2.2 tok/s
View benchmarks →

RTX A5000

discrete gpu

16 benchmarks total1 user
Best325 tok/s
Median261 tok/s
Min32.3 tok/s
View benchmarks →

M3 Ultra

unified

15 benchmarks total1 user
Best141 tok/s
Median57.1 tok/s
Min18.5 tok/s
View benchmarks →

RTX 2080

discrete gpu

15 benchmarks total1 user
Best93.0 tok/s
Median21.0 tok/s
Min10.0 tok/s
View benchmarks →

M5 Pro

unified

14 benchmarks total1 user
Best106 tok/s
Median77.0 tok/s
Min5.4 tok/s
View benchmarks →

Tesla P100

discrete gpu

10 benchmarks total1 user
Best144 tok/s
Median41.1 tok/s
Min7.5 tok/s
View benchmarks →
2x variant6 runs
Best144 tok/s
Median52.3 tok/s
Min15.3 tok/s

RX 9060 XT

discrete gpu

9 benchmarks total1 user
Best100 tok/s
Median53.9 tok/s
Min38.1 tok/s
View benchmarks →

RX 9070 XT

discrete gpu

9 benchmarks total1 user
Best96.6 tok/s
Median24.9 tok/s
Min1.0 tok/s
View benchmarks →

H200 NVL

discrete gpu

7 benchmarks total1 user
Best2.7k tok/s
Median333 tok/s
Min175 tok/s
View benchmarks →
2x variant4 runs
Best339 tok/s
Median333 tok/s
Min303 tok/s

H200 SXM

discrete gpu

7 benchmarks total1 user
Best878 tok/s
Median496 tok/s
Min197 tok/s
View benchmarks →
4x variant7 runs
Best878 tok/s
Median496 tok/s
Min197 tok/s

Ryzen 9 7940HS Radeon 780M Minisforum UM790 Pro

unified

7 benchmarks total1 user
Best24.8 tok/s
Median19.5 tok/s
Min2.8 tok/s
View benchmarks →

Core Ultra Meteor Lake Ultra 7 155H

unified

4 benchmarks total1 user
Best28.0 tok/s
Median10.3 tok/s
Min6.5 tok/s
View benchmarks →

Intel R Core TM Ultra 7 155H

cpu only

4 benchmarks total1 user
Best27.6 tok/s
Median14.0 tok/s
Min8.4 tok/s
View benchmarks →

MT6897 TECNO POVA 7 Ultra 5G / Mali G615 MC6

unified

4 benchmarks total1 user
Best19.1 tok/s
Median16.9 tok/s
Min7.1 tok/s
View benchmarks →

RTX 4070

discrete gpu

4 benchmarks total1 user
Best62.1 tok/s
Median57.4 tok/s
Min54.5 tok/s
View benchmarks →

RTX A6000

discrete gpu

4 benchmarks total1 user
Best166 tok/s
Median131 tok/s
Min97.3 tok/s
View benchmarks →
2x variant4 runs
Best166 tok/s
Median131 tok/s
Min97.3 tok/s

RTX 2080 Ti

discrete gpu

3 benchmarks total1 user
Best106 tok/s
Median89.0 tok/s
Min80.0 tok/s
View benchmarks →

RTX 3090 + RTX 4090

discrete gpu

3 benchmarks total1 user
Best33.8 tok/s
Median27.7 tok/s
Min24.0 tok/s
View benchmarks →
2x variant3 runs
Best33.8 tok/s
Median27.7 tok/s
Min24.0 tok/s

RX 9070

discrete gpu

3 benchmarks total1 user
Best76.0 tok/s
Median47.0 tok/s
Min34.2 tok/s
View benchmarks →

Strix Halo Radeon 8060S

unified

3 benchmarks total1 user
Best256 tok/s
Median105 tok/s
Min88.3 tok/s
View benchmarks →

Jetson Orin Orin Nano Super Developer Kit

unified

2 benchmarks total1 user
Best27.9 tok/s
Median21.9 tok/s
Min15.9 tok/s
View benchmarks →

5060 Ti

discrete gpu

1 benchmark total1 user
Best23.0 tok/s
Median23.0 tok/s
Min23.0 tok/s
View benchmarks →

GTX 1060

discrete gpu

1 benchmark total1 user
Best15.0 tok/s
Median15.0 tok/s
Min15.0 tok/s
View benchmarks →

GTX 1650

discrete gpu

1 benchmark total1 user
Best30.6 tok/s
Median30.6 tok/s
Min30.6 tok/s
View benchmarks →

M2 Pro

unified

1 benchmark total1 user
Best33.0 tok/s
Median33.0 tok/s
Min33.0 tok/s
View benchmarks →

Qualcomm Snapdragon 888 ARM64

cpu only

1 benchmark total1 user
Best6.2 tok/s
Median6.2 tok/s
Min6.2 tok/s
View benchmarks →

Radeon 8060S

discrete gpu

1 benchmark total1 user
Best14.8 tok/s
Median14.8 tok/s
Min14.8 tok/s
View benchmarks →

RTX 3070 Ti

discrete gpu

1 benchmark total1 user
Best33.5 tok/s
Median33.5 tok/s
Min33.5 tok/s
View benchmarks →

RTX 3080 Ti

discrete gpu

1 benchmark total1 user
Best15.4 tok/s
Median15.4 tok/s
Min15.4 tok/s
View benchmarks →

RTX 4060

discrete gpu

1 benchmark total1 user
Best29.9 tok/s
Median29.9 tok/s
Min29.9 tok/s
View benchmarks →

RTX 4070 Super

discrete gpu

1 benchmark total1 user
Best77.4 tok/s
Median77.4 tok/s
Min77.4 tok/s
View benchmarks →

RTX 5060 Ti + RTX 5070 Ti

discrete gpu

1 benchmark total1 user
Best34.3 tok/s
Median34.3 tok/s
Min34.3 tok/s
View benchmarks →
2x variant1 runs
Best34.3 tok/s
Median34.3 tok/s
Min34.3 tok/s

RTX 5070

discrete gpu

1 benchmark total1 user
Best64.5 tok/s
Median64.5 tok/s
Min64.5 tok/s
View benchmarks →

RTX 5080

discrete gpu

1 benchmark total1 user
Best151 tok/s
Median151 tok/s
Min151 tok/s
View benchmarks →

RTX PRO 6000

discrete gpu

1 benchmark total1 user
Best92.8 tok/s
Median92.8 tok/s
Min92.8 tok/s
View benchmarks →
2x variant1 runs
Best92.8 tok/s
Median92.8 tok/s
Min92.8 tok/s

RX 5700 XT

discrete gpu

1 benchmark total1 user
Best61.6 tok/s
Median61.6 tok/s
Min61.6 tok/s
View benchmarks →

RX 6800

discrete gpu

1 benchmark total1 user
Best89.2 tok/s
Median89.2 tok/s
Min89.2 tok/s
View benchmarks →

RX 6950 XT

discrete gpu

1 benchmark total1 user
Best222 tok/s
Median222 tok/s
Min222 tok/s
View benchmarks →

Ryzen AI Max Max 395

unified

1 benchmark total1 user
Best12.7 tok/s
Median12.7 tok/s
Min12.7 tok/s
View benchmarks →

Ryzen AI Max Radeon 780M

unified

1 benchmark total1 user
Best26.9 tok/s
Median26.9 tok/s
Min26.9 tok/s
View benchmarks →

Tesla V100

discrete gpu

1 benchmark total1 user
Best66.8 tok/s
Median66.8 tok/s
Min66.8 tok/s
View benchmarks →