ModelsLeaderboardHardwareMarketplaceEvalsTrainRentalsProAPI Docs
Language
Lucebox Hub campaign banner

Hardware

74 hardware groups · 107 total

RTX 3090

discrete gpu

149 benchmarks total28 users
Best667 tok/s
Median48.5 tok/s
Min5.5 tok/s
View benchmarks →
10x variant1 runs
Best22.1 tok/s
Median22.1 tok/s
Min22.1 tok/s
8x variant6 runs
Best52.7 tok/s
Median33.5 tok/s
Min5.5 tok/s
4x variant7 runs
Best67.1 tok/s
Median51.3 tok/s
Min48.5 tok/s
2x variant71 runs
Best303 tok/s
Median65.2 tok/s
Min14.4 tok/s

RTX PRO 6000 Blackwell

discrete gpu

79 benchmarks total14 users
Best1.0k tok/s
Median129 tok/s
Min14.7 tok/s
View benchmarks →
8x variant2 runs
Best74.5 tok/s
Median74.3 tok/s
Min74.0 tok/s
4x variant17 runs
Best326 tok/s
Median217 tok/s
Min39.7 tok/s
2x variant13 runs
Best262 tok/s
Median249 tok/s
Min99.6 tok/s

RTX 5090

discrete gpu

58 benchmarks total13 users
Best341 tok/s
Median101 tok/s
Min20.0 tok/s
View benchmarks →
2x variant7 runs
Best341 tok/s
Median138 tok/s
Min78.0 tok/s

GB10 Grace Blackwell

unified

82 benchmarks total12 users
Best609 tok/s
Median32.9 tok/s
Min3.9 tok/s
View benchmarks →

Intel Arc Pro B70

discrete gpu

374 benchmarks total10 users
Best796 tok/s
Median65.2 tok/s
Min0.3 tok/s
View benchmarks →
4x variant127 runs
Best796 tok/s
Median46.1 tok/s
Min0.5 tok/s
3x variant22 runs
Best50.9 tok/s
Median45.8 tok/s
Min38.4 tok/s
2x variant13 runs
Best111 tok/s
Median39.8 tok/s
Min20.1 tok/s

RTX 3060

discrete gpu

122 benchmarks total9 users
Best251 tok/s
Median68.2 tok/s
Min9.0 tok/s
View benchmarks →
2x variant47 runs
Best251 tok/s
Median54.4 tok/s
Min9.0 tok/s

RTX 4090

discrete gpu

20 benchmarks total9 users
Best214 tok/s
Median59.6 tok/s
Min41.8 tok/s
View benchmarks →

RX 7900 XTX

discrete gpu

63 benchmarks total8 users
Best577 tok/s
Median64.1 tok/s
Min1.6 tok/s
View benchmarks →

Ryzen AI Max 395

unified

222 benchmarks total7 users
Best138 tok/s
Median47.5 tok/s
Min3.8 tok/s
View benchmarks →

Radeon AI Pro R9700

discrete gpu

171 benchmarks total7 users
Best1.4k tok/s
Median59.7 tok/s
Min3.2 tok/s
View benchmarks →
3x variant133 runs
Best541 tok/s
Median59.7 tok/s
Min6.2 tok/s
2x variant10 runs
Best991 tok/s
Median70.6 tok/s
Min22.9 tok/s

RTX 5060 Ti

discrete gpu

17 benchmarks total7 users
Best281 tok/s
Median69.2 tok/s
Min15.9 tok/s
View benchmarks →
2x variant6 runs
Best69.3 tok/s
Median47.6 tok/s
Min15.9 tok/s

M5 Pro

unified

39 benchmarks total5 users
Best268 tok/s
Median67.2 tok/s
Min5.4 tok/s
View benchmarks →

M5 Max

unified

29 benchmarks total4 users
Best391 tok/s
Median96.1 tok/s
Min17.8 tok/s
View benchmarks →

RTX 5070 Ti

discrete gpu

6 benchmarks total4 users
Best402 tok/s
Median221 tok/s
Min124 tok/s
View benchmarks →
2x variant1 runs
Best141 tok/s
Median141 tok/s
Min141 tok/s

Tesla P100

discrete gpu

14 benchmarks total3 users
Best209 tok/s
Median47.5 tok/s
Min7.5 tok/s
View benchmarks →
3x variant1 runs
Best42.0 tok/s
Median42.0 tok/s
Min42.0 tok/s
2x variant9 runs
Best209 tok/s
Median54.8 tok/s
Min15.3 tok/s

M4 Max

unified

13 benchmarks total3 users
Best135 tok/s
Median22.0 tok/s
Min13.0 tok/s
View benchmarks →

RTX 3080

discrete gpu

37 benchmarks total2 users
Best149 tok/s
Median74.0 tok/s
Min10.0 tok/s
View benchmarks →

GTX 1080 Ti

discrete gpu

27 benchmarks total2 users
Best94.9 tok/s
Median34.3 tok/s
Min2.2 tok/s
View benchmarks →

Ryzen AI Max 385

unified

22 benchmarks total2 users
Best51.0 tok/s
Median22.1 tok/s
Min4.0 tok/s
View benchmarks →

Strix Point Radeon 890M

unified

18 benchmarks total2 users
Best35.2 tok/s
Median18.9 tok/s
Min4.2 tok/s
View benchmarks →

GTX 1060

discrete gpu

16 benchmarks total2 users
Best68.6 tok/s
Median21.5 tok/s
Min3.1 tok/s
View benchmarks →
2x variant3 runs
Best27.2 tok/s
Median18.3 tok/s
Min18.3 tok/s

RTX 5080

discrete gpu

12 benchmarks total2 users
Best448 tok/s
Median145 tok/s
Min79.5 tok/s
View benchmarks →

RTX 3090 Ti

discrete gpu

9 benchmarks total2 users
Best156 tok/s
Median119 tok/s
Min32.6 tok/s
View benchmarks →
2x variant2 runs
Best132 tok/s
Median101 tok/s
Min70.3 tok/s

RTX 5070

discrete gpu

9 benchmarks total2 users
Best265 tok/s
Median69.2 tok/s
Min51.3 tok/s
View benchmarks →

RTX 3060 Ti

discrete gpu

8 benchmarks total2 users
Best590 tok/s
Median74.1 tok/s
Min17.4 tok/s
View benchmarks →

RTX 2080 Ti

discrete gpu

5 benchmarks total2 users
Best106 tok/s
Median80.0 tok/s
Min20.1 tok/s
View benchmarks →
2x variant2 runs
Best20.8 tok/s
Median20.5 tok/s
Min20.1 tok/s

Tesla V100

discrete gpu

5 benchmarks total2 users
Best101 tok/s
Median96.7 tok/s
Min66.8 tok/s
View benchmarks →
2x variant4 runs
Best101 tok/s
Median98.6 tok/s
Min96.7 tok/s

Radeon 8060S

discrete gpu

2 benchmarks total2 users
Best19.0 tok/s
Median16.9 tok/s
Min14.8 tok/s
View benchmarks →

RTX 4060 Ti

discrete gpu

2 benchmarks total2 users
Best62.0 tok/s
Median61.1 tok/s
Min60.2 tok/s
View benchmarks →
2x variant1 runs
Best62.0 tok/s
Median62.0 tok/s
Min62.0 tok/s

Intel Arc Pro B60

discrete gpu

51 benchmarks total1 user
Best195 tok/s
Median44.5 tok/s
Min9.2 tok/s
View benchmarks →
2x variant27 runs
Best195 tok/s
Median44.5 tok/s
Min9.2 tok/s

RX 570 4GB

discrete gpu

48 benchmarks total1 user
Best143 tok/s
Median27.5 tok/s
Min6.6 tok/s
View benchmarks →
2x variant42 runs
Best143 tok/s
Median25.5 tok/s
Min6.6 tok/s

M3 Ultra

unified

22 benchmarks total1 user
Best213 tok/s
Median67.3 tok/s
Min14.8 tok/s
View benchmarks →

RTX A5000

discrete gpu

16 benchmarks total1 user
Best325 tok/s
Median261 tok/s
Min32.3 tok/s
View benchmarks →

RTX 2080

discrete gpu

15 benchmarks total1 user
Best93.0 tok/s
Median21.0 tok/s
Min10.0 tok/s
View benchmarks →

RTX 5000

discrete gpu

12 benchmarks total1 user
Best76.6 tok/s
Median31.5 tok/s
Min21.5 tok/s
View benchmarks →

RX 9060 XT

discrete gpu

9 benchmarks total1 user
Best100 tok/s
Median53.9 tok/s
Min38.1 tok/s
View benchmarks →

RX 9070 XT

discrete gpu

9 benchmarks total1 user
Best96.6 tok/s
Median24.9 tok/s
Min1.0 tok/s
View benchmarks →

AMD Ryzen 7 8745H w/ Radeon 780M

cpu only

8 benchmarks total1 user
Best47.4 tok/s
Median29.3 tok/s
Min13.9 tok/s
View benchmarks →

H200 NVL

discrete gpu

7 benchmarks total1 user
Best2.7k tok/s
Median333 tok/s
Min175 tok/s
View benchmarks →
2x variant4 runs
Best339 tok/s
Median333 tok/s
Min303 tok/s

H200 SXM

discrete gpu

7 benchmarks total1 user
Best878 tok/s
Median496 tok/s
Min197 tok/s
View benchmarks →
4x variant7 runs
Best878 tok/s
Median496 tok/s
Min197 tok/s

Ryzen 9 7940HS Radeon 780M Minisforum UM790 Pro

unified

7 benchmarks total1 user
Best24.8 tok/s
Median19.5 tok/s
Min2.8 tok/s
View benchmarks →

M1 Max

unified

6 benchmarks total1 user
Best83.6 tok/s
Median51.1 tok/s
Min11.3 tok/s
View benchmarks →

RTX 3050

discrete gpu

6 benchmarks total1 user
Best47.7 tok/s
Median43.5 tok/s
Min31.0 tok/s
View benchmarks →

RX 5700

discrete gpu

6 benchmarks total1 user
Best73.1 tok/s
Median27.4 tok/s
Min27.4 tok/s
View benchmarks →

RX 6700

discrete gpu

6 benchmarks total1 user
Best172 tok/s
Median101 tok/s
Min10.1 tok/s
View benchmarks →

AMD Ryzen 7 8745H w/ Radeon 780M Graphics

cpu only

5 benchmarks total1 user
Best63.1 tok/s
Median58.6 tok/s
Min22.0 tok/s
View benchmarks →

M4 Pro

unified

5 benchmarks total1 user
Best65.3 tok/s
Median47.1 tok/s
Min12.0 tok/s
View benchmarks →

RTX 3060 + RTX 5060 Ti

discrete gpu

5 benchmarks total1 user
Best102 tok/s
Median85.1 tok/s
Min21.9 tok/s
View benchmarks →
2x variant5 runs
Best102 tok/s
Median85.1 tok/s
Min21.9 tok/s

Core Ultra Meteor Lake Ultra 7 155H

unified

4 benchmarks total1 user
Best28.0 tok/s
Median10.3 tok/s
Min6.5 tok/s
View benchmarks →

Intel R Core TM Ultra 7 155H

cpu only

4 benchmarks total1 user
Best27.6 tok/s
Median14.0 tok/s
Min8.4 tok/s
View benchmarks →

MT6897 TECNO POVA 7 Ultra 5G / Mali G615 MC6

unified

4 benchmarks total1 user
Best19.1 tok/s
Median16.9 tok/s
Min7.1 tok/s
View benchmarks →

RTX 4070

discrete gpu

4 benchmarks total1 user
Best62.1 tok/s
Median57.4 tok/s
Min54.5 tok/s
View benchmarks →

RTX A6000

discrete gpu

4 benchmarks total1 user
Best166 tok/s
Median131 tok/s
Min97.3 tok/s
View benchmarks →
2x variant4 runs
Best166 tok/s
Median131 tok/s
Min97.3 tok/s

RTX 3090 + RTX 4090

discrete gpu

3 benchmarks total1 user
Best33.8 tok/s
Median27.7 tok/s
Min24.0 tok/s
View benchmarks →
2x variant3 runs
Best33.8 tok/s
Median27.7 tok/s
Min24.0 tok/s

RX 9070

discrete gpu

3 benchmarks total1 user
Best76.0 tok/s
Median47.0 tok/s
Min34.2 tok/s
View benchmarks →

Strix Halo Radeon 8060S

unified

3 benchmarks total1 user
Best256 tok/s
Median105 tok/s
Min88.3 tok/s
View benchmarks →

Jetson Orin Orin Nano Super Developer Kit

unified

2 benchmarks total1 user
Best27.9 tok/s
Median21.9 tok/s
Min15.9 tok/s
View benchmarks →

5060 Ti

discrete gpu

1 benchmark total1 user
Best23.0 tok/s
Median23.0 tok/s
Min23.0 tok/s
View benchmarks →

GTX 1650

discrete gpu

1 benchmark total1 user
Best30.6 tok/s
Median30.6 tok/s
Min30.6 tok/s
View benchmarks →

H100

discrete gpu

1 benchmark total1 user
Best1.4k tok/s
Median1.4k tok/s
Min1.4k tok/s
View benchmarks →

M2 Pro

unified

1 benchmark total1 user
Best33.0 tok/s
Median33.0 tok/s
Min33.0 tok/s
View benchmarks →

Qualcomm Snapdragon 888 ARM64

cpu only

1 benchmark total1 user
Best6.2 tok/s
Median6.2 tok/s
Min6.2 tok/s
View benchmarks →

RTX 3070 Ti

discrete gpu

1 benchmark total1 user
Best33.5 tok/s
Median33.5 tok/s
Min33.5 tok/s
View benchmarks →

RTX 3080 Ti

discrete gpu

1 benchmark total1 user
Best15.4 tok/s
Median15.4 tok/s
Min15.4 tok/s
View benchmarks →

RTX 4060

discrete gpu

1 benchmark total1 user
Best29.9 tok/s
Median29.9 tok/s
Min29.9 tok/s
View benchmarks →

RTX 4070 Super

discrete gpu

1 benchmark total1 user
Best77.4 tok/s
Median77.4 tok/s
Min77.4 tok/s
View benchmarks →

RTX 5060 Ti + RTX 5070 Ti

discrete gpu

1 benchmark total1 user
Best34.3 tok/s
Median34.3 tok/s
Min34.3 tok/s
View benchmarks →
2x variant1 runs
Best34.3 tok/s
Median34.3 tok/s
Min34.3 tok/s

RTX PRO 6000

discrete gpu

1 benchmark total1 user
Best92.8 tok/s
Median92.8 tok/s
Min92.8 tok/s
View benchmarks →
2x variant1 runs
Best92.8 tok/s
Median92.8 tok/s
Min92.8 tok/s

RX 5700 XT

discrete gpu

1 benchmark total1 user
Best61.6 tok/s
Median61.6 tok/s
Min61.6 tok/s
View benchmarks →

RX 6600

discrete gpu

1 benchmark total1 user
Best40.5 tok/s
Median40.5 tok/s
Min40.5 tok/s
View benchmarks →
2x variant1 runs
Best40.5 tok/s
Median40.5 tok/s
Min40.5 tok/s

RX 6800

discrete gpu

1 benchmark total1 user
Best89.2 tok/s
Median89.2 tok/s
Min89.2 tok/s
View benchmarks →

RX 6950 XT

discrete gpu

1 benchmark total1 user
Best222 tok/s
Median222 tok/s
Min222 tok/s
View benchmarks →

Ryzen AI Max Max 395

unified

1 benchmark total1 user
Best12.7 tok/s
Median12.7 tok/s
Min12.7 tok/s
View benchmarks →

Ryzen AI Max Radeon 780M

unified

1 benchmark total1 user
Best26.9 tok/s
Median26.9 tok/s
Min26.9 tok/s
View benchmarks →