МоделиТаблица лидеровОборудованиеМаркетплейсОценкиОбучениеАрендаДокументация API
Язык
Lucebox Hub campaign banner

Hardware

62 hardware groups · 85 total

RTX 3090

discrete gpu

132 benchmarks total23 users
Best303 tok/s
Median48.0 tok/s
Min5.5 tok/s
View benchmarks →
8x variant6 runs
Best52.7 tok/s
Median33.5 tok/s
Min5.5 tok/s
4x variant7 runs
Best67.1 tok/s
Median51.3 tok/s
Min48.5 tok/s
2x variant61 runs
Best303 tok/s
Median65.3 tok/s
Min14.4 tok/s

RTX 5090

discrete gpu

31 benchmarks total9 users
Best341 tok/s
Median138 tok/s
Min54.6 tok/s
View benchmarks →
2x variant6 runs
Best341 tok/s
Median111 tok/s
Min78.0 tok/s

GB10 Grace Blackwell

unified

53 benchmarks total7 users
Best102 tok/s
Median30.9 tok/s
Min4.7 tok/s
View benchmarks →

RX 7900 XTX

discrete gpu

50 benchmarks total7 users
Best577 tok/s
Median94.4 tok/s
Min1.6 tok/s
View benchmarks →

RTX 4090

discrete gpu

17 benchmarks total7 users
Best214 tok/s
Median68.0 tok/s
Min41.8 tok/s
View benchmarks →

Ryzen AI Max 395

unified

186 benchmarks total6 users
Best138 tok/s
Median48.2 tok/s
Min3.8 tok/s
View benchmarks →

RTX PRO 6000 Blackwell

discrete gpu

37 benchmarks total6 users
Best1.0k tok/s
Median88.3 tok/s
Min14.7 tok/s
View benchmarks →
8x variant2 runs
Best74.5 tok/s
Median74.3 tok/s
Min74.0 tok/s

Intel Arc Pro B70

discrete gpu

177 benchmarks total5 users
Best796 tok/s
Median41.7 tok/s
Min0.5 tok/s
View benchmarks →
4x variant123 runs
Best796 tok/s
Median43.7 tok/s
Min0.5 tok/s
3x variant22 runs
Best50.9 tok/s
Median45.8 tok/s
Min38.4 tok/s
2x variant11 runs
Best49.1 tok/s
Median38.6 tok/s
Min20.1 tok/s

Radeon AI Pro R9700

discrete gpu

117 benchmarks total5 users
Best1.4k tok/s
Median68.0 tok/s
Min6.2 tok/s
View benchmarks →
3x variant93 runs
Best223 tok/s
Median67.4 tok/s
Min6.2 tok/s
2x variant10 runs
Best991 tok/s
Median70.6 tok/s
Min22.9 tok/s

RTX 3060

discrete gpu

62 benchmarks total4 users
Best251 tok/s
Median74.0 tok/s
Min15.2 tok/s
View benchmarks →
2x variant13 runs
Best251 tok/s
Median69.5 tok/s
Min15.2 tok/s

M4 Max

unified

13 benchmarks total3 users
Best135 tok/s
Median22.0 tok/s
Min13.0 tok/s
View benchmarks →

RTX 5060 Ti

discrete gpu

13 benchmarks total3 users
Best171 tok/s
Median106 tok/s
Min32.1 tok/s
View benchmarks →
2x variant2 runs
Best60.9 tok/s
Median46.5 tok/s
Min32.1 tok/s

M5 Max

unified

12 benchmarks total3 users
Best122 tok/s
Median53.0 tok/s
Min17.8 tok/s
View benchmarks →

RTX 5070 Ti

discrete gpu

3 benchmarks total3 users
Best141 tok/s
Median133 tok/s
Min124 tok/s
View benchmarks →
2x variant1 runs
Best141 tok/s
Median141 tok/s
Min141 tok/s

RTX 3080

discrete gpu

37 benchmarks total2 users
Best149 tok/s
Median74.0 tok/s
Min10.0 tok/s
View benchmarks →

GTX 1080 Ti

discrete gpu

27 benchmarks total2 users
Best94.9 tok/s
Median34.3 tok/s
Min2.2 tok/s
View benchmarks →

M5 Pro

unified

15 benchmarks total2 users
Best189 tok/s
Median77.5 tok/s
Min5.4 tok/s
View benchmarks →

RTX 3090 Ti

discrete gpu

9 benchmarks total2 users
Best156 tok/s
Median119 tok/s
Min32.6 tok/s
View benchmarks →
2x variant2 runs
Best132 tok/s
Median101 tok/s
Min70.3 tok/s

RTX 2080 Ti

discrete gpu

5 benchmarks total2 users
Best106 tok/s
Median80.0 tok/s
Min20.1 tok/s
View benchmarks →
2x variant2 runs
Best20.8 tok/s
Median20.5 tok/s
Min20.1 tok/s

Radeon 8060S

discrete gpu

2 benchmarks total2 users
Best19.0 tok/s
Median16.9 tok/s
Min14.8 tok/s
View benchmarks →

RTX 4060 Ti

discrete gpu

2 benchmarks total2 users
Best62.0 tok/s
Median61.1 tok/s
Min60.2 tok/s
View benchmarks →
2x variant1 runs
Best62.0 tok/s
Median62.0 tok/s
Min62.0 tok/s

RTX A5000

discrete gpu

16 benchmarks total1 user
Best325 tok/s
Median261 tok/s
Min32.3 tok/s
View benchmarks →

M3 Ultra

unified

15 benchmarks total1 user
Best141 tok/s
Median57.1 tok/s
Min18.5 tok/s
View benchmarks →

RTX 2080

discrete gpu

15 benchmarks total1 user
Best93.0 tok/s
Median21.0 tok/s
Min10.0 tok/s
View benchmarks →

Tesla P100

discrete gpu

10 benchmarks total1 user
Best144 tok/s
Median41.1 tok/s
Min7.5 tok/s
View benchmarks →
2x variant6 runs
Best144 tok/s
Median52.3 tok/s
Min15.3 tok/s

RX 9060 XT

discrete gpu

9 benchmarks total1 user
Best100 tok/s
Median53.9 tok/s
Min38.1 tok/s
View benchmarks →

RX 9070 XT

discrete gpu

9 benchmarks total1 user
Best96.6 tok/s
Median24.9 tok/s
Min1.0 tok/s
View benchmarks →

H200 NVL

discrete gpu

7 benchmarks total1 user
Best2.7k tok/s
Median333 tok/s
Min175 tok/s
View benchmarks →
2x variant4 runs
Best339 tok/s
Median333 tok/s
Min303 tok/s

H200 SXM

discrete gpu

7 benchmarks total1 user
Best878 tok/s
Median496 tok/s
Min197 tok/s
View benchmarks →
4x variant7 runs
Best878 tok/s
Median496 tok/s
Min197 tok/s

Ryzen 9 7940HS Radeon 780M Minisforum UM790 Pro

unified

7 benchmarks total1 user
Best24.8 tok/s
Median19.5 tok/s
Min2.8 tok/s
View benchmarks →

M1 Max

unified

6 benchmarks total1 user
Best83.6 tok/s
Median51.1 tok/s
Min11.3 tok/s
View benchmarks →

RX 6700

discrete gpu

6 benchmarks total1 user
Best172 tok/s
Median101 tok/s
Min10.1 tok/s
View benchmarks →

AMD Ryzen 7 8745H w/ Radeon 780M Graphics

cpu only

5 benchmarks total1 user
Best63.1 tok/s
Median58.6 tok/s
Min22.0 tok/s
View benchmarks →

Core Ultra Meteor Lake Ultra 7 155H

unified

4 benchmarks total1 user
Best28.0 tok/s
Median10.3 tok/s
Min6.5 tok/s
View benchmarks →

Intel R Core TM Ultra 7 155H

cpu only

4 benchmarks total1 user
Best27.6 tok/s
Median14.0 tok/s
Min8.4 tok/s
View benchmarks →

MT6897 TECNO POVA 7 Ultra 5G / Mali G615 MC6

unified

4 benchmarks total1 user
Best19.1 tok/s
Median16.9 tok/s
Min7.1 tok/s
View benchmarks →

RTX 4070

discrete gpu

4 benchmarks total1 user
Best62.1 tok/s
Median57.4 tok/s
Min54.5 tok/s
View benchmarks →

RTX A6000

discrete gpu

4 benchmarks total1 user
Best166 tok/s
Median131 tok/s
Min97.3 tok/s
View benchmarks →
2x variant4 runs
Best166 tok/s
Median131 tok/s
Min97.3 tok/s

RTX 3090 + RTX 4090

discrete gpu

3 benchmarks total1 user
Best33.8 tok/s
Median27.7 tok/s
Min24.0 tok/s
View benchmarks →
2x variant3 runs
Best33.8 tok/s
Median27.7 tok/s
Min24.0 tok/s

RX 9070

discrete gpu

3 benchmarks total1 user
Best76.0 tok/s
Median47.0 tok/s
Min34.2 tok/s
View benchmarks →

Strix Halo Radeon 8060S

unified

3 benchmarks total1 user
Best256 tok/s
Median105 tok/s
Min88.3 tok/s
View benchmarks →

AMD Ryzen 7 8745H w/ Radeon 780M

cpu only

2 benchmarks total1 user
Best45.9 tok/s
Median33.9 tok/s
Min21.8 tok/s
View benchmarks →

Jetson Orin Orin Nano Super Developer Kit

unified

2 benchmarks total1 user
Best27.9 tok/s
Median21.9 tok/s
Min15.9 tok/s
View benchmarks →

5060 Ti

discrete gpu

1 benchmark total1 user
Best23.0 tok/s
Median23.0 tok/s
Min23.0 tok/s
View benchmarks →

GTX 1060

discrete gpu

1 benchmark total1 user
Best15.0 tok/s
Median15.0 tok/s
Min15.0 tok/s
View benchmarks →

GTX 1650

discrete gpu

1 benchmark total1 user
Best30.6 tok/s
Median30.6 tok/s
Min30.6 tok/s
View benchmarks →

M2 Pro

unified

1 benchmark total1 user
Best33.0 tok/s
Median33.0 tok/s
Min33.0 tok/s
View benchmarks →

Qualcomm Snapdragon 888 ARM64

cpu only

1 benchmark total1 user
Best6.2 tok/s
Median6.2 tok/s
Min6.2 tok/s
View benchmarks →

RTX 3070 Ti

discrete gpu

1 benchmark total1 user
Best33.5 tok/s
Median33.5 tok/s
Min33.5 tok/s
View benchmarks →

RTX 3080 Ti

discrete gpu

1 benchmark total1 user
Best15.4 tok/s
Median15.4 tok/s
Min15.4 tok/s
View benchmarks →

RTX 4060

discrete gpu

1 benchmark total1 user
Best29.9 tok/s
Median29.9 tok/s
Min29.9 tok/s
View benchmarks →

RTX 4070 Super

discrete gpu

1 benchmark total1 user
Best77.4 tok/s
Median77.4 tok/s
Min77.4 tok/s
View benchmarks →

RTX 5060 Ti + RTX 5070 Ti

discrete gpu

1 benchmark total1 user
Best34.3 tok/s
Median34.3 tok/s
Min34.3 tok/s
View benchmarks →
2x variant1 runs
Best34.3 tok/s
Median34.3 tok/s
Min34.3 tok/s

RTX 5070

discrete gpu

1 benchmark total1 user
Best64.5 tok/s
Median64.5 tok/s
Min64.5 tok/s
View benchmarks →

RTX 5080

discrete gpu

1 benchmark total1 user
Best151 tok/s
Median151 tok/s
Min151 tok/s
View benchmarks →

RTX PRO 6000

discrete gpu

1 benchmark total1 user
Best92.8 tok/s
Median92.8 tok/s
Min92.8 tok/s
View benchmarks →
2x variant1 runs
Best92.8 tok/s
Median92.8 tok/s
Min92.8 tok/s

RX 5700 XT

discrete gpu

1 benchmark total1 user
Best61.6 tok/s
Median61.6 tok/s
Min61.6 tok/s
View benchmarks →

RX 6800

discrete gpu

1 benchmark total1 user
Best89.2 tok/s
Median89.2 tok/s
Min89.2 tok/s
View benchmarks →

RX 6950 XT

discrete gpu

1 benchmark total1 user
Best222 tok/s
Median222 tok/s
Min222 tok/s
View benchmarks →

Ryzen AI Max Max 395

unified

1 benchmark total1 user
Best12.7 tok/s
Median12.7 tok/s
Min12.7 tok/s
View benchmarks →

Ryzen AI Max Radeon 780M

unified

1 benchmark total1 user
Best26.9 tok/s
Median26.9 tok/s
Min26.9 tok/s
View benchmarks →

Tesla V100

discrete gpu

1 benchmark total1 user
Best66.8 tok/s
Median66.8 tok/s
Min66.8 tok/s
View benchmarks →