Erste Schritte Leaderboard Modelle Hardware Benchmarks Marktplatz Vermietungen Pro API-Doku

Sprache

Hardware

82 hardware groups · 118 total

RTX 3090

discrete gpu

726 benchmarks total35 users

Median55.9 tok/s

View speed tests →

10x variant1 runs

Median22.1 tok/s

8x variant6 runs

Median33.5 tok/s

4x variant11 runs

Median52.1 tok/s

3x variant1 runs

Median231 tok/s

2x variant92 runs

Median71.2 tok/s

GB10 Grace Blackwell

unified

164 benchmarks total19 users

Median54.9 tok/s

View speed tests →

RTX PRO 6000 Blackwell

discrete gpu

127 benchmarks total18 users

Median121 tok/s

View speed tests →

8x variant2 runs

Median74.3 tok/s

4x variant27 runs

Median146 tok/s

2x variant16 runs

Median210 tok/s

RTX 5090

discrete gpu

172 benchmarks total15 users

Median171 tok/s

View speed tests →

4x variant3 runs

Median157 tok/s

2x variant7 runs

Median138 tok/s

Intel Arc Pro B70

discrete gpu

463 benchmarks total11 users

Median63.3 tok/s

View speed tests →

4x variant168 runs

Median43.7 tok/s

3x variant22 runs

Median45.8 tok/s

2x variant24 runs

Median53.8 tok/s

RTX 3060

discrete gpu

1091 benchmarks total10 users

Median52.5 tok/s

View speed tests →

2x variant543 runs

Median40.2 tok/s

Ryzen AI Max 395

unified

259 benchmarks total10 users

Median41.4 tok/s

View speed tests →

RTX 4090

discrete gpu

21 benchmarks total10 users

Median61.3 tok/s

View speed tests →

RX 7900 XTX

discrete gpu

100 benchmarks total9 users

Median62.7 tok/s

View speed tests →

Radeon AI Pro R9700

discrete gpu

238 benchmarks total8 users

Median46.2 tok/s

View speed tests →

3x variant186 runs

Median44.7 tok/s

2x variant10 runs

Median70.6 tok/s

RTX 5060 Ti

discrete gpu

22 benchmarks total8 users

Median69.3 tok/s

View speed tests →

2x variant11 runs

Median60.9 tok/s

M5 Max

unified

39 benchmarks total5 users

Median91.4 tok/s

View speed tests →

M5 Pro

unified

39 benchmarks total5 users

Median67.2 tok/s

View speed tests →

Tesla P100

discrete gpu

32 benchmarks total4 users

Median44.2 tok/s

View speed tests →

3x variant1 runs

Median42.0 tok/s

2x variant27 runs

Median45.2 tok/s

RTX 5070 Ti

discrete gpu

6 benchmarks total4 users

Median221 tok/s

View speed tests →

2x variant1 runs

Median141 tok/s

RTX 3060 Ti

discrete gpu

163 benchmarks total3 users

Median71.7 tok/s

View speed tests →

RTX 4070

discrete gpu

45 benchmarks total3 users

Median39.6 tok/s

View speed tests →

M4 Max

unified

13 benchmarks total3 users

Median22.0 tok/s

View speed tests →

RTX 3080

discrete gpu

37 benchmarks total2 users

Median74.0 tok/s

View speed tests →

GTX 1080 Ti

discrete gpu

27 benchmarks total2 users

Median34.3 tok/s

View speed tests →

M3 Ultra

unified

26 benchmarks total2 users

Median39.5 tok/s

View speed tests →

M1 Max

unified

24 benchmarks total2 users

Median51.1 tok/s

View speed tests →

Ryzen AI Max 385

unified

22 benchmarks total2 users

Median22.1 tok/s

View speed tests →

Strix Point Radeon 890M

unified

18 benchmarks total2 users

Median18.9 tok/s

View speed tests →

GTX 1060

discrete gpu

16 benchmarks total2 users

Median21.5 tok/s

View speed tests →

2x variant3 runs

Median18.3 tok/s

RTX 5080

discrete gpu

12 benchmarks total2 users

Median145 tok/s

View speed tests →

RTX 3090 Ti

discrete gpu

9 benchmarks total2 users

Median119 tok/s

View speed tests →

2x variant2 runs

Median101 tok/s

RTX 5070

discrete gpu

9 benchmarks total2 users

Median69.2 tok/s

View speed tests →

RTX 2080 Ti

discrete gpu

5 benchmarks total2 users

Median80.0 tok/s

View speed tests →

2x variant2 runs

Median20.5 tok/s

Tesla V100

discrete gpu

5 benchmarks total2 users

Median96.7 tok/s

View speed tests →

2x variant4 runs

Median98.6 tok/s

Radeon 8060S

discrete gpu

2 benchmarks total2 users

Median16.9 tok/s

View speed tests →

RTX 4060 Ti

discrete gpu

2 benchmarks total2 users

Median61.1 tok/s

View speed tests →

2x variant1 runs

Median62.0 tok/s

RX 570 4GB

discrete gpu

224 benchmarks total1 user

Median44.0 tok/s

View speed tests →

2x variant174 runs

Median41.6 tok/s

AMD Ryzen 7 7840HS

cpu only

87 benchmarks total1 user

Median219 tok/s

View speed tests →

Intel Arc Pro B60

discrete gpu

51 benchmarks total1 user

Median44.5 tok/s

View speed tests →

2x variant27 runs

Median44.5 tok/s

RTX A5000

discrete gpu

16 benchmarks total1 user

Median261 tok/s

View speed tests →

RTX 2080

discrete gpu

15 benchmarks total1 user

Median21.0 tok/s

View speed tests →

RX 7700 XT

discrete gpu

15 benchmarks total1 user

Median50.2 tok/s

View speed tests →

RTX 5000

discrete gpu

12 benchmarks total1 user

Median31.5 tok/s

View speed tests →

RX 9060 XT

discrete gpu

9 benchmarks total1 user

Median53.9 tok/s

View speed tests →

RX 9070 XT

discrete gpu

9 benchmarks total1 user

Median24.9 tok/s

View speed tests →

AMD Ryzen 7 8745H w/ Radeon 780M

cpu only

8 benchmarks total1 user

Median29.3 tok/s

View speed tests →

H200 NVL

discrete gpu

7 benchmarks total1 user

Median333 tok/s

View speed tests →

2x variant4 runs

Median333 tok/s

H200 SXM

discrete gpu

7 benchmarks total1 user

Median496 tok/s

View speed tests →

4x variant7 runs

Median496 tok/s

RX 5700

discrete gpu

7 benchmarks total1 user

Median27.4 tok/s

View speed tests →

Ryzen 9 7940HS Radeon 780M Minisforum UM790 Pro

unified

7 benchmarks total1 user

Median19.5 tok/s

View speed tests →

RTX 3050

discrete gpu

6 benchmarks total1 user

Median43.5 tok/s

View speed tests →

RX 6700

discrete gpu

6 benchmarks total1 user

Median101 tok/s

View speed tests →

AMD Ryzen 7 8745H w/ Radeon 780M Graphics

cpu only

5 benchmarks total1 user

Median58.6 tok/s

View speed tests →

M4 Pro

unified

5 benchmarks total1 user

Median47.1 tok/s

View speed tests →

RTX 3060 + RTX 5060 Ti

discrete gpu

5 benchmarks total1 user

Median85.1 tok/s

View speed tests →

2x variant5 runs

Median85.1 tok/s

Core Ultra Meteor Lake Ultra 7 155H

unified

4 benchmarks total1 user

Median10.3 tok/s

View speed tests →

Intel R Core TM Ultra 7 155H

cpu only

4 benchmarks total1 user

Median14.0 tok/s

View speed tests →

MT6897 TECNO POVA 7 Ultra 5G / Mali G615 MC6

unified

4 benchmarks total1 user

Median16.9 tok/s

View speed tests →

RTX A6000

discrete gpu

4 benchmarks total1 user

Median131 tok/s

View speed tests →

2x variant4 runs

Median131 tok/s

M4 M4

unified

3 benchmarks total1 user

Median20.4 tok/s

View speed tests →

RTX 3090 + RTX 4090

discrete gpu

3 benchmarks total1 user

Median27.7 tok/s

View speed tests →

2x variant3 runs

Median27.7 tok/s

RX 9070

discrete gpu

3 benchmarks total1 user

Median47.0 tok/s

View speed tests →

Strix Halo Radeon 8060S

unified

3 benchmarks total1 user

Median105 tok/s

View speed tests →

AMD Ryzen 5 7640U

cpu only

2 benchmarks total1 user

Median25.4 tok/s

View speed tests →

Jetson Orin Orin Nano Super Developer Kit

unified

2 benchmarks total1 user

Median21.9 tok/s

View speed tests →

T4

discrete gpu

2 benchmarks total1 user

Median57.0 tok/s

View speed tests →

5060 Ti

discrete gpu

1 benchmark total1 user

Median23.0 tok/s

View speed tests →

GTX 1650

discrete gpu

1 benchmark total1 user

Median30.6 tok/s

View speed tests →

H100

discrete gpu

1 benchmark total1 user

Median1.4k tok/s

View speed tests →

M2 Pro

unified

1 benchmark total1 user

Median33.0 tok/s

View speed tests →

M5 M5

unified

1 benchmark total1 user

Median34.3 tok/s

View speed tests →

Qualcomm Snapdragon 888 ARM64

cpu only

1 benchmark total1 user

Median6.2 tok/s

View speed tests →

RTX 3070 Ti

discrete gpu

1 benchmark total1 user

Median33.5 tok/s

View speed tests →

RTX 3080 Ti

discrete gpu

1 benchmark total1 user

Median15.4 tok/s

View speed tests →

RTX 4060

discrete gpu

1 benchmark total1 user

Median29.9 tok/s

View speed tests →

RTX 4070 Super

discrete gpu

1 benchmark total1 user

Median77.4 tok/s

View speed tests →

RTX 4070 Ti + RTX 5080

discrete gpu

1 benchmark total1 user

Median428 tok/s

View speed tests →

2x variant1 runs

Median428 tok/s

RTX 5060 Ti + RTX 5070 Ti

discrete gpu

1 benchmark total1 user

Median34.3 tok/s

View speed tests →

2x variant1 runs

Median34.3 tok/s

RTX PRO 6000

discrete gpu

1 benchmark total1 user

Median92.8 tok/s

View speed tests →

2x variant1 runs

Median92.8 tok/s

RX 5700 XT

discrete gpu

1 benchmark total1 user

Median61.6 tok/s

View speed tests →

RX 6600

discrete gpu

1 benchmark total1 user

Median40.5 tok/s

View speed tests →

2x variant1 runs

Median40.5 tok/s

RX 6750 XT

discrete gpu

1 benchmark total1 user

Median500 tok/s

View speed tests →

RX 6800

discrete gpu

1 benchmark total1 user

Median89.2 tok/s

View speed tests →

RX 6950 XT

discrete gpu

1 benchmark total1 user

Median222 tok/s

View speed tests →

Ryzen AI Max Max 395

unified

1 benchmark total1 user

Median12.7 tok/s

View speed tests →

Ryzen AI Max Radeon 780M

unified

1 benchmark total1 user

Median26.9 tok/s

View speed tests →