Hardware
114 hardware groups · 208 total
RTX 3090
Discrete GPU
903 snelheidstests in totaal52 users
Best5.0k tok/s
Median65.8 tok/s
Min5.5 tok/s
View speed tests →
10x variant1 runs
Best22.1 tok/s
Median22.1 tok/s
Min22.1 tok/s
8x variant24 runs
Best404 tok/s
Median93.3 tok/s
Min5.5 tok/s
7x variant2 runs
Best50.8 tok/s
Median42.3 tok/s
Min33.9 tok/s
6x variant1 runs
Best47.4 tok/s
Median47.4 tok/s
Min47.4 tok/s
4x variant13 runs
Best152 tok/s
Median51.3 tok/s
Min35.3 tok/s
3x variant1 runs
Best231 tok/s
Median231 tok/s
Min231 tok/s
2x variant197 runs
Best5.0k tok/s
Median145 tok/s
Min14.4 tok/s
Single GPU (1x)664 runs
Best710 tok/s
Median56.2 tok/s
Min5.7 tok/s
CMP 170HX
Discrete GPU
1.969 snelheidstests in totaal5 users
Best3.3k tok/s
Median68.6 tok/s
Min11.4 tok/s
View speed tests →
10x variant29 runs
Best29.7 tok/s
Median29.7 tok/s
Min29.7 tok/s
8x variant55 runs
Best75.1 tok/s
Median30.6 tok/s
Min30.6 tok/s
6x variant10 runs
Best169 tok/s
Median113 tok/s
Min104 tok/s
4x variant36 runs
Best707 tok/s
Median112 tok/s
Min78.5 tok/s
2x variant20 runs
Best138 tok/s
Median64.6 tok/s
Min26.1 tok/s
Single GPU (1x)1819 runs
Best3.3k tok/s
Median71.1 tok/s
Min11.4 tok/s