Оборудование
119 hardware groups · 220 total
RTX 3090
Discrete GPU
Всего 926 тестов скорости53 users
Best5.0k tok/s
Median66.4 tok/s
Min5.5 tok/s
View speed tests →
10x variant1 runs
Best22.1 tok/s
Median22.1 tok/s
Min22.1 tok/s
8x variant26 runs
Best404 tok/s
Median86.2 tok/s
Min5.5 tok/s
7x variant2 runs
Best50.8 tok/s
Median42.3 tok/s
Min33.9 tok/s
6x variant1 runs
Best47.4 tok/s
Median47.4 tok/s
Min47.4 tok/s
4x variant13 runs
Best152 tok/s
Median51.3 tok/s
Min35.3 tok/s
3x variant1 runs
Best231 tok/s
Median231 tok/s
Min231 tok/s
2x variant206 runs
Best5.0k tok/s
Median144 tok/s
Min14.4 tok/s
Single GPU (1x)676 runs
Best710 tok/s
Median56.5 tok/s
Min5.7 tok/s
CMP 170HX
Discrete GPU
Всего 2 082 теста скорости5 users
Best3.3k tok/s
Median71.8 tok/s
Min11.4 tok/s
View speed tests →
10x variant29 runs
Best29.7 tok/s
Median29.7 tok/s
Min29.7 tok/s
8x variant106 runs
Best158 tok/s
Median54.0 tok/s
Min30.6 tok/s
6x variant10 runs
Best169 tok/s
Median113 tok/s
Min104 tok/s
4x variant50 runs
Best707 tok/s
Median118 tok/s
Min71.0 tok/s
2x variant28 runs
Best147 tok/s
Median68.6 tok/s
Min26.1 tok/s
Single GPU (1x)1859 runs
Best3.3k tok/s
Median72.3 tok/s
Min11.4 tok/s