시작하기리더보드Decode calculator모델Reports하드웨어벤치마크마켓플레이스렌탈ProAPI 문서
언어
Actual Computer — Every computer, one endpoint

하드웨어

113 hardware groups · 201 total

RTX 3090

Discrete GPU

속도 테스트 825개 합계52 users
Best710 tok/s
Median57.9 tok/s
Min5.5 tok/s
View speed tests →
10x variant실행 1개
Best22.1 tok/s
Median22.1 tok/s
Min22.1 tok/s
8x variant실행 24개
Best404 tok/s
Median93.3 tok/s
Min5.5 tok/s
7x variant실행 2개
Best50.8 tok/s
Median42.3 tok/s
Min33.9 tok/s
6x variant실행 1개
Best47.4 tok/s
Median47.4 tok/s
Min47.4 tok/s
4x variant실행 13개
Best152 tok/s
Median51.3 tok/s
Min35.3 tok/s
3x variant실행 1개
Best231 tok/s
Median231 tok/s
Min231 tok/s
2x variant실행 119개
Best314 tok/s
Median71.0 tok/s
Min14.4 tok/s
Single GPU (1x)실행 664개
Best710 tok/s
Median56.2 tok/s
Min5.7 tok/s

RTX 5090

Discrete GPU

속도 테스트 340개 합계34 users
Best4.8k tok/s
Median138 tok/s
Min4.1 tok/s
View speed tests →
4x variant실행 5개
Best212 tok/s
Median157 tok/s
Min87.1 tok/s
2x variant실행 13개
Best341 tok/s
Median184 tok/s
Min78.0 tok/s
Single GPU (1x)실행 322개
Best4.8k tok/s
Median136 tok/s
Min4.1 tok/s

GB10 Grace Blackwell

Unified memory

속도 테스트 352개 합계30 users
Best807 tok/s
Median54.5 tok/s
Min2.2 tok/s
View speed tests →

RTX PRO 6000 Blackwell

Discrete GPU

속도 테스트 241개 합계28 users
Best306.1k tok/s
Median129 tok/s
Min2.4 tok/s
View speed tests →
8x variant실행 2개
Best74.5 tok/s
Median74.3 tok/s
Min74.0 tok/s
4x variant실행 38개
Best346 tok/s
Median146 tok/s
Min36.8 tok/s
2x variant실행 52개
Best1.0k tok/s
Median179 tok/s
Min83.8 tok/s
Single GPU (1x)실행 149개
Best306.1k tok/s
Median98.0 tok/s
Min2.4 tok/s

Intel Arc Pro B70

Discrete GPU

속도 테스트 641개 합계19 users
Best1.1k tok/s
Median63.1 tok/s
Min0.3 tok/s
View speed tests →
4x variant실행 189개
Best796 tok/s
Median43.7 tok/s
Min0.5 tok/s
3x variant실행 22개
Best50.9 tok/s
Median45.8 tok/s
Min38.4 tok/s
2x variant실행 61개
Best237 tok/s
Median58.5 tok/s
Min20.1 tok/s
Single GPU (1x)실행 369개
Best1.1k tok/s
Median73.2 tok/s
Min0.3 tok/s

Ryzen AI Max 395

Unified memory

속도 테스트 465개 합계17 users
Best1.2k tok/s
Median41.5 tok/s
Min3.8 tok/s
View speed tests →

RTX 3060

Discrete GPU

속도 테스트 1,146개 합계15 users
Best1.3k tok/s
Median53.2 tok/s
Min5.3 tok/s
View speed tests →
2x variant실행 562개
Best317 tok/s
Median40.1 tok/s
Min5.3 tok/s
Single GPU (1x)실행 584개
Best1.3k tok/s
Median65.9 tok/s
Min8.6 tok/s

Radeon AI Pro R9700

Discrete GPU

속도 테스트 495개 합계15 users
Best6.0k tok/s
Median51.9 tok/s
Min1.2 tok/s
View speed tests →
4x variant실행 8개
Best6.0k tok/s
Median232 tok/s
Min53.1 tok/s
3x variant실행 299개
Best856 tok/s
Median40.1 tok/s
Min6.2 tok/s
2x variant실행 43개
Best991 tok/s
Median115 tok/s
Min22.9 tok/s
Single GPU (1x)실행 145개
Best4.3k tok/s
Median56.7 tok/s
Min1.2 tok/s

RX 7900 XTX

Discrete GPU

속도 테스트 153개 합계15 users
Best1.5k tok/s
Median65.5 tok/s
Min1.6 tok/s
View speed tests →
2x variant실행 25개
Best199 tok/s
Median48.9 tok/s
Min19.7 tok/s
Single GPU (1x)실행 128개
Best1.5k tok/s
Median67.9 tok/s
Min1.6 tok/s

RTX 5060 Ti

Discrete GPU

속도 테스트 33개 합계13 users
Best281 tok/s
Median63.2 tok/s
Min10.3 tok/s
View speed tests →
7x variant실행 3개
Best44.6 tok/s
Median26.3 tok/s
Min15.3 tok/s
2x variant실행 14개
Best129 tok/s
Median62.0 tok/s
Min15.9 tok/s
Single GPU (1x)실행 16개
Best281 tok/s
Median107 tok/s
Min10.3 tok/s

RTX 4090

Discrete GPU

속도 테스트 23개 합계11 users
Best214 tok/s
Median61.3 tok/s
Min41.8 tok/s
View speed tests →

M5 Max

Unified memory

속도 테스트 58개 합계8 users
Best391 tok/s
Median66.7 tok/s
Min8.9 tok/s
View speed tests →

Tesla V100

Discrete GPU

속도 테스트 42개 합계8 users
Best427 tok/s
Median42.2 tok/s
Min3.5 tok/s
View speed tests →
4x variant실행 2개
Best427 tok/s
Median409 tok/s
Min391 tok/s
2x variant실행 8개
Best101 tok/s
Median86.8 tok/s
Min24.0 tok/s
Single GPU (1x)실행 32개
Best108 tok/s
Median33.8 tok/s
Min3.5 tok/s

RTX PRO 6000 Blackwell Workstation Edition

Discrete GPU

속도 테스트 38개 합계6 users
Best260 tok/s
Median93.8 tok/s
Min14.7 tok/s
View speed tests →
2x variant실행 5개
Best260 tok/s
Median189 tok/s
Min137 tok/s
Single GPU (1x)실행 33개
Best223 tok/s
Median88.4 tok/s
Min14.7 tok/s

RTX 5070 Ti

Discrete GPU

속도 테스트 19개 합계6 users
Best970 tok/s
Median287 tok/s
Min59.3 tok/s
View speed tests →
2x variant실행 14개
Best970 tok/s
Median280 tok/s
Min59.3 tok/s
Single GPU (1x)실행 5개
Best402 tok/s
Median301 tok/s
Min124 tok/s

CMP 170HX

Discrete GPU

속도 테스트 1,932개 합계5 users
Best3.3k tok/s
Median68.3 tok/s
Min11.4 tok/s
View speed tests →
10x variant실행 29개
Best29.7 tok/s
Median29.7 tok/s
Min29.7 tok/s
8x variant실행 37개
Best30.6 tok/s
Median30.6 tok/s
Min30.6 tok/s
6x variant실행 10개
Best169 tok/s
Median113 tok/s
Min104 tok/s
4x variant실행 17개
Best193 tok/s
Median90.6 tok/s
Min78.5 tok/s
2x variant실행 20개
Best138 tok/s
Median64.6 tok/s
Min26.1 tok/s
Single GPU (1x)실행 1819개
Best3.3k tok/s
Median71.1 tok/s
Min11.4 tok/s

RTX 5080

Discrete GPU

속도 테스트 63개 합계5 users
Best895 tok/s
Median58.2 tok/s
Min12.2 tok/s
View speed tests →

M5 Pro

Unified memory

속도 테스트 39개 합계5 users
Best268 tok/s
Median67.2 tok/s
Min5.4 tok/s
View speed tests →

RX 9070 XT

Discrete GPU

속도 테스트 30개 합계5 users
Best4.8k tok/s
Median533 tok/s
Min1.0 tok/s
View speed tests →

M3 Ultra

Unified memory

속도 테스트 43개 합계4 users
Best213 tok/s
Median39.4 tok/s
Min13.0 tok/s
View speed tests →

Tesla P100

Discrete GPU

속도 테스트 34개 합계4 users
Best209 tok/s
Median44.9 tok/s
Min7.5 tok/s
View speed tests →
3x variant실행 1개
Best42.0 tok/s
Median42.0 tok/s
Min42.0 tok/s
2x variant실행 29개
Best209 tok/s
Median46.7 tok/s
Min15.3 tok/s
Single GPU (1x)실행 4개
Best136 tok/s
Median28.3 tok/s
Min7.5 tok/s

M4 Max

Unified memory

속도 테스트 18개 합계4 users
Best135 tok/s
Median23.3 tok/s
Min9.2 tok/s
View speed tests →

H200 SXM

Discrete GPU

속도 테스트 16개 합계4 users
Best12.0k tok/s
Median494 tok/s
Min182 tok/s
View speed tests →
4x variant실행 7개
Best878 tok/s
Median496 tok/s
Min197 tok/s
Single GPU (1x)실행 9개
Best12.0k tok/s
Median338 tok/s
Min182 tok/s

RTX 4070

Discrete GPU

속도 테스트 261개 합계3 users
Best132 tok/s
Median35.8 tok/s
Min0.7 tok/s
View speed tests →

RTX 3060 Ti

Discrete GPU

속도 테스트 163개 합계3 users
Best590 tok/s
Median71.7 tok/s
Min15.0 tok/s
View speed tests →

Intel Arc Pro B60

Discrete GPU

속도 테스트 64개 합계3 users
Best195 tok/s
Median43.3 tok/s
Min9.2 tok/s
View speed tests →
2x variant실행 31개
Best195 tok/s
Median36.1 tok/s
Min9.2 tok/s
Single GPU (1x)실행 33개
Best195 tok/s
Median47.0 tok/s
Min13.6 tok/s

RTX 3080

Discrete GPU

속도 테스트 54개 합계3 users
Best328 tok/s
Median71.2 tok/s
Min6.0 tok/s
View speed tests →

Strix Point Radeon 890M

Unified memory

속도 테스트 28개 합계3 users
Best35.2 tok/s
Median19.6 tok/s
Min4.2 tok/s
View speed tests →

RTX 2080 Ti

Discrete GPU

속도 테스트 16개 합계3 users
Best323 tok/s
Median141 tok/s
Min20.1 tok/s
View speed tests →
2x variant실행 2개
Best20.8 tok/s
Median20.5 tok/s
Min20.1 tok/s
Single GPU (1x)실행 14개
Best323 tok/s
Median144 tok/s
Min43.3 tok/s

M4 Pro

Unified memory

속도 테스트 13개 합계3 users
Best107 tok/s
Median47.8 tok/s
Min12.0 tok/s
View speed tests →

RTX 3090 Ti

Discrete GPU

속도 테스트 11개 합계3 users
Best156 tok/s
Median108 tok/s
Min32.6 tok/s
View speed tests →
2x variant실행 2개
Best132 tok/s
Median101 tok/s
Min70.3 tok/s
Single GPU (1x)실행 9개
Best156 tok/s
Median108 tok/s
Min32.6 tok/s

RTX 4060 Ti

Discrete GPU

속도 테스트 8개 합계3 users
Best62.0 tok/s
Median43.8 tok/s
Min37.4 tok/s
View speed tests →
2x variant실행 7개
Best62.0 tok/s
Median43.6 tok/s
Min37.4 tok/s
Single GPU (1x)실행 1개
Best60.2 tok/s
Median60.2 tok/s
Min60.2 tok/s

BC-250

Discrete GPU

속도 테스트 104개 합계2 users
Best90.5 tok/s
Median44.8 tok/s
Min7.8 tok/s
View speed tests →
2x variant실행 2개
Best90.5 tok/s
Median90.5 tok/s
Min90.5 tok/s
Single GPU (1x)실행 102개
Best85.2 tok/s
Median44.8 tok/s
Min7.8 tok/s

RTX 5070

Discrete GPU

속도 테스트 36개 합계2 users
Best350 tok/s
Median71.4 tok/s
Min45.8 tok/s
View speed tests →

GTX 1080 Ti

Discrete GPU

속도 테스트 27개 합계2 users
Best94.9 tok/s
Median34.3 tok/s
Min2.2 tok/s
View speed tests →

M1 Max

Unified memory

속도 테스트 25개 합계2 users
Best83.6 tok/s
Median51.3 tok/s
Min3.8 tok/s
View speed tests →

Tenstorrent P150

AI accelerator

속도 테스트 20개 합계2 users
Best138 tok/s
Median60.0 tok/s
Min19.9 tok/s
View speed tests →
4x variant실행 9개
Best85.4 tok/s
Median69.0 tok/s
Min33.8 tok/s
Single card (1x)실행 11개
Best138 tok/s
Median53.9 tok/s
Min19.9 tok/s

RTX 2080

Discrete GPU

속도 테스트 19개 합계2 users
Best93.0 tok/s
Median22.9 tok/s
Min10.0 tok/s
View speed tests →

GTX 1060

Discrete GPU

속도 테스트 16개 합계2 users
Best68.6 tok/s
Median21.5 tok/s
Min3.1 tok/s
View speed tests →
2x variant실행 3개
Best27.2 tok/s
Median18.3 tok/s
Min18.3 tok/s
Single GPU (1x)실행 13개
Best68.6 tok/s
Median24.7 tok/s
Min3.1 tok/s

RTX PRO 6000 Blackwell Max-Q Workstation Edition

Discrete GPU

속도 테스트 16개 합계2 users
Best373 tok/s
Median263 tok/s
Min133 tok/s
View speed tests →
4x variant실행 7개
Best352 tok/s
Median312 tok/s
Min198 tok/s
2x variant실행 6개
Best373 tok/s
Median172 tok/s
Min165 tok/s
Single GPU (1x)실행 3개
Best361 tok/s
Median237 tok/s
Min133 tok/s

H100

Discrete GPU

속도 테스트 10개 합계2 users
Best9.9k tok/s
Median2.5k tok/s
Min247 tok/s
View speed tests →

Jetson Orin Orin Nano Super Developer Kit

Unified memory

속도 테스트 8개 합계2 users
Best27.9 tok/s
Median22.0 tok/s
Min15.9 tok/s
View speed tests →

AMD Ryzen 7 9800X3D

CPU only

속도 테스트 5개 합계2 users
Best36.7k tok/s
Median6.3k tok/s
Min6.0 tok/s
View speed tests →

A100

Discrete GPU

속도 테스트 3개 합계2 users
Best87.1 tok/s
Median41.1 tok/s
Min33.7 tok/s
View speed tests →

Radeon 8060S

Discrete GPU

속도 테스트 2개 합계2 users
Best19.0 tok/s
Median16.9 tok/s
Min14.8 tok/s
View speed tests →

RX 570 4GB

Discrete GPU

속도 테스트 287개 합계1 user
Best213 tok/s
Median39.0 tok/s
Min0.7 tok/s
View speed tests →
2x variant실행 174개
Best213 tok/s
Median41.6 tok/s
Min2.9 tok/s
Single GPU (1x)실행 113개
Best133 tok/s
Median33.7 tok/s
Min0.7 tok/s

AMD Ryzen 7 7840HS

CPU only

속도 테스트 87개 합계1 user
Best5.0k tok/s
Median219 tok/s
Min3.5 tok/s
View speed tests →

Instinct MI210

Discrete GPU

속도 테스트 26개 합계1 user
Best228 tok/s
Median32.6 tok/s
Min12.1 tok/s
View speed tests →

2x RTX 3090 + RTX 3090 Ti

Discrete GPU

속도 테스트 25개 합계1 user
Best120 tok/s
Median72.1 tok/s
Min23.9 tok/s
View speed tests →
3x variant실행 25개
Best120 tok/s
Median72.1 tok/s
Min23.9 tok/s

Ryzen AI Max 385

Unified memory

속도 테스트 21개 합계1 user
Best35.2 tok/s
Median21.5 tok/s
Min4.0 tok/s
View speed tests →

RX 6700 XT

Discrete GPU

속도 테스트 20개 합계1 user
Best50.3 tok/s
Median36.8 tok/s
Min19.8 tok/s
View speed tests →

RTX A5000

Discrete GPU

속도 테스트 16개 합계1 user
Best325 tok/s
Median261 tok/s
Min32.3 tok/s
View speed tests →

RX 7700 XT

Discrete GPU

속도 테스트 15개 합계1 user
Best157 tok/s
Median50.2 tok/s
Min13.7 tok/s
View speed tests →

RTX 5000

Discrete GPU

속도 테스트 12개 합계1 user
Best76.6 tok/s
Median31.5 tok/s
Min21.5 tok/s
View speed tests →

B200

Discrete GPU

속도 테스트 11개 합계1 user
Best14.5k tok/s
Median3.0k tok/s
Min86.8 tok/s
View speed tests →

RX 5700 XT

Discrete GPU

속도 테스트 11개 합계1 user
Best648 tok/s
Median279 tok/s
Min61.6 tok/s
View speed tests →

RTX 5060 Ti + RTX 5080

Discrete GPU

속도 테스트 10개 합계1 user
Best96.7 tok/s
Median88.3 tok/s
Min82.5 tok/s
View speed tests →
2x variant실행 10개
Best96.7 tok/s
Median88.3 tok/s
Min82.5 tok/s

RX 9060 XT

Discrete GPU

속도 테스트 9개 합계1 user
Best100 tok/s
Median53.9 tok/s
Min38.1 tok/s
View speed tests →

AMD Ryzen 7 8745H w/ Radeon 780M

CPU only

속도 테스트 8개 합계1 user
Best47.4 tok/s
Median29.3 tok/s
Min13.9 tok/s
View speed tests →

H200 NVL

Discrete GPU

속도 테스트 7개 합계1 user
Best2.7k tok/s
Median333 tok/s
Min175 tok/s
View speed tests →
2x variant실행 4개
Best339 tok/s
Median333 tok/s
Min303 tok/s
Single GPU (1x)실행 3개
Best2.7k tok/s
Median262 tok/s
Min175 tok/s

RX 5700

Discrete GPU

속도 테스트 7개 합계1 user
Best222 tok/s
Median27.4 tok/s
Min27.4 tok/s
View speed tests →

Ryzen 9 7940HS Radeon 780M Minisforum UM790 Pro

Unified memory

속도 테스트 7개 합계1 user
Best24.8 tok/s
Median19.5 tok/s
Min2.8 tok/s
View speed tests →

RTX 3050

Discrete GPU

속도 테스트 6개 합계1 user
Best47.7 tok/s
Median43.5 tok/s
Min31.0 tok/s
View speed tests →

RX 6700

Discrete GPU

속도 테스트 6개 합계1 user
Best172 tok/s
Median101 tok/s
Min10.1 tok/s
View speed tests →

AMD Ryzen 7 8745H w/ Radeon 780M Graphics

CPU only

속도 테스트 5개 합계1 user
Best63.1 tok/s
Median58.6 tok/s
Min22.0 tok/s
View speed tests →

RTX 2060 Super

Discrete GPU

속도 테스트 5개 합계1 user
Best97.1 tok/s
Median60.4 tok/s
Min46.4 tok/s
View speed tests →

RTX 3060 + RTX 5060 Ti

Discrete GPU

속도 테스트 5개 합계1 user
Best102 tok/s
Median85.1 tok/s
Min21.9 tok/s
View speed tests →
2x variant실행 5개
Best102 tok/s
Median85.1 tok/s
Min21.9 tok/s

Core Ultra Meteor Lake Ultra 7 155H

Unified memory

속도 테스트 4개 합계1 user
Best28.0 tok/s
Median10.3 tok/s
Min6.5 tok/s
View speed tests →

Intel R Core TM Ultra 7 155H

CPU only

속도 테스트 4개 합계1 user
Best27.6 tok/s
Median14.0 tok/s
Min8.4 tok/s
View speed tests →

MT6897 TECNO POVA 7 Ultra 5G / Mali G615 MC6

Unified memory

속도 테스트 4개 합계1 user
Best19.1 tok/s
Median16.9 tok/s
Min7.1 tok/s
View speed tests →

RTX A6000

Discrete GPU

속도 테스트 4개 합계1 user
Best166 tok/s
Median131 tok/s
Min97.3 tok/s
View speed tests →
2x variant실행 4개
Best166 tok/s
Median131 tok/s
Min97.3 tok/s

RX 6900 XT

Discrete GPU

속도 테스트 4개 합계1 user
Best584 tok/s
Median452 tok/s
Min276 tok/s
View speed tests →

RX 7900 XT

Discrete GPU

속도 테스트 4개 합계1 user
Best116 tok/s
Median88.1 tok/s
Min59.9 tok/s
View speed tests →
2x variant실행 3개
Best116 tok/s
Median116 tok/s
Min59.9 tok/s
Single GPU (1x)실행 1개
Best60.6 tok/s
Median60.6 tok/s
Min60.6 tok/s

T4

Discrete GPU

속도 테스트 4개 합계1 user
Best59.3 tok/s
Median54.0 tok/s
Min46.6 tok/s
View speed tests →
3x variant실행 1개
Best46.6 tok/s
Median46.6 tok/s
Min46.6 tok/s
Single GPU (1x)실행 3개
Best59.3 tok/s
Median54.7 tok/s
Min53.3 tok/s

M4 M4

Unified memory

속도 테스트 3개 합계1 user
Best21.6 tok/s
Median20.4 tok/s
Min12.7 tok/s
View speed tests →

RTX 3090 + RTX 4090

Discrete GPU

속도 테스트 3개 합계1 user
Best33.8 tok/s
Median27.7 tok/s
Min24.0 tok/s
View speed tests →
2x variant실행 3개
Best33.8 tok/s
Median27.7 tok/s
Min24.0 tok/s

RX 9070

Discrete GPU

속도 테스트 3개 합계1 user
Best76.0 tok/s
Median47.0 tok/s
Min34.2 tok/s
View speed tests →

Strix Halo Radeon 8060S

Unified memory

속도 테스트 3개 합계1 user
Best256 tok/s
Median105 tok/s
Min88.3 tok/s
View speed tests →

AMD BC 250

CPU only

속도 테스트 2개 합계1 user
Best129 tok/s
Median109 tok/s
Min88.8 tok/s
View speed tests →

AMD Ryzen 5 7640U

CPU only

속도 테스트 2개 합계1 user
Best28.4 tok/s
Median25.4 tok/s
Min22.3 tok/s
View speed tests →

Intel Arc B580

Discrete GPU

속도 테스트 2개 합계1 user
Best19.6 tok/s
Median15.4 tok/s
Min11.1 tok/s
View speed tests →

Intel R Xeon R CPU E5 2699 v4 @ 2.20GHz

CPU only

속도 테스트 2개 합계1 user
Best14.2 tok/s
Median12.3 tok/s
Min10.5 tok/s
View speed tests →

M1 Pro

Unified memory

속도 테스트 2개 합계1 user
Best32.2 tok/s
Median21.7 tok/s
Min11.1 tok/s
View speed tests →

RTX 4060 Ti + RTX 5080

Discrete GPU

속도 테스트 2개 합계1 user
Best161 tok/s
Median114 tok/s
Min66.1 tok/s
View speed tests →
2x variant실행 2개
Best161 tok/s
Median114 tok/s
Min66.1 tok/s

RX 7800 XT

Discrete GPU

속도 테스트 2개 합계1 user
Best42.0 tok/s
Median35.0 tok/s
Min28.0 tok/s
View speed tests →

5060 Ti

Discrete GPU

속도 테스트 1개 합계1 user
Best23.0 tok/s
Median23.0 tok/s
Min23.0 tok/s
View speed tests →

AMD Ryzen Threadripper 9960X 24 Cores

CPU only

속도 테스트 1개 합계1 user
Best52.2 tok/s
Median52.2 tok/s
Min52.2 tok/s
View speed tests →

GTX 1650

Discrete GPU

속도 테스트 1개 합계1 user
Best30.6 tok/s
Median30.6 tok/s
Min30.6 tok/s
View speed tests →

H100 NVL

Discrete GPU

속도 테스트 1개 합계1 user
Best293 tok/s
Median293 tok/s
Min293 tok/s
View speed tests →
2x variant실행 1개
Best293 tok/s
Median293 tok/s
Min293 tok/s

Instinct MI100

Discrete GPU

속도 테스트 1개 합계1 user
Best132 tok/s
Median132 tok/s
Min132 tok/s
View speed tests →
4x variant실행 1개
Best132 tok/s
Median132 tok/s
Min132 tok/s

M2 Pro

Unified memory

속도 테스트 1개 합계1 user
Best33.0 tok/s
Median33.0 tok/s
Min33.0 tok/s
View speed tests →

M3 M3

Unified memory

속도 테스트 1개 합계1 user
Best23.3 tok/s
Median23.3 tok/s
Min23.3 tok/s
View speed tests →

M5 M5

Unified memory

속도 테스트 1개 합계1 user
Best34.3 tok/s
Median34.3 tok/s
Min34.3 tok/s
View speed tests →

Qualcomm Snapdragon 888 ARM64

CPU only

속도 테스트 1개 합계1 user
Best6.2 tok/s
Median6.2 tok/s
Min6.2 tok/s
View speed tests →

Radeon AI Pro R9700 + RTX 4070 Ti

Discrete GPU

속도 테스트 1개 합계1 user
Best86.3 tok/s
Median86.3 tok/s
Min86.3 tok/s
View speed tests →
2x variant실행 1개
Best86.3 tok/s
Median86.3 tok/s
Min86.3 tok/s

Radeon AI Pro R9700 + RX 7900 XTX

Discrete GPU

속도 테스트 1개 합계1 user
Best36.7 tok/s
Median36.7 tok/s
Min36.7 tok/s
View speed tests →
2x variant실행 1개
Best36.7 tok/s
Median36.7 tok/s
Min36.7 tok/s

RTX 3070

Discrete GPU

속도 테스트 1개 합계1 user
Best41.5 tok/s
Median41.5 tok/s
Min41.5 tok/s
View speed tests →

RTX 3070 Ti

Discrete GPU

속도 테스트 1개 합계1 user
Best33.5 tok/s
Median33.5 tok/s
Min33.5 tok/s
View speed tests →

RTX 3080 Ti

Discrete GPU

속도 테스트 1개 합계1 user
Best15.4 tok/s
Median15.4 tok/s
Min15.4 tok/s
View speed tests →

RTX 3090 + RTX 4090 + RTX 5090 + RTX 5090

Discrete GPU

속도 테스트 1개 합계1 user
Best89.7 tok/s
Median89.7 tok/s
Min89.7 tok/s
View speed tests →
4x variant실행 1개
Best89.7 tok/s
Median89.7 tok/s
Min89.7 tok/s

RTX 4060

Discrete GPU

속도 테스트 1개 합계1 user
Best29.9 tok/s
Median29.9 tok/s
Min29.9 tok/s
View speed tests →

RTX 4070 Super

Discrete GPU

속도 테스트 1개 합계1 user
Best77.4 tok/s
Median77.4 tok/s
Min77.4 tok/s
View speed tests →

RTX 4070 Ti + RTX 5080

Discrete GPU

속도 테스트 1개 합계1 user
Best428 tok/s
Median428 tok/s
Min428 tok/s
View speed tests →
2x variant실행 1개
Best428 tok/s
Median428 tok/s
Min428 tok/s

RTX 5060 Ti + RTX 5070 Ti

Discrete GPU

속도 테스트 1개 합계1 user
Best34.3 tok/s
Median34.3 tok/s
Min34.3 tok/s
View speed tests →
2x variant실행 1개
Best34.3 tok/s
Median34.3 tok/s
Min34.3 tok/s

RTX PRO 6000

Discrete GPU

속도 테스트 1개 합계1 user
Best92.8 tok/s
Median92.8 tok/s
Min92.8 tok/s
View speed tests →
2x variant실행 1개
Best92.8 tok/s
Median92.8 tok/s
Min92.8 tok/s

RTX PRO 6000 Blackwell Server Edition

Discrete GPU

속도 테스트 1개 합계1 user
Best128 tok/s
Median128 tok/s
Min128 tok/s
View speed tests →

RX 6600

Discrete GPU

속도 테스트 1개 합계1 user
Best40.5 tok/s
Median40.5 tok/s
Min40.5 tok/s
View speed tests →
2x variant실행 1개
Best40.5 tok/s
Median40.5 tok/s
Min40.5 tok/s

RX 6750 XT

Discrete GPU

속도 테스트 1개 합계1 user
Best500 tok/s
Median500 tok/s
Min500 tok/s
View speed tests →

RX 6800

Discrete GPU

속도 테스트 1개 합계1 user
Best89.2 tok/s
Median89.2 tok/s
Min89.2 tok/s
View speed tests →

RX 6950 XT

Discrete GPU

속도 테스트 1개 합계1 user
Best222 tok/s
Median222 tok/s
Min222 tok/s
View speed tests →

Ryzen AI Max Max 395

Unified memory

속도 테스트 1개 합계1 user
Best12.7 tok/s
Median12.7 tok/s
Min12.7 tok/s
View speed tests →

Ryzen AI Max Radeon 780M

Unified memory

속도 테스트 1개 합계1 user
Best26.9 tok/s
Median26.9 tok/s
Min26.9 tok/s
View speed tests →

VII

Discrete GPU

속도 테스트 1개 합계1 user
Best88.2 tok/s
Median88.2 tok/s
Min88.2 tok/s
View speed tests →