ハードウェア

113 hardware groups · 201 total

RTX 3090

Discrete GPU

合計 825 件の速度テスト52 users

Single GPU (1x)664 件の実行

Best710 tok/s

Median56.2 tok/s

Min5.7 tok/s

RTX 5090

Discrete GPU

合計 340 件の速度テスト34 users

Single GPU (1x)322 件の実行

Best4.8k tok/s

Median136 tok/s

Min4.1 tok/s

GB10 Grace Blackwell

Unified memory

合計 352 件の速度テスト30 users

RTX PRO 6000 Blackwell

Discrete GPU

合計 241 件の速度テスト28 users

Single GPU (1x)149 件の実行

Best306.1k tok/s

Median98.0 tok/s

Min2.4 tok/s

Intel Arc Pro B70

Discrete GPU

合計 641 件の速度テスト19 users

Single GPU (1x)369 件の実行

Best1.1k tok/s

Median73.2 tok/s

Min0.3 tok/s

Ryzen AI Max 395

Unified memory

合計 465 件の速度テスト17 users

RTX 3060

Discrete GPU

合計 1,146 件の速度テスト15 users

Single GPU (1x)584 件の実行

Best1.3k tok/s

Median65.9 tok/s

Min8.6 tok/s

Radeon AI Pro R9700

Discrete GPU

合計 495 件の速度テスト15 users

Single GPU (1x)145 件の実行

Best4.3k tok/s

Median56.7 tok/s

Min1.2 tok/s

RX 7900 XTX

Discrete GPU

合計 153 件の速度テスト15 users

Single GPU (1x)128 件の実行

Best1.5k tok/s

Median67.9 tok/s

Min1.6 tok/s

RTX 5060 Ti

Discrete GPU

合計 33 件の速度テスト13 users

Single GPU (1x)16 件の実行

Best281 tok/s

Median107 tok/s

Min10.3 tok/s

RTX 4090

Discrete GPU

合計 23 件の速度テスト11 users

M5 Max

Unified memory

Tesla V100

Discrete GPU

Single GPU (1x)32 件の実行

Best108 tok/s

Median33.8 tok/s

Min3.5 tok/s

RTX PRO 6000 Blackwell Workstation Edition

Discrete GPU

Single GPU (1x)33 件の実行

Best223 tok/s

Median88.4 tok/s

Min14.7 tok/s

RTX 5070 Ti

Discrete GPU

Single GPU (1x)5 件の実行

Best402 tok/s

Median301 tok/s

Min124 tok/s

CMP 170HX

Discrete GPU

合計 1,932 件の速度テスト5 users

Single GPU (1x)1819 件の実行

Best3.3k tok/s

Median71.1 tok/s

Min11.4 tok/s

RTX 5080

Discrete GPU

M5 Pro

Unified memory

RX 9070 XT

Discrete GPU

M3 Ultra

Unified memory

Tesla P100

Discrete GPU

Single GPU (1x)4 件の実行

Best136 tok/s

Median28.3 tok/s

Min7.5 tok/s

M4 Max

Unified memory

H200 SXM

Discrete GPU

Single GPU (1x)9 件の実行

Best12.0k tok/s

Median338 tok/s

Min182 tok/s

RTX 4070

Discrete GPU

合計 261 件の速度テスト3 users

RTX 3060 Ti

Discrete GPU

合計 163 件の速度テスト3 users

Intel Arc Pro B60

Discrete GPU

Single GPU (1x)33 件の実行

Best195 tok/s

Median47.0 tok/s

Min13.6 tok/s

RTX 3080

Discrete GPU

Strix Point Radeon 890M

Unified memory

RTX 2080 Ti

Discrete GPU

Single GPU (1x)14 件の実行

Best323 tok/s

Median144 tok/s

Min43.3 tok/s

M4 Pro

Unified memory

RTX 3090 Ti

Discrete GPU

Single GPU (1x)9 件の実行

Best156 tok/s

Median108 tok/s

Min32.6 tok/s

RTX 4060 Ti

Discrete GPU

Single GPU (1x)1 件の実行

Best60.2 tok/s

Median60.2 tok/s

Min60.2 tok/s

BC-250

Discrete GPU

合計 104 件の速度テスト2 users

Single GPU (1x)102 件の実行

Best85.2 tok/s

Median44.8 tok/s

Min7.8 tok/s

RTX 5070

Discrete GPU

GTX 1080 Ti

Discrete GPU

M1 Max

Unified memory

Tenstorrent P150

AI accelerator

Single card (1x)11 件の実行

Best138 tok/s

Median53.9 tok/s

Min19.9 tok/s

RTX 2080

Discrete GPU

GTX 1060

Discrete GPU

Single GPU (1x)13 件の実行

Best68.6 tok/s

Median24.7 tok/s

Min3.1 tok/s

RTX PRO 6000 Blackwell Max-Q Workstation Edition

Discrete GPU

Single GPU (1x)3 件の実行

Best361 tok/s

Median237 tok/s

Min133 tok/s

H100

Discrete GPU

Jetson Orin Orin Nano Super Developer Kit

Unified memory

AMD Ryzen 7 9800X3D

CPU only

A100

Discrete GPU

Radeon 8060S

Discrete GPU

RX 570 4GB

Discrete GPU

Single GPU (1x)113 件の実行

Best133 tok/s

Median33.7 tok/s

Min0.7 tok/s

AMD Ryzen 7 7840HS

CPU only

Instinct MI210

Discrete GPU

2x RTX 3090 + RTX 3090 Ti

Discrete GPU

Ryzen AI Max 385

Unified memory

RX 6700 XT

Discrete GPU

RTX A5000

Discrete GPU

RX 7700 XT

Discrete GPU

RTX 5000

Discrete GPU

B200

Discrete GPU

RX 5700 XT

Discrete GPU

RTX 5060 Ti + RTX 5080

Discrete GPU

RX 9060 XT

Discrete GPU

AMD Ryzen 7 8745H w/ Radeon 780M

CPU only

H200 NVL

Discrete GPU

Single GPU (1x)3 件の実行

Best2.7k tok/s

Median262 tok/s

Min175 tok/s

RX 5700

Discrete GPU

Ryzen 9 7940HS Radeon 780M Minisforum UM790 Pro

Unified memory

RTX 3050

Discrete GPU

RX 6700

Discrete GPU

AMD Ryzen 7 8745H w/ Radeon 780M Graphics

CPU only

RTX 2060 Super

Discrete GPU

RTX 3060 + RTX 5060 Ti

Discrete GPU

Core Ultra Meteor Lake Ultra 7 155H

Unified memory

Intel R Core TM Ultra 7 155H

CPU only

MT6897 TECNO POVA 7 Ultra 5G / Mali G615 MC6

Unified memory

RTX A6000

Discrete GPU

RX 6900 XT

Discrete GPU

RX 7900 XT

Discrete GPU

Single GPU (1x)1 件の実行

Discrete GPU

Single GPU (1x)3 件の実行

Best59.3 tok/s

Median54.7 tok/s

Min53.3 tok/s

M4 M4

Unified memory

RTX 3090 + RTX 4090

Discrete GPU

RX 9070

Discrete GPU

Strix Halo Radeon 8060S

Unified memory

AMD BC 250

CPU only

AMD Ryzen 5 7640U

CPU only

Intel Arc B580

Discrete GPU

Intel R Xeon R CPU E5 2699 v4 @ 2.20GHz

CPU only

M1 Pro

Unified memory

RTX 4060 Ti + RTX 5080

Discrete GPU

RX 7800 XT

Discrete GPU

5060 Ti

Discrete GPU

AMD Ryzen Threadripper 9960X 24 Cores

CPU only

GTX 1650

Discrete GPU

H100 NVL

Discrete GPU

Instinct MI100

Discrete GPU

M2 Pro

Unified memory

M3 M3

Unified memory

M5 M5

Unified memory

Qualcomm Snapdragon 888 ARM64

CPU only

Radeon AI Pro R9700 + RTX 4070 Ti

Discrete GPU

Radeon AI Pro R9700 + RX 7900 XTX

Discrete GPU

RTX 3070

Discrete GPU

RTX 3070 Ti

Discrete GPU

RTX 3080 Ti

Discrete GPU

RTX 3090 + RTX 4090 + RTX 5090 + RTX 5090

Discrete GPU

RTX 4060

Discrete GPU

RTX 4070 Super

Discrete GPU

RTX 4070 Ti + RTX 5080

Discrete GPU

RTX 5060 Ti + RTX 5070 Ti

Discrete GPU

RTX PRO 6000

Discrete GPU

RTX PRO 6000 Blackwell Server Edition

Discrete GPU

RX 6600

Discrete GPU

RX 6750 XT

Discrete GPU

RX 6800

Discrete GPU

RX 6950 XT

Discrete GPU

Ryzen AI Max Max 395

Unified memory

Ryzen AI Max Radeon 780M

Unified memory

VII

Discrete GPU