Geekbench ML Score

3223
ONNX CPU Inference Score
Geekbench ML 0.6.0 for Windows AVX2

Result Information

Upload Date July 05 2024 09:05 AM
Views 8

System Information

System Information
Operating System Microsoft Windows Server 2022 Datacenter Azure Edition (64-bit)
Model Microsoft Corporation Virtual Machine
Motherboard Microsoft Corporation Virtual Machine
Power PlanHigh performance
CPU Information
Name Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
Topology 1 Processor, 8 Cores, 16 Threads
Identifier GenuineIntel Family 6 Model 106 Stepping 6
Base Frequency 2.79 GHz
Cluster 18 Cores
L1 Instruction Cache32.0 KB x 8
L1 Data Cache48.0 KB x 8
L2 Cache1.25 MB x 8
L3 Cache48.0 MB x 1
Memory Information
Size 64.00 GB
Inference Information
Framework ONNX
Backend CPU
Device Default

Inference Performance

Workload Accuracy Score
Image Classification (F32)
100% 1699
317.9 IPS
 
Image Classification (F16)
100% 1839
344.2 IPS
 
Image Classification (I8)
99% 2763
517.1 IPS
 
Image Segmentation (F32)
100% 1181
19.7 IPS
 
Image Segmentation (F16)
100% 1160
19.4 IPS
 
Image Segmentation (I8)
98% 1824
30.5 IPS
 
Pose Estimation (F32)
100% 9276
11.2 IPS
 
Pose Estimation (F16)
100% 8641
10.5 IPS
 
Pose Estimation (I8)
100% 22683
27.5 IPS
 
Object Detection (F32)
100% 1719
128.3 IPS
 
Object Detection (F16)
100% 1707
127.4 IPS
 
Object Detection (I8)
62% 1376
102.7 IPS
 
Face Detection (F32)
100% 3370
40.1 IPS
 
Face Detection (F16)
100% 3525
41.9 IPS
 
Face Detection (I8)
89% 3028
36.0 IPS
 
Depth Estimation (F32)
100% 7564
58.7 IPS
 
Depth Estimation (F16)
100% 7995
62.0 IPS
 
Depth Estimation (I8)
96% 11921
92.4 IPS
 
Style Transfer (F32)
100% 16779
22.1 IPS
 
Style Transfer (F16)
100% 16849
22.2 IPS
 
Style Transfer (I8)
98% 17742
23.3 IPS
 
Image Super-Resolution (F32)
100% 3394
121.2 IPS
 
Image Super-Resolution (F16)
100% 3317
118.5 IPS
 
Image Super-Resolution (I8)
99% 3370
120.4 IPS
 
Text Classification (F32)
100% 1186
1.70 KIPS
 
Text Classification (F16)
100% 1279
1.84 KIPS
 
Text Classification (I8)
98% 285
409.7 IPS
 
Machine Translation (F32)
100% 1673
30.8 IPS
 
Machine Translation (F16)
100% 1685
31.0 IPS
 
Machine Translation (I8)
67% 1864
34.3 IPS
 

Compare

Set Baseline Geekbench 6 now available