Geekbench ML Score

3272
ONNX CPU Inference Score
Geekbench ML 0.6.0 for Windows x86 (64-bit)

Result Information

Upload Date July 05 2024 09:10 AM
Views 6

System Information

System Information
Operating System Microsoft Windows Server 2022 Datacenter Azure Edition (64-bit)
Model Microsoft Corporation Virtual Machine
Motherboard Microsoft Corporation Virtual Machine
Power PlanHigh performance
CPU Information
Name Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
Topology 1 Processor, 8 Cores, 16 Threads
Identifier GenuineIntel Family 6 Model 106 Stepping 6
Base Frequency 2.79 GHz
Cluster 18 Cores
L1 Instruction Cache32.0 KB x 8
L1 Data Cache48.0 KB x 8
L2 Cache1.25 MB x 8
L3 Cache48.0 MB x 1
Memory Information
Size 64.00 GB
Inference Information
Framework ONNX
Backend CPU
Device Default

Inference Performance

Workload Accuracy Score
Image Classification (F32)
100% 1701
318.3 IPS
 
Image Classification (F16)
100% 1872
350.2 IPS
 
Image Classification (I8)
99% 2754
515.3 IPS
 
Image Segmentation (F32)
100% 1257
21.0 IPS
 
Image Segmentation (F16)
100% 1190
19.9 IPS
 
Image Segmentation (I8)
98% 1612
26.9 IPS
 
Pose Estimation (F32)
100% 9232
11.2 IPS
 
Pose Estimation (F16)
100% 9269
11.2 IPS
 
Pose Estimation (I8)
100% 25914
31.4 IPS
 
Object Detection (F32)
100% 1654
123.5 IPS
 
Object Detection (F16)
100% 1708
127.5 IPS
 
Object Detection (I8)
65% 1373
102.5 IPS
 
Face Detection (F32)
100% 3214
38.2 IPS
 
Face Detection (F16)
100% 3522
41.9 IPS
 
Face Detection (I8)
89% 3156
37.5 IPS
 
Depth Estimation (F32)
100% 7930
61.5 IPS
 
Depth Estimation (F16)
100% 7843
60.8 IPS
 
Depth Estimation (I8)
96% 12581
97.6 IPS
 
Style Transfer (F32)
100% 17276
22.7 IPS
 
Style Transfer (F16)
100% 17530
23.1 IPS
 
Style Transfer (I8)
98% 17699
23.3 IPS
 
Image Super-Resolution (F32)
100% 3402
121.5 IPS
 
Image Super-Resolution (F16)
100% 3408
121.7 IPS
 
Image Super-Resolution (I8)
99% 3576
127.7 IPS
 
Text Classification (F32)
100% 1266
1.82 KIPS
 
Text Classification (F16)
100% 1249
1.79 KIPS
 
Text Classification (I8)
98% 313
449.7 IPS
 
Machine Translation (F32)
100% 1698
31.3 IPS
 
Machine Translation (F16)
100% 1551
28.5 IPS
 
Machine Translation (I8)
67% 1906
35.1 IPS
 

Compare

Set Baseline Geekbench 6 now available