Geekbench ML Score

3143
ONNX CPU Inference Score
Geekbench ML 0.6.0 for Windows AVX2

Result Information

Upload Date July 05 2024 09:08 AM
Views 7

System Information

System Information
Operating System Microsoft Windows Server 2022 Datacenter Azure Edition (64-bit)
Model Microsoft Corporation Virtual Machine
Motherboard Microsoft Corporation Virtual Machine
Power PlanHigh performance
CPU Information
Name Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
Topology 1 Processor, 8 Cores, 16 Threads
Identifier GenuineIntel Family 6 Model 106 Stepping 6
Base Frequency 2.79 GHz
Cluster 18 Cores
L1 Instruction Cache32.0 KB x 8
L1 Data Cache48.0 KB x 8
L2 Cache1.25 MB x 8
L3 Cache48.0 MB x 1
Memory Information
Size 64.00 GB
Inference Information
Framework ONNX
Backend CPU
Device Default

Inference Performance

Workload Accuracy Score
Image Classification (F32)
100% 1802
337.3 IPS
 
Image Classification (F16)
100% 1851
346.4 IPS
 
Image Classification (I8)
99% 2712
507.6 IPS
 
Image Segmentation (F32)
100% 1079
18.0 IPS
 
Image Segmentation (F16)
100% 1019
17.0 IPS
 
Image Segmentation (I8)
98% 1640
27.4 IPS
 
Pose Estimation (F32)
100% 9207
11.1 IPS
 
Pose Estimation (F16)
100% 9016
10.9 IPS
 
Pose Estimation (I8)
100% 22102
26.8 IPS
 
Object Detection (F32)
100% 1736
129.6 IPS
 
Object Detection (F16)
100% 1733
129.4 IPS
 
Object Detection (I8)
62% 1368
102.2 IPS
 
Face Detection (F32)
100% 3557
42.3 IPS
 
Face Detection (F16)
100% 3343
39.8 IPS
 
Face Detection (I8)
89% 3107
36.9 IPS
 
Depth Estimation (F32)
100% 7655
59.4 IPS
 
Depth Estimation (F16)
100% 7967
61.8 IPS
 
Depth Estimation (I8)
96% 12219
94.8 IPS
 
Style Transfer (F32)
100% 17513
23.0 IPS
 
Style Transfer (F16)
100% 17234
22.7 IPS
 
Style Transfer (I8)
98% 17349
22.8 IPS
 
Image Super-Resolution (F32)
100% 3363
120.1 IPS
 
Image Super-Resolution (F16)
100% 1969
70.3 IPS
 
Image Super-Resolution (I8)
99% 3647
130.3 IPS
 
Text Classification (F32)
100% 1294
1.86 KIPS
 
Text Classification (F16)
100% 986
1.42 KIPS
 
Text Classification (I8)
98% 313
449.8 IPS
 
Machine Translation (F32)
100% 1683
31.0 IPS
 
Machine Translation (F16)
100% 1557
28.7 IPS
 
Machine Translation (I8)
67% 1856
34.2 IPS
 

Compare

Set Baseline Geekbench 6 now available