Geekbench ML Score

2758
ONNX CPU Inference Score
Geekbench ML 0.6.0 for Windows AVX2

Result Information

Upload Date November 19 2024 10:03 PM
Views 2

System Information

System Information
Operating System Windows 11 Pro (64-bit)
Model HUANANZHI
Motherboard HUANANZHI X99-BD4
CPU Information
Name Intel Xeon E5-2699 v3
Topology 1 Processor, 18 Cores, 36 Threads
Identifier GenuineIntel Family 6 Model 63 Stepping 2
Base Frequency 2.30 GHz
Cluster 118 Cores
L1 Instruction Cache32.0 KB x 18
L1 Data Cache32.0 KB x 18
L2 Cache256 KB x 18
L3 Cache45.0 MB x 1
Memory Information
Size 64.00 GB
Inference Information
Framework ONNX
Backend CPU
Device Default

Inference Performance

Workload Accuracy Score
Image Classification (F32)
100% 1612
301.6 IPS
 
Image Classification (F16)
100% 1616
302.5 IPS
 
Image Classification (I8)
97% 1836
343.5 IPS
 
Image Segmentation (F32)
100% 1363
22.8 IPS
 
Image Segmentation (F16)
100% 1351
22.6 IPS
 
Image Segmentation (I8)
97% 1525
25.5 IPS
 
Pose Estimation (F32)
100% 9856
11.9 IPS
 
Pose Estimation (F16)
100% 9784
11.8 IPS
 
Pose Estimation (I8)
100% 10143
12.3 IPS
 
Object Detection (F32)
100% 1449
108.2 IPS
 
Object Detection (F16)
100% 1448
108.1 IPS
 
Object Detection (I8)
60% 1025
76.5 IPS
 
Face Detection (F32)
100% 3098
36.8 IPS
 
Face Detection (F16)
100% 3088
36.7 IPS
 
Face Detection (I8)
87% 2702
32.1 IPS
 
Depth Estimation (F32)
100% 7965
61.8 IPS
 
Depth Estimation (F16)
100% 7894
61.2 IPS
 
Depth Estimation (I8)
74% 8105
62.9 IPS
 
Style Transfer (F32)
100% 18896
24.9 IPS
 
Style Transfer (F16)
100% 18996
25.0 IPS
 
Style Transfer (I8)
85% 12667
16.7 IPS
 
Image Super-Resolution (F32)
100% 2693
96.2 IPS
 
Image Super-Resolution (F16)
100% 2680
95.7 IPS
 
Image Super-Resolution (I8)
97% 2238
79.9 IPS
 
Text Classification (F32)
100% 925
1.33 KIPS
 
Text Classification (F16)
100% 925
1.33 KIPS
 
Text Classification (I8)
94% 253
363.1 IPS
 
Machine Translation (F32)
100% 1368
25.2 IPS
 
Machine Translation (F16)
100% 1365
25.1 IPS
 
Machine Translation (I8)
67% 1500
27.6 IPS
 

Compare

Set Baseline Geekbench 6 now available