Geekbench ML Score

2277
ONNX CPU Inference Score
Geekbench ML 0.6.0 for Windows AVX2

Result Information

User saiht
Upload Date July 16 2024 12:22 PM
Views 6

System Information

System Information
Operating System Microsoft Windows 10 Pro (64-bit)
Model INTEL X99
Motherboard INTEL X99
Power PlanHigh performance
CPU Information
Name Intel Xeon E5-2696 v3
Topology 1 Processor, 18 Cores, 36 Threads
Identifier GenuineIntel Family 6 Model 63 Stepping 2
Base Frequency 2.30 GHz
Cluster 118 Cores
L1 Instruction Cache32.0 KB x 18
L1 Data Cache32.0 KB x 18
L2 Cache256 KB x 18
L3 Cache45.0 MB x 1
Memory Information
Size 64.00 GB
Inference Information
Framework ONNX
Backend CPU
Device Default

Inference Performance

Workload Accuracy Score
Image Classification (F32)
100% 1434
268.3 IPS
 
Image Classification (F16)
100% 1430
267.5 IPS
 
Image Classification (I8)
97% 1624
304.0 IPS
 
Image Segmentation (F32)
100% 1143
19.1 IPS
 
Image Segmentation (F16)
100% 1141
19.1 IPS
 
Image Segmentation (I8)
97% 1332
22.2 IPS
 
Pose Estimation (F32)
100% 7684
9.30 IPS
 
Pose Estimation (F16)
100% 7695
9.32 IPS
 
Pose Estimation (I8)
100% 8562
10.4 IPS
 
Object Detection (F32)
100% 1061
79.2 IPS
 
Object Detection (F16)
100% 1201
89.7 IPS
 
Object Detection (I8)
60% 912
68.1 IPS
 
Face Detection (F32)
100% 1886
22.4 IPS
 
Face Detection (F16)
100% 2036
24.2 IPS
 
Face Detection (I8)
87% 2221
26.4 IPS
 
Depth Estimation (F32)
100% 6261
48.6 IPS
 
Depth Estimation (F16)
100% 6129
47.5 IPS
 
Depth Estimation (I8)
74% 6880
53.4 IPS
 
Style Transfer (F32)
100% 14757
19.4 IPS
 
Style Transfer (F16)
100% 14654
19.3 IPS
 
Style Transfer (I8)
85% 9438
12.4 IPS
 
Image Super-Resolution (F32)
100% 2347
83.8 IPS
 
Image Super-Resolution (F16)
100% 2356
84.1 IPS
 
Image Super-Resolution (I8)
97% 1967
70.3 IPS
 
Text Classification (F32)
100% 820
1.18 KIPS
 
Text Classification (F16)
100% 833
1.20 KIPS
 
Text Classification (I8)
94% 231
332.7 IPS
 
Machine Translation (F32)
100% 1222
22.5 IPS
 
Machine Translation (F16)
100% 1224
22.5 IPS
 
Machine Translation (I8)
67% 1326
24.4 IPS
 

Compare

Set Baseline Geekbench 6 now available