Upload Date | July 05 2024 09:05 AM |
Views | 8 |
System Information | |
---|---|
Operating System | Microsoft Windows Server 2022 Datacenter Azure Edition (64-bit) |
Model | Microsoft Corporation Virtual Machine |
Motherboard | Microsoft Corporation Virtual Machine |
Power Plan | High performance |
CPU Information | |
---|---|
Name | Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz |
Topology | 1 Processor, 8 Cores, 16 Threads |
Identifier | GenuineIntel Family 6 Model 106 Stepping 6 |
Base Frequency | 2.79 GHz |
Cluster 1 | 8 Cores |
L1 Instruction Cache | 32.0 KB x 8 |
L1 Data Cache | 48.0 KB x 8 |
L2 Cache | 1.25 MB x 8 |
L3 Cache | 48.0 MB x 1 |
Memory Information | |
---|---|
Size | 64.00 GB |
Inference Information | |
---|---|
Framework | ONNX |
Backend | CPU |
Device | Default |
Workload | Accuracy | Score | |
---|---|---|---|
Image Classification (F32)
|
100% |
1699
317.9 IPS |
|
Image Classification (F16)
|
100% |
1839
344.2 IPS |
|
Image Classification (I8)
|
99% |
2763
517.1 IPS |
|
Image Segmentation (F32)
|
100% |
1181
19.7 IPS |
|
Image Segmentation (F16)
|
100% |
1160
19.4 IPS |
|
Image Segmentation (I8)
|
98% |
1824
30.5 IPS |
|
Pose Estimation (F32)
|
100% |
9276
11.2 IPS |
|
Pose Estimation (F16)
|
100% |
8641
10.5 IPS |
|
Pose Estimation (I8)
|
100% |
22683
27.5 IPS |
|
Object Detection (F32)
|
100% |
1719
128.3 IPS |
|
Object Detection (F16)
|
100% |
1707
127.4 IPS |
|
Object Detection (I8)
|
62% |
1376
102.7 IPS |
|
Face Detection (F32)
|
100% |
3370
40.1 IPS |
|
Face Detection (F16)
|
100% |
3525
41.9 IPS |
|
Face Detection (I8)
|
89% |
3028
36.0 IPS |
|
Depth Estimation (F32)
|
100% |
7564
58.7 IPS |
|
Depth Estimation (F16)
|
100% |
7995
62.0 IPS |
|
Depth Estimation (I8)
|
96% |
11921
92.4 IPS |
|
Style Transfer (F32)
|
100% |
16779
22.1 IPS |
|
Style Transfer (F16)
|
100% |
16849
22.2 IPS |
|
Style Transfer (I8)
|
98% |
17742
23.3 IPS |
|
Image Super-Resolution (F32)
|
100% |
3394
121.2 IPS |
|
Image Super-Resolution (F16)
|
100% |
3317
118.5 IPS |
|
Image Super-Resolution (I8)
|
99% |
3370
120.4 IPS |
|
Text Classification (F32)
|
100% |
1186
1.70 KIPS |
|
Text Classification (F16)
|
100% |
1279
1.84 KIPS |
|
Text Classification (I8)
|
98% |
285
409.7 IPS |
|
Machine Translation (F32)
|
100% |
1673
30.8 IPS |
|
Machine Translation (F16)
|
100% |
1685
31.0 IPS |
|
Machine Translation (I8)
|
67% |
1864
34.3 IPS |