Upload Date | July 05 2024 09:10 AM |
Views | 6 |
System Information | |
---|---|
Operating System | Microsoft Windows Server 2022 Datacenter Azure Edition (64-bit) |
Model | Microsoft Corporation Virtual Machine |
Motherboard | Microsoft Corporation Virtual Machine |
Power Plan | High performance |
CPU Information | |
---|---|
Name | Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz |
Topology | 1 Processor, 8 Cores, 16 Threads |
Identifier | GenuineIntel Family 6 Model 106 Stepping 6 |
Base Frequency | 2.79 GHz |
Cluster 1 | 8 Cores |
L1 Instruction Cache | 32.0 KB x 8 |
L1 Data Cache | 48.0 KB x 8 |
L2 Cache | 1.25 MB x 8 |
L3 Cache | 48.0 MB x 1 |
Memory Information | |
---|---|
Size | 64.00 GB |
Inference Information | |
---|---|
Framework | ONNX |
Backend | CPU |
Device | Default |
Workload | Accuracy | Score | |
---|---|---|---|
Image Classification (F32)
|
100% |
1701
318.3 IPS |
|
Image Classification (F16)
|
100% |
1872
350.2 IPS |
|
Image Classification (I8)
|
99% |
2754
515.3 IPS |
|
Image Segmentation (F32)
|
100% |
1257
21.0 IPS |
|
Image Segmentation (F16)
|
100% |
1190
19.9 IPS |
|
Image Segmentation (I8)
|
98% |
1612
26.9 IPS |
|
Pose Estimation (F32)
|
100% |
9232
11.2 IPS |
|
Pose Estimation (F16)
|
100% |
9269
11.2 IPS |
|
Pose Estimation (I8)
|
100% |
25914
31.4 IPS |
|
Object Detection (F32)
|
100% |
1654
123.5 IPS |
|
Object Detection (F16)
|
100% |
1708
127.5 IPS |
|
Object Detection (I8)
|
65% |
1373
102.5 IPS |
|
Face Detection (F32)
|
100% |
3214
38.2 IPS |
|
Face Detection (F16)
|
100% |
3522
41.9 IPS |
|
Face Detection (I8)
|
89% |
3156
37.5 IPS |
|
Depth Estimation (F32)
|
100% |
7930
61.5 IPS |
|
Depth Estimation (F16)
|
100% |
7843
60.8 IPS |
|
Depth Estimation (I8)
|
96% |
12581
97.6 IPS |
|
Style Transfer (F32)
|
100% |
17276
22.7 IPS |
|
Style Transfer (F16)
|
100% |
17530
23.1 IPS |
|
Style Transfer (I8)
|
98% |
17699
23.3 IPS |
|
Image Super-Resolution (F32)
|
100% |
3402
121.5 IPS |
|
Image Super-Resolution (F16)
|
100% |
3408
121.7 IPS |
|
Image Super-Resolution (I8)
|
99% |
3576
127.7 IPS |
|
Text Classification (F32)
|
100% |
1266
1.82 KIPS |
|
Text Classification (F16)
|
100% |
1249
1.79 KIPS |
|
Text Classification (I8)
|
98% |
313
449.7 IPS |
|
Machine Translation (F32)
|
100% |
1698
31.3 IPS |
|
Machine Translation (F16)
|
100% |
1551
28.5 IPS |
|
Machine Translation (I8)
|
67% |
1906
35.1 IPS |