Upload Date | July 05 2024 09:08 AM |
Views | 7 |
System Information | |
---|---|
Operating System | Microsoft Windows Server 2022 Datacenter Azure Edition (64-bit) |
Model | Microsoft Corporation Virtual Machine |
Motherboard | Microsoft Corporation Virtual Machine |
Power Plan | High performance |
CPU Information | |
---|---|
Name | Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz |
Topology | 1 Processor, 8 Cores, 16 Threads |
Identifier | GenuineIntel Family 6 Model 106 Stepping 6 |
Base Frequency | 2.79 GHz |
Cluster 1 | 8 Cores |
L1 Instruction Cache | 32.0 KB x 8 |
L1 Data Cache | 48.0 KB x 8 |
L2 Cache | 1.25 MB x 8 |
L3 Cache | 48.0 MB x 1 |
Memory Information | |
---|---|
Size | 64.00 GB |
Inference Information | |
---|---|
Framework | ONNX |
Backend | CPU |
Device | Default |
Workload | Accuracy | Score | |
---|---|---|---|
Image Classification (F32)
|
100% |
1802
337.3 IPS |
|
Image Classification (F16)
|
100% |
1851
346.4 IPS |
|
Image Classification (I8)
|
99% |
2712
507.6 IPS |
|
Image Segmentation (F32)
|
100% |
1079
18.0 IPS |
|
Image Segmentation (F16)
|
100% |
1019
17.0 IPS |
|
Image Segmentation (I8)
|
98% |
1640
27.4 IPS |
|
Pose Estimation (F32)
|
100% |
9207
11.1 IPS |
|
Pose Estimation (F16)
|
100% |
9016
10.9 IPS |
|
Pose Estimation (I8)
|
100% |
22102
26.8 IPS |
|
Object Detection (F32)
|
100% |
1736
129.6 IPS |
|
Object Detection (F16)
|
100% |
1733
129.4 IPS |
|
Object Detection (I8)
|
62% |
1368
102.2 IPS |
|
Face Detection (F32)
|
100% |
3557
42.3 IPS |
|
Face Detection (F16)
|
100% |
3343
39.8 IPS |
|
Face Detection (I8)
|
89% |
3107
36.9 IPS |
|
Depth Estimation (F32)
|
100% |
7655
59.4 IPS |
|
Depth Estimation (F16)
|
100% |
7967
61.8 IPS |
|
Depth Estimation (I8)
|
96% |
12219
94.8 IPS |
|
Style Transfer (F32)
|
100% |
17513
23.0 IPS |
|
Style Transfer (F16)
|
100% |
17234
22.7 IPS |
|
Style Transfer (I8)
|
98% |
17349
22.8 IPS |
|
Image Super-Resolution (F32)
|
100% |
3363
120.1 IPS |
|
Image Super-Resolution (F16)
|
100% |
1969
70.3 IPS |
|
Image Super-Resolution (I8)
|
99% |
3647
130.3 IPS |
|
Text Classification (F32)
|
100% |
1294
1.86 KIPS |
|
Text Classification (F16)
|
100% |
986
1.42 KIPS |
|
Text Classification (I8)
|
98% |
313
449.8 IPS |
|
Machine Translation (F32)
|
100% |
1683
31.0 IPS |
|
Machine Translation (F16)
|
100% |
1557
28.7 IPS |
|
Machine Translation (I8)
|
67% |
1856
34.2 IPS |