Upload Date | October 13 2024 02:28 AM |
Views | 2 |
System Information | |
---|---|
Operating System | Microsoft Windows Server 2025 Datacenter (64-bit) |
Model | Gigabyte Technology Co., Ltd. TRX50 AERO D |
Motherboard | Gigabyte Technology Co., Ltd. TRX50 AERO D |
Power Plan | High performance |
CPU Information | |
---|---|
Name | AMD Ryzen Threadripper 7960X 24-Cores |
Topology | 1 Processor, 24 Cores, 48 Threads |
Identifier | AuthenticAMD Family 25 Model 24 Stepping 1 |
Base Frequency | 4.20 GHz |
Cluster 1 | 24 Cores |
L1 Instruction Cache | 32.0 KB x 24 |
L1 Data Cache | 32.0 KB x 24 |
L2 Cache | 1.00 MB x 24 |
L3 Cache | 32.0 MB x 4 |
Memory Information | |
---|---|
Size | 64.00 GB |
Inference Information | |
---|---|
Framework | ONNX |
Backend | DirectML |
Device | NVIDIA GeForce RTX 4080 |
Workload | Accuracy | Score | |
---|---|---|---|
Image Classification (F32)
|
100% |
11005
2.06 KIPS |
|
Image Classification (F16)
|
100% |
12010
2.25 KIPS |
|
Image Classification (I8)
|
100% |
10411
1.95 KIPS |
|
Image Segmentation (F32)
|
100% |
19710
329.2 IPS |
|
Image Segmentation (F16)
|
100% |
19524
326.1 IPS |
|
Image Segmentation (I8)
|
98% |
18769
313.5 IPS |
|
Pose Estimation (F32)
|
100% |
234214
283.6 IPS |
|
Pose Estimation (F16)
|
100% |
233724
283.0 IPS |
|
Pose Estimation (I8)
|
100% |
207720
251.5 IPS |
|
Object Detection (F32)
|
100% |
7531
562.2 IPS |
|
Object Detection (F16)
|
100% |
7610
568.2 IPS |
|
Object Detection (I8)
|
56% |
7011
523.4 IPS |
|
Face Detection (F32)
|
100% |
40880
486.1 IPS |
|
Face Detection (F16)
|
100% |
40584
482.5 IPS |
|
Face Detection (I8)
|
89% |
36105
429.3 IPS |
|
Depth Estimation (F32)
|
100% |
66703
517.3 IPS |
|
Depth Estimation (F16)
|
100% |
67762
525.5 IPS |
|
Depth Estimation (I8)
|
94% |
54985
426.4 IPS |
|
Style Transfer (F32)
|
100% |
322340
424.0 IPS |
|
Style Transfer (F16)
|
100% |
332859
437.8 IPS |
|
Style Transfer (I8)
|
98% |
296023
389.4 IPS |
|
Image Super-Resolution (F32)
|
100% |
41418
1.48 KIPS |
|
Image Super-Resolution (F16)
|
100% |
41631
1.49 KIPS |
|
Image Super-Resolution (I8)
|
99% |
33561
1.20 KIPS |
|
Text Classification (F32)
|
100% |
2807
4.03 KIPS |
|
Text Classification (F16)
|
100% |
2891
4.15 KIPS |
|
Text Classification (I8)
|
98% |
1847
2.65 KIPS |
|
Machine Translation (F32)
|
100% |
5351
98.5 IPS |
|
Machine Translation (F16)
|
100% |
5381
99.0 IPS |
|
Machine Translation (I8)
|
70% |
2961
54.5 IPS |