| Run orig_default | Run icx_default | Run aocc_9 | Run icx_5 |
| Loop Source Regions | - /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-631-1351/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/llamafile/sgemm.cpp: 138-138
- /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-631-1351/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/llamafile/sgemm.cpp: 818-846
- /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-631-1351/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/llamafile/sgemm.cpp: 1038-1038
- /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-631-1351/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/llamafile/sgemm.cpp: 1044-1044
| Loop Source Regions | - /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-631-1351/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/llamafile/sgemm.cpp: 138-138
- /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-631-1351/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/llamafile/sgemm.cpp: 818-821
- /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-631-1351/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/llamafile/sgemm.cpp: 827-846
- /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-631-1351/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/llamafile/sgemm.cpp: 966-966
- /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-631-1351/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/llamafile/sgemm.cpp: 1038-1038
- /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-631-1351/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/llamafile/sgemm.cpp: 1044-1044
| Loop Source Regions | - /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-631-1351/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/llamafile/sgemm.cpp: 138-138
- /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-631-1351/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/llamafile/sgemm.cpp: 826-846
- /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-631-1351/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/llamafile/sgemm.cpp: 966-966
- /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-631-1351/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/llamafile/sgemm.cpp: 1038-1038
- /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-631-1351/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/llamafile/sgemm.cpp: 1044-1044
| Loop Source Regions | |
| ASM Loop ID | Max Time Over Threads (s) | Time w.r.t. Wall Time (s) | Cov (%) | Vect. Ratio (%) | Vector Length Use (%) | ASM Loop ID | Max Time Over Threads (s) | Time w.r.t. Wall Time (s) | Cov (%) | Vect. Ratio (%) | Vector Length Use (%) | ASM Loop ID | Max Time Over Threads (s) | Time w.r.t. Wall Time (s) | Cov (%) | Vect. Ratio (%) | Vector Length Use (%) | ASM Loop ID | Max Time Over Threads (s) | Time w.r.t. Wall Time (s) | Cov (%) | Vect. Ratio (%) | Vector Length Use (%) |
|---|
| 2364 | 0.08 | 0.05 | 0.46 | 0 | 0 | 2688 | 0.08 | 0.05 | 0.46 | 0 | 0 | 1814 | 0.06 | 0.04 | 0.34 | 0 | 0 | |
| | | |
| Sum on 1 analyzed binary loop (libggml-cpu.so - 2364) | Sum on 1 analyzed binary loop (libggml-cpu.so - 2688) | Sum on 1 analyzed binary loop (libggml-cpu.so - 1814) | No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count. |
| Analysis | Count | Analysis | Count | Analysis | Count | Analysis | Count |
|---|
| Run orig_default | Run icx_default | Run aocc_9 | Run icx_5 |
| Loop Source Regions | | Loop Source Regions | | Loop Source Regions | | Loop Source Regions | - /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-631-1351/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/simd-mappings.h: 130-130
- /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-631-1351/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/quants.c: 1066-1073
|
| ASM Loop ID | Max Time Over Threads (s) | Time w.r.t. Wall Time (s) | Cov (%) | Vect. Ratio (%) | Vector Length Use (%) | ASM Loop ID | Max Time Over Threads (s) | Time w.r.t. Wall Time (s) | Cov (%) | Vect. Ratio (%) | Vector Length Use (%) | ASM Loop ID | Max Time Over Threads (s) | Time w.r.t. Wall Time (s) | Cov (%) | Vect. Ratio (%) | Vector Length Use (%) | ASM Loop ID | Max Time Over Threads (s) | Time w.r.t. Wall Time (s) | Cov (%) | Vect. Ratio (%) | Vector Length Use (%) |
|---|
| | | 3755 | 0.16 | 0.14 | 1.17 | 88.89 | 20.14 |
| | | |
| No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count. | No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count. | No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count. | Sum on 1 analyzed binary loop (libggml-cpu.so - 3755) |
| Analysis | Count | Analysis | Count | Analysis | Count | Analysis | Count |
|---|
| | | | | | Loop Computation Issues | |
| | | | | | Less than 10% of the FP ADD/SUB/MUL arithmetic operations are performed using FMA | 1 |
| | | | | | Data Access Issues | |
| | | | | | Presence of indirect access | 1 |
| | | | | | Presence of special instructions executing on a single port | 1 |
| | | | | | Vectorization Roadblocks | |
| | | | | | Presence of indirect access | 1 |
| | | | | | Inefficient Vectorization | |
| | | | | | Presence of special instructions executing on a single port | 1 |
| Run orig_default | Run icx_default | Run aocc_9 | Run icx_5 |
| Loop Source Regions | | Loop Source Regions | | Loop Source Regions | | Loop Source Regions | |
| ASM Loop ID | Max Time Over Threads (s) | Time w.r.t. Wall Time (s) | Cov (%) | Vect. Ratio (%) | Vector Length Use (%) | ASM Loop ID | Max Time Over Threads (s) | Time w.r.t. Wall Time (s) | Cov (%) | Vect. Ratio (%) | Vector Length Use (%) | ASM Loop ID | Max Time Over Threads (s) | Time w.r.t. Wall Time (s) | Cov (%) | Vect. Ratio (%) | Vector Length Use (%) | ASM Loop ID | Max Time Over Threads (s) | Time w.r.t. Wall Time (s) | Cov (%) | Vect. Ratio (%) | Vector Length Use (%) |
|---|
| 2738 | 0.00 | 0.00 | 0.00 | 0 | 0 | 1425 | 0.01 | 0.00 | 0.00 | 0 | 0 | 2256 | 0.00 | 0.00 | 0.00 | 0 | 0 | 4393 | 0.00 | 0.00 | 0.00 | 0 | 0 |
| 2485 | 0.00 | 0.00 | 0.00 | 0 | 0 | 2289 | 0.01 | 0.00 | 0.00 | 0 | 0 | 2448 | 0.00 | 0.00 | 0.00 | 0 | 0 | 4225 | 0.00 | 0.00 | 0.00 | 0 | 0 |
| 2638 | 0.00 | 0.00 | 0.00 | 0 | 0 | 278 | 0.01 | 0.00 | 0.00 | 0 | 0 | 2349 | 0.01 | 0.00 | 0.00 | 0 | 0 | 4391 | 0.01 | 0.00 | 0.00 | 0 | 0 |
| 2741 | 0.02 | 0.00 | 0.00 | 0 | 0 | 2294 | 0.01 | 0.00 | 0.00 | 0 | 0 | 2131 | 0.01 | 0.00 | 0.00 | 0 | 0 | 4399 | 0.00 | 0.00 | 0.00 | 0 | 0 |
| 765 | 0.01 | 0.00 | 0.02 | 0 | 0 | 2395 | 0.01 | 0.00 | 0.00 | 0 | 0 | 1139 | 0.01 | 0.00 | 0.00 | 0 | 0 | 4413 | 0.00 | 0.00 | 0.00 | 0 | 0 |
| 484 | 0.01 | 0.00 | 0.00 | 0 | 0 | 2155 | 0.01 | 0.00 | 0.00 | 0 | 0 | 1142 | 0.02 | 0.00 | 0.02 | 0 | 0 | 694 | 0.01 | 0.00 | 0.01 | 0 | 0 |
| 90 | 0.01 | 0.00 | 0.00 | 0 | 0 | 2504 | 0.01 | 0.00 | 0.00 | 0 | 0 | 695 | 0.02 | 0.00 | 0.02 | 0 | 0 | 708 | 0.04 | 0.00 | 0.00 | 0 | 0 |
| 2537 | 0.01 | 0.01 | 0.05 | 0 | 0 | 2298 | 0.01 | 0.00 | 0.00 | 0 | 0 | 994 | 0.02 | 0.00 | 0.01 | 0 | 0 | 1 | 0.00 | 0.00 | 0.00 | 0 | 0 |
| 398 | 0.02 | 0.00 | 0.01 | 0 | 0 | 372 | 0.03 | 0.00 | 0.00 | 0 | 0 | 423 | 0.00 | 0.00 | 0.01 | 0 | 0 | 1610 | 0.03 | 0.01 | 0.07 | 0 | 0 |
| 5 | 0.00 | 0.00 | 0.00 | 0 | 0 | 1948 | 0.00 | 0.00 | 0.00 | 0 | 0 | 353 | 0.01 | 0.00 | 0.01 | 0 | 0 | 3404 | 0.00 | 0.00 | 0.00 | 0 | 0 |
| 1462 | 0.01 | 0.00 | 0.01 | 0 | 0 | 444 | 0.02 | 0.00 | 0.01 | 0 | 0 | 1297 | 0.00 | 0.00 | 0.00 | 0 | 0 | 2819 | 0.01 | 0.00 | 0.01 | 0 | 0 |
| 1456 | 0.00 | 0.00 | 0.00 | 0 | 0 | 866 | 0.01 | 0.00 | 0.00 | 0 | 0 | 1301 | 0.01 | 0.00 | 0.00 | 0 | 0 | 76 | 0.00 | 0.00 | 0.00 | 0 | 0 |
| 87 | 0.00 | 0.00 | 0.00 | 0 | 0 | 124 | 0.00 | 0.00 | 0.00 | 0 | 0 | 1951 | 0.01 | 0.00 | 0.00 | 0 | 0 | 64 | 0.00 | 0.00 | 0.00 | 0 | 0 |
| 1723 | 0.01 | 0.00 | 0.01 | 0 | 0 | 2094 | 0.00 | 0.00 | 0.00 | 0 | 0 | 1963 | 0.01 | 0.01 | 0.05 | 0 | 0 | 690 | 0.01 | 0.00 | 0.01 | 0 | 0 |
| 1196 | 0.01 | 0.00 | 0.00 | 0 | 0 | 2099 | 0.01 | 0.00 | 0.01 | 0 | 0 | 4 | 0.00 | 0.00 | 0.00 | 0 | 0 | 3410 | 0.01 | 0.00 | 0.00 | 0 | 0 |
| 1195 | 0.01 | 0.00 | 0.01 | 0 | 0 | 1412 | 0.01 | 0.00 | 0.00 | 0 | 0 | 1312 | 0.01 | 0.00 | 0.02 | 0 | 0 | 3400 | 0.00 | 0.00 | 0.00 | 0 | 0 |
| 99 | 0.01 | 0.00 | 0.00 | 0 | 0 | 1418 | 0.02 | 0.00 | 0.02 | 0 | 0 | 1317 | 0.01 | 0.00 | 0.00 | 0 | 0 | 922 | 0.01 | 0.00 | 0.00 | 0 | 0 |
| 2527 | 0.01 | 0.00 | 0.01 | 0 | 0 | 1707 | 0.00 | 0.00 | 0.00 | 0 | 0 | 71 | 0.00 | 0.00 | 0.00 | 0 | 0 | 2795 | 0.01 | 0.00 | 0.00 | 0 | 0 |
| 1374 | 0.00 | 0.00 | 0.00 | 0 | 0 | 558 | 0.01 | 0.00 | 0.01 | 0 | 0 | 1812 | 0.00 | 0.00 | 0.00 | 0 | 0 | 1622 | 0.02 | 0.00 | 0.02 | 0 | 0 |
| 1730 | 0.00 | 0.00 | 0.00 | 0 | 0 | 2918 | 0.01 | 0.00 | 0.00 | 0 | 0 | 689 | 0.01 | 0.00 | 0.00 | 0 | 0 | 93 | 0.01 | 0.00 | 0.00 | 0 | 0 |
| 1709 | 0.01 | 0.00 | 0.01 | 0 | 0 | 2929 | 0.01 | 0.01 | 0.05 | 0 | 0 | 993 | 0.01 | 0.00 | 0.00 | 0 | 0 | 2463 | 0.01 | 0.00 | 0.00 | 0 | 0 |
| 761 | 0.01 | 0.00 | 0.00 | 0 | 0 | 2109 | 0.01 | 0.00 | 0.01 | 0 | 0 | 298 | 0.01 | 0.00 | 0.00 | 0 | 0 | 2465 | 0.01 | 0.00 | 0.01 | 0 | 0 |
| 317 | 0.01 | 0.00 | 0.00 | 0 | 0 | 1734 | 0.01 | 0.00 | 0.01 | 0 | 0 | | |
| 913 | 0.00 | 0.00 | 0.00 | 0 | 0 | 873 | 0.01 | 0.00 | 0.02 | 0 | 0 | | |
| 2111 | 0.01 | 0.00 | 0.00 | 0 | 0 | | |
| 6 | 0.01 | 0.00 | 0.00 | 0 | 0 | | |
| | | |
| No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count. | No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count. | No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count. | No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count. |
| Analysis | Count | Analysis | Count | Analysis | Count | Analysis | Count |
|---|
| Run orig_default | Run icx_default | Run aocc_9 | Run icx_5 |
| Loop Source Regions | | Loop Source Regions | | Loop Source Regions | | Loop Source Regions | - /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-631-1351/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 508-509
- /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-631-1351/llama.cpp/build/llama.cpp/ggml/src/./ggml-impl.h: 346-346
- /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-631-1351/llama.cpp/build/llama.cpp/ggml/src/./ggml-impl.h: 355-355
- /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-631-1351/llama.cpp/build/llama.cpp/ggml/src/./ggml-impl.h: 389-404
|
| ASM Loop ID | Max Time Over Threads (s) | Time w.r.t. Wall Time (s) | Cov (%) | Vect. Ratio (%) | Vector Length Use (%) | ASM Loop ID | Max Time Over Threads (s) | Time w.r.t. Wall Time (s) | Cov (%) | Vect. Ratio (%) | Vector Length Use (%) | ASM Loop ID | Max Time Over Threads (s) | Time w.r.t. Wall Time (s) | Cov (%) | Vect. Ratio (%) | Vector Length Use (%) | ASM Loop ID | Max Time Over Threads (s) | Time w.r.t. Wall Time (s) | Cov (%) | Vect. Ratio (%) | Vector Length Use (%) |
|---|
| | | 3409 | 0.07 | 0.04 | 0.33 | 4.17 | 7.03 |
| | | |
| No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count. | No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count. | No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count. | Sum on 1 analyzed binary loop (libggml-cpu.so - 3409) |
| Analysis | Count | Analysis | Count | Analysis | Count | Analysis | Count |
|---|
| | | | | | Loop Computation Issues | |
| | | | | | Less than 10% of the FP ADD/SUB/MUL arithmetic operations are performed using FMA | 1 |
| | | | | | Presence of a large number of scalar integer instructions | 1 |
| | | | | | Data Access Issues | |
| | | | | | Presence of indirect access | 1 |
| | | | | | Vectorization Roadblocks | |
| | | | | | Presence of indirect access | 1 |
