| Run orig_default | Run icx_default | Run aocc_4 | Run icx_9 |
| Loop Source Regions | | Loop Source Regions | | Loop Source Regions | | Loop Source Regions | |
| ASM Loop ID | Max Time Over Threads (s) | Time w.r.t. Wall Time (s) | Cov (%) | Vect. Ratio (%) | Vector Length Use (%) | ASM Loop ID | Max Time Over Threads (s) | Time w.r.t. Wall Time (s) | Cov (%) | Vect. Ratio (%) | Vector Length Use (%) | ASM Loop ID | Max Time Over Threads (s) | Time w.r.t. Wall Time (s) | Cov (%) | Vect. Ratio (%) | Vector Length Use (%) | ASM Loop ID | Max Time Over Threads (s) | Time w.r.t. Wall Time (s) | Cov (%) | Vect. Ratio (%) | Vector Length Use (%) |
|---|
| 2485 | 0.01 | 0.00 | 0.00 | 0 | 0 | 2395 | 0.01 | 0.00 | 0.00 | 0 | 0 | 2713 | 0.01 | 0.00 | 0.00 | 0 | 0 | 4115 | 0.00 | 0.00 | 0.00 | 0 | 0 |
| 2738 | 0.01 | 0.00 | 0.00 | 0 | 0 | 2504 | 0.00 | 0.00 | 0.00 | 0 | 0 | 2604 | 0.00 | 0.00 | 0.00 | 0 | 0 | 4118 | 0.02 | 0.00 | 0.00 | 0 | 0 |
| 2741 | 0.02 | 0.00 | 0.00 | 0 | 0 | 2294 | 0.00 | 0.00 | 0.00 | 0 | 0 | 1106 | 0.00 | 0.00 | 0.00 | 0 | 0 | 4130 | 0.00 | 0.00 | 0.00 | 0 | 0 |
| 317 | 0.16 | 0.00 | 0.00 | 0 | 0 | 372 | 0.13 | 0.00 | 0.00 | 0 | 0 | 805 | 0.00 | 0.00 | 0.00 | 0 | 0 | 4120 | 0.00 | 0.00 | 0.00 | 0 | 0 |
| 984 | 0.01 | 0.00 | 0.00 | 0 | 0 | 813 | 0.00 | 0.00 | 0.00 | 0 | 0 | 314 | 0.19 | 0.00 | 0.00 | 0 | 0 | 648 | 0.00 | 0.00 | 0.00 | 0 | 0 |
| 765 | 0.09 | 0.02 | 0.05 | 0 | 0 | 1949 | 0.00 | 0.00 | 0.00 | 0 | 0 | 985 | 0.00 | 0.00 | 0.00 | 0 | 0 | 664 | 0.14 | 0.00 | 0.00 | 0 | 0 |
| 484 | 0.04 | 0.01 | 0.02 | 0 | 0 | 1948 | 0.00 | 0.00 | 0.00 | 0 | 0 | 1611 | 0.01 | 0.00 | 0.01 | 0 | 0 | 321 | 0.00 | 0.00 | 0.00 | 0 | 0 |
| 2527 | 0.01 | 0.00 | 0.00 | 0 | 0 | 444 | 0.04 | 0.01 | 0.02 | 0 | 0 | 1148 | 0.04 | 0.02 | 0.04 | 0 | 0 | 3505 | 0.01 | 0.00 | 0.00 | 0 | 0 |
| 1 | 0.01 | 0.00 | 0.00 | 0 | 0 | 114 | 0.01 | 0.00 | 0.00 | 0 | 0 | 83 | 0.00 | 0.00 | 0.00 | 0 | 0 | 1747 | 0.08 | 0.03 | 0.05 | 0 | 0 |
| 5 | 0.01 | 0.00 | 0.01 | 0 | 0 | 866 | 0.03 | 0.01 | 0.02 | 0 | 0 | 1386 | 0.06 | 0.03 | 0.05 | 0 | 0 | 114 | 0.00 | 0.00 | 0.00 | 0 | 0 |
| 1704 | 0.01 | 0.00 | 0.00 | 0 | 0 | 124 | 0.01 | 0.00 | 0.00 | 0 | 0 | 386 | 0.03 | 0.01 | 0.02 | 0 | 0 | 2816 | 0.00 | 0.00 | 0.00 | 0 | 0 |
| 1456 | 0.01 | 0.00 | 0.01 | 0 | 0 | 2094 | 0.01 | 0.00 | 0.00 | 0 | 0 | 1380 | 0.04 | 0.00 | 0.01 | 0 | 0 | 135 | 0.00 | 0.00 | 0.00 | 0 | 0 |
| 398 | 0.04 | 0.01 | 0.03 | 0 | 0 | 2099 | 0.01 | 0.00 | 0.01 | 0 | 0 | 738 | 0.09 | 0.03 | 0.06 | 0 | 0 | 108 | 0.00 | 0.00 | 0.00 | 0 | 0 |
| 1723 | 0.05 | 0.02 | 0.04 | 0 | 0 | 1412 | 0.02 | 0.00 | 0.01 | 0 | 0 | 1311 | 0.00 | 0.00 | 0.00 | 0 | 0 | 2986 | 0.04 | 0.02 | 0.04 | 0 | 0 |
| 1196 | 0.01 | 0.00 | 0.01 | 0 | 0 | 1418 | 0.05 | 0.02 | 0.04 | 0 | 0 | 462 | 0.04 | 0.01 | 0.02 | 0 | 0 | 117 | 0.00 | 0.00 | 0.00 | 0 | 0 |
| 1195 | 0.05 | 0.02 | 0.05 | 0 | 0 | 1707 | 0.02 | 0.00 | 0.01 | 0 | 0 | 92 | 0.01 | 0.00 | 0.00 | 0 | 0 | 3446 | 0.02 | 0.00 | 0.01 | 0 | 0 |
| 761 | 0.03 | 0.01 | 0.02 | 0 | 0 | 401 | 0.00 | 0.00 | 0.00 | 0 | 0 | 732 | 0.03 | 0.01 | 0.02 | 0 | 0 | 2572 | 0.02 | 0.00 | 0.01 | 0 | 0 |
| 1709 | 0.02 | 0.00 | 0.01 | 0 | 0 | 2237 | 0.00 | 0.00 | 0.00 | 0 | 0 | 4 | 0.02 | 0.00 | 0.01 | 0 | 0 | 2574 | 0.06 | 0.02 | 0.04 | 0 | 0 |
| 1374 | 0.01 | 0.00 | 0.00 | 0 | 0 | 558 | 0.02 | 0.01 | 0.02 | 0 | 0 | 0 | 0.00 | 0.00 | 0.00 | 0 | 0 | 2975 | 0.02 | 0.00 | 0.01 | 0 | 0 |
| 1730 | 0.01 | 0.00 | 0.00 | 0 | 0 | 2918 | 0.01 | 0.00 | 0.00 | 0 | 0 | 1759 | 0.00 | 0.00 | 0.00 | 0 | 0 | 3675 | 0.00 | 0.00 | 0.00 | 0 | 0 |
| 99 | 0.01 | 0.00 | 0.00 | 0 | 0 | 113 | 0.01 | 0.00 | 0.00 | 0 | 0 | 1149 | 0.02 | 0.00 | 0.01 | 0 | 0 | 119 | 0.00 | 0.00 | 0.00 | 0 | 0 |
| 1462 | 0.04 | 0.02 | 0.04 | 0 | 0 | 2111 | 0.01 | 0.00 | 0.00 | 0 | 0 | 1622 | 0.04 | 0.02 | 0.04 | 0 | 0 | 649 | 0.04 | 0.01 | 0.02 | 0 | 0 |
| 2109 | 0.05 | 0.02 | 0.04 | 0 | 0 | 1627 | 0.01 | 0.00 | 0.00 | 0 | 0 | 3 | 0.02 | 0.00 | 0.01 | 0 | 0 |
| 1734 | 0.04 | 0.02 | 0.03 | 0 | 0 | 2387 | 0.01 | 0.00 | 0.00 | 0 | 0 | 3433 | 0.01 | 0.00 | 0.00 | 0 | 0 |
| 873 | 0.09 | 0.02 | 0.05 | 0 | 0 | 1604 | 0.00 | 0.00 | 0.00 | 0 | 0 | 3429 | 0.01 | 0.00 | 0.00 | 0 | 0 |
| 6 | 0.02 | 0.00 | 0.01 | 0 | 0 | | 945 | 0.03 | 0.01 | 0.02 | 0 | 0 |
| 1605 | 0.00 | 0.00 | 0.00 | 0 | 0 | | |
| | | |
| No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count. | No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count. | No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count. | No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count. |
| Analysis | Count | Analysis | Count | Analysis | Count | Analysis | Count |
|---|
| Run orig_default | Run icx_default | Run aocc_4 | Run icx_9 |
| Loop Source Regions | | Loop Source Regions | | Loop Source Regions | | Loop Source Regions | - /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-626-0869/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/simd-mappings.h: 130-130
- /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-626-0869/llama.cpp/build/llama.cpp/ggml/src/./ggml-impl.h: 346-346
- /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-626-0869/llama.cpp/build/llama.cpp/ggml/src/./ggml-impl.h: 389-389
- /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-626-0869/llama.cpp/build/llama.cpp/ggml/src/./ggml-impl.h: 399-404
- /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-626-0869/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 508-509
|
| ASM Loop ID | Max Time Over Threads (s) | Time w.r.t. Wall Time (s) | Cov (%) | Vect. Ratio (%) | Vector Length Use (%) | ASM Loop ID | Max Time Over Threads (s) | Time w.r.t. Wall Time (s) | Cov (%) | Vect. Ratio (%) | Vector Length Use (%) | ASM Loop ID | Max Time Over Threads (s) | Time w.r.t. Wall Time (s) | Cov (%) | Vect. Ratio (%) | Vector Length Use (%) | ASM Loop ID | Max Time Over Threads (s) | Time w.r.t. Wall Time (s) | Cov (%) | Vect. Ratio (%) | Vector Length Use (%) |
|---|
| | | 3443 | 0.33 | 0.25 | 0.52 | 85.05 | 20.79 |
| | | |
| No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count. | No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count. | No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count. | Sum on 1 analyzed binary loop (libggml-cpu.so - 3443) |
| Analysis | Count | Analysis | Count | Analysis | Count | Analysis | Count |
|---|
| | | | | | Loop Computation Issues | |
| | | | | | Less than 10% of the FP ADD/SUB/MUL arithmetic operations are performed using FMA | 1 |
| | | | | | Data Access Issues | |
| | | | | | Presence of indirect access | 1 |
| | | | | | Presence of special instructions executing on a single port | 1 |
| | | | | | Vectorization Roadblocks | |
| | | | | | Presence of indirect access | 1 |
| | | | | | Inefficient Vectorization | |
| | | | | | Presence of special instructions executing on a single port | 1 |
| Run orig_default | Run icx_default | Run aocc_4 | Run icx_9 |
| Loop Source Regions | - /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-626-0869/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/llamafile/sgemm.cpp: 138-138
- /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-626-0869/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/llamafile/sgemm.cpp: 818-846
- /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-626-0869/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/llamafile/sgemm.cpp: 1038-1038
- /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-626-0869/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/llamafile/sgemm.cpp: 1044-1044
| Loop Source Regions | - /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-626-0869/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/llamafile/sgemm.cpp: 138-138
- /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-626-0869/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/llamafile/sgemm.cpp: 818-821
- /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-626-0869/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/llamafile/sgemm.cpp: 827-846
- /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-626-0869/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/llamafile/sgemm.cpp: 966-966
- /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-626-0869/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/llamafile/sgemm.cpp: 1038-1038
- /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-626-0869/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/llamafile/sgemm.cpp: 1044-1044
| Loop Source Regions | - /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-626-0869/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/llamafile/sgemm.cpp: 138-138
- /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-626-0869/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/llamafile/sgemm.cpp: 818-846
- /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-626-0869/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/llamafile/sgemm.cpp: 1038-1038
- /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-626-0869/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/llamafile/sgemm.cpp: 1044-1044
| Loop Source Regions | |
| ASM Loop ID | Max Time Over Threads (s) | Time w.r.t. Wall Time (s) | Cov (%) | Vect. Ratio (%) | Vector Length Use (%) | ASM Loop ID | Max Time Over Threads (s) | Time w.r.t. Wall Time (s) | Cov (%) | Vect. Ratio (%) | Vector Length Use (%) | ASM Loop ID | Max Time Over Threads (s) | Time w.r.t. Wall Time (s) | Cov (%) | Vect. Ratio (%) | Vector Length Use (%) | ASM Loop ID | Max Time Over Threads (s) | Time w.r.t. Wall Time (s) | Cov (%) | Vect. Ratio (%) | Vector Length Use (%) |
|---|
| 2364 | 0.08 | 0.05 | 0.11 | 0 | 0 | 2688 | 0.08 | 0.05 | 0.11 | 0 | 0 | 2224 | 0.09 | 0.06 | 0.12 | 0 | 0 | |
| | | |
| Sum on 1 analyzed binary loop (libggml-cpu.so - 2364) | Sum on 1 analyzed binary loop (libggml-cpu.so - 2688) | Sum on 1 analyzed binary loop (libggml-cpu.so - 2224) | No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count. |
| Analysis | Count | Analysis | Count | Analysis | Count | Analysis | Count |
|---|
| Run orig_default | Run icx_default | Run aocc_4 | Run icx_9 |
| Loop Source Regions | | Loop Source Regions | | Loop Source Regions | | Loop Source Regions | - /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-626-0869/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/simd-mappings.h: 130-130
- /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-626-0869/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/quants.c: 1066-1073
|
| ASM Loop ID | Max Time Over Threads (s) | Time w.r.t. Wall Time (s) | Cov (%) | Vect. Ratio (%) | Vector Length Use (%) | ASM Loop ID | Max Time Over Threads (s) | Time w.r.t. Wall Time (s) | Cov (%) | Vect. Ratio (%) | Vector Length Use (%) | ASM Loop ID | Max Time Over Threads (s) | Time w.r.t. Wall Time (s) | Cov (%) | Vect. Ratio (%) | Vector Length Use (%) | ASM Loop ID | Max Time Over Threads (s) | Time w.r.t. Wall Time (s) | Cov (%) | Vect. Ratio (%) | Vector Length Use (%) |
|---|
| | | 3844 | 0.16 | 0.14 | 0.28 | 88.89 | 20.14 |
| | | |
| No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count. | No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count. | No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count. | Sum on 1 analyzed binary loop (libggml-cpu.so - 3844) |
| Analysis | Count | Analysis | Count | Analysis | Count | Analysis | Count |
|---|
| | | | | | Loop Computation Issues | |
| | | | | | Less than 10% of the FP ADD/SUB/MUL arithmetic operations are performed using FMA | 1 |
| | | | | | Data Access Issues | |
| | | | | | Presence of indirect access | 1 |
| | | | | | Presence of special instructions executing on a single port | 1 |
| | | | | | Vectorization Roadblocks | |
| | | | | | Presence of indirect access | 1 |
| | | | | | Inefficient Vectorization | |
| | | | | | Presence of special instructions executing on a single port | 1 |
| Run orig_default | Run icx_default | Run aocc_4 | Run icx_9 |
| Loop Source Regions | | Loop Source Regions | | Loop Source Regions | | Loop Source Regions | - /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-626-0869/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/simd-mappings.h: 130-130
- /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-626-0869/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.cpp: 331-332
|
| ASM Loop ID | Max Time Over Threads (s) | Time w.r.t. Wall Time (s) | Cov (%) | Vect. Ratio (%) | Vector Length Use (%) | ASM Loop ID | Max Time Over Threads (s) | Time w.r.t. Wall Time (s) | Cov (%) | Vect. Ratio (%) | Vector Length Use (%) | ASM Loop ID | Max Time Over Threads (s) | Time w.r.t. Wall Time (s) | Cov (%) | Vect. Ratio (%) | Vector Length Use (%) | ASM Loop ID | Max Time Over Threads (s) | Time w.r.t. Wall Time (s) | Cov (%) | Vect. Ratio (%) | Vector Length Use (%) |
|---|
| | | 1733 | 0.19 | 0.13 | 0.27 | 5.88 | 8.82 |
| | | |
| No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count. | No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count. | No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count. | Sum on 1 analyzed binary loop (libggml-cpu.so - 1733) |
| Analysis | Count | Analysis | Count | Analysis | Count | Analysis | Count |
|---|
| | | | | | Loop Computation Issues | |
| | | | | | Less than 10% of the FP ADD/SUB/MUL arithmetic operations are performed using FMA | 1 |
| | | | | | Data Access Issues | |
| | | | | | Presence of indirect access | 1 |
| | | | | | Vectorization Roadblocks | |
| | | | | | Presence of indirect access | 1 |
