| Name | Module | Max Thread Time / Walltime gcc_0 (%) | Coverage gcc_0 (%) | Coverage Excluding Loops gcc_0 (%) | Max Inclusive Time Over Threads gcc_0 (s) | Max Exclusive Time Over Threads gcc_0 (s) | Inclusive Time w.r.t. Wall Time gcc_0 (s) | Exclusive Time w.r.t. Wall Time gcc_0 (s) | Nb Threads gcc_0 | Deviation (coverage) gcc_0 | Deviation (walltime) gcc_0 | Categories gcc_0 | GFLOPS gcc_0 | Compilation Options |
|---|
| ►ggml_vec_dot_q8_0_q8_0+ | libggml-cpu.so | 78.56 | 58.48 | 0.03 | 52.10 | 0.05 | 33.66 | 0.02 | 192 | 27.70 | 15.89 | /beegfs/hackathon/users/eoseret/qaas_runs_test/175-950-2189/intel/llama.cpp/build/llama.cpp/../gcc/bin/libggml-blas.so (%): 100.00 | 60.34 | GNU C11 14.2.0 -march=znver5 -mmmx -mpopcnt -msse -msse2 -msse3 -mssse3 -msse4.1 -msse4.2 -mavx -mavx2 -msse4a -mno-fma4 -mno-xop -mfma -mavx512f -mbmi -mbmi2 -maes -mpclmul -mavx512vl -mavx512bw -mavx512dq -mavx512cd -mavx512vbmi -mavx512ifma -mavx512vpop... |
| ○Loop 1989 - quants.c:108-1035 - libggml-cpu.so [...] | | 78.51 | 58.45 | 58.45 | 52.07 | 52.07 | 33.64 | 33.64 | 192 | 27.70 | 15.89 | | 60.31 | |
| ○gomp_team_barrier_wait_end | libgomp.so.1.0.0 | 72.51 | 37.28 | 37.28 | 48.09 | 48.09 | 21.45 | 21.45 | 192 | 28.28 | 16.24 | OMP (%): 100.00 | 0.06 | |
| ○gomp_team_barrier_wait | libgomp.so.1.0.0 | 4.04 | 3.27 | 3.27 | 2.68 | 2.68 | 1.88 | 1.88 | 192 | 0.79 | 0.45 | OMP (%): 100.00 | 3.23 | |
| ○gomp_barrier_wait_end | libgomp.so.1.0.0 | 0.36 | 0.26 | 0.26 | 0.24 | 0.24 | 0.15 | 0.15 | 191 | 0.06 | 0.03 | OMP (%): 100.00 | 0.00 | |
| ►ggml_compute_forward_mul_mat+ | libggml-cpu.so | 0.26 | 0.13 | 0.01 | 0.17 | 0.03 | 0.07 | 0.00 | 192 | 0.06 | 0.03 | /beegfs/hackathon/users/eoseret/qaas_runs_test/175-950-2189/intel/llama.cpp/build/llama.cpp/../gcc/bin/libggml-blas.so (%): 100.00 | 70.86 | GNU C11 14.2.0 -march=znver5 -mmmx -mpopcnt -msse -msse2 -msse3 -mssse3 -msse4.1 -msse4.2 -mavx -mavx2 -msse4a -mno-fma4 -mno-xop -mfma -mavx512f -mbmi -mbmi2 -maes -mpclmul -mavx512vl -mavx512bw -mavx512dq -mavx512cd -mavx512vbmi -mavx512ifma -mavx512vpop... |
| ►Loop 69 - ggml-cpu.c:1248-1260 - libggml-cpu.so+ | | 0.00 | 0.01 | 0.00 | 0.02 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 70 - ggml-cpu.c:1249-1260 - libggml-cpu.so | | 0.03 | 0.01 | 0.01 | 0.02 | 0.02 | 0.00 | 0.00 | 62 | 0.01 | 0.00 | | 0.00 | |
| ►Loop 68 - ggml-cpu.c:1289-1297 - libggml-cpu.so+ | | 0.00 | 0.00 | 0.00 | 0.02 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ►Loop 67 - ggml-cpu.c:1290-1297 - libggml-cpu.so+ | | 0.00 | 0.00 | 0.00 | 0.02 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 66 - ggml-cpu.c:1291-1297 - libggml-cpu.so | | 0.03 | 0.00 | 0.00 | 0.02 | 0.02 | 0.00 | 0.00 | 10 | 0.01 | 0.00 | | 0.00 | |
| ►Loop 56 - ggml-cpu.c:1125-1397 - libggml-cpu.so [...]+ | | 0.06 | 0.11 | 0.01 | 0.28 | 0.04 | 0.07 | 0.00 | 94 | 0.01 | 0.01 | | 67.13 | |
| ►Loop 59 - ggml-cpu.c:1162-1397 - libggml-cpu.so [...]+ | | 0.02 | 0.11 | 0.00 | 0.24 | 0.01 | 0.06 | 0.00 | 35 | 0.01 | 0.00 | | 225.65 | |
| ►Loop 60 - ggml-cpu.c:1163-1198 - libggml-cpu.so [...]+ | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ►Loop 61 - ggml-cpu.c:1164-1198 - libggml-cpu.so [...]+ | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 62 - ggml-cpu.c:1197-1198 - libggml-cpu.so | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ►Loop 58 - ggml-cpu.c:1163-1397 - libggml-cpu.so [...]+ | | 0.08 | 0.11 | 0.01 | 0.23 | 0.05 | 0.06 | 0.01 | 157 | 0.02 | 0.01 | | 73.61 | |
| ►Loop 63 - ggml-cpu.c:1164-1397 - libggml-cpu.so [...]+ | | 0.21 | 0.09 | 0.08 | 0.18 | 0.14 | 0.05 | 0.05 | 192 | 0.04 | 0.03 | | 75.80 | |
| ○Loop 64 - ggml-cpu.c:1193-1194 - libggml-cpu.so | | 0.05 | 0.01 | 0.01 | 0.03 | 0.03 | 0.01 | 0.01 | 165 | 0.01 | 0.01 | | 116.96 | |
| ○Loop 65 - ggml-cpu.c:1193-1194 - libggml-cpu.so | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 57 - ggml-cpu.c:1197-1198 - libggml-cpu.so | | 0.02 | 0.00 | 0.00 | 0.01 | 0.01 | 0.00 | 0.00 | 25 | 0.01 | 0.00 | | 113.66 | |
| ►Loop 54 - ggml-cpu.c:1316-1328 - libggml-cpu.so+ | | 0.02 | 0.00 | 0.00 | 0.03 | 0.01 | 0.00 | 0.00 | 2 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 55 - ggml-cpu.c:1317-1328 - libggml-cpu.so | | 0.03 | 0.00 | 0.00 | 0.02 | 0.02 | 0.00 | 0.00 | 26 | 0.01 | 0.00 | | 5.74 | |
| ►void (anonymous namespace)::tinyBLAS_Q0_AVX<block_q8_0, block_q8_0, float>::gemm4xN<4>(long, long, long, long)+ | libggml-cpu.so | 0.17 | 0.10 | 0.00 | 0.11 | 0.01 | 0.05 | 0.00 | 189 | 0.05 | 0.03 | /beegfs/hackathon/users/eoseret/qaas_runs_test/175-950-2189/intel/llama.cpp/build/llama.cpp/../gcc/bin/libggml-blas.so (%): 100.00 | 263.87 | GNU C++17 14.2.0 -march=znver5 -mmmx -mpopcnt -msse -msse2 -msse3 -mssse3 -msse4.1 -msse4.2 -mavx -mavx2 -msse4a -mno-fma4 -mno-xop -mfma -mavx512f -mbmi -mbmi2 -maes -mpclmul -mavx512vl -mavx512bw -mavx512dq -mavx512cd -mavx512vbmi -mavx512ifma -mavx512vp... |
| ►Loop 1617 - sgemm.cpp:814-1038 - libggml-cpu.so [...]+ | | 0.00 | 0.10 | 0.00 | 0.11 | 0.00 | 0.05 | 0.00 | 16 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 1618 - sgemm.cpp:818-1038 - libggml-cpu.so [...] | | 0.17 | 0.10 | 0.10 | 0.11 | 0.11 | 0.05 | 0.05 | 189 | 0.05 | 0.03 | | 263.21 | |
| ►void (anonymous namespace)::tinyBLAS_Q0_AVX<block_q8_0, block_q8_0, float>::gemm4xN<2>(long, long, long, long)+ | libggml-cpu.so | 0.17 | 0.09 | 0.00 | 0.11 | 0.00 | 0.05 | 0.00 | 189 | 0.05 | 0.03 | /beegfs/hackathon/users/eoseret/qaas_runs_test/175-950-2189/intel/llama.cpp/build/llama.cpp/../gcc/bin/libggml-blas.so (%): 100.00 | 130.01 | GNU C++17 14.2.0 -march=znver5 -mmmx -mpopcnt -msse -msse2 -msse3 -mssse3 -msse4.1 -msse4.2 -mavx -mavx2 -msse4a -mno-fma4 -mno-xop -mfma -mavx512f -mbmi -mbmi2 -maes -mpclmul -mavx512vl -mavx512bw -mavx512dq -mavx512cd -mavx512vbmi -mavx512ifma -mavx512vp... |
| ►Loop 1625 - sgemm.cpp:814-1038 - libggml-cpu.so [...]+ | | 0.02 | 0.09 | 0.00 | 0.12 | 0.01 | 0.05 | 0.00 | 7 | 0.01 | 0.00 | | 335.10 | |
| ○Loop 1626 - sgemm.cpp:818-1038 - libggml-cpu.so [...] | | 0.17 | 0.09 | 0.09 | 0.11 | 0.11 | 0.05 | 0.05 | 189 | 0.05 | 0.03 | | 129.76 | |
| ►ggml_graph_compute_thread+ | libggml-cpu.so | 0.27 | 0.08 | 0.01 | 0.18 | 0.03 | 0.05 | 0.00 | 181 | 0.06 | 0.03 | /beegfs/hackathon/users/eoseret/qaas_runs_test/175-950-2189/intel/llama.cpp/build/llama.cpp/../gcc/bin/libggml-blas.so (%): 100.00 | 3.72 | GNU C11 14.2.0 -march=znver5 -mmmx -mpopcnt -msse -msse2 -msse3 -mssse3 -msse4.1 -msse4.2 -mavx -mavx2 -msse4a -mno-fma4 -mno-xop -mfma -mavx512f -mbmi -mbmi2 -maes -mpclmul -mavx512vl -mavx512bw -mavx512dq -mavx512cd -mavx512vbmi -mavx512ifma -mavx512vpop... |
| ►Loop 74 - ggml-cpu.c:1424-1654 - libggml-cpu.so [...]+ | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ►Loop 75 - ggml-cpu.c:1424-1654 - libggml-cpu.so [...]+ | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ►Loop 76 - ggml-cpu.c:1429-1465 - libggml-cpu.so [...]+ | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ►Loop 78 - ggml-cpu.c:1437-1465 - libggml-cpu.so [...]+ | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 79 - ggml-cpu.c:1438-1465 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ►Loop 77 - ggml-cpu.c:1437-1465 - libggml-cpu.so [...]+ | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ►Loop 80 - ggml-cpu.c:1438-1465 - libggml-cpu.so [...]+ | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 81 - ggml-cpu.c:1461-1462 - libggml-cpu.so | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ►Loop 86 - ggml-cpu.c:1552-1560 - libggml-cpu.so+ | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ►Loop 85 - ggml-cpu.c:1553-1560 - libggml-cpu.so+ | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 84 - ggml-cpu.c:1554-1560 - libggml-cpu.so | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 72 - ggml-cpu.c:1474-1539 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 71 - ggml-cpu.c:1664-2891 - libggml-cpu.so [...] | | 0.24 | 0.08 | 0.08 | 0.16 | 0.16 | 0.04 | 0.04 | 180 | 0.06 | 0.03 | | 3.79 | |
| ►Loop 83 - ggml-cpu.c:1572-1579 - libggml-cpu.so+ | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 82 - ggml-cpu.c:1572-1579 - libggml-cpu.so | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 73 - ggml-cpu.c:1585-1587 - libggml-cpu.so | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 87 - ggml-cpu.c:2087-2088 - libggml-cpu.so | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ►ggml_compute_forward_flash_attn_ext+ | libggml-cpu.so | 0.39 | 0.05 | 0.00 | 0.26 | 0.02 | 0.03 | 0.00 | 60 | 0.15 | 0.09 | /beegfs/hackathon/users/eoseret/qaas_runs_test/175-950-2189/intel/llama.cpp/build/llama.cpp/../gcc/bin/libggml-blas.so (%): 100.00 | 1573.06 | GNU C++17 14.2.0 -march=znver5 -mmmx -mpopcnt -msse -msse2 -msse3 -mssse3 -msse4.1 -msse4.2 -mavx -mavx2 -msse4a -mno-fma4 -mno-xop -mfma -mavx512f -mbmi -mbmi2 -maes -mpclmul -mavx512vl -mavx512bw -mavx512dq -mavx512cd -mavx512vbmi -mavx512ifma -mavx512vp... |
| ►Loop 1436 - vec.h:375-751 - libggml-cpu.so [...]+ | | 0.00 | 0.05 | 0.00 | 0.37 | 0.00 | 0.03 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ►Loop 1430 - vec.h:375-751 - libggml-cpu.so [...]+ | | 0.06 | 0.05 | 0.00 | 0.37 | 0.04 | 0.03 | 0.00 | 32 | 0.02 | 0.01 | | 3396.18 | |
| ○Loop 1437 - vec.h:740-740 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 7 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 1443 - vec.h:677-677 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 1440 - vec.h:386-387 - libggml-cpu.so | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 1438 - vec.h:386-387 - libggml-cpu.so | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 1442 - vec.h:687-688 - libggml-cpu.so | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 1435 - vec.h:750-751 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 1433 - vec.h:491-491 - libggml-cpu.so [...] | | 0.33 | 0.04 | 0.04 | 0.22 | 0.22 | 0.02 | 0.02 | 33 | 0.07 | 0.04 | | 1583.82 | |
| ○Loop 1439 - vec.h:375-375 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 1444 - ops.cpp:8817-8819 - libggml-cpu.so [...] | | 0.05 | 0.00 | 0.00 | 0.03 | 0.03 | 0.00 | 0.00 | 36 | 0.01 | 0.01 | | 2179.32 | |
| ○Loop 1434 - vec.h:750-751 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 1441 - vec.h:375-375 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 1431 - vec.h:502-503 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ►Loop 1447 - ops.cpp:8778-8920 - libggml-cpu.so [...]+ | | 0.03 | 0.00 | 0.00 | 0.08 | 0.02 | 0.00 | 0.00 | 7 | 0.01 | 0.01 | | 127.06 | |
| ►Loop 1445 - ops.cpp:8778-8920 - libggml-cpu.so [...]+ | | 0.02 | 0.00 | 0.00 | 0.06 | 0.01 | 0.00 | 0.00 | 5 | 0.01 | 0.01 | | 31.91 | |
| ○Loop 1448 - vec.h:687-688 - libggml-cpu.so | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 1449 - vec.h:677-677 - libggml-cpu.so [...] | | 0.03 | 0.00 | 0.00 | 0.02 | 0.02 | 0.00 | 0.00 | 5 | 0.01 | 0.01 | | 13.68 | |
| ○Loop 1451 - vec.h:677-677 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 1450 - vec.h:687-688 - libggml-cpu.so | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 1446 - ops.cpp:8885-8886 - libggml-cpu.so [...] | | 0.05 | 0.00 | 0.00 | 0.03 | 0.03 | 0.00 | 0.00 | 35 | 0.02 | 0.01 | | 202.68 | |
| ○Loop 1429 - vec.h:502-503 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 1432 - vec.h:502-502 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ►ggml_vec_dot_f16+ | libggml-cpu.so | 0.32 | 0.04 | 0.00 | 0.21 | 0.05 | 0.03 | 0.00 | 33 | 0.07 | 0.04 | /beegfs/hackathon/users/eoseret/qaas_runs_test/175-950-2189/intel/llama.cpp/build/llama.cpp/../gcc/bin/libggml-blas.so (%): 100.00 | 1081.54 | GNU C++17 14.2.0 -march=znver5 -mmmx -mpopcnt -msse -msse2 -msse3 -mssse3 -msse4.1 -msse4.2 -mavx -mavx2 -msse4a -mno-fma4 -mno-xop -mfma -mavx512f -mbmi -mbmi2 -maes -mpclmul -mavx512vl -mavx512bw -mavx512dq -mavx512cd -mavx512vbmi -mavx512ifma -mavx512vp... |
| ○Loop 722 - vec.cpp:311-311 - libggml-cpu.so [...] | | 0.30 | 0.04 | 0.04 | 0.20 | 0.20 | 0.02 | 0.02 | 33 | 0.07 | 0.04 | | 990.43 | |
| ○Loop 721 - vec.cpp:324-325 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ►ggml_compute_forward_rope_f32(ggml_compute_params const*, ggml_tensor*, bool)+ | libggml-cpu.so | 0.12 | 0.04 | 0.01 | 0.08 | 0.03 | 0.02 | 0.00 | 192 | 0.03 | 0.02 | /beegfs/hackathon/users/eoseret/qaas_runs_test/175-950-2189/intel/llama.cpp/build/llama.cpp/../gcc/bin/libggml-blas.so (%): 100.00 | 171.98 | GNU C++17 14.2.0 -march=znver5 -mmmx -mpopcnt -msse -msse2 -msse3 -mssse3 -msse4.1 -msse4.2 -mavx -mavx2 -msse4a -mno-fma4 -mno-xop -mfma -mavx512f -mbmi -mbmi2 -maes -mpclmul -mavx512vl -mavx512bw -mavx512dq -mavx512cd -mavx512vbmi -mavx512ifma -mavx512vp... |
| ►Loop 748 - ops.cpp:6210-6484 - libggml-cpu.so [...]+ | | 0.02 | 0.03 | 0.00 | 0.15 | 0.01 | 0.02 | 0.00 | 8 | 0.01 | 0.01 | | 27.52 | |
| ►Loop 747 - ops.cpp:6210-6484 - libggml-cpu.so [...]+ | | 0.02 | 0.03 | 0.00 | 0.14 | 0.01 | 0.02 | 0.00 | 98 | 0.01 | 0.00 | | 375.24 | |
| ►Loop 749 - ops.cpp:6238-6484 - libggml-cpu.so [...]+ | | 0.03 | 0.00 | 0.00 | 0.06 | 0.02 | 0.00 | 0.00 | 167 | 0.01 | 0.01 | | 509.56 | |
| ○Loop 753 - ops.cpp:6446-6456 - libggml-cpu.so [...] | | 0.06 | 0.00 | 0.00 | 0.04 | 0.04 | 0.00 | 0.00 | 21 | 0.02 | 0.01 | | 142.04 | |
| ○Loop 755 - ops.cpp:6413-6426 - libggml-cpu.so | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 752 - ops.cpp:6446-6456 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 751 - ops.cpp:6479-6484 - libggml-cpu.so | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 750 - ops.cpp:6479-6484 - libggml-cpu.so | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 754 - ops.cpp:6462-6475 - libggml-cpu.so | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 756 - ops.cpp:6429-6442 - libggml-cpu.so | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 757 - ops.cpp:6210-6245 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 758 - ops.cpp:6220-6245 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 759 - ops.cpp:6210-6245 - libggml-cpu.so [...] | | 0.11 | 0.03 | 0.03 | 0.07 | 0.07 | 0.02 | 0.02 | 192 | 0.02 | 0.01 | | 163.90 | |
| ○Loop 760 - ops.cpp:6368-6372 - libggml-cpu.so | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ►quantize_row_q8_0+ | libggml-cpu.so | 0.14 | 0.03 | 0.00 | 0.09 | 0.02 | 0.02 | 0.00 | 144 | 0.02 | 0.01 | /beegfs/hackathon/users/eoseret/qaas_runs_test/175-950-2189/intel/llama.cpp/build/llama.cpp/../gcc/bin/libggml-blas.so (%): 100.00 | 0.42 | GNU C11 14.2.0 -march=znver5 -mmmx -mpopcnt -msse -msse2 -msse3 -mssse3 -msse4.1 -msse4.2 -mavx -mavx2 -msse4a -mno-fma4 -mno-xop -mfma -mavx512f -mbmi -mbmi2 -maes -mpclmul -mavx512vl -mavx512bw -mavx512dq -mavx512cd -mavx512vbmi -mavx512ifma -mavx512vpop... |
| ○Loop 1982 - quants.c:298-321 - libggml-cpu.so [...] | | 0.11 | 0.03 | 0.03 | 0.07 | 0.07 | 0.02 | 0.02 | 139 | 0.02 | 0.01 | | 0.46 | |
| ○ggml_barrier | libggml-cpu.so | 0.11 | 0.03 | 0.03 | 0.07 | 0.07 | 0.02 | 0.02 | 157 | 0.03 | 0.02 | /beegfs/hackathon/users/eoseret/qaas_runs_test/175-950-2189/intel/llama.cpp/build/llama.cpp/../gcc/bin/libggml-blas.so (%): 100.00 | 24.82 | GNU C11 14.2.0 -march=znver5 -mmmx -mpopcnt -msse -msse2 -msse3 -mssse3 -msse4.1 -msse4.2 -mavx -mavx2 -msse4a -mno-fma4 -mno-xop -mfma -mavx512f -mbmi -mbmi2 -maes -mpclmul -mavx512vl -mavx512bw -mavx512dq -mavx512cd -mavx512vbmi -mavx512ifma -mavx512vpop... |
| ○f64xsubf128 | libm.so.6 | 0.11 | 0.02 | 0.02 | 0.07 | 0.07 | 0.01 | 0.01 | 192 | 0.02 | 0.01 | Math (%): 100.00 | 1131.77 | |
| ○__memcpy_avx512_unaligned_erms | libc.so.6 | 0.09 | 0.02 | 0.02 | 0.06 | 0.06 | 0.01 | 0.01 | 170 | 0.02 | 0.01 | Memory (%): 100.00 | 95.11 | |
| ►ggml_compute_forward_mul+ | libggml-cpu.so | 0.09 | 0.01 | 0.00 | 0.06 | 0.02 | 0.00 | 0.00 | 48 | 0.01 | 0.01 | /beegfs/hackathon/users/eoseret/qaas_runs_test/175-950-2189/intel/llama.cpp/build/llama.cpp/../gcc/bin/libggml-blas.so (%): 100.00 | 43.81 | GNU C++17 14.2.0 -march=znver5 -mmmx -mpopcnt -msse -msse2 -msse3 -mssse3 -msse4.1 -msse4.2 -mavx -mavx2 -msse4a -mno-fma4 -mno-xop -mfma -mavx512f -mbmi -mbmi2 -maes -mpclmul -mavx512vl -mavx512bw -mavx512dq -mavx512cd -mavx512vbmi -mavx512ifma -mavx512vp... |
| ►Loop 462 - binary-ops.cpp:18-101 - libggml-cpu.so [...]+ | | 0.00 | 0.00 | 0.00 | 0.05 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 467 - binary-ops.cpp:18-45 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ►Loop 464 - binary-ops.cpp:18-101 - libggml-cpu.so [...]+ | | 0.00 | 0.00 | 0.00 | 0.05 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 463 - binary-ops.cpp:18-32 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ►Loop 465 - binary-ops.cpp:18-101 - libggml-cpu.so [...]+ | | 0.00 | 0.00 | 0.00 | 0.05 | 0.00 | 0.00 | 0.00 | 1 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 466 - binary-ops.cpp:18-32 - libggml-cpu.so [...] | | 0.08 | 0.00 | 0.00 | 0.05 | 0.05 | 0.00 | 0.00 | 2 | 0.06 | 0.04 | | 507.44 | |
| ►Loop 431 - binary-ops.cpp:18-101 - libggml-cpu.so [...]+ | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ►Loop 433 - binary-ops.cpp:18-101 - libggml-cpu.so [...]+ | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 432 - binary-ops.cpp:18-31 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ►Loop 434 - binary-ops.cpp:18-101 - libggml-cpu.so [...]+ | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 435 - binary-ops.cpp:18-31 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 436 - binary-ops.cpp:18-32 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 437 - binary-ops.cpp:18-44 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ►Loop 456 - binary-ops.cpp:18-101 - libggml-cpu.so [...]+ | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ►Loop 459 - binary-ops.cpp:18-101 - libggml-cpu.so [...]+ | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 460 - binary-ops.cpp:18-101 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 461 - binary-ops.cpp:18-45 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ►Loop 458 - binary-ops.cpp:18-101 - libggml-cpu.so [...]+ | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 457 - binary-ops.cpp:18-32 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ►Loop 442 - binary-ops.cpp:18-101 - libggml-cpu.so [...]+ | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ►Loop 444 - binary-ops.cpp:18-101 - libggml-cpu.so [...]+ | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ►Loop 445 - binary-ops.cpp:18-101 - libggml-cpu.so [...]+ | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 447 - binary-ops.cpp:18-32 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 446 - binary-ops.cpp:31-31 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 443 - binary-ops.cpp:31-31 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 448 - binary-ops.cpp:42-44 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ►Loop 449 - binary-ops.cpp:18-101 - libggml-cpu.so [...]+ | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ►Loop 451 - binary-ops.cpp:18-101 - libggml-cpu.so [...]+ | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 450 - binary-ops.cpp:31-31 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ►Loop 452 - binary-ops.cpp:18-101 - libggml-cpu.so [...]+ | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 454 - binary-ops.cpp:18-32 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 453 - binary-ops.cpp:31-31 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 455 - binary-ops.cpp:42-44 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ►Loop 438 - binary-ops.cpp:18-101 - libggml-cpu.so [...]+ | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ►Loop 440 - binary-ops.cpp:18-101 - libggml-cpu.so [...]+ | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 439 - binary-ops.cpp:18-32 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 441 - binary-ops.cpp:18-45 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ►Loop 424 - binary-ops.cpp:18-101 - libggml-cpu.so [...]+ | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 430 - binary-ops.cpp:18-44 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ►Loop 426 - binary-ops.cpp:18-101 - libggml-cpu.so [...]+ | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 425 - binary-ops.cpp:18-31 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ►Loop 427 - binary-ops.cpp:18-101 - libggml-cpu.so [...]+ | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 428 - binary-ops.cpp:18-31 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 429 - binary-ops.cpp:18-32 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ○Loop 423 - binary-ops.cpp:126-139 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
| ►ggml_vec_swiglu_f32+ | libggml-cpu.so | 0.26 | 0.00 | 0.00 | 0.17 | 0.00 | 0.00 | 0.00 | 7 | 0.11 | 0.06 | /beegfs/hackathon/users/eoseret/qaas_runs_test/175-950-2189/intel/llama.cpp/build/llama.cpp/../gcc/bin/libggml-blas.so (%): 100.00 | 5292.44 | GNU C++17 14.2.0 -march=znver5 -mmmx -mpopcnt -msse -msse2 -msse3 -mssse3 -msse4.1 -msse4.2 -mavx -mavx2 -msse4a -mno-fma4 -mno-xop -mfma -mavx512f -mbmi -mbmi2 -maes -mpclmul -mavx512vl -mavx512bw -mavx512dq -mavx512cd -mavx512vbmi -mavx512ifma -mavx512vp... |
| ○Loop 726 - vec.cpp:372-372 - libggml-cpu.so [...] | | 0.26 | 0.00 | 0.00 | 0.17 | 0.17 | 0.00 | 0.00 | 7 | 0.11 | 0.06 | | 5257.86 | |
| ○Loop 725 - vec.cpp:402-403 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | 0.00 | |
