| Name | Module | Max Thread Time / Walltime run_0 (%) | Coverage run_0 (%) | Coverage Excluding Loops run_0 (%) | Max Inclusive Time Over Threads run_0 (s) | Max Exclusive Time Over Threads run_0 (s) | Inclusive Time w.r.t. Wall Time run_0 (s) | Exclusive Time w.r.t. Wall Time run_0 (s) | Nb Threads run_0 | Deviation (coverage) run_0 | Deviation (walltime) run_0 | Categories run_0 | Compilation Options |
|---|
| ►ggml_vec_dot_q8_0_q8_0+ | libggml-cpu.so | 87.31 | 84.95 | 0.17 | 94.92 | 0.29 | 91.06 | 0.18 | 52 | 3.21 | 3.52 | libggml-cpu.so (%): 100.00 | clang based Intel(R) oneAPI DPC++/C++ Compiler 2024.0.0 (2024.0.0.20231017) |
| ○Loop 2498 - quants.c:1066-1073 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 2499 - quants.c:101-1042 - libggml-cpu.so [...] | | 87.17 | 84.78 | 84.78 | 94.78 | 94.78 | 90.88 | 90.88 | 52 | 3.23 | 3.54 | | |
| ○bool _INTERNAL021345c1::__kmp_wait_template<kmp_flag_64<false, true>, true, false, true>(kmp_info*, kmp_flag_64<false, true>*, void*) | libiomp5.so | 26.70 | 11.34 | 11.34 | 29.03 | 29.03 | 12.15 | 12.15 | 51 | 4.30 | 4.57 | OMP (%): 100.00 | |
| ○_INTERNAL021345c1::__kmp_hyper_barrier_gather(barrier_type, kmp_info*, int, int, void (*)(void*, void*), void*) | libiomp5.so | 7.67 | 1.23 | 1.23 | 8.34 | 8.34 | 1.31 | 1.31 | 52 | 2.14 | 2.29 | OMP (%): 100.00 | |
| ►ggml_compute_forward_flash_attn_ext+ | libggml-cpu.so | 1.03 | 0.51 | 0.00 | 1.12 | 0.02 | 0.54 | 0.00 | 43 | 0.37 | 0.40 | libggml-cpu.so (%): 100.00 | clang based Intel(R) oneAPI DPC++/C++ Compiler 2024.0.0 (2024.0.0.20231017) |
| ►Loop 1754 - ops.cpp:8759-8927 - libggml-cpu.so [...]+ | | 0.01 | 0.50 | 0.00 | 1.23 | 0.02 | 0.54 | 0.00 | 13 | 0.00 | 0.00 | | |
| ○Loop 1755 - vec.h:687-688 - libggml-cpu.so | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ►Loop 1761 - vec.h:375-751 - libggml-cpu.so [...]+ | | 0.18 | 0.49 | 0.08 | 1.12 | 0.19 | 0.52 | 0.08 | 33 | 0.03 | 0.04 | | |
| ○Loop 1764 - vec.h:386-387 - libggml-cpu.so | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 1767 - vec.h:677-682 - libggml-cpu.so | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 1769 - vec.h:502-503 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 1771 - vec.h:740-745 - libggml-cpu.so | | 0.00 | 0.00 | 0.00 | 0.01 | 0.01 | 0.00 | 0.00 | 4 | 0.00 | 0.00 | | |
| ○Loop 1762 - vec.h:386-387 - libggml-cpu.so | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 1768 - vec.h:491-497 - libggml-cpu.so | | 0.85 | 0.41 | 0.41 | 0.92 | 0.92 | 0.44 | 0.44 | 37 | 0.25 | 0.26 | | |
| ○Loop 1765 - vec.h:375-381 - libggml-cpu.so | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 1766 - vec.h:687-688 - libggml-cpu.so | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 1770 - vec.h:750-751 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 1763 - vec.h:375-381 - libggml-cpu.so | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 1759 - ops.cpp:8885-8886 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 1760 - ops.cpp:8885-8886 - libggml-cpu.so [...] | | 0.05 | 0.01 | 0.01 | 0.05 | 0.05 | 0.01 | 0.01 | 31 | 0.01 | 0.01 | | |
| ○Loop 1756 - vec.h:677-682 - libggml-cpu.so | | 0.04 | 0.00 | 0.00 | 0.04 | 0.04 | 0.00 | 0.00 | 10 | 0.01 | 0.01 | | |
| ○Loop 1758 - vec.h:677-682 - libggml-cpu.so | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 1757 - vec.h:687-688 - libggml-cpu.so | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ►ggml_vec_dot_f16+ | libggml-cpu.so | 0.83 | 0.40 | 0.09 | 0.90 | 0.23 | 0.43 | 0.10 | 34 | 0.18 | 0.19 | libggml-cpu.so (%): 100.00 | clang based Intel(R) oneAPI DPC++/C++ Compiler 2024.0.0 (2024.0.0.20231017) |
| ○Loop 766 - vec.cpp:324-325 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 765 - vec.cpp:324-325 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 767 - vec.cpp:311-316 - libggml-cpu.so | | 0.73 | 0.31 | 0.31 | 0.79 | 0.79 | 0.33 | 0.33 | 34 | 0.14 | 0.15 | | |
| ○kmp_flag_native<unsigned long long, (flag_type)1, true>::notdone_check() | libiomp5.so | 0.58 | 0.35 | 0.35 | 0.63 | 0.63 | 0.38 | 0.38 | 52 | 0.09 | 0.10 | OMP (%): 100.00 | |
| ►ggml_compute_forward_mul_mat+ | libggml-cpu.so | 0.39 | 0.24 | 0.03 | 0.42 | 0.08 | 0.26 | 0.03 | 52 | 0.07 | 0.08 | libggml-cpu.so (%): 100.00 | clang based Intel(R) oneAPI DPC++/C++ Compiler 2024.0.0 (2024.0.0.20231017) |
| ►Loop 61 - ggml-cpu.c:1125-1395 - libggml-cpu.so [...]+ | | 0.16 | 0.19 | 0.08 | 0.43 | 0.17 | 0.21 | 0.09 | 52 | 0.04 | 0.04 | | |
| ►Loop 62 - ggml-cpu.c:1162-1198 - libggml-cpu.so [...]+ | | 0.02 | 0.11 | 0.00 | 0.26 | 0.02 | 0.12 | 0.00 | 31 | 0.00 | 0.00 | | |
| ►Loop 63 - ggml-cpu.c:1163-1198 - libggml-cpu.so [...]+ | | 0.01 | 0.11 | 0.00 | 0.24 | 0.01 | 0.12 | 0.00 | 25 | 0.00 | 0.00 | | |
| ►Loop 64 - ggml-cpu.c:1164-1198 - libggml-cpu.so [...]+ | | 0.09 | 0.11 | 0.05 | 0.22 | 0.10 | 0.11 | 0.05 | 52 | 0.02 | 0.02 | | |
| ○Loop 67 - ggml-cpu.c:1193-1194 - libggml-cpu.so | | 0.09 | 0.05 | 0.05 | 0.10 | 0.10 | 0.06 | 0.06 | 52 | 0.02 | 0.02 | | |
| ○Loop 65 - ggml-cpu.c:1197-1198 - libggml-cpu.so | | 0.02 | 0.01 | 0.01 | 0.03 | 0.03 | 0.01 | 0.01 | 42 | 0.00 | 0.00 | | |
| ○Loop 66 - ggml-cpu.c:1197-1198 - libggml-cpu.so | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ►Loop 69 - ggml-cpu.c:1316-1328 - libggml-cpu.so+ | | 0.00 | 0.00 | 0.00 | 0.02 | 0.00 | 0.00 | 0.00 | 2 | 0.00 | 0.00 | | |
| ○Loop 68 - ggml-cpu.c:1317-1328 - libggml-cpu.so | | 0.01 | 0.00 | 0.00 | 0.01 | 0.01 | 0.00 | 0.00 | 23 | 0.00 | 0.00 | | |
| ►Loop 70 - ggml-cpu.c:1289-1295 - libggml-cpu.so+ | | 0.00 | 0.01 | 0.00 | 0.03 | 0.01 | 0.01 | 0.00 | 4 | 0.00 | 0.00 | | |
| ►Loop 71 - ggml-cpu.c:1290-1295 - libggml-cpu.so+ | | 0.01 | 0.01 | 0.00 | 0.03 | 0.01 | 0.01 | 0.00 | 6 | 0.00 | 0.00 | | |
| ○Loop 72 - ggml-cpu.c:1291-1295 - libggml-cpu.so | | 0.02 | 0.00 | 0.00 | 0.02 | 0.02 | 0.00 | 0.00 | 33 | 0.00 | 0.00 | | |
| ○Loop 73 - ggml-cpu.c:1291-1295 - libggml-cpu.so | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ►Loop 75 - ggml-cpu.c:1248-1260 - libggml-cpu.so+ | | 0.00 | 0.01 | 0.00 | 0.03 | 0.00 | 0.01 | 0.00 | 1 | 0.00 | 0.00 | | |
| ○Loop 74 - ggml-cpu.c:1249-1260 - libggml-cpu.so | | 0.03 | 0.01 | 0.01 | 0.03 | 0.03 | 0.01 | 0.01 | 44 | 0.00 | 0.01 | | |
| ○_INTERNAL021345c1::__kmp_hyper_barrier_release(barrier_type, kmp_info*, int, int, int, void*) | libiomp5.so | 1.53 | 0.16 | 0.16 | 1.66 | 1.66 | 0.17 | 0.17 | 52 | 0.29 | 0.31 | OMP (%): 100.00 | |
| ○__sched_yield | libc.so.6 | 0.31 | 0.10 | 0.10 | 0.33 | 0.33 | 0.11 | 0.11 | 52 | 0.05 | 0.06 | System (%): 100.00 | |
| ►void (anonymous namespace)::tinyBLAS_Q0_AVX<block_q8_0, block_q8_0, float>::gemm4xN<4>(long, long, long, long)+ | libggml-cpu.so | 0.16 | 0.10 | 0.00 | 0.17 | 0.00 | 0.11 | 0.00 | 52 | 0.04 | 0.04 | libggml-cpu.so (%): 100.00 | clang based Intel(R) oneAPI DPC++/C++ Compiler 2024.0.0 (2024.0.0.20231017) |
| ○Loop 2293 - sgemm.cpp:814-853 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ►Loop 2295 - sgemm.cpp:138-1044 - libggml-cpu.so [...]+ | | 0.00 | 0.10 | 0.00 | 0.18 | 0.00 | 0.11 | 0.00 | 3 | 0.00 | 0.00 | | |
| ○Loop 2294 - sgemm.cpp:138-1044 - libggml-cpu.so [...] | | 0.16 | 0.10 | 0.10 | 0.17 | 0.17 | 0.11 | 0.11 | 52 | 0.04 | 0.04 | | |
| ►quantize_row_q8_0+ | libggml-cpu.so | 0.16 | 0.08 | 0.00 | 0.17 | 0.01 | 0.09 | 0.00 | 52 | 0.03 | 0.03 | libggml-cpu.so (%): 100.00 | clang based Intel(R) oneAPI DPC++/C++ Compiler 2024.0.0 (2024.0.0.20231017) |
| ○Loop 2489 - quants.c:298-355 - libggml-cpu.so [...] | | 0.15 | 0.08 | 0.08 | 0.16 | 0.16 | 0.08 | 0.08 | 52 | 0.03 | 0.03 | | |
| ►void (anonymous namespace)::tinyBLAS_Q0_AVX<block_q8_0, block_q8_0, float>::gemm4xN<2>(long, long, long, long)+ | libggml-cpu.so | 0.11 | 0.07 | 0.00 | 0.12 | 0.00 | 0.07 | 0.00 | 52 | 0.02 | 0.02 | libggml-cpu.so (%): 100.00 | clang based Intel(R) oneAPI DPC++/C++ Compiler 2024.0.0 (2024.0.0.20231017) |
| ○Loop 2305 - sgemm.cpp:814-853 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ►Loop 2307 - sgemm.cpp:138-1044 - libggml-cpu.so [...]+ | | 0.00 | 0.07 | 0.00 | 0.12 | 0.00 | 0.07 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 2306 - sgemm.cpp:138-1044 - libggml-cpu.so [...] | | 0.11 | 0.07 | 0.07 | 0.12 | 0.12 | 0.07 | 0.07 | 52 | 0.02 | 0.02 | | |
| ○__libm_expf_l9 | llama-cli | 0.17 | 0.07 | 0.07 | 0.18 | 0.18 | 0.07 | 0.07 | 33 | 0.03 | 0.03 | Math (%): 100.00 | |
| ○kmp_flag_native<unsigned long long, (flag_type)1, true>::done_check() | libiomp5.so | 0.46 | 0.05 | 0.05 | 0.50 | 0.50 | 0.06 | 0.06 | 41 | 0.10 | 0.11 | OMP (%): 100.00 | |
| ○__libm_sincosf_e7 | llama-cli | 0.10 | 0.04 | 0.04 | 0.11 | 0.11 | 0.04 | 0.04 | 52 | 0.02 | 0.02 | Exe (%): 100.00 | |
| ►ggml_compute_forward_rope_f32(ggml_compute_params const*, ggml_tensor*, bool)+ | libggml-cpu.so | 0.10 | 0.04 | 0.00 | 0.11 | 0.02 | 0.04 | 0.00 | 51 | 0.02 | 0.02 | libggml-cpu.so (%): 100.00 | clang based Intel(R) oneAPI DPC++/C++ Compiler 2024.0.0 (2024.0.0.20231017) |
| ►Loop 1409 - ops.cpp:6210-6484 - libggml-cpu.so [...]+ | | 0.00 | 0.03 | 0.00 | 0.14 | 0.00 | 0.03 | 0.00 | 2 | 0.00 | 0.00 | | |
| ►Loop 1410 - ops.cpp:6210-6484 - libggml-cpu.so [...]+ | | 0.02 | 0.03 | 0.00 | 0.14 | 0.02 | 0.03 | 0.00 | 24 | 0.00 | 0.00 | | |
| ○Loop 1437 - ops.cpp:6220-6245 - libggml-cpu.so [...] | | 0.04 | 0.01 | 0.01 | 0.04 | 0.04 | 0.02 | 0.02 | 48 | 0.01 | 0.01 | | |
| ○Loop 1426 - ops.cpp:6210-6303 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 1418 - ops.cpp:6220-6303 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 1431 - ops.cpp:6220-6245 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 1434 - ops.cpp:6210-6245 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 1427 - ops.cpp:6210-6303 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 1428 - ops.cpp:6220-6303 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 1422 - ops.cpp:6220-6303 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 1421 - ops.cpp:6210-6303 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 1438 - ops.cpp:6210-6245 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 1435 - ops.cpp:6210-6245 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 1424 - ops.cpp:6210-6303 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 1423 - ops.cpp:6210-6303 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 1439 - ops.cpp:6210-6245 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 1425 - ops.cpp:6220-6303 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ►Loop 1411 - ops.cpp:6365-6484 - libggml-cpu.so [...]+ | | 0.03 | 0.01 | 0.01 | 0.07 | 0.04 | 0.01 | 0.01 | 31 | 0.01 | 0.01 | | |
| ○Loop 1416 - ops.cpp:6413-6426 - libggml-cpu.so | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 1412 - ops.cpp:6462-6475 - libggml-cpu.so | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 1414 - ops.cpp:6479-6484 - libggml-cpu.so | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 1417 - ops.cpp:6429-6442 - libggml-cpu.so | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 1415 - ops.cpp:6446-6457 - libggml-cpu.so | | 0.04 | 0.01 | 0.01 | 0.04 | 0.04 | 0.01 | 0.01 | 25 | 0.01 | 0.01 | | |
| ○Loop 1413 - ops.cpp:6479-6484 - libggml-cpu.so | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 1432 - ops.cpp:6220-6245 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 1436 - ops.cpp:6220-6245 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 1429 - ops.cpp:6210-6303 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 1420 - ops.cpp:6210-6303 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 1433 - ops.cpp:6210-6245 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 1419 - ops.cpp:6220-6303 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 1430 - ops.cpp:6210-6303 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ►ggml_graph_compute_thread+ | libggml-cpu.so | 0.06 | 0.03 | 0.01 | 0.06 | 0.03 | 0.04 | 0.01 | 52 | 0.01 | 0.02 | libggml-cpu.so (%): 100.00 | clang based Intel(R) oneAPI DPC++/C++ Compiler 2024.0.0 (2024.0.0.20231017) |
| ○Loop 84 - ggml-cpu.c:2087-2088 - libggml-cpu.so | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 82 - ggml-cpu.c:533-2891 - libggml-cpu.so [...] | | 0.06 | 0.03 | 0.03 | 0.06 | 0.06 | 0.03 | 0.03 | 52 | 0.01 | 0.02 | | |
| ○Loop 83 - ggml-cpu.c:2087-2088 - libggml-cpu.so | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○__kmp_barrier | libiomp5.so | 0.07 | 0.03 | 0.03 | 0.08 | 0.08 | 0.04 | 0.04 | 52 | 0.01 | 0.02 | OMP (%): 100.00 | |
| ►void (anonymous namespace)::tinyBLAS_Q0_AVX<block_q8_0, block_q8_0, float>::gemm4xN<3>(long, long, long, long)+ | libggml-cpu.so | 0.08 | 0.02 | 0.00 | 0.09 | 0.00 | 0.02 | 0.00 | 52 | 0.02 | 0.02 | libggml-cpu.so (%): 100.00 | clang based Intel(R) oneAPI DPC++/C++ Compiler 2024.0.0 (2024.0.0.20231017) |
| ►Loop 2298 - sgemm.cpp:138-1044 - libggml-cpu.so [...]+ | | 0.00 | 0.02 | 0.00 | 0.09 | 0.00 | 0.02 | 0.00 | 1 | 0.00 | 0.00 | | |
| ○Loop 2297 - sgemm.cpp:138-1044 - libggml-cpu.so [...] | | 0.08 | 0.02 | 0.02 | 0.09 | 0.09 | 0.02 | 0.02 | 52 | 0.02 | 0.02 | | |
| ○Loop 2296 - sgemm.cpp:814-853 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ►__intel_avx_rep_memcpy+ | llama-cli | 0.09 | 0.02 | 0.02 | 0.10 | 0.10 | 0.02 | 0.02 | 47 | 0.02 | 0.02 | Memory (%): 100.00 | |
| ○Loop 3159 - - llama-cli | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 3160 - - llama-cli | | 0.00 | 0.00 | 0.00 | 0.01 | 0.01 | 0.00 | 0.00 | 4 | 0.00 | 0.00 | | |
| ○_intel_fast_memcpy | llama-cli | 0.05 | 0.01 | 0.01 | 0.05 | 0.05 | 0.02 | 0.02 | 44 | 0.01 | 0.01 | Memory (%): 100.00 | |
| ►ggml_compute_forward_rms_norm+ | libggml-cpu.so | 0.51 | 0.01 | 0.00 | 0.56 | 0.01 | 0.01 | 0.00 | 17 | 0.12 | 0.13 | libggml-cpu.so (%): 100.00 | clang based Intel(R) oneAPI DPC++/C++ Compiler 2024.0.0 (2024.0.0.20231017) |
| ►Loop 1175 - ops.cpp:4319-4355 - libggml-cpu.so [...]+ | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ►Loop 1176 - ops.cpp:4320-4355 - libggml-cpu.so [...]+ | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ►Loop 1177 - ops.cpp:4321-4355 - libggml-cpu.so [...]+ | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 1178 - vec.h:687-688 - libggml-cpu.so | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 1179 - vec.h:677-682 - libggml-cpu.so | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ►Loop 1159 - ops.cpp:4319-4355 - libggml-cpu.so [...]+ | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ►Loop 1160 - ops.cpp:4320-4355 - libggml-cpu.so [...]+ | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ►Loop 1161 - ops.cpp:4321-4355 - libggml-cpu.so [...]+ | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 1162 - vec.h:687-688 - libggml-cpu.so | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 1163 - ops.cpp:4325-4326 - libggml-cpu.so | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 1164 - ops.cpp:4325-4326 - libggml-cpu.so | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ►Loop 1169 - ops.cpp:4319-4338 - libggml-cpu.so [...]+ | | 0.00 | 0.01 | 0.00 | 0.55 | 0.00 | 0.01 | 0.00 | 0 | 0.00 | 0.00 | | |
| ►Loop 1170 - ops.cpp:4320-4338 - libggml-cpu.so [...]+ | | 0.00 | 0.01 | 0.00 | 0.55 | 0.00 | 0.01 | 0.00 | 1 | 0.00 | 0.00 | | |
| ►Loop 1171 - vec.h:673-682 - libggml-cpu.so [...]+ | | 0.00 | 0.01 | 0.00 | 0.55 | 0.00 | 0.01 | 0.00 | 1 | 0.00 | 0.00 | | |
| ○Loop 1172 - vec.h:677-682 - libggml-cpu.so | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 0.00 | 0.00 | | |
| ○Loop 1173 - ops.cpp:4325-4326 - libggml-cpu.so | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 1174 - ops.cpp:4325-4326 - libggml-cpu.so | | 0.49 | 0.01 | 0.01 | 0.54 | 0.54 | 0.01 | 0.01 | 2 | 0.35 | 0.37 | | |
| ►Loop 1165 - ops.cpp:4319-4333 - libggml-cpu.so [...]+ | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ►Loop 1166 - ops.cpp:4320-4333 - libggml-cpu.so [...]+ | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ►Loop 1167 - vec.h:677-682 - libggml-cpu.so [...]+ | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 1168 - vec.h:677-682 - libggml-cpu.so | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ►Loop 1148 - ops.cpp:4319-4333 - libggml-cpu.so [...]+ | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 1149 - ops.cpp:4321-4333 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ►Loop 1147 - ops.cpp:4320-4333 - libggml-cpu.so [...]+ | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 1145 - ops.cpp:4320-4333 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 1146 - ops.cpp:4321-4333 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ►Loop 1180 - ops.cpp:4319-4355 - libggml-cpu.so [...]+ | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ►Loop 1181 - ops.cpp:4320-4355 - libggml-cpu.so [...]+ | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ►Loop 1182 - ops.cpp:4321-4355 - libggml-cpu.so [...]+ | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 1184 - vec.h:677-682 - libggml-cpu.so | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 1186 - ops.cpp:4325-4326 - libggml-cpu.so | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 1185 - ops.cpp:4325-4326 - libggml-cpu.so | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 1183 - vec.h:687-688 - libggml-cpu.so | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ►Loop 1153 - ops.cpp:4319-4333 - libggml-cpu.so [...]+ | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ►Loop 1152 - ops.cpp:4320-4333 - libggml-cpu.so [...]+ | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 1150 - ops.cpp:4320-4333 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 1151 - ops.cpp:4321-4333 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 1154 - ops.cpp:4321-4333 - libggml-cpu.so [...] | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ►Loop 1155 - ops.cpp:4319-4355 - libggml-cpu.so [...]+ | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ►Loop 1156 - ops.cpp:4320-4355 - libggml-cpu.so [...]+ | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ►Loop 1157 - ops.cpp:4321-4355 - libggml-cpu.so [...]+ | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
| ○Loop 1158 - vec.h:687-688 - libggml-cpu.so | | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 0.00 | 0.00 | | |
