OV - - Functions and Loops

Name	Module	Max Thread Time / Walltime run_0 (%)	Coverage run_0 (%)	Coverage Excluding Loops run_0 (%)	Max Inclusive Time Over Threads run_0 (s)	Max Exclusive Time Over Threads run_0 (s)	Inclusive Time w.r.t. Wall Time run_0 (s)	Exclusive Time w.r.t. Wall Time run_0 (s)	Nb Threads run_0	Deviation (coverage) run_0	Deviation (walltime) run_0	Categories run_0	Compilation Options
►ggml_vec_dot_q8_0_q8_0+	libggml-cpu.so	88.12	84.68	0.18	96.82	0.28	91.90	0.19	52	3.38	3.78	libggml-cpu.so (%): 100.00	clang based Intel(R) oneAPI DPC++/C++ Compiler 2024.0.0 (2024.0.0.20231017)
○Loop 2498 - quants.c:1066-1073 - libggml-cpu.so [...]		0.00	0.00	0.00	0.00	0.00	0.00	0.00	0	0.00	0.00
○Loop 2499 - quants.c:101-1042 - libggml-cpu.so [...]		87.98	84.50	84.50	96.67	96.67	91.71	91.71	52	3.39	3.79
○bool _INTERNAL021345c1::__kmp_wait_template<kmp_flag_64<false, true>, true, false, true>(kmp_info, kmp_flag_64<false, true>, void*)	libiomp5.so	24.98	11.61	11.61	27.44	27.44	12.60	12.60	51	4.22	4.54	OMP (%): 100.00
○_INTERNAL021345c1::__kmp_hyper_barrier_gather(barrier_type, kmp_info, int, int, void ()(void, void), void*)	libiomp5.so	11.54	1.28	1.28	12.68	12.68	1.39	1.39	52	2.72	2.95	OMP (%): 100.00
►ggml_compute_forward_flash_attn_ext+	libggml-cpu.so	0.93	0.46	0.00	1.02	0.01	0.50	0.00	45	0.35	0.38	libggml-cpu.so (%): 100.00	clang based Intel(R) oneAPI DPC++/C++ Compiler 2024.0.0 (2024.0.0.20231017)
►Loop 1754 - ops.cpp:8759-8927 - libggml-cpu.so [...]+		0.01	0.46	0.00	1.13	0.01	0.50	0.00	16	0.00	0.00
○Loop 1755 - vec.h:687-688 - libggml-cpu.so		0.00	0.00	0.00	0.00	0.00	0.00	0.00	0	0.00	0.00
►Loop 1761 - vec.h:375-751 - libggml-cpu.so [...]+		0.15	0.44	0.07	1.05	0.17	0.48	0.07	35	0.04	0.04
○Loop 1764 - vec.h:386-387 - libggml-cpu.so		0.00	0.00	0.00	0.00	0.00	0.00	0.00	0	0.00	0.00
○Loop 1767 - vec.h:677-682 - libggml-cpu.so		0.00	0.00	0.00	0.00	0.00	0.00	0.00	0	0.00	0.00
○Loop 1769 - vec.h:502-503 - libggml-cpu.so [...]		0.00	0.00	0.00	0.00	0.00	0.00	0.00	0	0.00	0.00
○Loop 1771 - vec.h:740-745 - libggml-cpu.so		0.01	0.00	0.00	0.01	0.01	0.00	0.00	2	0.00	0.00
○Loop 1762 - vec.h:386-387 - libggml-cpu.so		0.00	0.00	0.00	0.00	0.00	0.00	0.00	0	0.00	0.00
○Loop 1768 - vec.h:491-497 - libggml-cpu.so		0.79	0.38	0.38	0.87	0.87	0.41	0.41	37	0.23	0.24
○Loop 1765 - vec.h:375-381 - libggml-cpu.so		0.00	0.00	0.00	0.00	0.00	0.00	0.00	0	0.00	0.00
○Loop 1766 - vec.h:687-688 - libggml-cpu.so		0.00	0.00	0.00	0.00	0.00	0.00	0.00	0	0.00	0.00
○Loop 1770 - vec.h:750-751 - libggml-cpu.so [...]		0.00	0.00	0.00	0.00	0.00	0.00	0.00	0	0.00	0.00
○Loop 1763 - vec.h:375-381 - libggml-cpu.so		0.00	0.00	0.00	0.00	0.00	0.00	0.00	0	0.00	0.00
○Loop 1759 - ops.cpp:8885-8886 - libggml-cpu.so [...]		0.00	0.00	0.00	0.00	0.00	0.00	0.00	0	0.00	0.00
○Loop 1760 - ops.cpp:8885-8886 - libggml-cpu.so [...]		0.05	0.01	0.01	0.05	0.05	0.01	0.01	31	0.01	0.01
○Loop 1756 - vec.h:677-682 - libggml-cpu.so		0.01	0.00	0.00	0.01	0.01	0.00	0.00	15	0.00	0.00
○Loop 1758 - vec.h:677-682 - libggml-cpu.so		0.00	0.00	0.00	0.00	0.00	0.00	0.00	0	0.00	0.00
○Loop 1757 - vec.h:687-688 - libggml-cpu.so		0.00	0.00	0.00	0.00	0.00	0.00	0.00	0	0.00	0.00
►ggml_vec_dot_f16+	libggml-cpu.so	0.75	0.37	0.08	0.82	0.22	0.40	0.09	38	0.23	0.25	libggml-cpu.so (%): 100.00	clang based Intel(R) oneAPI DPC++/C++ Compiler 2024.0.0 (2024.0.0.20231017)
○Loop 766 - vec.cpp:324-325 - libggml-cpu.so [...]		0.00	0.00	0.00	0.00	0.00	0.00	0.00	0	0.00	0.00
○Loop 765 - vec.cpp:324-325 - libggml-cpu.so [...]		0.00	0.00	0.00	0.00	0.00	0.00	0.00	0	0.00	0.00
○Loop 767 - vec.cpp:311-316 - libggml-cpu.so		0.56	0.28	0.28	0.62	0.62	0.31	0.31	38	0.18	0.19
○kmp_flag_native<unsigned long long, (flag_type)1, true>::notdone_check()	libiomp5.so	0.59	0.37	0.37	0.65	0.65	0.40	0.40	52	0.09	0.10	OMP (%): 100.00
►ggml_compute_forward_mul_mat+	libggml-cpu.so	0.35	0.22	0.04	0.38	0.09	0.24	0.04	52	0.06	0.07	libggml-cpu.so (%): 100.00	clang based Intel(R) oneAPI DPC++/C++ Compiler 2024.0.0 (2024.0.0.20231017)
►Loop 61 - ggml-cpu.c:1125-1395 - libggml-cpu.so [...]+		0.12	0.17	0.06	0.41	0.14	0.19	0.07	52	0.02	0.02
►Loop 62 - ggml-cpu.c:1162-1198 - libggml-cpu.so [...]+		0.01	0.11	0.00	0.27	0.01	0.12	0.00	24	0.00	0.00
►Loop 63 - ggml-cpu.c:1163-1198 - libggml-cpu.so [...]+		0.01	0.11	0.00	0.26	0.01	0.12	0.00	20	0.00	0.00
►Loop 64 - ggml-cpu.c:1164-1198 - libggml-cpu.so [...]+		0.10	0.10	0.05	0.24	0.10	0.11	0.05	52	0.02	0.03
○Loop 67 - ggml-cpu.c:1193-1194 - libggml-cpu.so		0.10	0.05	0.05	0.11	0.11	0.05	0.05	52	0.02	0.02
○Loop 65 - ggml-cpu.c:1197-1198 - libggml-cpu.so		0.02	0.01	0.01	0.02	0.02	0.01	0.01	42	0.01	0.01
○Loop 66 - ggml-cpu.c:1197-1198 - libggml-cpu.so		0.00	0.00	0.00	0.00	0.00	0.00	0.00	0	0.00	0.00
►Loop 69 - ggml-cpu.c:1316-1328 - libggml-cpu.so+		0.00	0.00	0.00	0.02	0.00	0.00	0.00	1	0.00	0.00
○Loop 68 - ggml-cpu.c:1317-1328 - libggml-cpu.so		0.01	0.00	0.00	0.02	0.02	0.00	0.00	33	0.00	0.00
►Loop 70 - ggml-cpu.c:1289-1295 - libggml-cpu.so+		0.00	0.00	0.00	0.03	0.01	0.01	0.00	5	0.00	0.00
►Loop 71 - ggml-cpu.c:1290-1295 - libggml-cpu.so+		0.00	0.00	0.00	0.03	0.01	0.00	0.00	11	0.00	0.00
○Loop 72 - ggml-cpu.c:1291-1295 - libggml-cpu.so		0.01	0.00	0.00	0.02	0.02	0.00	0.00	29	0.00	0.00
○Loop 73 - ggml-cpu.c:1291-1295 - libggml-cpu.so		0.00	0.00	0.00	0.01	0.01	0.00	0.00	1	0.00	0.00
►Loop 75 - ggml-cpu.c:1248-1260 - libggml-cpu.so+		0.00	0.01	0.00	0.03	0.00	0.01	0.00	2	0.00	0.00
○Loop 74 - ggml-cpu.c:1249-1260 - libggml-cpu.so		0.02	0.01	0.01	0.03	0.03	0.01	0.01	35	0.01	0.01
○_INTERNAL021345c1::__kmp_hyper_barrier_release(barrier_type, kmp_info, int, int, int, void)	libiomp5.so	1.17	0.15	0.15	1.28	1.28	0.16	0.16	52	0.27	0.29	OMP (%): 100.00
○__sched_yield	libc.so.6	0.25	0.11	0.11	0.28	0.28	0.12	0.12	52	0.05	0.05	System (%): 100.00
►void (anonymous namespace)::tinyBLAS_Q0_AVX<block_q8_0, block_q8_0, float>::gemm4xN<4>(long, long, long, long)+	libggml-cpu.so	0.14	0.09	0.00	0.16	0.00	0.10	0.00	52	0.02	0.03	libggml-cpu.so (%): 100.00	clang based Intel(R) oneAPI DPC++/C++ Compiler 2024.0.0 (2024.0.0.20231017)
○Loop 2293 - sgemm.cpp:814-853 - libggml-cpu.so [...]		0.00	0.00	0.00	0.00	0.00	0.00	0.00	0	0.00	0.00
►Loop 2295 - sgemm.cpp:138-1044 - libggml-cpu.so [...]+		0.00	0.09	0.00	0.16	0.01	0.10	0.00	2	0.00	0.00
○Loop 2294 - sgemm.cpp:138-1044 - libggml-cpu.so [...]		0.14	0.09	0.09	0.16	0.16	0.10	0.10	52	0.02	0.03
►quantize_row_q8_0+	libggml-cpu.so	0.16	0.09	0.01	0.18	0.03	0.10	0.01	52	0.03	0.03	libggml-cpu.so (%): 100.00	clang based Intel(R) oneAPI DPC++/C++ Compiler 2024.0.0 (2024.0.0.20231017)
○Loop 2489 - quants.c:298-355 - libggml-cpu.so [...]		0.15	0.08	0.08	0.17	0.17	0.09	0.09	52	0.03	0.03
►void (anonymous namespace)::tinyBLAS_Q0_AVX<block_q8_0, block_q8_0, float>::gemm4xN<2>(long, long, long, long)+	libggml-cpu.so	0.11	0.07	0.00	0.13	0.00	0.07	0.00	52	0.02	0.02	libggml-cpu.so (%): 100.00	clang based Intel(R) oneAPI DPC++/C++ Compiler 2024.0.0 (2024.0.0.20231017)
○Loop 2305 - sgemm.cpp:814-853 - libggml-cpu.so [...]		0.00	0.00	0.00	0.00	0.00	0.00	0.00	0	0.00	0.00
►Loop 2307 - sgemm.cpp:138-1044 - libggml-cpu.so [...]+		0.00	0.07	0.00	0.12	0.01	0.07	0.00	4	0.00	0.00
○Loop 2306 - sgemm.cpp:138-1044 - libggml-cpu.so [...]		0.11	0.06	0.06	0.12	0.12	0.07	0.07	52	0.02	0.02
○__libm_expf_l9	llama-cli	0.15	0.06	0.06	0.16	0.16	0.07	0.07	32	0.02	0.03	Math (%): 100.00
○kmp_flag_native<unsigned long long, (flag_type)1, true>::done_check()	libiomp5.so	0.32	0.05	0.05	0.35	0.35	0.05	0.05	38	0.09	0.09	OMP (%): 100.00
►ggml_graph_compute_thread+	libggml-cpu.so	0.10	0.05	0.01	0.11	0.02	0.05	0.01	52	0.02	0.02	libggml-cpu.so (%): 100.00	clang based Intel(R) oneAPI DPC++/C++ Compiler 2024.0.0 (2024.0.0.20231017)
○Loop 84 - ggml-cpu.c:2087-2088 - libggml-cpu.so		0.00	0.00	0.00	0.00	0.00	0.00	0.00	0	0.00	0.00
○Loop 82 - ggml-cpu.c:533-2891 - libggml-cpu.so [...]		0.09	0.04	0.04	0.10	0.10	0.04	0.04	52	0.02	0.02
○Loop 83 - ggml-cpu.c:2087-2088 - libggml-cpu.so		0.00	0.00	0.00	0.00	0.00	0.00	0.00	0	0.00	0.00
○__libm_sincosf_e7	llama-cli	0.10	0.05	0.05	0.10	0.10	0.05	0.05	52	0.02	0.02	Exe (%): 100.00
○__kmp_barrier	libiomp5.so	0.11	0.04	0.04	0.13	0.13	0.05	0.05	51	0.02	0.02	OMP (%): 100.00
►ggml_compute_forward_rope_f32(ggml_compute_params const, ggml_tensor, bool)+	libggml-cpu.so	0.10	0.04	0.00	0.12	0.02	0.04	0.00	52	0.02	0.02	libggml-cpu.so (%): 100.00	clang based Intel(R) oneAPI DPC++/C++ Compiler 2024.0.0 (2024.0.0.20231017)
►Loop 1409 - ops.cpp:6210-6484 - libggml-cpu.so [...]+		0.00	0.03	0.00	0.17	0.01	0.04	0.00	10	0.00	0.00
►Loop 1410 - ops.cpp:6210-6484 - libggml-cpu.so [...]+		0.02	0.03	0.00	0.16	0.03	0.04	0.00	28	0.01	0.01
○Loop 1437 - ops.cpp:6220-6245 - libggml-cpu.so [...]		0.05	0.02	0.02	0.06	0.06	0.02	0.02	50	0.01	0.01
○Loop 1426 - ops.cpp:6210-6303 - libggml-cpu.so [...]		0.00	0.00	0.00	0.00	0.00	0.00	0.00	0	0.00	0.00
○Loop 1418 - ops.cpp:6220-6303 - libggml-cpu.so [...]		0.00	0.00	0.00	0.00	0.00	0.00	0.00	0	0.00	0.00
○Loop 1431 - ops.cpp:6220-6245 - libggml-cpu.so [...]		0.00	0.00	0.00	0.00	0.00	0.00	0.00	0	0.00	0.00
○Loop 1434 - ops.cpp:6210-6245 - libggml-cpu.so [...]		0.00	0.00	0.00	0.00	0.00	0.00	0.00	0	0.00	0.00
○Loop 1427 - ops.cpp:6210-6303 - libggml-cpu.so [...]		0.00	0.00	0.00	0.00	0.00	0.00	0.00	0	0.00	0.00
○Loop 1428 - ops.cpp:6220-6303 - libggml-cpu.so [...]		0.00	0.00	0.00	0.00	0.00	0.00	0.00	0	0.00	0.00
○Loop 1422 - ops.cpp:6220-6303 - libggml-cpu.so [...]		0.00	0.00	0.00	0.00	0.00	0.00	0.00	0	0.00	0.00
○Loop 1421 - ops.cpp:6210-6303 - libggml-cpu.so [...]		0.00	0.00	0.00	0.00	0.00	0.00	0.00	0	0.00	0.00
○Loop 1438 - ops.cpp:6210-6245 - libggml-cpu.so [...]		0.00	0.00	0.00	0.00	0.00	0.00	0.00	0	0.00	0.00
○Loop 1435 - ops.cpp:6210-6245 - libggml-cpu.so [...]		0.00	0.00	0.00	0.00	0.00	0.00	0.00	0	0.00	0.00
○Loop 1424 - ops.cpp:6210-6303 - libggml-cpu.so [...]		0.00	0.00	0.00	0.00	0.00	0.00	0.00	0	0.00	0.00
○Loop 1423 - ops.cpp:6210-6303 - libggml-cpu.so [...]		0.00	0.00	0.00	0.00	0.00	0.00	0.00	0	0.00	0.00
○Loop 1439 - ops.cpp:6210-6245 - libggml-cpu.so [...]		0.00	0.00	0.00	0.00	0.00	0.00	0.00	0	0.00	0.00
○Loop 1425 - ops.cpp:6220-6303 - libggml-cpu.so [...]		0.00	0.00	0.00	0.00	0.00	0.00	0.00	0	0.00	0.00
►Loop 1411 - ops.cpp:6365-6484 - libggml-cpu.so [...]+		0.02	0.01	0.00	0.07	0.02	0.01	0.00	33	0.00	0.00
○Loop 1416 - ops.cpp:6413-6426 - libggml-cpu.so		0.00	0.00	0.00	0.00	0.00	0.00	0.00	0	0.00	0.00
○Loop 1412 - ops.cpp:6462-6475 - libggml-cpu.so		0.00	0.00	0.00	0.00	0.00	0.00	0.00	0	0.00	0.00
○Loop 1414 - ops.cpp:6479-6484 - libggml-cpu.so		0.00	0.00	0.00	0.00	0.00	0.00	0.00	0	0.00	0.00
○Loop 1417 - ops.cpp:6429-6442 - libggml-cpu.so		0.00	0.00	0.00	0.00	0.00	0.00	0.00	0	0.00	0.00
○Loop 1415 - ops.cpp:6446-6457 - libggml-cpu.so		0.05	0.01	0.01	0.05	0.05	0.01	0.01	29	0.01	0.01
○Loop 1413 - ops.cpp:6479-6484 - libggml-cpu.so		0.00	0.00	0.00	0.00	0.00	0.00	0.00	0	0.00	0.00
○Loop 1432 - ops.cpp:6220-6245 - libggml-cpu.so [...]		0.00	0.00	0.00	0.00	0.00	0.00	0.00	0	0.00	0.00
○Loop 1436 - ops.cpp:6220-6245 - libggml-cpu.so [...]		0.00	0.00	0.00	0.00	0.00	0.00	0.00	0	0.00	0.00
○Loop 1429 - ops.cpp:6210-6303 - libggml-cpu.so [...]		0.00	0.00	0.00	0.00	0.00	0.00	0.00	0	0.00	0.00
○Loop 1420 - ops.cpp:6210-6303 - libggml-cpu.so [...]		0.00	0.00	0.00	0.00	0.00	0.00	0.00	0	0.00	0.00
○Loop 1433 - ops.cpp:6210-6245 - libggml-cpu.so [...]		0.00	0.00	0.00	0.00	0.00	0.00	0.00	0	0.00	0.00
○Loop 1419 - ops.cpp:6220-6303 - libggml-cpu.so [...]		0.00	0.00	0.00	0.00	0.00	0.00	0.00	0	0.00	0.00
○Loop 1430 - ops.cpp:6210-6303 - libggml-cpu.so [...]		0.00	0.00	0.00	0.00	0.00	0.00	0.00	0	0.00	0.00
►void (anonymous namespace)::tinyBLAS_Q0_AVX<block_q8_0, block_q8_0, float>::gemm4xN<3>(long, long, long, long)+	libggml-cpu.so	0.04	0.02	0.00	0.04	0.00	0.02	0.00	52	0.01	0.01	libggml-cpu.so (%): 100.00	clang based Intel(R) oneAPI DPC++/C++ Compiler 2024.0.0 (2024.0.0.20231017)
►Loop 2298 - sgemm.cpp:138-1044 - libggml-cpu.so [...]+		0.00	0.02	0.00	0.05	0.00	0.02	0.00	2	0.00	0.00
○Loop 2297 - sgemm.cpp:138-1044 - libggml-cpu.so [...]		0.04	0.02	0.02	0.04	0.04	0.02	0.02	52	0.01	0.01
○Loop 2296 - sgemm.cpp:814-853 - libggml-cpu.so [...]		0.00	0.00	0.00	0.00	0.00	0.00	0.00	0	0.00	0.00
►__intel_avx_rep_memcpy+	llama-cli	0.11	0.02	0.02	0.13	0.12	0.02	0.02	46	0.02	0.02	Memory (%): 100.00
○Loop 3159 - - llama-cli		0.00	0.00	0.00	0.00	0.00	0.00	0.00	0	0.00	0.00
○Loop 3160 - - llama-cli		0.00	0.00	0.00	0.00	0.00	0.00	0.00	1	0.00	0.00
○__kmpc_barrier	libiomp5.so	0.04	0.01	0.01	0.05	0.05	0.01	0.01	48	0.01	0.01	OMP (%): 100.00

Report Configuration

Functions and Loops

▶Filters

▼Columns Filter