| Loop id | Source Location | Source Function | Level | Max Thread Time / Walltime gcc_6 (%) | Exclusive Coverage gcc_6 (%) | Inclusive Coverage gcc_6 (%) | Max Exclusive Time Over Threads gcc_6 (s) | Max Inclusive Time Over Threads gcc_6 (s) | Exclusive Time w.r.t. Wall Time gcc_6 (s) | Inclusive Time w.r.t. Wall Time gcc_6 (s) | Nb Threads gcc_6 | GFLOPS gcc_6 | Vectorization Ratio (%) | Vector Length Use (%) | Speedup If No Scalar Integer | Speedup If FP Vectorized | Speedup If Fully Vectorized | Speedup If Perfect Load Balancing gcc_6 | Stride 0 | Stride 1 | Stride n | Stride Unknown | Stride Indirect | Array Access Efficiency |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 387 | libggml-cpu.so - mmq.cpp:1581-1597 [...] | (anonymous namespace)::tinygemm_kernel_vnni<block_q8_0, block_q8_0, float, 1, 64, 32>::apply(int, void const*, void const*, float*, int) | Single | 24.40 | 14.84 | 14.84 | 10.91 | 10.91 | 4.09 | 4.09 | 183 | 87.73 | 95.52 | 62.97 | 1.01 | 1 | 1.27 | 2.57 | 2 | 4 | 2 | 0 | 1 | 83.33 |
| 584 | libggml-cpu.so - mmq.cpp:520-2194 [...] | ggml_backend_amx_mul_mat(ggml_compute_params const*, ggml_tensor*)::{lambda(int, int)#3}::operator()(int, int) const::{lambda()#1}::operator()() const | InBetween | 0.17 | 0.09 | 0.09 | 0.08 | 0.08 | 0.03 | 0.03 | 150 | 204.54 | NA | NA | NA | NA | NA | 2.37 | NA | NA | NA | NA | NA | 0.00 |
| 1640 | libggml-cpu.so - ops.cpp:8778-8920 [...] | ggml_compute_forward_flash_attn_ext | InBetween | 0.39 | 0.07 | 0.08 | 0.17 | 0.19 | 0.02 | 0.02 | 33 | 1388.10 | 44.3 | 41.41 | 1.67 | 1.03 | 1.42 | 1.54 | NA | NA | NA | NA | NA | 0.00 |
| 59 | libggml-cpu.so - ggml-cpu.c:1664-2891 [...] | ggml_graph_compute_thread | Single | 0.09 | 0.03 | 0.03 | 0.04 | 0.04 | 0.01 | 0.01 | 149 | 0.55 | 0 | 9.17 | 1 | 1 | 14.19 | 3.85 | NA | NA | NA | NA | NA | 0.00 |
| 409 | libggml-cpu.so - mmq.cpp:822-1392 [...] | void parallel_for<(anonymous namespace)::convert_B_packed_format<block_q8_0, 32>(void*, block_q8_0 const*, int, int)::{lambda(int, int)#1}>(int, (anonymous namespace)::convert_B_packed_format<block_q8_0, 32>(void*, block_q8_0 const*, int,... | Innermost | 0.08 | 0.03 | 0.03 | 0.04 | 0.04 | 0.01 | 0.01 | 143 | 0.00 | 29.73 | 31.25 | 4.38 | 1 | 1.3 | 3.24 | 2 | 0 | 0 | 21 | 0 | 54.35 |
| 965 | libggml-cpu.so - ops.cpp:6238-6245 | ggml_rope_cache_init(float, float, float const*, float*, long, float, float, float*, float, float) | Single | 0.07 | 0.03 | 0.03 | 0.03 | 0.03 | 0.01 | 0.01 | 192 | 474.82 | 6.25 | 8.2 | 1.56 | 1.75 | 6.22 | 4.33 | NA | NA | NA | NA | NA | 0.00 |
| 951 | libggml-cpu.so - vec.cpp:311-311 [...] | ggml_vec_dot_f16 | Single | 0.15 | 0.02 | 0.02 | 0.06 | 0.06 | 0.01 | 0.01 | 34 | 1504.10 | 100 | 66.67 | 1 | 1 | 1.67 | 1.83 | 0 | 2 | 0 | 0 | 0 | 100.00 |
| 2188 | libggml-cpu.so - quants.c:298-321 [...] | quantize_row_q8_0 | Single | 0.87 | 0.01 | 0.01 | 0.39 | 0.39 | 0.00 | 0.00 | 1 | 675.34 | 59.65 | 29.28 | 1.03 | 1.4 | 2.86 | 1 | NA | NA | NA | NA | NA | 0.00 |
| 953 | libggml-cpu.so - vec.cpp:372-372 [...] | ggml_vec_swiglu_f32 | Single | 0.48 | 0.00 | 0.00 | 0.21 | 0.21 | 0.00 | 0.00 | 7 | 4277.56 | 100 | 100 | 1.04 | 1 | 1 | 6.69 | 0 | 0 | 0 | 3 | 0 | 50.00 |
| 1320 | libggml-cpu.so - ops.cpp:4325-4326 | ggml_compute_forward_rms_norm | Innermost | 0.31 | 0.00 | 0.00 | 0.14 | 0.14 | 0.00 | 0.00 | 3 | 355.96 | 0 | 7.81 | 1 | 1.98 | 13.02 | 2.9 | 0 | 1 | 0 | 0 | 0 | 100.00 |
| 2881 | exec - sampling.cpp:125-126 | common_sampler_sample(common_sampler*, llama_context*, int, bool) | Innermost | 0.23 | 0.00 | 0.00 | 0.11 | 0.11 | 0.00 | 0.00 | 1 | 0.00 | 0 | 6.25 | 3 | 1 | 16 | 1 | 0 | 1 | 1 | 0 | 0 | 87.50 |
| 705 | libggml-cpu.so - binary-ops.cpp:18-32 [...] | ggml_compute_forward_mul | Innermost | 0.19 | 0.00 | 0.00 | 0.08 | 0.08 | 0.00 | 0.00 | 7 | 282.74 | 0 | 6.25 | 1 | 1.06 | 16 | 5.95 | 0 | 2 | 2 | 0 | 0 | 87.50 |
| 633 | libggml-cpu.so - binary-ops.cpp:10-32 [...] | ggml_compute_forward_add_non_quantized | Innermost | 0.19 | 0.00 | 0.00 | 0.08 | 0.08 | 0.00 | 0.00 | 3 | 275.71 | 0 | 6.25 | 1 | 1.06 | 16 | 3 | 0 | 2 | 2 | 0 | 0 | 87.50 |