| Loop id | Source Location | Source Function | Level | Max Thread Time / Walltime gcc_3 (%) | Exclusive Coverage gcc_3 (%) | Inclusive Coverage gcc_3 (%) | Max Exclusive Time Over Threads gcc_3 (s) | Max Inclusive Time Over Threads gcc_3 (s) | Exclusive Time w.r.t. Wall Time gcc_3 (s) | Inclusive Time w.r.t. Wall Time gcc_3 (s) | Nb Threads gcc_3 | GFLOPS gcc_3 | Vectorization Ratio (%) | Vector Length Use (%) | Speedup If No Scalar Integer | Speedup If FP Vectorized | Speedup If Fully Vectorized | Speedup If Perfect Load Balancing gcc_3 | Stride 0 | Stride 1 | Stride n | Stride Unknown | Stride Indirect | Array Access Efficiency |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1950 | libggml-cpu.so - quants.c:108-1035 [...] | ggml_vec_dot_q8_0_q8_0 | Single | 77.06 | 57.47 | 57.47 | 50.89 | 50.89 | 32.98 | 32.98 | 192 | 59.81 | NA | NA | NA | NA | NA | 1.55 | NA | NA | NA | NA | NA | 0.00 |
| 65 | libggml-cpu.so - ggml-cpu.c:1164-1397 [...] | ggml_compute_forward_mul_mat | InBetween | 0.29 | 0.11 | 0.11 | 0.19 | 0.19 | 0.06 | 0.07 | 192 | 138.09 | 0 | 11.88 | 1 | 1 | 8 | 3.1 | NA | NA | NA | NA | NA | 0.00 |
| 1587 | libggml-cpu.so - sgemm.cpp:818-1038 [...] | void (anonymous namespace)::tinyBLAS_Q0_AVX<block_q8_0, block_q8_0, float>::gemm4xN<2>(long, long, long, long) | Innermost | 0.15 | 0.09 | 0.09 | 0.10 | 0.10 | 0.05 | 0.05 | 189 | 129.70 | NA | NA | NA | NA | NA | 1.82 | NA | NA | NA | NA | NA | 0.00 |
| 1579 | libggml-cpu.so - sgemm.cpp:818-1038 [...] | void (anonymous namespace)::tinyBLAS_Q0_AVX<block_q8_0, block_q8_0, float>::gemm4xN<4>(long, long, long, long) | Innermost | 0.15 | 0.09 | 0.09 | 0.10 | 0.10 | 0.05 | 0.05 | 189 | 280.09 | NA | NA | NA | NA | NA | 1.92 | NA | NA | NA | NA | NA | 0.00 |
| 73 | libggml-cpu.so - ggml-cpu.c:1664-2891 [...] | ggml_graph_compute_thread | Single | 0.12 | 0.05 | 0.05 | 0.08 | 0.08 | 0.03 | 0.03 | 187 | 19.34 | 0 | 9.56 | 1 | 1 | 13.33 | 2.89 | NA | NA | NA | NA | NA | 0.00 |
| 1394 | libggml-cpu.so - vec.h:491-491 [...] | ggml_compute_forward_flash_attn_ext | Innermost | 0.36 | 0.03 | 0.03 | 0.24 | 0.24 | 0.02 | 0.02 | 33 | 1616.69 | 100 | 70 | 1 | 1 | 1.45 | 2.08 | 0 | 2 | 1 | 0 | 0 | 91.67 |
| 1943 | libggml-cpu.so - quants.c:298-321 [...] | quantize_row_q8_0 | Single | 0.12 | 0.03 | 0.03 | 0.08 | 0.08 | 0.02 | 0.02 | 150 | 0.00 | 59.65 | 29.28 | 1 | 1.17 | 2.64 | 3.65 | NA | NA | NA | NA | NA | 0.00 |
| 698 | libggml-cpu.so - vec.cpp:311-311 [...] | ggml_vec_dot_f16 | Single | 0.20 | 0.02 | 0.02 | 0.13 | 0.13 | 0.01 | 0.01 | 33 | 968.80 | 100 | 66.67 | 1 | 1 | 1.63 | 1.67 | 0 | 0 | 4 | 0 | 0 | 75.00 |
| 1392 | libggml-cpu.so - ops.cpp:8778-8920 [...] | ggml_compute_forward_flash_attn_ext | InBetween | 0.09 | 0.01 | 0.04 | 0.06 | 0.29 | 0.00 | 0.03 | 32 | 4807.29 | 46.93 | 31.86 | 1.93 | 1.03 | 1.34 | 3.15 | NA | NA | NA | NA | NA | 0.00 |
| 700 | libggml-cpu.so - vec.cpp:372-372 [...] | ggml_vec_swiglu_f32 | Single | 0.27 | 0.00 | 0.00 | 0.18 | 0.18 | 0.00 | 0.00 | 7 | 4375.96 | 100 | 100 | 1 | 1 | 1 | 6 | 0 | 3 | 0 | 0 | 0 | 100.00 |
| 372 | libggml-cpu.so - binary-ops.cpp:10-32 [...] | ggml_compute_forward_add_non_quantized | Innermost | 0.15 | 0.00 | 0.00 | 0.10 | 0.10 | 0.00 | 0.00 | 1 | 259.45 | 100 | 50 | 1 | 1 | 2 | 1 | 0 | 3 | 0 | 0 | 0 | 100.00 |
| 454 | libggml-cpu.so - binary-ops.cpp:18-32 [...] | ggml_compute_forward_mul | Innermost | 0.09 | 0.00 | 0.00 | 0.06 | 0.06 | 0.00 | 0.00 | 1 | 360.35 | 100 | 50 | 1 | 1 | 2 | 1 | 0 | 3 | 0 | 0 | 0 | 100.00 |