| Loop id | Source Location | Source Function | Level | Max Thread Time / Walltime 1x1 (%) | Max Thread Time / Walltime 1x2 (%) | Max Thread Time / Walltime 1x4 (%) | Max Thread Time / Walltime 1x8 (%) | Max Thread Time / Walltime 1x16 (%) | Max Thread Time / Walltime 1x24 (%) | Max Thread Time / Walltime 1x32 (%) | Max Thread Time / Walltime 1x40 (%) | Max Thread Time / Walltime 1x48 (%) | Max Thread Time / Walltime 1x56 (%) | Max Thread Time / Walltime 1x64 (%) | Max Thread Time / Walltime 1x72 (%) | Max Thread Time / Walltime 1x80 (%) | Max Thread Time / Walltime 1x88 (%) | Max Thread Time / Walltime 1x96 (%) | Exclusive Coverage 1x1 (%) | Exclusive Coverage 1x2 (%) | Exclusive Coverage 1x4 (%) | Exclusive Coverage 1x8 (%) | Exclusive Coverage 1x16 (%) | Exclusive Coverage 1x24 (%) | Exclusive Coverage 1x32 (%) | Exclusive Coverage 1x40 (%) | Exclusive Coverage 1x48 (%) | Exclusive Coverage 1x56 (%) | Exclusive Coverage 1x64 (%) | Exclusive Coverage 1x72 (%) | Exclusive Coverage 1x80 (%) | Exclusive Coverage 1x88 (%) | Exclusive Coverage 1x96 (%) | Inclusive Coverage 1x1 (%) | Inclusive Coverage 1x2 (%) | Inclusive Coverage 1x4 (%) | Inclusive Coverage 1x8 (%) | Inclusive Coverage 1x16 (%) | Inclusive Coverage 1x24 (%) | Inclusive Coverage 1x32 (%) | Inclusive Coverage 1x40 (%) | Inclusive Coverage 1x48 (%) | Inclusive Coverage 1x56 (%) | Inclusive Coverage 1x64 (%) | Inclusive Coverage 1x72 (%) | Inclusive Coverage 1x80 (%) | Inclusive Coverage 1x88 (%) | Inclusive Coverage 1x96 (%) | Max Exclusive Time Over Threads 1x1 (s) | Max Exclusive Time Over Threads 1x2 (s) | Max Exclusive Time Over Threads 1x4 (s) | Max Exclusive Time Over Threads 1x8 (s) | Max Exclusive Time Over Threads 1x16 (s) | Max Exclusive Time Over Threads 1x24 (s) | Max Exclusive Time Over Threads 1x32 (s) | Max Exclusive Time Over Threads 1x40 (s) | Max Exclusive Time Over Threads 1x48 (s) | Max Exclusive Time Over Threads 1x56 (s) | Max Exclusive Time Over Threads 1x64 (s) | Max Exclusive Time Over Threads 1x72 (s) | Max Exclusive Time Over Threads 1x80 (s) | Max Exclusive Time Over Threads 1x88 (s) | Max Exclusive Time Over Threads 1x96 (s) | Max Inclusive Time Over Threads 1x1 (s) | Max Inclusive Time Over Threads 1x2 (s) | Max Inclusive Time Over Threads 1x4 (s) | Max Inclusive Time Over Threads 1x8 (s) | Max Inclusive Time Over Threads 1x16 (s) | Max Inclusive Time Over Threads 1x24 (s) | Max Inclusive Time Over Threads 1x32 (s) | Max Inclusive Time Over Threads 1x40 (s) | Max Inclusive Time Over Threads 1x48 (s) | Max Inclusive Time Over Threads 1x56 (s) | Max Inclusive Time Over Threads 1x64 (s) | Max Inclusive Time Over Threads 1x72 (s) | Max Inclusive Time Over Threads 1x80 (s) | Max Inclusive Time Over Threads 1x88 (s) | Max Inclusive Time Over Threads 1x96 (s) | Exclusive Time w.r.t. Wall Time 1x1 (s) | Exclusive Time w.r.t. Wall Time 1x2 (s) | Exclusive Time w.r.t. Wall Time 1x4 (s) | Exclusive Time w.r.t. Wall Time 1x8 (s) | Exclusive Time w.r.t. Wall Time 1x16 (s) | Exclusive Time w.r.t. Wall Time 1x24 (s) | Exclusive Time w.r.t. Wall Time 1x32 (s) | Exclusive Time w.r.t. Wall Time 1x40 (s) | Exclusive Time w.r.t. Wall Time 1x48 (s) | Exclusive Time w.r.t. Wall Time 1x56 (s) | Exclusive Time w.r.t. Wall Time 1x64 (s) | Exclusive Time w.r.t. Wall Time 1x72 (s) | Exclusive Time w.r.t. Wall Time 1x80 (s) | Exclusive Time w.r.t. Wall Time 1x88 (s) | Exclusive Time w.r.t. Wall Time 1x96 (s) | Inclusive Time w.r.t. Wall Time 1x1 (s) | Inclusive Time w.r.t. Wall Time 1x2 (s) | Inclusive Time w.r.t. Wall Time 1x4 (s) | Inclusive Time w.r.t. Wall Time 1x8 (s) | Inclusive Time w.r.t. Wall Time 1x16 (s) | Inclusive Time w.r.t. Wall Time 1x24 (s) | Inclusive Time w.r.t. Wall Time 1x32 (s) | Inclusive Time w.r.t. Wall Time 1x40 (s) | Inclusive Time w.r.t. Wall Time 1x48 (s) | Inclusive Time w.r.t. Wall Time 1x56 (s) | Inclusive Time w.r.t. Wall Time 1x64 (s) | Inclusive Time w.r.t. Wall Time 1x72 (s) | Inclusive Time w.r.t. Wall Time 1x80 (s) | Inclusive Time w.r.t. Wall Time 1x88 (s) | Inclusive Time w.r.t. Wall Time 1x96 (s) | Nb Threads 1x1 | Nb Threads 1x2 | Nb Threads 1x4 | Nb Threads 1x8 | Nb Threads 1x16 | Nb Threads 1x24 | Nb Threads 1x32 | Nb Threads 1x40 | Nb Threads 1x48 | Nb Threads 1x56 | Nb Threads 1x64 | Nb Threads 1x72 | Nb Threads 1x80 | Nb Threads 1x88 | Nb Threads 1x96 | Vectorization Ratio (%) | Vector Length Use (%) | Speedup If No Scalar Integer | Speedup If FP Vectorized | Speedup If Fully Vectorized | Speedup If Perfect Load Balancing 1x1 | Speedup If Perfect Load Balancing 1x2 | Speedup If Perfect Load Balancing 1x4 | Speedup If Perfect Load Balancing 1x8 | Speedup If Perfect Load Balancing 1x16 | Speedup If Perfect Load Balancing 1x24 | Speedup If Perfect Load Balancing 1x32 | Speedup If Perfect Load Balancing 1x40 | Speedup If Perfect Load Balancing 1x48 | Speedup If Perfect Load Balancing 1x56 | Speedup If Perfect Load Balancing 1x64 | Speedup If Perfect Load Balancing 1x72 | Speedup If Perfect Load Balancing 1x80 | Speedup If Perfect Load Balancing 1x88 | Speedup If Perfect Load Balancing 1x96 | Stride 0 | Stride 1 | Stride n | Stride Unknown | Stride Indirect | Array Access Efficiency | (1x1) Efficiency | (1x1) Potential Speed-Up (%) | (1x2) Efficiency | (1x2) Potential Speed-Up (%) | (1x4) Efficiency | (1x4) Potential Speed-Up (%) | (1x8) Efficiency | (1x8) Potential Speed-Up (%) | (1x16) Efficiency | (1x16) Potential Speed-Up (%) | (1x24) Efficiency | (1x24) Potential Speed-Up (%) | (1x32) Efficiency | (1x32) Potential Speed-Up (%) | (1x40) Efficiency | (1x40) Potential Speed-Up (%) | (1x48) Efficiency | (1x48) Potential Speed-Up (%) | (1x56) Efficiency | (1x56) Potential Speed-Up (%) | (1x64) Efficiency | (1x64) Potential Speed-Up (%) | (1x72) Efficiency | (1x72) Potential Speed-Up (%) | (1x80) Efficiency | (1x80) Potential Speed-Up (%) | (1x88) Efficiency | (1x88) Potential Speed-Up (%) | (1x96) Efficiency | (1x96) Potential Speed-Up (%) |
|---|
| 2528 | libggml-cpu.so - kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c:131-131 | kai_run_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm | Innermost | 68.06 | 66.90 | 65.44 | 61.16 | 54.84 | 50.71 | 47.83 | 45.11 | 41.57 | 39.94 | 37.68 | 37.25 | 34.55 | 32.95 | 31.48 | 68.66 | 68.27 | 67.86 | 66.43 | 63.95 | 62.09 | 60.53 | 58.18 | 56.51 | 54.76 | 54.94 | 51.75 | 52.05 | 49.90 | 48.23 | 68.66 | 68.27 | 67.86 | 66.43 | 63.95 | 62.09 | 60.53 | 58.18 | 56.51 | 54.76 | 54.94 | 51.75 | 52.05 | 49.90 | 48.23 | 118.24 | 59.07 | 29.78 | 14.82 | 7.56 | 5.64 | 4.65 | 3.94 | 3.42 | 3.13 | 2.84 | 2.74 | 2.52 | 2.40 | 2.30 | 118.24 | 59.07 | 29.78 | 14.82 | 7.56 | 5.64 | 4.65 | 3.94 | 3.42 | 3.13 | 2.84 | 2.74 | 2.52 | 2.40 | 2.30 | 118.24 | 59.20 | 29.86 | 15.10 | 7.82 | 5.93 | 4.84 | 4.02 | 3.65 | 3.26 | 3.01 | 2.72 | 2.62 | 2.57 | 2.41 | 118.24 | 59.20 | 29.86 | 15.10 | 7.82 | 5.93 | 4.84 | 4.02 | 3.65 | 3.26 | 3.01 | 2.72 | 2.62 | 2.57 | 2.41 | 1 | 2 | 4 | 8 | 16 | 24 | 32 | 40 | 48 | 56 | 64 | 72 | 80 | 88 | 95 | 28.14 | 55.37 | 1 | 1 | 1.85 | 1 | 1 | 1.01 | 1.01 | 1.02 | 1.03 | 1.05 | 1.08 | 1.07 | 1.1 | 1.07 | 1.15 | 1.11 | 1.12 | 1.13 | 0 | 0 | 5 | 0 | 0 | 75.00 | 1 | 0 | 1 | 0.09 | 0.99 | 0.68 | 0.98 | 1.39 | 0.95 | 3.5 | 0.83 | 10.53 | 0.76 | 14.29 | 0.74 | 15.37 | 0.67 | 18.38 | 0.65 | 19.28 | 0.61 | 21.19 | 0.6 | 20.5 | 0.56 | 22.67 | 0.52 | 23.78 | 0.51 | 23.6 |
| 2425 | libggml-cpu.so - quants.c:2506-2590 [...] | ggml_vec_dot_q6_K_q8_K | Innermost | 22.98 | 22.53 | 22.09 | 20.61 | 18.97 | 16.92 | 15.09 | 14.01 | 12.82 | 11.66 | 11.15 | 10.45 | 9.03 | 8.24 | 7.72 | 23.18 | 22.90 | 22.84 | 22.32 | 21.56 | 20.30 | 19.25 | 18.31 | 17.44 | 16.28 | 15.50 | 15.29 | 14.04 | 13.02 | 12.07 | 23.18 | 22.90 | 22.84 | 22.32 | 21.56 | 20.30 | 19.25 | 18.31 | 17.44 | 16.28 | 15.50 | 15.29 | 14.04 | 13.02 | 12.07 | 39.92 | 19.90 | 10.05 | 4.99 | 2.61 | 1.88 | 1.46 | 1.22 | 1.05 | 0.91 | 0.84 | 0.77 | 0.66 | 0.60 | 0.56 | 39.92 | 19.90 | 10.05 | 4.99 | 2.61 | 1.88 | 1.46 | 1.22 | 1.05 | 0.91 | 0.84 | 0.77 | 0.66 | 0.60 | 0.56 | 39.92 | 19.86 | 10.05 | 5.07 | 2.64 | 1.94 | 1.54 | 1.26 | 1.13 | 0.97 | 0.85 | 0.80 | 0.71 | 0.67 | 0.60 | 39.92 | 19.86 | 10.05 | 5.07 | 2.64 | 1.94 | 1.54 | 1.26 | 1.13 | 0.97 | 0.85 | 0.80 | 0.71 | 0.67 | 0.60 | 1 | 2 | 4 | 8 | 16 | 24 | 32 | 40 | 48 | 56 | 64 | 72 | 80 | 88 | 96 | 50.56 | 65.8 | 1 | 1 | 1.47 | 1 | 1.01 | 1.01 | 1.01 | 1.04 | 1.05 | 1.04 | 1.07 | 1.07 | 1.08 | 1.12 | 1.1 | 1.08 | 1.07 | 1.12 | 2 | 0 | 1 | 19 | 0 | 55.68 | 1 | 0 | 1 | 0 | 0.99 | 0.16 | 0.98 | 0.36 | 0.95 | 1.15 | 0.86 | 2.9 | 0.81 | 3.64 | 0.79 | 3.86 | 0.74 | 4.56 | 0.74 | 4.3 | 0.73 | 4.11 | 0.69 | 4.74 | 0.71 | 4.12 | 0.68 | 4.2 | 0.69 | 3.75 |
| 2426 | libggml-cpu.so - quants.c:2492-2660 [...] | ggml_vec_dot_q6_K_q8_K | Outermost | 3.12 | 3.18 | 3.29 | 3.05 | 3.19 | 2.83 | 2.47 | 2.46 | 2.07 | 2.04 | 1.86 | 1.90 | 1.71 | 1.72 | 1.64 | 3.14 | 3.18 | 3.12 | 3.13 | 2.87 | 2.68 | 2.50 | 2.58 | 2.36 | 2.12 | 2.08 | 1.96 | 1.84 | 1.69 | 1.74 | 26.32 | 26.09 | 25.95 | 25.45 | 24.43 | 22.98 | 21.75 | 20.88 | 19.79 | 18.41 | 17.58 | 17.25 | 15.89 | 14.71 | 13.81 | 5.41 | 2.81 | 1.50 | 0.74 | 0.44 | 0.31 | 0.24 | 0.22 | 0.17 | 0.16 | 0.14 | 0.14 | 0.13 | 0.13 | 0.12 | 45.33 | 22.59 | 11.34 | 5.68 | 2.89 | 2.07 | 1.61 | 1.33 | 1.16 | 0.99 | 0.91 | 0.85 | 0.73 | 0.64 | 0.62 | 5.41 | 2.76 | 1.37 | 0.71 | 0.35 | 0.26 | 0.20 | 0.18 | 0.15 | 0.13 | 0.11 | 0.10 | 0.09 | 0.09 | 0.09 | 45.33 | 22.62 | 11.42 | 5.78 | 2.99 | 2.20 | 1.74 | 1.44 | 1.28 | 1.10 | 0.96 | 0.91 | 0.80 | 0.76 | 0.69 | 1 | 2 | 4 | 8 | 16 | 24 | 32 | 40 | 48 | 56 | 64 | 72 | 80 | 88 | 96 | 19.23 | 39.9 | 1 | 1 | 2.32 | 1 | 1.02 | 1.1 | 1.06 | 1.32 | 1.33 | 1.31 | 1.33 | 1.27 | 1.44 | 1.4 | 1.55 | 1.56 | 1.72 | 1.65 | 0 | 0 | 0 | 22 | 0 | 50.00 | 1 | 0 | 0.98 | 0.06 | 0.99 | 0.04 | 0.95 | 0.15 | 0.97 | 0.1 | 0.88 | 0.32 | 0.85 | 0.39 | 0.76 | 0.61 | 0.74 | 0.61 | 0.76 | 0.5 | 0.74 | 0.53 | 0.73 | 0.53 | 0.73 | 0.5 | 0.71 | 0.5 | 0.65 | 0.61 |
| 1896 | libggml-cpu.so - ops.cpp:8793-8881 [...] | ggml_compute_forward_flash_attn_ext | InBetween | 1.31 | 1.23 | 1.13 | 1.20 | 1.41 | 1.44 | 1.29 | 1.20 | 1.09 | 1.08 | 1.00 | 0.88 | 0.89 | 0.76 | 0.82 | 1.32 | 1.24 | 1.15 | 1.13 | 1.28 | 1.06 | 1.02 | 0.93 | 0.88 | 0.80 | 0.79 | 0.68 | 0.71 | 0.62 | 0.59 | 1.69 | 1.60 | 1.48 | 1.43 | 1.64 | 1.38 | 1.33 | 1.21 | 1.18 | 1.09 | 1.04 | 0.98 | 1.09 | 0.94 | 0.92 | 2.27 | 1.09 | 0.51 | 0.29 | 0.20 | 0.16 | 0.13 | 0.10 | 0.09 | 0.09 | 0.07 | 0.07 | 0.07 | 0.05 | 0.06 | 2.90 | 1.39 | 0.67 | 0.36 | 0.27 | 0.21 | 0.15 | 0.13 | 0.10 | 0.11 | 0.09 | 0.09 | 0.09 | 0.09 | 0.08 | 2.27 | 1.08 | 0.51 | 0.26 | 0.16 | 0.10 | 0.08 | 0.06 | 0.06 | 0.05 | 0.04 | 0.04 | 0.04 | 0.03 | 0.03 | 2.90 | 1.39 | 0.65 | 0.33 | 0.20 | 0.13 | 0.11 | 0.08 | 0.08 | 0.06 | 0.06 | 0.05 | 0.05 | 0.05 | 0.05 | 1 | 2 | 4 | 8 | 16 | 24 | 32 | 40 | 47 | 52 | 64 | 64 | 73 | 85 | 86 | 0 | 34.34 | 2.26 | 2.85 | 1.19 | 1 | 1.02 | 1.02 | 1.16 | 1.31 | 1.71 | 1.68 | 1.81 | 1.77 | 1.9 | 1.97 | 1.84 | 1.92 | 1.98 | 2.16 | NA | NA | NA | NA | NA | 0.00 | 1 | 0 | 1.06 | 0 | 1.12 | 0 | 1.11 | 0 | 0.91 | 0.12 | 0.94 | 0.07 | 0.87 | 0.13 | 0.89 | 0.1 | 0.83 | 0.15 | 0.86 | 0.11 | 0.82 | 0.14 | 0.88 | 0.08 | 0.8 | 0.15 | 0.8 | 0.12 | 0.8 | 0.12 |
| 916 | libggml-cpu.so - vec.h:1045-1072 [...] | ggml_vec_swiglu_f32 | Innermost | 0.45 | 0.58 | 0.53 | 0.70 | 1.12 | 0.90 | 1.08 | 1.20 | 1.34 | 1.53 | 1.26 | 1.49 | 1.30 | 1.44 | 1.57 | 0.46 | 0.57 | 0.48 | 0.59 | 0.80 | 0.52 | 0.53 | 0.45 | 0.41 | 0.44 | 0.37 | 0.36 | 0.32 | 0.31 | 0.28 | 0.46 | 0.57 | 0.48 | 0.59 | 0.80 | 0.52 | 0.53 | 0.45 | 0.41 | 0.44 | 0.37 | 0.36 | 0.32 | 0.31 | 0.28 | 0.79 | 0.51 | 0.24 | 0.17 | 0.15 | 0.10 | 0.11 | 0.11 | 0.11 | 0.12 | 0.09 | 0.11 | 0.09 | 0.10 | 0.12 | 0.79 | 0.51 | 0.24 | 0.17 | 0.15 | 0.10 | 0.11 | 0.11 | 0.11 | 0.12 | 0.09 | 0.11 | 0.09 | 0.10 | 0.12 | 0.79 | 0.49 | 0.21 | 0.13 | 0.10 | 0.05 | 0.04 | 0.03 | 0.03 | 0.03 | 0.02 | 0.02 | 0.02 | 0.02 | 0.01 | 0.79 | 0.49 | 0.21 | 0.13 | 0.10 | 0.05 | 0.04 | 0.03 | 0.03 | 0.03 | 0.02 | 0.02 | 0.02 | 0.02 | 0.01 | 1 | 2 | 4 | 8 | 16 | 16 | 16 | 16 | 16 | 16 | 16 | 16 | 16 | 16 | 16 | 73.33 | 91.67 | 1.04 | 1 | 1 | 1 | 1.04 | 1.15 | 1.31 | 1.67 | 1.45 | 1.35 | 1.48 | 1.58 | 1.51 | 1.35 | 1.5 | 1.38 | 1.42 | 1.61 | NA | NA | NA | NA | NA | 0.00 | 1 | 0 | 0.8 | 0.11 | 0.94 | 0.03 | 0.74 | 0.15 | 0.51 | 0.39 | 0.66 | 0.17 | 0.58 | 0.22 | 0.63 | 0.17 | 0.62 | 0.16 | 0.54 | 0.2 | 0.62 | 0.14 | 0.59 | 0.15 | 0.62 | 0.12 | 0.56 | 0.14 | 0.58 | 0.12 |
| 1908 | libggml-cpu.so - vec.h:491-497 | ggml_compute_forward_flash_attn_ext | Innermost | 0.36 | 0.35 | 0.35 | 0.33 | 0.54 | 0.58 | 0.36 | 0.46 | 0.49 | 0.57 | 0.40 | 0.61 | 0.62 | 0.55 | 0.55 | 0.36 | 0.35 | 0.31 | 0.30 | 0.36 | 0.32 | 0.31 | 0.28 | 0.29 | 0.29 | 0.24 | 0.30 | 0.37 | 0.31 | 0.33 | 0.36 | 0.35 | 0.31 | 0.30 | 0.36 | 0.32 | 0.31 | 0.28 | 0.29 | 0.29 | 0.24 | 0.30 | 0.37 | 0.31 | 0.33 | 0.62 | 0.31 | 0.16 | 0.08 | 0.08 | 0.06 | 0.04 | 0.04 | 0.04 | 0.04 | 0.03 | 0.04 | 0.04 | 0.04 | 0.04 | 0.62 | 0.31 | 0.16 | 0.08 | 0.08 | 0.06 | 0.04 | 0.04 | 0.04 | 0.04 | 0.03 | 0.04 | 0.04 | 0.04 | 0.04 | 0.62 | 0.30 | 0.14 | 0.07 | 0.04 | 0.03 | 0.02 | 0.02 | 0.02 | 0.02 | 0.01 | 0.02 | 0.02 | 0.02 | 0.02 | 0.62 | 0.30 | 0.14 | 0.07 | 0.04 | 0.03 | 0.02 | 0.02 | 0.02 | 0.02 | 0.01 | 0.02 | 0.02 | 0.02 | 0.02 | 1 | 2 | 4 | 8 | 16 | 24 | 31 | 39 | 46 | 46 | 57 | 63 | 73 | 78 | 80 | 40 | 100 | 1 | 1 | 1 | 1 | 1.01 | 1.17 | 1.22 | 1.79 | 2.33 | 1.49 | 2.21 | 2.34 | 2.45 | 2.26 | 2.89 | 2.55 | 2.66 | 2.42 | 2 | 0 | 0 | 0 | 0 | 100.00 | 1 | 0 | 1.02 | 0 | 1.13 | 0 | 1.15 | 0 | 0.88 | 0.04 | 0.86 | 0.05 | 0.78 | 0.07 | 0.8 | 0.06 | 0.69 | 0.09 | 0.64 | 0.1 | 0.72 | 0.07 | 0.55 | 0.13 | 0.42 | 0.22 | 0.44 | 0.17 | 0.39 | 0.2 |
| 908 | libggml-cpu.so - vec.cpp:311-316 | ggml_vec_dot_f16 | Single | 0.35 | 0.43 | 0.52 | 0.43 | 0.44 | 0.54 | 0.82 | 0.74 | 0.85 | 0.76 | 0.80 | 0.88 | 0.75 | 0.76 | 0.89 | 0.36 | 0.44 | 0.46 | 0.38 | 0.33 | 0.41 | 0.55 | 0.54 | 0.53 | 0.56 | 0.64 | 0.47 | 0.60 | 0.61 | 0.56 | 0.36 | 0.44 | 0.46 | 0.38 | 0.33 | 0.41 | 0.55 | 0.54 | 0.53 | 0.56 | 0.64 | 0.47 | 0.60 | 0.61 | 0.56 | 0.62 | 0.38 | 0.23 | 0.10 | 0.06 | 0.06 | 0.08 | 0.07 | 0.07 | 0.06 | 0.06 | 0.06 | 0.06 | 0.05 | 0.06 | 0.62 | 0.38 | 0.23 | 0.10 | 0.06 | 0.06 | 0.08 | 0.07 | 0.07 | 0.06 | 0.06 | 0.06 | 0.06 | 0.05 | 0.06 | 0.61 | 0.38 | 0.20 | 0.09 | 0.04 | 0.04 | 0.04 | 0.04 | 0.03 | 0.03 | 0.03 | 0.02 | 0.03 | 0.03 | 0.03 | 0.61 | 0.38 | 0.20 | 0.09 | 0.04 | 0.04 | 0.04 | 0.04 | 0.03 | 0.03 | 0.03 | 0.02 | 0.03 | 0.03 | 0.03 | 1 | 2 | 4 | 8 | 16 | 24 | 32 | 40 | 46 | 52 | 64 | 64 | 73 | 85 | 86 | 50 | 100 | 1 | 1 | 1 | 1 | 1.01 | 1.18 | 1.24 | 1.57 | 1.66 | 2.01 | 1.92 | 2.24 | 1.89 | 1.95 | 2.65 | 1.93 | 2.04 | 2.48 | 2 | 0 | 0 | 0 | 0 | 100.00 | 1 | 0 | 0.81 | 0.08 | 0.77 | 0.11 | 0.89 | 0.04 | 0.96 | 0.01 | 0.66 | 0.14 | 0.44 | 0.31 | 0.41 | 0.32 | 0.38 | 0.33 | 0.33 | 0.38 | 0.28 | 0.46 | 0.34 | 0.31 | 0.26 | 0.44 | 0.22 | 0.47 | 0.23 | 0.43 |
| 2496 | libggml-cpu.so - kai_lhs_quant_pack_qsi8d32p4x8sb_f32_neon.c:96-258 [...] | kai_run_lhs_quant_pack_qsi8d32p4x8sb_f32_neon | Innermost | 0.34 | 0.33 | 0.35 | 0.72 | 1.45 | 1.62 | 2.37 | 1.83 | 2.25 | 2.55 | 3.05 | 2.85 | 3.01 | 2.68 | 2.46 | 0.34 | 0.34 | 0.28 | 0.35 | 0.39 | 0.27 | 0.28 | 0.23 | 0.22 | 0.23 | 0.26 | 0.23 | 0.20 | 0.18 | 0.17 | 0.34 | 0.34 | 0.28 | 0.35 | 0.39 | 0.27 | 0.28 | 0.23 | 0.22 | 0.23 | 0.26 | 0.23 | 0.20 | 0.18 | 0.17 | 0.58 | 0.29 | 0.16 | 0.17 | 0.20 | 0.18 | 0.23 | 0.16 | 0.18 | 0.20 | 0.23 | 0.21 | 0.22 | 0.19 | 0.18 | 0.58 | 0.29 | 0.16 | 0.17 | 0.20 | 0.18 | 0.23 | 0.16 | 0.18 | 0.20 | 0.23 | 0.21 | 0.22 | 0.19 | 0.18 | 0.58 | 0.29 | 0.12 | 0.08 | 0.05 | 0.03 | 0.02 | 0.02 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.58 | 0.29 | 0.12 | 0.08 | 0.05 | 0.03 | 0.02 | 0.02 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 1 | 2 | 4 | 4 | 4 | 4 | 4 | 4 | 4 | 4 | 4 | 4 | 4 | 4 | 4 | 77.23 | 96.44 | 1 | 1 | 1.03 | 1 | 1.01 | 1.32 | 1.12 | 1.11 | 1.27 | 1.39 | 1.12 | 1.24 | 1.18 | 1.15 | 1.11 | 1.26 | 1.16 | 1.07 | 1 | 0 | 1 | 3 | 0 | 65.00 | 1 | 0 | 1 | 0 | 1.19 | 0 | 0.91 | 0.03 | 0.77 | 0.09 | 0.96 | 0.01 | 0.81 | 0.05 | 0.93 | 0.02 | 0.86 | 0.03 | 0.75 | 0.06 | 0.64 | 0.09 | 0.68 | 0.07 | 0.72 | 0.06 | 0.72 | 0.05 | 0.73 | 0.04 |
| 2529 | libggml-cpu.so - kai_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm.c:131-131 | kai_run_matmul_clamp_f32_qsi8d32p4x8_qsi4c32p4x8_16x4_neon_i8mm | InBetween | 0.33 | 0.31 | 0.43 | 0.47 | 0.40 | 0.45 | 0.46 | 0.40 | 0.30 | 0.38 | 0.33 | 0.27 | 0.27 | 0.34 | 0.34 | 0.33 | 0.30 | 0.34 | 0.30 | 0.28 | 0.28 | 0.27 | 0.24 | 0.20 | 0.22 | 0.17 | 0.19 | 0.16 | 0.16 | 0.13 | 68.99 | 68.56 | 68.21 | 66.74 | 64.23 | 62.37 | 60.80 | 58.42 | 56.71 | 54.99 | 55.11 | 51.95 | 52.21 | 50.05 | 48.35 | 0.57 | 0.27 | 0.19 | 0.11 | 0.05 | 0.05 | 0.04 | 0.04 | 0.03 | 0.03 | 0.03 | 0.02 | 0.02 | 0.03 | 0.03 | 118.81 | 59.31 | 29.90 | 14.91 | 7.60 | 5.69 | 4.67 | 3.96 | 3.43 | 3.14 | 2.84 | 2.76 | 2.53 | 2.40 | 2.28 | 0.57 | 0.26 | 0.15 | 0.07 | 0.03 | 0.03 | 0.02 | 0.02 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 118.81 | 59.45 | 30.01 | 15.17 | 7.85 | 5.96 | 4.86 | 4.03 | 3.66 | 3.27 | 3.02 | 2.73 | 2.63 | 2.58 | 2.42 | 1 | 2 | 4 | 8 | 16 | 24 | 31 | 37 | 47 | 53 | 54 | 64 | 69 | 69 | 61 | 27.59 | 55.71 | 1 | 1 | 1.62 | 1 | 1.06 | 1.31 | 1.7 | 1.69 | 2.02 | 2.25 | 2.18 | 2.12 | 2.43 | 2.55 | 2.02 | 2.46 | 2.92 | 3.02 | NA | NA | NA | NA | NA | 0.00 | 1 | 0 | 1.11 | 0 | 0.95 | 0.02 | 1.03 | 0 | 1.04 | 0 | 0.89 | 0.03 | 0.84 | 0.04 | 0.87 | 0.03 | 0.9 | 0.02 | 0.76 | 0.05 | 0.95 | 0.01 | 0.78 | 0.04 | 0.88 | 0.02 | 0.81 | 0.03 | 0.95 | 0.01 |
| 2511 | libggml-cpu.so - kai_rhs_pack_nxk_qsi4c32pscalef16_qsu4c32s16s0.c:127-139 [...] | kai_run_rhs_pack_nxk_qsi4c32pscalef16_qsu4c32s16s0 | Innermost | 0.17 | 0.24 | 0.67 | 0.99 | 1.89 | 3.19 | 2.47 | 3.03 | 2.92 | 4.39 | 4.05 | 3.53 | 4.38 | 4.67 | 3.35 | 0.17 | 0.12 | 0.18 | 0.14 | 0.14 | 0.17 | 0.10 | 0.11 | 0.09 | 0.12 | 0.10 | 0.08 | 0.09 | 0.09 | 0.06 | 0.17 | 0.12 | 0.18 | 0.14 | 0.14 | 0.17 | 0.10 | 0.11 | 0.09 | 0.12 | 0.10 | 0.08 | 0.09 | 0.09 | 0.06 | 0.30 | 0.21 | 0.31 | 0.24 | 0.26 | 0.36 | 0.24 | 0.27 | 0.24 | 0.34 | 0.31 | 0.26 | 0.32 | 0.34 | 0.25 | 0.30 | 0.21 | 0.31 | 0.24 | 0.26 | 0.36 | 0.24 | 0.27 | 0.24 | 0.34 | 0.31 | 0.26 | 0.32 | 0.34 | 0.25 | 0.30 | 0.11 | 0.08 | 0.03 | 0.02 | 0.02 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 | 0.30 | 0.11 | 0.08 | 0.03 | 0.02 | 0.02 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 0 | 50 | 1 | 1 | 2 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 0 | 0 | 0 | 1 | 50.00 | 1 | 0 | 1.42 | 0 | 0.97 | 0 | 1.22 | 0 | 1.1 | 0 | 0.78 | 0.04 | 1.14 | 0 | 1.03 | 0 | 1.1 | 0 | 0.76 | 0.03 | 0.87 | 0.01 | 1.01 | 0 | 0.81 | 0.02 | 0.74 | 0.02 | 1.03 | 0 |
| 0 | libggml-cpu.so - ggml-cpu.c:3228-3229 [...] | ggml_cpu_fp32_to_fp16 | Single | 0.13 | 0.12 | 0.10 | 0.19 | 0.29 | 0.22 | 0.26 | 0.23 | 0.24 | 0.32 | 0.33 | 0.54 | 0.34 | 0.27 | 0.34 | 0.13 | 0.12 | 0.09 | 0.11 | 0.12 | 0.09 | 0.10 | 0.13 | 0.09 | 0.12 | 0.13 | 0.09 | 0.09 | 0.09 | 0.09 | 0.13 | 0.12 | 0.09 | 0.11 | 0.12 | 0.09 | 0.10 | 0.13 | 0.09 | 0.12 | 0.13 | 0.09 | 0.09 | 0.09 | 0.09 | 0.23 | 0.10 | 0.04 | 0.04 | 0.04 | 0.03 | 0.02 | 0.02 | 0.02 | 0.03 | 0.03 | 0.04 | 0.03 | 0.02 | 0.02 | 0.23 | 0.10 | 0.04 | 0.04 | 0.04 | 0.03 | 0.02 | 0.02 | 0.02 | 0.03 | 0.03 | 0.04 | 0.03 | 0.02 | 0.02 | 0.23 | 0.10 | 0.04 | 0.02 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 | 0.23 | 0.10 | 0.04 | 0.02 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 2 | 4 | 8 | 16 | 18 | 24 | 31 | 28 | 33 | 41 | 34 | 38 | 44 | 39 | 91.67 | 98.61 | 1 | 1 | 1 | 1 | 1.05 | 1.2 | 1.89 | 2.98 | 2.37 | 2.45 | 1.97 | 2.29 | 2.29 | 2.63 | 4.61 | 2.97 | 2.67 | 2.75 | 2 | 0 | 0 | 0 | 0 | 100.00 | 1 | 0 | 1.15 | 0 | 1.52 | 0 | 1.18 | 0 | 1.02 | 0 | 1.12 | 0 | 0.86 | 0.01 | 0.66 | 0.04 | 0.82 | 0.02 | 0.56 | 0.05 | 0.52 | 0.06 | 0.68 | 0.03 | 0.62 | 0.03 | 0.58 | 0.04 | 0.54 | 0.04 |
| 541 | libggml-cpu.so - binary-ops.cpp:18-32 [...] | ggml_compute_forward_mul | Innermost | 0.12 | 0.15 | 0.13 | 0.23 | 0.29 | 0.27 | 0.41 | 0.46 | 0.36 | 0.51 | 0.53 | 0.75 | 0.48 | 0.48 | 0.48 | 0.12 | 0.14 | 0.12 | 0.17 | 0.17 | 0.15 | 0.13 | 0.14 | 0.12 | 0.11 | 0.12 | 0.14 | 0.10 | 0.08 | 0.09 | 0.12 | 0.14 | 0.12 | 0.17 | 0.17 | 0.15 | 0.13 | 0.14 | 0.12 | 0.11 | 0.12 | 0.14 | 0.10 | 0.08 | 0.09 | 0.21 | 0.13 | 0.06 | 0.05 | 0.04 | 0.03 | 0.04 | 0.04 | 0.03 | 0.04 | 0.04 | 0.05 | 0.04 | 0.04 | 0.04 | 0.21 | 0.13 | 0.06 | 0.05 | 0.04 | 0.03 | 0.04 | 0.04 | 0.03 | 0.04 | 0.04 | 0.05 | 0.04 | 0.04 | 0.04 | 0.21 | 0.13 | 0.05 | 0.04 | 0.02 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.00 | 0.00 | 0.00 | 0.21 | 0.13 | 0.05 | 0.04 | 0.02 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.00 | 0.00 | 0.00 | 1 | 2 | 4 | 8 | 16 | 16 | 15 | 16 | 16 | 16 | 16 | 16 | 16 | 16 | 16 | 0 | 23.68 | 1 | 1 | 5.33 | 1 | 1.04 | 1.17 | 1.47 | 2.03 | 1.48 | 1.94 | 1.8 | 1.5 | 2 | 1.73 | 1.96 | 1.62 | 1.93 | 1.58 | 0 | 0 | 0 | 3 | 0 | 50.00 | 1 | 0 | 0.86 | 0.02 | 1.04 | 0 | 0.7 | 0.05 | 0.65 | 0.06 | 0.61 | 0.06 | 0.63 | 0.05 | 0.55 | 0.06 | 0.59 | 0.05 | 0.59 | 0.04 | 0.51 | 0.06 | 0.42 | 0.08 | 0.54 | 0.05 | 0.62 | 0.03 | 0.51 | 0.04 |
| 437 | libggml-cpu.so - binary-ops.cpp:10-32 [...] | ggml_compute_forward_add_non_quantized | Innermost | 0.12 | 0.16 | 0.26 | 0.29 | 0.29 | 0.36 | 0.41 | 0.63 | 0.61 | 0.51 | 0.53 | 0.61 | 0.41 | 0.55 | 0.48 | 0.12 | 0.15 | 0.21 | 0.19 | 0.20 | 0.16 | 0.16 | 0.15 | 0.14 | 0.11 | 0.11 | 0.12 | 0.08 | 0.10 | 0.07 | 0.12 | 0.15 | 0.21 | 0.19 | 0.20 | 0.16 | 0.16 | 0.15 | 0.14 | 0.11 | 0.11 | 0.12 | 0.08 | 0.10 | 0.07 | 0.20 | 0.14 | 0.12 | 0.07 | 0.04 | 0.04 | 0.04 | 0.06 | 0.05 | 0.04 | 0.04 | 0.05 | 0.03 | 0.04 | 0.04 | 0.20 | 0.14 | 0.12 | 0.07 | 0.04 | 0.04 | 0.04 | 0.06 | 0.05 | 0.04 | 0.04 | 0.05 | 0.03 | 0.04 | 0.04 | 0.21 | 0.13 | 0.09 | 0.04 | 0.02 | 0.02 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.00 | 0.01 | 0.00 | 0.21 | 0.13 | 0.09 | 0.04 | 0.02 | 0.02 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.00 | 0.01 | 0.00 | 1 | 2 | 4 | 8 | 16 | 15 | 15 | 16 | 15 | 16 | 16 | 16 | 16 | 16 | 16 | 0 | 25 | 1 | 1 | 5.33 | 1 | 1.09 | 1.3 | 1.67 | 1.73 | 1.76 | 1.6 | 2.35 | 1.92 | 2 | 1.83 | 1.8 | 1.75 | 1.68 | 1.93 | 0 | 0 | 0 | 3 | 0 | 50.00 | 1 | 0 | 0.77 | 0.04 | 0.55 | 0.1 | 0.6 | 0.08 | 0.53 | 0.09 | 0.56 | 0.07 | 0.5 | 0.08 | 0.5 | 0.08 | 0.46 | 0.08 | 0.56 | 0.05 | 0.52 | 0.05 | 0.45 | 0.07 | 0.65 | 0.03 | 0.45 | 0.06 | 0.59 | 0.03 |
| 1591 | libggml-cpu.so - ops.cpp:6446-6456 [...] | ggml_compute_forward_rope_f32(ggml_compute_params const*, ggml_tensor*, bool) | Innermost | 0.08 | 0.10 | 0.09 | 0.14 | 0.15 | 0.22 | 0.26 | 0.17 | 0.24 | 0.19 | 0.20 | 0.20 | 0.34 | 0.34 | 0.20 | 0.08 | 0.09 | 0.06 | 0.08 | 0.07 | 0.07 | 0.06 | 0.07 | 0.10 | 0.09 | 0.09 | 0.06 | 0.08 | 0.09 | 0.06 | 0.08 | 0.09 | 0.06 | 0.08 | 0.07 | 0.07 | 0.06 | 0.07 | 0.10 | 0.09 | 0.09 | 0.06 | 0.08 | 0.09 | 0.06 | 0.13 | 0.09 | 0.04 | 0.04 | 0.02 | 0.03 | 0.03 | 0.01 | 0.02 | 0.02 | 0.02 | 0.01 | 0.03 | 0.03 | 0.02 | 0.13 | 0.09 | 0.04 | 0.04 | 0.02 | 0.03 | 0.03 | 0.01 | 0.02 | 0.02 | 0.02 | 0.01 | 0.03 | 0.03 | 0.02 | 0.14 | 0.08 | 0.03 | 0.02 | 0.01 | 0.01 | 0.00 | 0.00 | 0.01 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.14 | 0.08 | 0.03 | 0.02 | 0.01 | 0.01 | 0.00 | 0.00 | 0.01 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 2 | 4 | 8 | 13 | 18 | 20 | 19 | 29 | 32 | 34 | 29 | 40 | 38 | 35 | 55.56 | 43.75 | 1.07 | 1.58 | 2.35 | 1 | 1.16 | 1.45 | 2.07 | 1.93 | 2.9 | 3.45 | 1.68 | 2.07 | 1.81 | 1.92 | 2.07 | 3.45 | 2.79 | 2.06 | 0 | 0 | 1 | 2 | 0 | 58.33 | 1 | 0 | 0.87 | 0.01 | 1.21 | 0 | 0.98 | 0 | 0.95 | 0 | 0.81 | 0.01 | 0.85 | 0.01 | 0.72 | 0.02 | 0.42 | 0.06 | 0.45 | 0.05 | 0.45 | 0.05 | 0.56 | 0.03 | 0.4 | 0.05 | 0.33 | 0.06 | 0.44 | 0.04 |
| 2512 | libggml-cpu.so - kai_rhs_pack_nxk_qsi4c32pscalef16_qsu4c32s16s0.c:115-118 | kai_run_rhs_pack_nxk_qsi4c32pscalef16_qsu4c32s16s0 | Innermost | 0.06 | 0.19 | 0.35 | 0.68 | 0.73 | 1.12 | 1.34 | 1.49 | 1.46 | 1.53 | 1.26 | 1.97 | 1.98 | 1.99 | 2.19 | 0.06 | 0.10 | 0.09 | 0.09 | 0.05 | 0.06 | 0.06 | 0.05 | 0.04 | 0.04 | 0.03 | 0.04 | 0.04 | 0.04 | 0.04 | 0.06 | 0.10 | 0.09 | 0.09 | 0.05 | 0.06 | 0.06 | 0.05 | 0.04 | 0.04 | 0.03 | 0.04 | 0.04 | 0.04 | 0.04 | 0.11 | 0.16 | 0.16 | 0.17 | 0.10 | 0.13 | 0.13 | 0.13 | 0.12 | 0.12 | 0.09 | 0.15 | 0.15 | 0.15 | 0.16 | 0.11 | 0.16 | 0.16 | 0.17 | 0.10 | 0.13 | 0.13 | 0.13 | 0.12 | 0.12 | 0.09 | 0.15 | 0.15 | 0.15 | 0.16 | 0.11 | 0.08 | 0.04 | 0.02 | 0.01 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.11 | 0.08 | 0.04 | 0.02 | 0.01 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 0 | 31.25 | 1 | 1 | 5.33 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 0 | 0 | 0 | 1 | 1 | 25.00 | 1 | 0 | 0.66 | 0.03 | 0.68 | 0.03 | 0.65 | 0.03 | 1.05 | 0 | 0.81 | 0.01 | 0.77 | 0.01 | 0.77 | 0.01 | 0.8 | 0.01 | 0.8 | 0.01 | 1.02 | 0 | 0.66 | 0.01 | 0.66 | 0.01 | 0.63 | 0.01 | 0.58 | 0.02 |
| 1353 | libggml-cpu.so - ops.cpp:4325-4326 | ggml_compute_forward_rms_norm | Innermost | 0.05 | 0.08 | 0.11 | 0.17 | 0.15 | 0.13 | 0.15 | 0.17 | 0.18 | 0.13 | 0.27 | 0.34 | 0.41 | 0.27 | 0.20 | 0.05 | 0.07 | 0.09 | 0.08 | 0.05 | 0.05 | 0.04 | 0.03 | 0.04 | 0.02 | 0.02 | 0.03 | 0.03 | 0.03 | 0.02 | 0.05 | 0.07 | 0.09 | 0.08 | 0.05 | 0.05 | 0.04 | 0.03 | 0.04 | 0.02 | 0.02 | 0.03 | 0.03 | 0.03 | 0.02 | 0.08 | 0.08 | 0.05 | 0.04 | 0.02 | 0.02 | 0.02 | 0.01 | 0.02 | 0.01 | 0.02 | 0.02 | 0.03 | 0.02 | 0.02 | 0.08 | 0.08 | 0.05 | 0.04 | 0.02 | 0.02 | 0.02 | 0.01 | 0.02 | 0.01 | 0.02 | 0.02 | 0.03 | 0.02 | 0.02 | 0.08 | 0.06 | 0.04 | 0.02 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.08 | 0.06 | 0.04 | 0.02 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 2 | 4 | 8 | 11 | 12 | 13 | 9 | 12 | 9 | 9 | 10 | 9 | 13 | 11 | 16.67 | 54.17 | 1 | 1.25 | 2 | 1 | 1.3 | 1.25 | 2.13 | 2.32 | 1.71 | 1.95 | 1.93 | 1.57 | 1.38 | 2.57 | 2.5 | 3 | 2.26 | 1.74 | 0 | 0 | 1 | 0 | 0 | 75.00 | 1 | 0 | 0.74 | 0.02 | 0.53 | 0.04 | 0.55 | 0.04 | 0.85 | 0.01 | 0.75 | 0.01 | 0.78 | 0.01 | 1.1 | 0 | 0.65 | 0.01 | 1.15 | 0 | 1.07 | 0 | 0.74 | 0.01 | 0.82 | 0 | 0.62 | 0.01 | 0.75 | 0.01 |
| 53 | libggml-cpu.so - ggml-cpu.c:1183-1194 [...] | ggml_compute_forward_mul_mat | Innermost | 0.03 | 0.07 | 0.08 | 0.10 | 0.15 | 0.13 | 0.15 | 0.11 | 0.12 | 0.13 | 0.13 | 0.14 | 0.14 | 0.14 | 0.14 | 0.03 | 0.05 | 0.05 | 0.06 | 0.07 | 0.05 | 0.06 | 0.03 | 0.04 | 0.04 | 0.04 | 0.05 | 0.03 | 0.03 | 0.03 | 0.03 | 0.05 | 0.05 | 0.06 | 0.07 | 0.05 | 0.06 | 0.03 | 0.04 | 0.04 | 0.04 | 0.05 | 0.03 | 0.03 | 0.03 | 0.06 | 0.06 | 0.04 | 0.03 | 0.02 | 0.02 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.06 | 0.06 | 0.04 | 0.03 | 0.02 | 0.02 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.06 | 0.05 | 0.02 | 0.01 | 0.01 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.06 | 0.05 | 0.02 | 0.01 | 0.01 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 2 | 4 | 7 | 13 | 14 | 18 | 14 | 20 | 20 | 19 | 29 | 17 | 19 | 23 | 0 | 50 | 1 | 1 | 2 | 1 | 1.33 | 1.56 | 1.75 | 1.93 | 1.83 | 2 | 1.65 | 1.67 | 1.9 | 1.58 | 1.66 | 1.7 | 1.73 | 1.7 | 1 | 0 | 0 | 0 | 0 | 100.00 | 1 | 0 | 0.66 | 0.02 | 0.66 | 0.02 | 0.59 | 0.02 | 0.42 | 0.04 | 0.48 | 0.03 | 0.41 | 0.03 | 0.64 | 0.01 | 0.44 | 0.02 | 0.5 | 0.02 | 0.44 | 0.02 | 0.3 | 0.04 | 0.52 | 0.01 | 0.46 | 0.02 | 0.37 | 0.02 |
| 1354 | libggml-cpu.so - vec.h:677-682 | ggml_compute_forward_rms_norm | Innermost | 0.03 | 0.03 | 0.04 | 0.06 | 0.04 | 0.09 | 0.10 | 0.17 | 0.06 | 0.06 | 0.13 | 0.20 | 0.14 | 0.14 | 0.14 | 0.03 | 0.03 | 0.03 | 0.02 | 0.02 | 0.02 | 0.02 | 0.02 | 0.01 | 0.01 | 0.01 | 0.02 | 0.02 | 0.02 | 0.01 | 0.03 | 0.03 | 0.03 | 0.02 | 0.02 | 0.02 | 0.02 | 0.02 | 0.01 | 0.01 | 0.01 | 0.02 | 0.02 | 0.02 | 0.01 | 0.05 | 0.02 | 0.02 | 0.01 | 0.01 | 0.01 | 0.01 | 0.02 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.05 | 0.02 | 0.02 | 0.01 | 0.01 | 0.01 | 0.01 | 0.02 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.05 | 0.02 | 0.01 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.05 | 0.02 | 0.01 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 2 | 4 | 5 | 8 | 6 | 6 | 7 | 7 | 4 | 6 | 10 | 11 | 10 | 6 | 50 | 100 | 1 | 1 | 1 | 1 | 1.11 | 1.6 | 1.88 | 1 | 1.71 | 1.5 | 1.75 | 1 | 1 | 1.5 | 2.14 | 1.69 | 1.54 | 1.5 | 1 | 0 | 0 | 0 | 0 | 100.00 | 1 | 0 | 1.11 | 0 | 0.99 | 0 | 1.22 | 0 | 1.19 | 0 | 1.32 | 0 | 1.14 | 0 | 0.76 | 0.01 | 1.25 | 0 | 2.19 | 0 | 1.1 | 0 | 0.62 | 0.01 | 0.67 | 0.01 | 0.64 | 0.01 | 1.05 | 0 |
| 1893 | libggml-cpu.so - vec.h:375-751 [...] | ggml_compute_forward_flash_attn_ext | InBetween | 0.02 | 0.05 | 0.02 | 0.04 | 0.11 | 0.04 | 0.05 | 0.11 | 0.06 | 0.06 | 0.07 | 0.07 | 0.14 | 0.14 | 0.07 | 0.02 | 0.03 | 0.02 | 0.02 | 0.04 | 0.03 | 0.01 | 0.01 | 0.02 | 0.01 | 0.02 | 0.01 | 0.02 | 0.02 | 0.02 | 1.71 | 1.64 | 1.51 | 1.46 | 1.70 | 1.42 | 1.35 | 1.24 | 1.21 | 1.12 | 1.09 | 1.01 | 1.14 | 0.98 | 0.98 | 0.04 | 0.04 | 0.01 | 0.01 | 0.02 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 2.95 | 1.42 | 0.68 | 0.37 | 0.22 | 0.21 | 0.16 | 0.13 | 0.09 | 0.08 | 0.08 | 0.10 | 0.08 | 0.07 | 0.08 | 0.04 | 0.03 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 2.95 | 1.42 | 0.66 | 0.33 | 0.21 | 0.14 | 0.11 | 0.09 | 0.08 | 0.07 | 0.06 | 0.05 | 0.06 | 0.05 | 0.05 | 1 | 2 | 4 | 5 | 9 | 12 | 4 | 4 | 11 | 5 | 15 | 6 | 10 | 16 | 16 | 0 | 44.59 | 2.01 | 1.34 | 1.34 | 1 | 1.33 | 1.33 | 1.67 | 1.8 | 1 | 1 | 1.33 | 1 | 1 | 1 | 1 | 1.82 | 1.88 | 1 | NA | NA | NA | NA | NA | 0.00 | 1 | 0 | 0.66 | 0.01 | 1.32 | 0 | 1.3 | 0 | 0.51 | 0.02 | 0.62 | 0.01 | 1.83 | 0 | 1.21 | 0 | 0.64 | 0.01 | 1.4 | 0 | 0.47 | 0.01 | 1.17 | 0 | 0.63 | 0.01 | 0.39 | 0.01 | 0.42 | 0.01 |
| 2510 | libggml-cpu.so - kai_rhs_pack_nxk_qsi4c32pscalef16_qsu4c32s16s0.c:107-154 [...] | kai_run_rhs_pack_nxk_qsi4c32pscalef16_qsu4c32s16s0 | Outermost | 0.02 | 0.07 | 0.08 | 0.31 | 0.47 | 0.36 | 0.57 | 0.63 | 0.85 | 0.38 | 0.27 | 0.68 | 0.55 | 0.76 | 0.61 | 0.02 | 0.03 | 0.02 | 0.04 | 0.03 | 0.02 | 0.02 | 0.02 | 0.03 | 0.01 | 0.01 | 0.02 | 0.01 | 0.01 | 0.01 | 0.26 | 0.25 | 0.29 | 0.27 | 0.23 | 0.25 | 0.18 | 0.18 | 0.16 | 0.17 | 0.14 | 0.14 | 0.15 | 0.14 | 0.11 | 0.04 | 0.06 | 0.04 | 0.08 | 0.07 | 0.04 | 0.05 | 0.05 | 0.07 | 0.03 | 0.02 | 0.05 | 0.04 | 0.06 | 0.05 | 0.44 | 0.44 | 0.50 | 0.48 | 0.43 | 0.52 | 0.42 | 0.45 | 0.43 | 0.50 | 0.42 | 0.46 | 0.51 | 0.54 | 0.45 | 0.03 | 0.03 | 0.01 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.44 | 0.22 | 0.13 | 0.06 | 0.03 | 0.02 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 0 | 46.25 | 1 | 1 | 2 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | NA | NA | NA | NA | NA | 0.00 | 1 | 0 | 0.58 | 0.01 | 0.99 | 0 | 0.46 | 0.02 | 0.51 | 0.02 | 0.81 | 0 | 0.58 | 0.01 | 0.58 | 0.01 | 0.44 | 0.01 | 1.02 | 0 | 1.54 | 0 | 0.61 | 0.01 | 0.76 | 0 | 0.53 | 0.01 | 0.65 | 0 |
| 54 | libggml-cpu.so - ggml-cpu.c:1125-1395 [...] | ggml_compute_forward_mul_mat | Innermost | 0.02 | 0.05 | 0.04 | 0.06 | 0.07 | 0.09 | 0.15 | 0.17 | 0.12 | 0.06 | 0.07 | 0.07 | 0.14 | 0.07 | 0.20 | 0.02 | 0.04 | 0.03 | 0.04 | 0.04 | 0.03 | 0.04 | 0.04 | 0.02 | 0.03 | 0.02 | 0.02 | 0.02 | 0.01 | 0.02 | 0.02 | 0.04 | 0.03 | 0.04 | 0.04 | 0.03 | 0.04 | 0.04 | 0.02 | 0.03 | 0.02 | 0.02 | 0.02 | 0.01 | 0.02 | 0.03 | 0.04 | 0.02 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.03 | 0.04 | 0.02 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.03 | 0.03 | 0.01 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.03 | 0.03 | 0.01 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 2 | 4 | 8 | 9 | 10 | 15 | 13 | 11 | 16 | 12 | 12 | 15 | 9 | 16 | 0 | 46.88 | 1 | 1 | 2 | 1 | 1.23 | 1.6 | 1.6 | 1.29 | 1.67 | 2.14 | 2.17 | 1.83 | 1 | 1 | 1 | 1.76 | 1 | 2.67 | NA | NA | NA | NA | NA | 0.00 | 1 | 0 | 0.46 | 0.02 | 0.59 | 0.01 | 0.39 | 0.03 | 0.41 | 0.02 | 0.46 | 0.02 | 0.26 | 0.03 | 0.3 | 0.02 | 0.44 | 0.01 | 0.33 | 0.02 | 0.44 | 0.01 | 0.44 | 0.01 | 0.31 | 0.02 | 0.56 | 0.01 | 0.28 | 0.02 |
| 1596 | libggml-cpu.so - ops.cpp:6220-6245 [...] | ggml_compute_forward_rope_f32(ggml_compute_params const*, ggml_tensor*, bool) | Innermost | 0.01 | 0.05 | 0.10 | 0.14 | 0.33 | 0.49 | 0.51 | 0.57 | 0.61 | 0.70 | 0.73 | 0.81 | 0.82 | 0.82 | 0.68 | 0.01 | 0.04 | 0.06 | 0.12 | 0.24 | 0.29 | 0.37 | 0.45 | 0.47 | 0.50 | 0.59 | 0.61 | 0.64 | 0.63 | 0.64 | 0.01 | 0.04 | 0.06 | 0.12 | 0.24 | 0.29 | 0.37 | 0.45 | 0.47 | 0.50 | 0.59 | 0.61 | 0.64 | 0.63 | 0.64 | 0.02 | 0.04 | 0.04 | 0.04 | 0.05 | 0.05 | 0.05 | 0.05 | 0.05 | 0.05 | 0.05 | 0.06 | 0.06 | 0.06 | 0.05 | 0.02 | 0.04 | 0.04 | 0.04 | 0.05 | 0.05 | 0.05 | 0.05 | 0.05 | 0.05 | 0.05 | 0.06 | 0.06 | 0.06 | 0.05 | 0.03 | 0.03 | 0.03 | 0.03 | 0.03 | 0.03 | 0.03 | 0.03 | 0.03 | 0.03 | 0.03 | 0.03 | 0.03 | 0.03 | 0.03 | 0.03 | 0.03 | 0.03 | 0.03 | 0.03 | 0.03 | 0.03 | 0.03 | 0.03 | 0.03 | 0.03 | 0.03 | 0.03 | 0.03 | 0.03 | 1 | 2 | 4 | 8 | 16 | 23 | 32 | 40 | 48 | 56 | 64 | 71 | 79 | 88 | 95 | 0 | 26.14 | 1 | 2 | 4.2 | 1 | 1.23 | 1.64 | 1.33 | 1.58 | 2.07 | 1.84 | 1.78 | 1.87 | 2.1 | 1.94 | 2.12 | 2.14 | 2.23 | 1.85 | 2 | 0 | 0 | 1 | 0 | 83.33 | 1 | 0 | 0.38 | 0.02 | 0.22 | 0.05 | 0.12 | 0.1 | 0.05 | 0.23 | 0.04 | 0.28 | 0.03 | 0.36 | 0.02 | 0.44 | 0.02 | 0.46 | 0.01 | 0.5 | 0.01 | 0.58 | 0.01 | 0.6 | 0.01 | 0.63 | 0.01 | 0.62 | 0.01 | 0.63 |
| 56 | libggml-cpu.so - ggml-cpu.c:1125-1395 [...] | ggml_compute_forward_mul_mat | InBetween | 0.01 | 0.02 | 0.04 | 0.06 | 0.11 | 0.09 | 0.10 | 0.06 | 0.06 | 0.06 | 0.13 | 0.14 | 0.14 | 0.07 | 0.14 | 0.01 | 0.02 | 0.02 | 0.03 | 0.03 | 0.02 | 0.02 | 0.01 | 0.00 | 0.02 | 0.01 | 0.02 | 0.02 | 0.01 | 0.01 | 0.06 | 0.11 | 0.10 | 0.14 | 0.14 | 0.10 | 0.13 | 0.08 | 0.07 | 0.08 | 0.07 | 0.09 | 0.07 | 0.05 | 0.07 | 0.02 | 0.02 | 0.02 | 0.02 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.11 | 0.12 | 0.06 | 0.04 | 0.04 | 0.02 | 0.04 | 0.02 | 0.02 | 0.02 | 0.02 | 0.01 | 0.02 | 0.01 | 0.01 | 0.02 | 0.02 | 0.01 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.10 | 0.10 | 0.04 | 0.03 | 0.02 | 0.01 | 0.01 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 2 | 3 | 7 | 6 | 7 | 7 | 6 | 2 | 10 | 8 | 9 | 10 | 7 | 9 | 0 | 48.2 | 1 | 1 | 2 | 1 | 1.33 | 2 | 1.75 | 1.8 | 1.56 | 1.56 | 1 | 1 | 1 | 1.78 | 1.8 | 1.82 | 1 | 1.8 | NA | NA | NA | NA | NA | 0.00 | 1 | 0 | 0.5 | 0.01 | 0.49 | 0.01 | 0.24 | 0.03 | 0.29 | 0.02 | 0.31 | 0.01 | 0.3 | 0.01 | 0.45 | 0.01 | 1.31 | 0 | 0.26 | 0.01 | 0.29 | 0.01 | 0.26 | 0.01 | 0.24 | 0.01 | 0.36 | 0.01 | 0.25 | 0.01 |
| 407 | libggml-cpu.so - traits.cpp:13-17 [...] | ggml_cpu_extra_compute_forward | Single | 0.01 | 0.01 | 0.01 | 0.02 | 0.04 | 0.04 | 0.05 | 0.06 | 0.06 | 0.06 | 0.13 | 0.14 | 0.07 | 0.07 | 0.14 | 0.01 | 0.01 | 0.01 | 0.00 | 0.01 | 0.00 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.00 | 0.01 | 0.00 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.02 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 | 0.01 | 0.01 | 0.00 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.02 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 | 0.01 | 0.01 | 0.00 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.02 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.02 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 1 | 2 | 1 | 3 | 2 | 7 | 3 | 7 | 6 | 5 | 4 | 8 | 5 | 9 | 0 | 50 | 1 | 1 | 2 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1.67 | 1.6 | 1 | 1 | 1.8 | 0 | 0 | 1 | 2 | 0 | 62.19 | 1 | 0 | 1.49 | 0 | 1.48 | 0 | 2.93 | 0 | 0.95 | 0 | 1.39 | 0 | 0.39 | 0.01 | 0.91 | 0 | 0.38 | 0.01 | 0.44 | 0.01 | 0.44 | 0.01 | 0.52 | 0 | 0.32 | 0.01 | 0.5 | 0 | 0.25 | 0.01 |
| 705 | libggml-base.so - ggml-quants.c:2563-2565 | quantize_row_q8_K_ref | Innermost | 0.01 | 0.01 | 0.02 | 0.06 | 0.04 | 0.04 | 0.05 | 0.06 | 0.06 | 0.06 | 0.07 | 0.07 | 0.14 | 0.07 | 0.07 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.01 | 0.00 | 0.01 | 0.01 | 0.01 | 0.00 | 0.00 | 0.00 | 0.01 | 0.01 | 0.00 | 0.01 | 0.01 | 0.01 | 0.00 | 0.01 | 0.00 | 0.01 | 0.01 | 0.01 | 0.00 | 0.00 | 0.00 | 0.01 | 0.01 | 0.00 | 0.01 | 0.01 | 0.01 | 0.00 | 0.01 | 0.01 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.01 | 0.01 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 2 | 3 | 3 | 5 | 2 | 1 | 1 | 2 | 3 | 2 | 3 | 1 | 3 | 3 | 0 | 19.44 | 1 | 1 | 5.18 | 1 | 1 | 1.5 | 1.8 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 0 | 0 | 0 | 1 | 0 | 50.00 | 1 | 0 | 1 | 0 | 0.49 | 0.01 | 0.39 | 0.01 | 0.38 | 0.01 | 0.93 | 0 | 1.83 | 0 | 1.82 | 0 | 0.88 | 0 | 0.58 | 0 | 0.88 | 0 | 0.58 | 0 | 0.87 | 0 | 0.56 | 0 | 0.56 | 0 |
| 1911 | libggml-cpu.so - vec.h:740-745 | ggml_compute_forward_flash_attn_ext | Innermost | 0.01 | 0.01 | 0.02 | 0.04 | 0.04 | 0.00 | 0.05 | 0.06 | 0.06 | 0.06 | 0.07 | 0.07 | 0.07 | 0.07 | 0.07 | 0.01 | 0.01 | 0.01 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 | 0.01 | 0.01 | 0.00 | 0.00 | 0.01 | 0.00 | 0.00 | 0.01 | 0.01 | 0.01 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 | 0.01 | 0.01 | 0.00 | 0.00 | 0.01 | 0.00 | 0.00 | 0.01 | 0.01 | 0.01 | 0.01 | 0.00 | 0.00 | 0.01 | 0.00 | 0.00 | 0.01 | 0.01 | 0.00 | 0.01 | 0.01 | 0.00 | 0.01 | 0.01 | 0.01 | 0.01 | 0.00 | 0.00 | 0.01 | 0.00 | 0.00 | 0.01 | 0.01 | 0.00 | 0.01 | 0.01 | 0.00 | 0.01 | 0.01 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.01 | 0.01 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 2 | 3 | 3 | 1 | 0 | 1 | 2 | 4 | 3 | 2 | 1 | 5 | 3 | 1 | 50 | 100 | 1 | 1 | 1 | 1 | 1.33 | 1.5 | 1.5 | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 100.00 | 1 | 0 | 0.66 | 0 | 0.49 | 0.01 | 0.49 | 0.01 | 1.9 | 0 | | | 1.83 | 0 | 0.91 | 0 | 0.44 | 0 | 0.58 | 0 | 0.88 | 0 | 1.75 | 0 | 0.35 | 0 | 0.56 | 0 | 1.68 | 0 |
| 1892 | libggml-cpu.so - ops.cpp:8885-8886 [...] | ggml_compute_forward_flash_attn_ext | Innermost | 0.00 | 0.02 | 0.01 | 0.06 | 0.04 | 0.04 | 0.05 | 0.06 | 0.06 | 0.00 | 0.07 | 0.07 | 0.07 | 0.07 | 0.07 | 0.00 | 0.01 | 0.01 | 0.01 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 | 0.01 | 0.01 | 0.01 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 | 0.01 | 0.01 | 0.01 | 0.00 | 0.00 | 0.00 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 | 0.01 | 0.01 | 0.01 | 0.00 | 0.00 | 0.00 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 1 | 2 | 1 | 4 | 2 | 1 | 1 | 1 | 0 | 2 | 4 | 2 | 2 | 1 | 0 | 50 | 1 | 1 | 1.6 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 0 | 1 | 0 | 0 | 87.50 | 1 | 0 | 0.33 | 0.01 | 0.49 | 0 | 0.33 | 0.01 | 0.24 | 0.01 | 0.46 | 0 | 0.91 | 0 | 0.91 | 0 | 0.88 | 0 | | | 0.44 | 0 | 0.22 | 0 | 0.43 | 0 | 0.42 | 0 | 0.84 | 0 |
| 1914 | libggml-cpu.so - vec.h:677-682 | ggml_compute_forward_flash_attn_ext | Innermost | 0.00 | 0.01 | 0.02 | 0.02 | 0.07 | 0.09 | 0.05 | 0.06 | 0.06 | 0.13 | 0.13 | 0.14 | 0.14 | 0.14 | 0.20 | 0.00 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.02 | 0.02 | 0.02 | 0.04 | 0.02 | 0.04 | 0.00 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.02 | 0.02 | 0.02 | 0.04 | 0.02 | 0.04 | 0.00 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.00 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.00 | 0.01 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.01 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 2 | 4 | 3 | 4 | 5 | 5 | 7 | 6 | 10 | 14 | 11 | 20 | 13 | 28 | 50 | 100 | 1 | 1 | 1 | 1 | 1.33 | 1.6 | 1 | 1.6 | 1.67 | 1 | 1 | 1 | 1.82 | 1.87 | 1.69 | 1.6 | 1.73 | 2.55 | 1 | 0 | 0 | 0 | 0 | 100.00 | 1 | 0 | 0.33 | 0.01 | 0.2 | 0.01 | 0.33 | 0.01 | 0.19 | 0.01 | 0.15 | 0.01 | 0.18 | 0.01 | 0.13 | 0.01 | 0.15 | 0.01 | 0.08 | 0.02 | 0.06 | 0.02 | 0.07 | 0.02 | 0.03 | 0.03 | 0.06 | 0.02 | 0.03 | 0.04 |
| 73 | libggml-cpu.so - ggml-cpu.c:533-2897 [...] | ggml_graph_compute_thread | Outermost | 0.00 | 0.01 | 0.02 | 0.02 | 0.04 | 0.09 | 0.10 | 0.11 | 0.06 | 0.19 | 0.27 | 0.20 | 0.14 | 0.55 | 0.61 | 0.00 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.02 | 0.02 | 0.01 | 0.02 | 0.09 | 0.05 | 0.03 | 0.23 | 0.19 | 0.00 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.02 | 0.02 | 0.01 | 0.02 | 0.09 | 0.05 | 0.03 | 0.23 | 0.19 | 0.00 | 0.00 | 0.01 | 0.00 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.02 | 0.02 | 0.01 | 0.04 | 0.04 | 0.00 | 0.00 | 0.01 | 0.00 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.02 | 0.02 | 0.01 | 0.04 | 0.04 | 0.00 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.01 | 0.01 | 0.00 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.01 | 0.01 | 0 | 2 | 1 | 2 | 4 | 4 | 9 | 9 | 7 | 10 | 35 | 27 | 15 | 61 | 66 | 0 | 38.84 | 1 | 1 | 5.33 | 0 | 1 | 1 | 1 | 1 | 1.6 | 1.64 | 1.8 | 1 | 2.31 | 2.5 | 2.25 | 1.5 | 2.77 | 3.93 | NA | NA | NA | NA | NA | 0.00 | | | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 |
| 1587 | libggml-cpu.so - ops.cpp:6210-6462 [...] | ggml_compute_forward_rope_f32(ggml_compute_params const*, ggml_tensor*, bool) | InBetween | 0.00 | 0.00 | 0.00 | 0.04 | 0.04 | 0.09 | 0.05 | 0.11 | 0.18 | 0.13 | 0.07 | 0.14 | 0.14 | 0.14 | 0.14 | 0.00 | 0.00 | 0.00 | 0.01 | 0.01 | 0.02 | 0.02 | 0.03 | 0.02 | 0.03 | 0.01 | 0.02 | 0.02 | 0.02 | 0.03 | 0.00 | 0.00 | 0.00 | 0.13 | 0.25 | 0.31 | 0.39 | 0.47 | 0.49 | 0.53 | 0.60 | 0.63 | 0.66 | 0.65 | 0.67 | 0.00 | 0.00 | 0.00 | 0.01 | 0.00 | 0.01 | 0.01 | 0.01 | 0.02 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.00 | 0.00 | 0.00 | 0.04 | 0.04 | 0.05 | 0.05 | 0.06 | 0.05 | 0.06 | 0.05 | 0.05 | 0.05 | 0.05 | 0.05 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.03 | 0.03 | 0.03 | 0.03 | 0.03 | 0.03 | 0.03 | 0.03 | 0.03 | 0.03 | 0.03 | 0.03 | 0 | 0 | 0 | 2 | 2 | 7 | 10 | 11 | 7 | 14 | 9 | 12 | 15 | 14 | 21 | 0 | 39.72 | 5.92 | 1.4 | 3.04 | 0 | 0 | 0 | 1 | 1 | 1.75 | 1 | 1.69 | 2.33 | 1.87 | 1 | 1.85 | 1.87 | 1.65 | 1.75 | NA | NA | NA | NA | NA | 0.00 | | | | | | | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 |
| 1588 | libggml-cpu.so - ops.cpp:6210-6484 [...] | ggml_compute_forward_rope_f32(ggml_compute_params const*, ggml_tensor*, bool) | Outermost | 0.00 | 0.01 | 0.01 | 0.02 | 0.07 | 0.09 | 0.05 | 0.06 | 0.06 | 0.13 | 0.13 | 0.07 | 0.14 | 0.07 | 0.14 | 0.00 | 0.00 | 0.01 | 0.01 | 0.01 | 0.01 | 0.01 | 0.02 | 0.01 | 0.02 | 0.02 | 0.01 | 0.02 | 0.01 | 0.01 | 0.00 | 0.13 | 0.13 | 0.22 | 0.34 | 0.39 | 0.46 | 0.56 | 0.60 | 0.64 | 0.71 | 0.70 | 0.76 | 0.75 | 0.74 | 0.00 | 0.00 | 0.00 | 0.01 | 0.01 | 0.01 | 0.00 | 0.00 | 0.01 | 0.01 | 0.01 | 0.00 | 0.01 | 0.01 | 0.01 | 0.00 | 0.09 | 0.07 | 0.07 | 0.05 | 0.06 | 0.04 | 0.06 | 0.06 | 0.05 | 0.07 | 0.04 | 0.07 | 0.05 | 0.05 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.11 | 0.06 | 0.05 | 0.04 | 0.04 | 0.04 | 0.04 | 0.04 | 0.04 | 0.04 | 0.04 | 0.04 | 0.04 | 0.04 | 0 | 1 | 2 | 4 | 4 | 3 | 3 | 9 | 5 | 10 | 10 | 4 | 10 | 9 | 8 | 0 | 41.88 | 1 | 1 | 3.01 | 0 | 1 | 1 | 1 | 1.6 | 1.2 | 1 | 1 | 1 | 1.54 | 1.67 | 1 | 1.82 | 1 | 1.78 | NA | NA | NA | NA | NA | 0.00 | | | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 |
| 57 | libggml-cpu.so - ggml-cpu.c:1197-1198 | ggml_compute_forward_mul_mat | Innermost | 0.00 | 0.01 | 0.00 | 0.04 | 0.04 | 0.00 | 0.05 | 0.06 | 0.00 | 0.06 | 0.07 | 0.07 | 0.07 | 0.07 | 0.07 | 0.00 | 0.00 | 0.00 | 0.01 | 0.00 | 0.00 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.01 | 0.00 | 0.00 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.01 | 0.00 | 0.00 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.01 | 0.01 | 0.01 | 0.00 | 0.00 | 0.00 | 0.01 | 0.00 | 0.00 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.01 | 0.01 | 0.01 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0 | 1 | 0 | 3 | 1 | 0 | 3 | 1 | 0 | 2 | 1 | 1 | 1 | 1 | 3 | 0 | 50 | 1 | 1 | 2 | 0 | 1 | 0 | 1.5 | 1 | 0 | 1 | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 100.00 | | | 1 | 0 | | | 1 | 0 | 1 | 0 | | | 1 | 0 | 1 | 0 | | | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 |