OV - Compare Loops

Loops

▶repack.cpp: 125 - 130.73 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)
Run orig_default						Run icx_default						Run aocc_5						Run icx_9
Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 125-125 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 137-140 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 869-908 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 943-968 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 1011-1031 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 755-779 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 822-842					Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 125-125 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 137-140 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 755-760 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 766-766 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 772-779 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 822-842 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 869-869 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 892-908 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 943-943 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 949-949 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 955-955 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 961-968 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 1011-1031					Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 125-125 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 137-140 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 869-908 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 943-968 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 1011-1031 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 755-779 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 822-842					Loop Source Regions
2591	2.04	1.75	42.91	99.23	80.75	2990	0.04	0.02	0.53	99.48	85.43	2712	2.12	1.74	43.01	99.23	80.75
2594	0.04	0.02	0.47	99.51	83.19	2985	2.02	1.81	43.31	99.19	85.93	2715	0.04	0.02	0.50	99.51	83.19

Sum on 2 analyzed binary loops (libggml-cpu.so - 2591, libggml-cpu.so - 2594)						Sum on 2 analyzed binary loops (libggml-cpu.so - 2990, libggml-cpu.so - 2985)						Sum on 2 analyzed binary loops (libggml-cpu.so - 2712, libggml-cpu.so - 2715)						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis					Count	Analysis					Count	Analysis					Count	Analysis	Count
Data Access Issues						Data Access Issues						Data Access Issues
More than 10% of the vector loads instructions are unaligned					0	More than 10% of the vector loads instructions are unaligned					1	More than 10% of the vector loads instructions are unaligned					0
Presence of special instructions executing on a single port					1	Presence of special instructions executing on a single port					1	Presence of special instructions executing on a single port					1
More than 20% of the loads are accessing the stack					1	More than 20% of the loads are accessing the stack					1	More than 20% of the loads are accessing the stack					1
Inefficient Vectorization						Inefficient Vectorization						Inefficient Vectorization
Presence of special instructions executing on a single port					1	Presence of special instructions executing on a single port					1	Presence of special instructions executing on a single port					1
Use of masked instructions					1	Use of masked instructions					1	Use of masked instructions					1

▶quants.c: 682 - 67.96 %

ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)
Run orig_default		Run icx_default		Run aocc_5		Run icx_9
Loop Source Regions		Loop Source Regions		Loop Source Regions		Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/quants.c: 682-682 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/quants.c: 690-695
						3839	8.90	8.52	67.96	93.02	21.37

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		Sum on 1 analyzed binary loop (libggml-cpu.so - 3839)
Analysis	Count	Analysis	Count	Analysis	Count	Analysis					Count
						Loop Computation Issues
						Less than 10% of the FP ADD/SUB/MUL arithmetic operations are performed using FMA					1
						Data Access Issues
						Presence of indirect access					1
						Presence of special instructions executing on a single port					1
						Vectorization Roadblocks
						Presence of indirect access					1
						Inefficient Vectorization
						Presence of special instructions executing on a single port					1

▶quants.c: 2150 - 33.96 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)
Run orig_default						Run icx_default						Run aocc_5						Run icx_9
Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/quants.c: 2150-2152 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/quants.c: 2158-2158 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/quants.c: 2166-2216					Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/quants.c: 2150-2152 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/quants.c: 2158-2158 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/quants.c: 2166-2216					Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/simd-mappings.h: 130-130 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/quants.c: 2150-2152 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/quants.c: 2158-2158 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/quants.c: 2166-2216					Loop Source Regions
2545	0.50	0.45	11.05	97.09	43.87	2936	0.49	0.48	11.42	96.81	44.08	2666	0.50	0.46	11.49	97.09	43.87

Sum on 1 analyzed binary loop (libggml-cpu.so - 2545)						Sum on 1 analyzed binary loop (libggml-cpu.so - 2936)						Sum on 1 analyzed binary loop (libggml-cpu.so - 2666)						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis					Count	Analysis					Count	Analysis					Count	Analysis	Count
Data Access Issues						Data Access Issues						Data Access Issues
Presence of constant non-unit stride data access					1	Presence of constant non-unit stride data access					1	Presence of constant non-unit stride data access					1
Presence of indirect access					1	Presence of indirect access					1	Presence of indirect access					1
Presence of special instructions executing on a single port					1	Presence of special instructions executing on a single port					1	Presence of special instructions executing on a single port					1
Vectorization Roadblocks						Vectorization Roadblocks						Vectorization Roadblocks
Presence of constant non-unit stride data access					1	Presence of constant non-unit stride data access					1	Presence of constant non-unit stride data access					1
Presence of indirect access					1	Presence of indirect access					1	Presence of indirect access					1
Inefficient Vectorization						Inefficient Vectorization						Inefficient Vectorization
Presence of special instructions executing on a single port					1	Presence of special instructions executing on a single port					1	Presence of special instructions executing on a single port					1

▶quants.c: 716 - 13.81 %

ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)
Run orig_default		Run icx_default		Run aocc_5		Run icx_9
Loop Source Regions		Loop Source Regions		Loop Source Regions		Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/simd-mappings.h: 130-130 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/quants.c: 716-716 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/quants.c: 725-725 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/quants.c: 733-736 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/quants.c: 745-754
						499	1.74	1.73	13.81	46.92	13.2

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		Sum on 1 analyzed binary loop (libggml-cpu.so - 499)
Analysis	Count	Analysis	Count	Analysis	Count	Analysis					Count
						Loop Computation Issues
						Less than 10% of the FP ADD/SUB/MUL arithmetic operations are performed using FMA					1
						Presence of a large number of scalar integer instructions					1
						Data Access Issues
						Presence of constant non-unit stride data access					1
						Presence of indirect access					1
						Presence of special instructions executing on a single port					1
						More than 20% of the loads are accessing the stack					1
						Vectorization Roadblocks
						Presence of constant non-unit stride data access					1
						Presence of indirect access					1
						Inefficient Vectorization
						Presence of special instructions executing on a single port					1

▶repack.cpp: 153 - 13.59 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)
Run orig_default						Run icx_default						Run aocc_5						Run icx_9
Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 153-153 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 170-172 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 1227-1251 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 1285-1301 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 1344-1363					Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 153-153 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 170-172 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 1227-1251 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 1285-1285 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 1291-1291 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 1297-1297 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 1344-1363					Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 153-153 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 170-172 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 1227-1251 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 1285-1301 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 1344-1363					Loop Source Regions
2584	0.33	0.19	4.54	0	0	2975	0.33	0.19	4.50	0	0	2705	0.33	0.18	4.54	0	0

Sum on 1 analyzed binary loop (libggml-cpu.so - 2584)						Sum on 1 analyzed binary loop (libggml-cpu.so - 2975)						Sum on 1 analyzed binary loop (libggml-cpu.so - 2705)						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis					Count	Analysis					Count	Analysis					Count	Analysis	Count

▶vec.h: 491 - 2.86 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)
Run orig_default						Run icx_default						Run aocc_5						Run icx_9
Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 491-497					Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 491-497					Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 491-497					Loop Source Regions
1724	0.09	0.04	0.98	100	75	2109	0.09	0.04	0.96	100	75	1825	0.08	0.04	0.93	100	75

Sum on 1 analyzed binary loop (libggml-cpu.so - 1724)						Sum on 1 analyzed binary loop (libggml-cpu.so - 2109)						Sum on 1 analyzed binary loop (libggml-cpu.so - 1825)						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis					Count	Analysis					Count	Analysis					Count	Analysis	Count

▶vec.cpp: 311 - 2.09 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)
Run orig_default						Run icx_default						Run aocc_5						Run icx_9
Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.cpp: 311-316					Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.cpp: 311-316					Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.cpp: 311-316					Loop Source Regions
762	0.06	0.03	0.67	100	66.67	866	0.08	0.03	0.73	100	66.67	812	0.08	0.03	0.69	100	66.67

Sum on 1 analyzed binary loop (libggml-cpu.so - 762)						Sum on 1 analyzed binary loop (libggml-cpu.so - 866)						Sum on 1 analyzed binary loop (libggml-cpu.so - 812)						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis					Count	Analysis					Count	Analysis					Count	Analysis	Count
Loop Computation Issues						Loop Computation Issues						Loop Computation Issues
Low iteration count						Low iteration count					1	Low iteration count
Control Flow Issues						Control Flow Issues						Control Flow Issues
Low iteration count						Low iteration count					1	Low iteration count

▶<unknown>: 0 - 2.06 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)
Run orig_default						Run icx_default						Run aocc_5						Run icx_9
Loop Source Regions						Loop Source Regions						Loop Source Regions						Loop Source Regions
1126	0.01	0.00	0.00	0	0	1189	0.01	0.00	0.00	0	0	2687	0.01	0.00	0.00	0	0	1714	0.00	0.00	0.00	0	0
1282	0.01	0.00	0.00	0	0	2294	0.00	0.00	0.00	0	0	2786	0.01	0.00	0.00	0	0	3825	0.00	0.00	0.00	0	0
2738	0.01	0.00	0.00	0	0	2395	0.01	0.00	0.00	0	0	2537	0.01	0.00	0.00	0	0	1922	0.00	0.00	0.00	0	0
2842	0.01	0.00	0.00	0	0	1123	0.00	0.00	0.00	0	0	2888	0.01	0.00	0.00	0	0	3941	0.00	0.00	0.00	0	0
1241	0.01	0.00	0.00	0	0	2504	0.00	0.00	0.00	0	0	2677	0.01	0.00	0.00	0	0	4115	0.00	0.00	0.00	0	0
2638	0.01	0.00	0.00	0	0	2298	0.00	0.00	0.00	0	0	2801	0.01	0.00	0.00	0	0	4118	0.00	0.00	0.00	0	0
2741	0.03	0.00	0.01	0	0	1947	0.04	0.00	0.01	0	0	0	0.01	0.00	0.00	0	0	4130	0.00	0.00	0.00	0	0
0	0.00	0.00	0.00	0	0	1948	0.00	0.00	0.01	0	0	99	0.01	0.00	0.05	0	0	4120	0.00	0.00	0.00	0	0
99	0.02	0.00	0.08	0	0	490	0.00	0.00	0.00	0	0	483	0.02	0.00	0.03	0	0	47	0.00	0.00	0.00	0	0
2587	0.01	0.00	0.06	0	0	368	0.01	0.00	0.00	0	0	358	0.01	0.00	0.00	0	0	3504	0.02	0.00	0.00	0	0
485	0.04	0.00	0.06	0	0	114	0.00	0.00	0.00	0	0	82	0.01	0.00	0.03	0	0	3505	0.01	0.00	0.01	0	0
2563	0.15	0.00	0.07	0	0	106	0.00	0.00	0.00	0	0	1554	0.02	0.00	0.07	0	0	114	0.00	0.00	0.00	0	0
83	0.00	0.00	0.00	0	0	108	0.00	0.00	0.00	0	0	5	0.02	0.00	0.06	0	0	2574	0.04	0.00	0.02	0	0
1197	0.00	0.00	0.00	0	0	1412	0.02	0.00	0.01	0	0	2708	0.01	0.00	0.04	0	0	530	0.01	0.00	0.00	0	0
1457	0.01	0.00	0.06	0	0	257	0.29	0.00	0.08	0	0	90	0.00	0.00	0.00	0	0	108	0.04	0.01	0.08	0	0
1705	0.01	0.00	0.01	0	0	6	0.01	0.00	0.07	0	0	1279	0.01	0.00	0.01	0	0	2986	0.04	0.01	0.08	0	0
359	0.01	0.00	0.01	0	0	2980	0.03	0.00	0.07	0	0	1278	0.01	0.00	0.01	0	0	2572	0.01	0.00	0.00	0	0
1196	0.03	0.00	0.03	0	0	401	0.01	0.00	0.01	0	0	2684	0.14	0.00	0.07	0	0	3433	0.01	0.00	0.01	0	0
82	0.01	0.00	0.03	0	0	1418	0.04	0.00	0.05	0	0	1806	0.01	0.00	0.01	0	0	2975	0.02	0.00	0.03	0	0
1370	0.00	0.00	0.00	0	0	1707	0.02	0.00	0.06	0	0	357	0.01	0.00	0.01	0	0	117	0.01	0.00	0.01	0	0
1375	0.00	0.00	0.00	0	0	2094	0.01	0.00	0.01	0	0	232	0.21	0.00	0.06	0	0	119	0.02	0.00	0.02	0	0
233	0.16	0.00	0.04	0	0	102	0.01	0.00	0.03	0	0	985	0.01	0.00	0.00	0	0	3	0.03	0.00	0.04	0	0
5	0.02	0.00	0.06	0	0	558	0.04	0.00	0.05	0	0	323	0.00	0.00	0.00	0	0	649	0.09	0.01	0.04	0	0
532	0.01	0.00	0.00	0	0	2111	0.01	0.00	0.03	0	0	454	0.01	0.00	0.00	0	0	3446	0.03	0.00	0.03	0	0
7	0.01	0.00	0.00	0	0	2954	0.15	0.00	0.08	0	0							112	0.01	0.00	0.01	0	0
																		3429	0.01	0.00	0.01	0	0
																		135	0.03	0.01	0.05	0	0
																		945	0.03	0.00	0.01	0	0

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis					Count	Analysis					Count	Analysis					Count	Analysis					Count

▶vec.cpp: 331 - 1.05 %

ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)
Run orig_default		Run icx_default		Run aocc_5		Run icx_9
Loop Source Regions		Loop Source Regions		Loop Source Regions		Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/simd-mappings.h: 130-130 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.cpp: 331-332
						1733	0.27	0.13	1.05	5.88	8.82

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		Sum on 1 analyzed binary loop (libggml-cpu.so - 1733)
Analysis	Count	Analysis	Count	Analysis	Count	Analysis					Count
						Loop Computation Issues
						Less than 10% of the FP ADD/SUB/MUL arithmetic operations are performed using FMA					1
						Data Access Issues
						Presence of indirect access					1
						Vectorization Roadblocks
						Presence of indirect access					1

▶ops.cpp: 6220 - 1.01 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)
Run orig_default						Run icx_default						Run aocc_5						Run icx_9
Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6220-6220 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6229-6230 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6238-6245					Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6220-6220 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6229-6230 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6238-6245					Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6220-6220 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6229-6229 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6238-6245					Loop Source Regions
1463	0.05	0.01	0.32	6.67	7.5	1734	0.03	0.01	0.30	15.56	9.17	1560	0.04	0.02	0.38	0	6.25

Sum on 1 analyzed binary loop (libggml-cpu.so - 1463)						Sum on 1 analyzed binary loop (libggml-cpu.so - 1734)						Sum on 1 analyzed binary loop (libggml-cpu.so - 1560)						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis					Count	Analysis					Count	Analysis					Count	Analysis	Count
Loop Computation Issues						Loop Computation Issues						Loop Computation Issues
Presence of expensive FP instructions					1	Presence of expensive FP instructions					1	Presence of expensive FP instructions					1
Less than 10% of the FP ADD/SUB/MUL arithmetic operations are performed using FMA					1	Less than 10% of the FP ADD/SUB/MUL arithmetic operations are performed using FMA					1	Less than 10% of the FP ADD/SUB/MUL arithmetic operations are performed using FMA					1
Presence of a large number of scalar integer instructions					1	Presence of a large number of scalar integer instructions					0	Presence of a large number of scalar integer instructions					1
Control Flow Issues						Control Flow Issues						Control Flow Issues
Presence of calls					1	Presence of calls					1	Presence of calls					1
Data Access Issues						Data Access Issues						Data Access Issues
More than 20% of the loads are accessing the stack					1	More than 20% of the loads are accessing the stack					1	More than 20% of the loads are accessing the stack					1
Vectorization Roadblocks						Vectorization Roadblocks						Vectorization Roadblocks
Presence of calls					1	Presence of calls					1	Presence of calls					1

▶vec.h: 508 - 0.97 %

ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)
Run orig_default		Run icx_default		Run aocc_5		Run icx_9
Loop Source Regions		Loop Source Regions		Loop Source Regions		Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/simd-mappings.h: 130-130 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 508-509 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/./ggml-impl.h: 346-346 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/./ggml-impl.h: 389-389 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/./ggml-impl.h: 399-404
						3443	0.20	0.12	0.97	85.05	20.79

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		Sum on 1 analyzed binary loop (libggml-cpu.so - 3443)
Analysis	Count	Analysis	Count	Analysis	Count	Analysis					Count
						Loop Computation Issues
						Less than 10% of the FP ADD/SUB/MUL arithmetic operations are performed using FMA					1
						Data Access Issues
						Presence of indirect access					1
						Presence of special instructions executing on a single port					1
						Vectorization Roadblocks
						Presence of indirect access					1
						Inefficient Vectorization
						Presence of special instructions executing on a single port					1

▶vec.h: 1084 - 0.65 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)
Run orig_default						Run icx_default						Run aocc_5						Run icx_9
Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 1084-1101 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 1113-1116 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.cpp: 372-373					Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 1084-1101 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 1113-1116 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.cpp: 372-373					Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 1084-1101 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 1115-1115 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.cpp: 372-373					Loop Source Regions
766	0.10	0.01	0.17	98	98.13	873	0.14	0.01	0.27	100	100	820	0.11	0.01	0.21	98	98.13

Sum on 1 analyzed binary loop (libggml-cpu.so - 766)						Sum on 1 analyzed binary loop (libggml-cpu.so - 873)						Sum on 1 analyzed binary loop (libggml-cpu.so - 820)						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis					Count	Analysis					Count	Analysis					Count	Analysis	Count
Loop Computation Issues						Loop Computation Issues						Loop Computation Issues
Presence of expensive FP instructions					1	Presence of expensive FP instructions					1	Presence of expensive FP instructions					1
Control Flow Issues						Control Flow Issues						Control Flow Issues
Presence of 2 to 4 paths					1	Presence of 2 to 4 paths					1	Presence of 2 to 4 paths					1
Data Access Issues						Data Access Issues						Data Access Issues
Presence of constant non-unit stride data access					1	Presence of constant non-unit stride data access					0	Presence of constant non-unit stride data access					1
More than 10% of the vector loads instructions are unaligned					1	More than 10% of the vector loads instructions are unaligned					1	More than 10% of the vector loads instructions are unaligned					1
Presence of special instructions executing on a single port					1	Presence of special instructions executing on a single port					0	Presence of special instructions executing on a single port					1
Vectorization Roadblocks						Vectorization Roadblocks						Vectorization Roadblocks
Presence of 2 to 4 paths					1	Presence of 2 to 4 paths					1	Presence of 2 to 4 paths					1
Presence of constant non-unit stride data access					1	Presence of constant non-unit stride data access					0	Presence of constant non-unit stride data access					1
Inefficient Vectorization						Inefficient Vectorization						Inefficient Vectorization
Presence of special instructions executing on a single port					1	Presence of special instructions executing on a single port					0	Presence of special instructions executing on a single port					1
Use of masked instructions					1	Use of masked instructions					1	Use of masked instructions					1

▶ops.cpp: 8885 - 0.41 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)
Run orig_default						Run icx_default						Run aocc_5						Run icx_9
Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/simd-mappings.h: 130-130 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 8885-8886					Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/simd-mappings.h: 130-130 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 8885-8886					Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/simd-mappings.h: 130-130 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 8885-8886					Loop Source Regions
1710	0.02	0.01	0.15	0	6.25	2099	0.02	0.00	0.12	0	6.25	1811	0.02	0.01	0.14	0	6.25

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis					Count	Analysis					Count	Analysis					Count	Analysis	Count

▶binary-ops.cpp: 10 - 0.39 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)
Run orig_default						Run icx_default						Run aocc_5						Run icx_9
Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/binary-ops.cpp: 10-10 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/binary-ops.cpp: 31-32					Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/binary-ops.cpp: 10-10 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/binary-ops.cpp: 31-32					Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/binary-ops.cpp: 10-10 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/binary-ops.cpp: 31-32					Loop Source Regions
399	0.08	0.01	0.13	0	6.25	444	0.10	0.01	0.13	0	6.25	397	0.09	0.00	0.12	0	6.25

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						Sum on 1 analyzed binary loop (libggml-cpu.so - 444)						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis					Count	Analysis					Count	Analysis					Count	Analysis	Count
						Loop Computation Issues
						Less than 10% of the FP ADD/SUB/MUL arithmetic operations are performed using FMA					1

▶vec.h: 1190 - 0.16 %

ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)
Run orig_default		Run icx_default		Run aocc_5		Run icx_9
Loop Source Regions		Loop Source Regions		Loop Source Regions		Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 1190-1215 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 1222-1225 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.cpp: 380-381
						1747	0.29	0.02	0.16	98.04	24.76

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		Sum on 1 analyzed binary loop (libggml-cpu.so - 1747)
Analysis	Count	Analysis	Count	Analysis	Count	Analysis					Count
						Loop Computation Issues
						Presence of expensive FP instructions					1
						Less than 10% of the FP ADD/SUB/MUL arithmetic operations are performed using FMA					1
						Control Flow Issues
						Presence of 2 to 4 paths					1
						Data Access Issues
						More than 10% of the vector loads instructions are unaligned					1
						Vectorization Roadblocks
						Presence of 2 to 4 paths					1

▶ggml-quants.c: 216 - 0.13 %

ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)
Run orig_default		Run icx_default		Run aocc_5		Run icx_9
Loop Source Regions		Loop Source Regions		Loop Source Regions		Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-quants.c: 216-219
						648	0.05	0.02	0.13	95	22.5

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		Sum on 1 analyzed binary loop (libggml-base.so - 648)
Analysis	Count	Analysis	Count	Analysis	Count	Analysis					Count
						Loop Computation Issues
						Less than 10% of the FP ADD/SUB/MUL arithmetic operations are performed using FMA					1
						Presence of a large number of scalar integer instructions					1
						Control Flow Issues
						Presence of calls					1
						Data Access Issues
						More than 10% of the vector loads instructions are unaligned					1
						Presence of special instructions executing on a single port					1
						More than 20% of the loads are accessing the stack					1
						Vectorization Roadblocks
						Presence of calls					1
						Inefficient Vectorization
						Presence of special instructions executing on a single port					1

▶ggml-cpu.c: 533 - 0.11 %

ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)
Run orig_default		Run icx_default						Run aocc_5		Run icx_9
Loop Source Regions		Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c: 533-534 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c: 1664-1673 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz12.benchmarkcenter.megware.com/176-989-3472/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c: 2879-2891					Loop Source Regions		Loop Source Regions
		124	0.02	0.00	0.11	0	9.82

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis	Count	Analysis					Count	Analysis	Count	Analysis	Count

Report Configuration

Loops

▶repack.cpp: 125 - 130.73 %

▶quants.c: 682 - 67.96 %

▶quants.c: 2150 - 33.96 %

▶quants.c: 716 - 13.81 %

▶repack.cpp: 153 - 13.59 %

▶vec.h: 491 - 2.86 %

▶vec.cpp: 311 - 2.09 %

▶<unknown>: 0 - 2.06 %

▶vec.cpp: 331 - 1.05 %

▶ops.cpp: 6220 - 1.01 %

▶vec.h: 508 - 0.97 %

▶vec.h: 1084 - 0.65 %

▶ops.cpp: 8885 - 0.41 %

▶binary-ops.cpp: 10 - 0.39 %

▶vec.h: 1190 - 0.16 %

▶ggml-quants.c: 216 - 0.13 %

▶ggml-cpu.c: 533 - 0.11 %