OV - Compare Loops

Loops

▶mmq.cpp: 1138 - 30.34 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s	ASM Loop ID	GFLOP/s	ASM Loop ID	GFLOP/s	ASM Loop ID	GFLOP/s
Run orig_default							Run aocc_default		Run icx_8		Run aocc_3
Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/amx/mmq.cpp: 1138-1151 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/amx/mmq.cpp: 2035-2040 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/amx/mmq.cpp: 2060-2074 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/amx/mmq.cpp: 2093-2101 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/amx/mmq.cpp: 2146-2152 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/amx/mmq.cpp: 2488-2488 /usr/lib/gcc/x86_64-redhat-linux/11/../../../../include/c++/11/bits/stl_algobase.h: 235-235						Loop Source Regions		Loop Source Regions		Loop Source Regions
565	0.02	0.01	0.31	0	0	500.66
577	0.95	0.82	30.03	0	0	688.54

Sum on 2 analyzed binary loops (libggml-cpu.so - 565, libggml-cpu.so - 577)							No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis						Count	Analysis	Count	Analysis	Count	Analysis	Count
Control Flow Issues
Vectorization Roadblocks
Presence of more than 4 paths						1

▶mmq.cpp: 303 - 4.35 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s
Run orig_default							Run aocc_default							Run icx_8							Run aocc_3
Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/amx/mmq.cpp: 303-330 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/amx/mmq.cpp: 651-663 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/amx/mmq.cpp: 816-818 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/amx/mmq.cpp: 825-825 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/amx/mmq.cpp: 1390-1392						Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/amx/mmq.cpp: 303-330 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/amx/mmq.cpp: 651-663 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/amx/mmq.cpp: 816-818 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/amx/mmq.cpp: 825-825 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/amx/mmq.cpp: 1390-1392						Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/amx/mmq.cpp: 303-330 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/amx/mmq.cpp: 651-663 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/amx/mmq.cpp: 816-818 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/amx/mmq.cpp: 825-825 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/amx/mmq.cpp: 1390-1392						Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/amx/mmq.cpp: 303-330 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/amx/mmq.cpp: 651-663 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/amx/mmq.cpp: 816-818 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/amx/mmq.cpp: 825-825 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/amx/mmq.cpp: 1390-1392
659	0.05	0.03	0.98	90.91	38.76	0	384	0.07	0.03	1.21	90.91	38.76	0	585	0.06	0.03	1.08	100	41.39	0	386	0.07	0.03	1.08	90.91	38.76	0

Sum on 1 analyzed binary loop (libggml-cpu.so - 659)							Sum on 1 analyzed binary loop (libggml-cpu.so - 384)							Sum on 1 analyzed binary loop (libggml-cpu.so - 585)							Sum on 1 analyzed binary loop (libggml-cpu.so - 386)
Analysis						Count	Analysis						Count	Analysis						Count	Analysis						Count
Loop Computation Issues							Loop Computation Issues							Loop Computation Issues							Loop Computation Issues
Presence of a large number of scalar integer instructions						1	Presence of a large number of scalar integer instructions						1	Presence of a large number of scalar integer instructions						1	Presence of a large number of scalar integer instructions						1
Data Access Issues							Data Access Issues							Data Access Issues							Data Access Issues
Presence of constant non-unit stride data access						1	Presence of constant non-unit stride data access						1	Presence of constant non-unit stride data access						1	Presence of constant non-unit stride data access						1
Presence of special instructions executing on a single port						1	Presence of special instructions executing on a single port						1	Presence of special instructions executing on a single port						1	Presence of special instructions executing on a single port						1
More than 20% of the loads are accessing the stack						1	More than 20% of the loads are accessing the stack						1	More than 20% of the loads are accessing the stack						0	More than 20% of the loads are accessing the stack						1
Vectorization Roadblocks							Vectorization Roadblocks							Vectorization Roadblocks							Vectorization Roadblocks
Presence of constant non-unit stride data access						1	Presence of constant non-unit stride data access						1	Presence of constant non-unit stride data access						1	Presence of constant non-unit stride data access						1
Inefficient Vectorization							Inefficient Vectorization							Inefficient Vectorization							Inefficient Vectorization
Presence of special instructions executing on a single port						1	Presence of special instructions executing on a single port						1	Presence of special instructions executing on a single port						1	Presence of special instructions executing on a single port						1

▶vec.h: 491 - 1.85 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s
Run orig_default							Run aocc_default							Run icx_8							Run aocc_3
Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 491-497						Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 491-497						Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 491-497						Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 491-497
2263	0.04	0.01	0.49	0	0	247.14	2437	0.04	0.01	0.38	0	0	212.22	2094	0.04	0.02	0.54	0	0	194.84	2442	0.04	0.01	0.44	0	0	94.95

Sum on 1 analyzed binary loop (libggml-cpu.so - 2263)							Sum on 1 analyzed binary loop (libggml-cpu.so - 2437)							Sum on 1 analyzed binary loop (libggml-cpu.so - 2094)							Sum on 1 analyzed binary loop (libggml-cpu.so - 2442)
Analysis						Count	Analysis						Count	Analysis						Count	Analysis						Count
Control Flow Issues							Control Flow Issues							Control Flow Issues							Control Flow Issues
Presence of 2 to 4 paths							Presence of 2 to 4 paths						1	Presence of 2 to 4 paths							Presence of 2 to 4 paths						1
Vectorization Roadblocks							Vectorization Roadblocks							Vectorization Roadblocks							Vectorization Roadblocks
Presence of 2 to 4 paths							Presence of 2 to 4 paths						1	Presence of 2 to 4 paths							Presence of 2 to 4 paths						1

▶<unknown>: 0 - 1.66 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s
Run orig_default							Run aocc_default							Run icx_8							Run aocc_3
Loop Source Regions							Loop Source Regions							Loop Source Regions							Loop Source Regions
2289	0.00	0.00	0.00	0	0	0	2628	0.00	0.00	0.00	0	0	0	2287	0.01	0.00	0.01	0	0	0	2611	0.02	0.00	0.01	0	0	0
2504	0.00	0.00	0.00	0	0	0	2640	0.01	0.00	0.00	0	0	0	2316	0.01	0.00	0.00	0	0	0	2792	0.01	0.00	0.00	0	0	0
2291	0.00	0.00	0.00	0	0	0	2739	0.00	0.00	0.00	0	0	0	2297	0.00	0.00	0.00	0	0	0	2905	0.01	0.00	0.00	0	0	0
1023	0.00	0.00	0.00	0	0	0	2450	0.00	0.00	0.00	0	0	0	2190	0.00	0.00	0.00	0	0	0	2802	0.02	0.00	0.01	0	0	0
2395	0.02	0.00	0.01	0	0	0	2638	0.02	0.00	0.01	0	0	0	2186	0.00	0.00	0.00	0	0	0	2906	0.01	0.00	0.00	0	0	0
2392	0.01	0.00	0.00	0	0	0	2741	0.01	0.00	0.00	0	0	0	2048	0.00	0.00	0.00	0	0	0	2903	0.01	0.00	0.00	0	0	0
2294	0.03	0.00	0.01	0	0	0	816	0.02	0.00	0.09	0	0	110.28	2187	0.00	0.00	0.00	0	0	0	2804	0.02	0.00	0.01	0	0	0
2298	0.02	0.00	0.01	0	0	0	695	0.01	0.00	0.02	0	0	861.09	2189	0.02	0.00	0.01	0	0	0	703	0.00	0.00	0.00	0	0	NA
1955	0.02	0.00	0.13	100	50	11.34	107	0.00	0.00	0.00	0	0	NA	2053	0.01	0.00	0.00	0	0	0	697	0.00	0.00	0.01	0	0	864.91
192	0.01	0.00	0.00	0	0	0	708	0.00	0.00	0.00	0	0	NA	1781	0.02	0.00	0.14	100	50	0.38	2032	0.00	0.00	0.01	0	0	0
372	0.00	0.00	0.00	0	0	0	1969	0.01	0.00	0.00	0	0	0	687	0.00	0.00	0.00	0	0	0	2128	0.01	0.00	0.04	0	0	427.08
1767	0.00	0.00	0.00	0	0	0	108	0.00	0.00	0.01	0	0	0	337	0.00	0.00	0.00	0	0	0	107	0.01	0.00	0.00	0	0	18.8
575	0.00	0.00	0.00	0	0	NA	2105	0.01	0.00	0.04	0	0	908.39	2085	0.02	0.00	0.09	0	0	2.29	108	0.00	0.00	0.01	0	0	0
1605	0.01	0.00	0.03	0	0	330.85	701	0.00	0.00	0.00	0	0	149.76	2096	0.01	0.00	0.03	0	0	54.83	2424	0.01	0.00	0.01	0	0	2.69
146	0.01	0.00	0.01	0	0	0	377	0.01	0.00	0.00	0	0	0	495	0.01	0.00	0.06	0	0	56.82	2415	0.00	0.00	0.01	0	0	0
2250	0.01	0.00	0.03	0	0	29.9	704	0.01	0.00	0.07	0	0	494.65	493	0.00	0.00	0.00	0	0	NA	707	0.01	0.00	0.06	0	0	3066.62
2265	0.01	0.00	0.04	0	0	41.7	407	0.00	0.00	0.00	0	0	NA	329	0.01	0.00	0.00	0	0	0	706	0.02	0.00	0.07	0	0	405.68
2254	0.01	0.00	0.08	0	0	0.94	2441	0.01	0.00	0.00	0	0	421.19	1589	0.01	0.00	0.04	0	0	225.53	710	0.00	0.00	0.00	0	0	NA
719	0.01	0.00	0.06	0	0	173.07	2419	0.01	0.00	0.08	0	0	1.4	492	0.01	0.00	0.00	0	0	299.57	409	0.00	0.00	0.00	0	0	NA
1863	0.01	0.00	0.05	0	0	316.19	2410	0.01	0.00	0.01	0	0	151.09	1742	0.01	0.00	0.00	0	0	0	339	0.01	0.00	0.00	0	0	0
570	0.00	0.00	0.00	0	0	900.62	705	0.01	0.00	0.06	0	0	3020.93	125	0.01	0.00	0.01	0	0	0
							1759	0.02	0.00	0.08	0	0	110.53	1817	0.01	0.00	0.02	0	0	653.15
							317	0.00	0.00	0.00	0	0	0	2081	0.01	0.00	0.03	0	0	32.77
							918	0.00	0.00	0.00	0	0	0
							838	0.00	0.00	0.00	0	0	0

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.							No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.							No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.							No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis						Count	Analysis						Count	Analysis						Count	Analysis						Count

▶binary-ops.cpp: 18 - 1.60 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s
Run orig_default							Run aocc_default							Run icx_8							Run aocc_3
Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/binary-ops.cpp: 18-18 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/binary-ops.cpp: 31-32						Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/binary-ops.cpp: 18-18 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/binary-ops.cpp: 31-32						Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/binary-ops.cpp: 18-18 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/binary-ops.cpp: 31-32						Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/binary-ops.cpp: 18-18 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/binary-ops.cpp: 31-32
833	0.03	0.01	0.35	0	6.25	29.28	914	0.04	0.01	0.39	0	6.25	26.75	785	0.04	0.01	0.49	0	6.25	21.21	913	0.03	0.01	0.37	0	6.25	24.44

Sum on 1 analyzed binary loop (libggml-cpu.so - 833)							Sum on 1 analyzed binary loop (libggml-cpu.so - 914)							Sum on 1 analyzed binary loop (libggml-cpu.so - 785)							Sum on 1 analyzed binary loop (libggml-cpu.so - 913)
Analysis						Count	Analysis						Count	Analysis						Count	Analysis						Count
Loop Computation Issues							Loop Computation Issues							Loop Computation Issues							Loop Computation Issues
Less than 10% of the FP ADD/SUB/MUL arithmetic operations are performed using FMA						1	Less than 10% of the FP ADD/SUB/MUL arithmetic operations are performed using FMA						1	Less than 10% of the FP ADD/SUB/MUL arithmetic operations are performed using FMA						1	Less than 10% of the FP ADD/SUB/MUL arithmetic operations are performed using FMA						1
Low iteration count						0	Low iteration count						0	Low iteration count						1	Low iteration count						0
Control Flow Issues							Control Flow Issues							Control Flow Issues							Control Flow Issues
Low iteration count							Low iteration count							Low iteration count						1	Low iteration count

▶vec.h: 1084 - 1.13 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s
Run orig_default							Run aocc_default							Run icx_8							Run aocc_3
Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 1084-1101 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 1113-1116 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.cpp: 372-373						Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 1084-1101 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 1113-1116 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.cpp: 372-373						Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 1084-1101 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 1113-1116 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.cpp: 372-373						Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 1084-1101 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 1115-1115 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.cpp: 372-373
1147	0.03	0.01	0.24	100	100	1544.62	1236	0.03	0.01	0.33	98	98.13	1149.33	1117	0.03	0.01	0.27	100	100	1343.85	1299	0.03	0.01	0.29	98	98.13	1265.17

Sum on 1 analyzed binary loop (libggml-cpu.so - 1147)							Sum on 1 analyzed binary loop (libggml-cpu.so - 1236)							Sum on 1 analyzed binary loop (libggml-cpu.so - 1117)							Sum on 1 analyzed binary loop (libggml-cpu.so - 1299)
Analysis						Count	Analysis						Count	Analysis						Count	Analysis						Count
Loop Computation Issues							Loop Computation Issues							Loop Computation Issues							Loop Computation Issues
Presence of expensive FP instructions						1	Presence of expensive FP instructions						1	Presence of expensive FP instructions						1	Presence of expensive FP instructions						1
Control Flow Issues							Control Flow Issues							Control Flow Issues							Control Flow Issues
Presence of 2 to 4 paths						1	Presence of 2 to 4 paths						1	Presence of 2 to 4 paths						1	Presence of 2 to 4 paths						1
Data Access Issues							Data Access Issues							Data Access Issues							Data Access Issues
Presence of constant non-unit stride data access							Presence of constant non-unit stride data access						1	Presence of constant non-unit stride data access							Presence of constant non-unit stride data access						1
Presence of special instructions executing on a single port							Presence of special instructions executing on a single port						1	Presence of special instructions executing on a single port							Presence of special instructions executing on a single port						1
Vectorization Roadblocks							Vectorization Roadblocks							Vectorization Roadblocks							Vectorization Roadblocks
Presence of 2 to 4 paths						1	Presence of 2 to 4 paths						1	Presence of 2 to 4 paths						1	Presence of 2 to 4 paths						1
Presence of constant non-unit stride data access						0	Presence of constant non-unit stride data access						1	Presence of constant non-unit stride data access						0	Presence of constant non-unit stride data access						1
Inefficient Vectorization							Inefficient Vectorization							Inefficient Vectorization							Inefficient Vectorization
Presence of special instructions executing on a single port						0	Presence of special instructions executing on a single port						1	Presence of special instructions executing on a single port						0	Presence of special instructions executing on a single port						1
Use of masked instructions						1	Use of masked instructions						1	Use of masked instructions						1	Use of masked instructions						1

▶vec.cpp: 311 - 1.13 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s
Run orig_default							Run aocc_default							Run icx_8							Run aocc_3
Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.cpp: 311-316						Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.cpp: 311-316						Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.cpp: 311-316						Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.cpp: 311-316
1140	0.02	0.01	0.28	0	0	451.48	1232	0.05	0.01	0.26	0	0	376.98	1110	0.03	0.01	0.23	0	0	473.82	1289	0.03	0.01	0.36	0	0	270.93

Sum on 1 analyzed binary loop (libggml-cpu.so - 1140)							Sum on 1 analyzed binary loop (libggml-cpu.so - 1232)							Sum on 1 analyzed binary loop (libggml-cpu.so - 1110)							Sum on 1 analyzed binary loop (libggml-cpu.so - 1289)
Analysis						Count	Analysis						Count	Analysis						Count	Analysis						Count
Control Flow Issues							Control Flow Issues							Control Flow Issues							Control Flow Issues
Presence of 2 to 4 paths						1	Presence of 2 to 4 paths							Presence of 2 to 4 paths						1	Presence of 2 to 4 paths
Vectorization Roadblocks							Vectorization Roadblocks							Vectorization Roadblocks							Vectorization Roadblocks
Presence of 2 to 4 paths						1	Presence of 2 to 4 paths							Presence of 2 to 4 paths						1	Presence of 2 to 4 paths

▶ops.cpp: 4325 - 1.05 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s
Run orig_default							Run aocc_default							Run icx_8							Run aocc_3
Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 4325-4326						Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 4325-4326						Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 4325-4326						Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 4325-4326
1610	0.03	0.01	0.28	0	7.81	70.26	1758	0.03	0.01	0.28	0	7.81	68.46	1591	0.02	0.01	0.27	0	7.81	71.5	1820	0.03	0.01	0.23	100	31.25	78.87

Sum on 1 analyzed binary loop (libggml-cpu.so - 1610)							Sum on 1 analyzed binary loop (libggml-cpu.so - 1758)							Sum on 1 analyzed binary loop (libggml-cpu.so - 1591)							Sum on 1 analyzed binary loop (libggml-cpu.so - 1820)
Analysis						Count	Analysis						Count	Analysis						Count	Analysis						Count
Loop Computation Issues							Loop Computation Issues							Loop Computation Issues							Loop Computation Issues
Less than 10% of the FP ADD/SUB/MUL arithmetic operations are performed using FMA						1	Less than 10% of the FP ADD/SUB/MUL arithmetic operations are performed using FMA						1	Less than 10% of the FP ADD/SUB/MUL arithmetic operations are performed using FMA						1	Less than 10% of the FP ADD/SUB/MUL arithmetic operations are performed using FMA						1

▶ops.cpp: 6220 - 1.00 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s
Run orig_default							Run aocc_default							Run icx_8							Run aocc_3
Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6220-6222 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6229-6230 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6238-6245						Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6220-6220 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6229-6230 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6238-6245						Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6220-6220 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6229-6230 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6238-6245						Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6220-6220 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6229-6229 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6238-6245
1888	0.03	0.01	0.23	15.56	9.17	398.71	2113	0.03	0.01	0.38	1.96	6.62	337.83	1829	0.03	0.01	0.22	19.15	9.84	410.7	2136	0.02	0.00	0.17	0	6.25	153.55

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.							Sum on 1 analyzed binary loop (libggml-cpu.so - 2113)							Sum on 1 analyzed binary loop (libggml-cpu.so - 1829)							No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis						Count	Analysis						Count	Analysis						Count	Analysis						Count
							Loop Computation Issues							Loop Computation Issues
							Presence of expensive FP instructions						1	Presence of expensive FP instructions						1
							Less than 10% of the FP ADD/SUB/MUL arithmetic operations are performed using FMA						1	Less than 10% of the FP ADD/SUB/MUL arithmetic operations are performed using FMA						1
							Control Flow Issues							Control Flow Issues
							Presence of calls						1	Presence of calls						1
							Data Access Issues							Data Access Issues
							More than 20% of the loads are accessing the stack						1	More than 20% of the loads are accessing the stack						1
							Vectorization Roadblocks							Vectorization Roadblocks
							Presence of calls						1	Presence of calls						1

▶quants.c: 298 - 0.91 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s
Run orig_default							Run aocc_default							Run icx_8							Run aocc_3
Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/quants.c: 298-347 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/quants.c: 353-355 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/./ggml-impl.h: 346-346 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/./ggml-impl.h: 355-355 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/./ggml-impl.h: 389-404						Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/quants.c: 298-347 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/quants.c: 353-355 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/./ggml-impl.h: 346-346 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/./ggml-impl.h: 355-355 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/./ggml-impl.h: 389-404						Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/quants.c: 298-347 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/quants.c: 353-355 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/./ggml-impl.h: 346-346 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/./ggml-impl.h: 355-355 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/./ggml-impl.h: 389-404						Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/quants.c: 298-347 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/quants.c: 353-355 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/./ggml-impl.h: 346-346 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/./ggml-impl.h: 355-355 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/./ggml-impl.h: 389-404
3016	0.59	0.01	0.23	59.66	29.26	441.17	3307	0.52	0.01	0.21	58.33	28.75	500.48	2807	0.63	0.01	0.24	60.7	29.66	412.58	3325	0.58	0.01	0.23	60.7	29.66	442.42

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.							No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.							Sum on 1 analyzed binary loop (libggml-cpu.so - 2807)							Sum on 1 analyzed binary loop (libggml-cpu.so - 3325)
Analysis						Count	Analysis						Count	Analysis						Count	Analysis						Count
														Loop Computation Issues							Loop Computation Issues
														Presence of expensive FP instructions						1	Presence of expensive FP instructions						1
														Control Flow Issues							Control Flow Issues
														Presence of 2 to 4 paths						1	Presence of 2 to 4 paths						1
														Data Access Issues							Data Access Issues
														More than 10% of the vector loads instructions are unaligned						1	More than 10% of the vector loads instructions are unaligned						1
														Presence of special instructions executing on a single port						1	Presence of special instructions executing on a single port						1
														Vectorization Roadblocks							Vectorization Roadblocks
														Presence of 2 to 4 paths						1	Presence of 2 to 4 paths						1
														Inefficient Vectorization							Inefficient Vectorization
														Presence of special instructions executing on a single port						1	Presence of special instructions executing on a single port						1

▶ggml-cpu.c: 3204 - 0.82 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s
Run orig_default							Run aocc_default							Run icx_8							Run aocc_3
Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c: 3204-3207						Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c: 3204-3207						Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c: 3204-3207						Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c: 3204-3207
6	0.02	0.01	0.22	100	100	0	5	0.03	0.01	0.23	100	100	1.27	6	0.02	0.00	0.16	100	100	0	5	0.03	0.01	0.21	100	100	0

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.							No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.							No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.							Sum on 1 analyzed binary loop (libggml-cpu.so - 5)
Analysis						Count	Analysis						Count	Analysis						Count	Analysis						Count

▶mmq.cpp: 1140 - 0.49 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s	ASM Loop ID	GFLOP/s	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s	ASM Loop ID	GFLOP/s
Run orig_default							Run aocc_default		Run icx_8							Run aocc_3
Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/amx/mmq.cpp: 1140-1142 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/amx/mmq.cpp: 1150-1151						Loop Source Regions		Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/amx/mmq.cpp: 1140-1142 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/amx/mmq.cpp: 1150-1151						Loop Source Regions
566	0.02	0.00	0.16	100	100	302.06			500	0.01	0.00	0.12	100	100	1710.05
567	0.01	0.00	0.10	100	100	1948.52			499	0.03	0.00	0.12	100	100	397.79

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.							No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.							No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis						Count	Analysis	Count	Analysis						Count	Analysis	Count

▶mmq.cpp: 2068 - 0.44 %

ASM Loop ID	GFLOP/s	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s	ASM Loop ID	GFLOP/s	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s
Run orig_default		Run aocc_default							Run icx_8		Run aocc_3
Loop Source Regions		Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/amx/mmq.cpp: 2068-2078						Loop Source Regions		Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/amx/mmq.cpp: 2068-2078
		710	0.02	0.01	0.24	0	0	31.2			712	0.02	0.01	0.20	0	0	25.57

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		Sum on 1 analyzed binary loop (libggml-cpu.so - 710)							No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis	Count	Analysis						Count	Analysis	Count	Analysis						Count

▶binary-ops.cpp: 10 - 0.22 %

ASM Loop ID	GFLOP/s	ASM Loop ID	GFLOP/s	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s
Run orig_default		Run aocc_default		Run icx_8							Run aocc_3
Loop Source Regions		Loop Source Regions		Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/binary-ops.cpp: 10-10 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/binary-ops.cpp: 31-32						Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/binary-ops.cpp: 10-10 /beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/binary-ops.cpp: 31-32
				651	0.02	0.00	0.11	0	6.25	88.85	815	0.01	0.00	0.11	0	6.25	85.93

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.							No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis	Count	Analysis	Count	Analysis						Count	Analysis						Count

▶vec.h: 677 - 0.11 %

ASM Loop ID	GFLOP/s	ASM Loop ID	GFLOP/s	ASM Loop ID	GFLOP/s	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	GFLOP/s
Run orig_default		Run aocc_default		Run icx_8		Run aocc_3
Loop Source Regions		Loop Source Regions		Loop Source Regions		Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/isix07.benchmarkcenter.megware.com/177-003-2424/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 677-682
						1821	0.02	0.00	0.11	100	100	68.94

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis	Count	Analysis	Count	Analysis	Count	Analysis						Count

Report Configuration

Loops

▶mmq.cpp: 1138 - 30.34 %

▶mmq.cpp: 303 - 4.35 %

▶vec.h: 491 - 1.85 %

▶<unknown>: 0 - 1.66 %

▶binary-ops.cpp: 18 - 1.60 %

▶vec.h: 1084 - 1.13 %

▶vec.cpp: 311 - 1.13 %

▶ops.cpp: 4325 - 1.05 %

▶ops.cpp: 6220 - 1.00 %

▶quants.c: 298 - 0.91 %

▶ggml-cpu.c: 3204 - 0.82 %

▶mmq.cpp: 1140 - 0.49 %

▶mmq.cpp: 2068 - 0.44 %

▶binary-ops.cpp: 10 - 0.22 %

▶vec.h: 677 - 0.11 %