OV - Compare Loops

Loops

▶repack.cpp: 125 - 126.40 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)
Run orig_default						Run icx_default						Run aocc_1						Run icx_6
Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 125-125 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 137-140 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 755-779 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 822-842					Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 125-125 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 137-140 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 755-760 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 766-766 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 772-779 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 822-842					Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 125-125 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 137-140 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 755-779 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 822-842					Loop Source Regions
2594	0.26	0.37	44.78	99.51	83.19	2990	0.25	0.36	41.53	99.48	85.43	2715	0.26	0.32	40.09	99.51	83.19

Sum on 1 analyzed binary loop (libggml-cpu.so - 2594)						Sum on 1 analyzed binary loop (libggml-cpu.so - 2990)						Sum on 1 analyzed binary loop (libggml-cpu.so - 2715)						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis					Count	Analysis					Count	Analysis					Count	Analysis	Count
Data Access Issues						Data Access Issues						Data Access Issues
Presence of special instructions executing on a single port					1	Presence of special instructions executing on a single port					1	Presence of special instructions executing on a single port					1
More than 20% of the loads are accessing the stack					1	More than 20% of the loads are accessing the stack					1	More than 20% of the loads are accessing the stack					1
Inefficient Vectorization						Inefficient Vectorization						Inefficient Vectorization
Presence of special instructions executing on a single port					1	Presence of special instructions executing on a single port					1	Presence of special instructions executing on a single port					1
Use of masked instructions					1	Use of masked instructions					1	Use of masked instructions					1

▶repack.cpp: 153 - 18.76 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)
Run orig_default						Run icx_default						Run aocc_1						Run icx_6
Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 153-153 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 170-172 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 1129-1143 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 1184-1202					Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 153-153 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 170-172 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 1129-1133 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 1139-1139 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 1184-1202 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 559-575 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 582-586 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 616-616					Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 153-153 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 170-172 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 1129-1143 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 1184-1202					Loop Source Regions
2587	0.06	0.05	5.95	99.37	47.56	2980	0.09	0.05	6.11	0	0	2708	0.07	0.05	6.56	99.37	47.56
						2960	0.00	0.00	0.15	0	0

Sum on 1 analyzed binary loop (libggml-cpu.so - 2587)						Sum on 1 analyzed binary loop (libggml-cpu.so - 2980)						Sum on 1 analyzed binary loop (libggml-cpu.so - 2708)						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis					Count	Analysis					Count	Analysis					Count	Analysis	Count
Data Access Issues						Data Access Issues						Data Access Issues
Presence of special instructions executing on a single port					1	Presence of special instructions executing on a single port						Presence of special instructions executing on a single port					1
More than 20% of the loads are accessing the stack					1	More than 20% of the loads are accessing the stack						More than 20% of the loads are accessing the stack					1
Inefficient Vectorization						Inefficient Vectorization						Inefficient Vectorization
Presence of special instructions executing on a single port					1	Presence of special instructions executing on a single port						Presence of special instructions executing on a single port					1
Use of masked instructions					1	Use of masked instructions						Use of masked instructions					1

▶repack.cpp: 190 - 4.08 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)
Run orig_default						Run icx_default						Run aocc_1						Run icx_6
Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/./ggml-impl.h: 389-404 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 190-215 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 222-222 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 228-256					Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/./ggml-impl.h: 346-346 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/./ggml-impl.h: 355-355 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/./ggml-impl.h: 389-404 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 190-215 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 222-222 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 228-256					Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/./ggml-impl.h: 389-404 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 190-215 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 222-222 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/repack.cpp: 228-256					Loop Source Regions
2563	0.02	0.01	1.01	89.71	38.68	2954	0.03	0.01	1.49	61.47	31.66	2684	0.03	0.01	1.58	89.6	38.84

Sum on 1 analyzed binary loop (libggml-cpu.so - 2563)						Sum on 1 analyzed binary loop (libggml-cpu.so - 2954)						Sum on 1 analyzed binary loop (libggml-cpu.so - 2684)						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis					Count	Analysis					Count	Analysis					Count	Analysis	Count
Loop Computation Issues						Loop Computation Issues						Loop Computation Issues
Presence of expensive FP instructions					1	Presence of expensive FP instructions					1	Presence of expensive FP instructions					1
Less than 10% of the FP ADD/SUB/MUL arithmetic operations are performed using FMA					1	Less than 10% of the FP ADD/SUB/MUL arithmetic operations are performed using FMA					0	Less than 10% of the FP ADD/SUB/MUL arithmetic operations are performed using FMA					0
Control Flow Issues						Control Flow Issues						Control Flow Issues
Presence of more than 4 paths					1	Presence of more than 4 paths					1	Presence of more than 4 paths					1
Data Access Issues						Data Access Issues						Data Access Issues
More than 10% of the vector loads instructions are unaligned					0	More than 10% of the vector loads instructions are unaligned					1	More than 10% of the vector loads instructions are unaligned					0
Presence of special instructions executing on a single port					1	Presence of special instructions executing on a single port					1	Presence of special instructions executing on a single port					1
More than 20% of the loads are accessing the stack					1	More than 20% of the loads are accessing the stack					0	More than 20% of the loads are accessing the stack					1
Vectorization Roadblocks						Vectorization Roadblocks						Vectorization Roadblocks
Presence of more than 4 paths					1	Presence of more than 4 paths					1	Presence of more than 4 paths					1
Inefficient Vectorization						Inefficient Vectorization						Inefficient Vectorization
Presence of special instructions executing on a single port					1	Presence of special instructions executing on a single port					1	Presence of special instructions executing on a single port					1
Use of masked instructions					1	Use of masked instructions					0	Use of masked instructions					1

▶vec.h: 1084 - 3.12 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)
Run orig_default						Run icx_default						Run aocc_1						Run icx_6
Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.cpp: 372-373 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 1084-1101 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 1113-1116					Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.cpp: 372-373 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 1084-1101 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 1113-1116					Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.cpp: 372-373 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 1084-1101 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 1115-1115					Loop Source Regions
766	0.01	0.01	1.14	98	98.13	873	0.02	0.01	1.20	100	100	820	0.01	0.01	0.79	98	98.13

Sum on 1 analyzed binary loop (libggml-cpu.so - 766)						Sum on 1 analyzed binary loop (libggml-cpu.so - 873)						Sum on 1 analyzed binary loop (libggml-cpu.so - 820)						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis					Count	Analysis					Count	Analysis					Count	Analysis	Count
Loop Computation Issues						Loop Computation Issues						Loop Computation Issues
Presence of expensive FP instructions					1	Presence of expensive FP instructions					1	Presence of expensive FP instructions					1
Control Flow Issues						Control Flow Issues						Control Flow Issues
Presence of 2 to 4 paths					1	Presence of 2 to 4 paths					1	Presence of 2 to 4 paths					1
Data Access Issues						Data Access Issues						Data Access Issues
Presence of constant non-unit stride data access					1	Presence of constant non-unit stride data access					0	Presence of constant non-unit stride data access					1
More than 10% of the vector loads instructions are unaligned					1	More than 10% of the vector loads instructions are unaligned					1	More than 10% of the vector loads instructions are unaligned					1
Presence of special instructions executing on a single port					1	Presence of special instructions executing on a single port					0	Presence of special instructions executing on a single port					1
Vectorization Roadblocks						Vectorization Roadblocks						Vectorization Roadblocks
Presence of 2 to 4 paths					1	Presence of 2 to 4 paths					1	Presence of 2 to 4 paths					1
Presence of constant non-unit stride data access					1	Presence of constant non-unit stride data access					0	Presence of constant non-unit stride data access					1
Inefficient Vectorization						Inefficient Vectorization						Inefficient Vectorization
Presence of special instructions executing on a single port					1	Presence of special instructions executing on a single port					0	Presence of special instructions executing on a single port					1
Use of masked instructions					1	Use of masked instructions					1	Use of masked instructions					1

▶quants.c: 2150 - 2.53 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)
Run orig_default						Run icx_default						Run aocc_1						Run icx_6
Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/quants.c: 2150-2152 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/quants.c: 2158-2158 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/quants.c: 2166-2216					Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/quants.c: 2150-2152 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/quants.c: 2158-2158 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/quants.c: 2166-2216					Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/simd-mappings.h: 130-130 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/quants.c: 2150-2152 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/quants.c: 2158-2158 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/quants.c: 2166-2216					Loop Source Regions
2545	0.00	0.01	1.03	97.09	43.87	2936	0.00	0.00	0.49	96.81	44.08	2666	0.00	0.01	1.00	97.09	43.87

Sum on 1 analyzed binary loop (libggml-cpu.so - 2545)						Sum on 1 analyzed binary loop (libggml-cpu.so - 2936)						Sum on 1 analyzed binary loop (libggml-cpu.so - 2666)						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis					Count	Analysis					Count	Analysis					Count	Analysis	Count
Data Access Issues						Data Access Issues						Data Access Issues
Presence of constant non-unit stride data access					1	Presence of constant non-unit stride data access					1	Presence of constant non-unit stride data access					1
Presence of indirect access					1	Presence of indirect access					1	Presence of indirect access					1
Presence of special instructions executing on a single port					1	Presence of special instructions executing on a single port					1	Presence of special instructions executing on a single port					1
Vectorization Roadblocks						Vectorization Roadblocks						Vectorization Roadblocks
Presence of constant non-unit stride data access					1	Presence of constant non-unit stride data access					1	Presence of constant non-unit stride data access					1
Presence of indirect access					1	Presence of indirect access					1	Presence of indirect access					1
Inefficient Vectorization						Inefficient Vectorization						Inefficient Vectorization
Presence of special instructions executing on a single port					1	Presence of special instructions executing on a single port					1	Presence of special instructions executing on a single port					1

▶binary-ops.cpp: 10 - 2.41 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)
Run orig_default						Run icx_default						Run aocc_1						Run icx_6
Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/binary-ops.cpp: 10-10 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/binary-ops.cpp: 31-32					Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/binary-ops.cpp: 10-10 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/binary-ops.cpp: 31-32					Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/binary-ops.cpp: 10-10 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/binary-ops.cpp: 31-32					Loop Source Regions
399	0.01	0.01	0.84	0	6.25	444	0.02	0.01	0.70	0	6.25	397	0.01	0.01	0.86	0	6.25

Sum on 1 analyzed binary loop (libggml-cpu.so - 399)						Sum on 1 analyzed binary loop (libggml-cpu.so - 444)						Sum on 1 analyzed binary loop (libggml-cpu.so - 397)						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis					Count	Analysis					Count	Analysis					Count	Analysis	Count
Loop Computation Issues						Loop Computation Issues						Loop Computation Issues
Less than 10% of the FP ADD/SUB/MUL arithmetic operations are performed using FMA					1	Less than 10% of the FP ADD/SUB/MUL arithmetic operations are performed using FMA					1	Less than 10% of the FP ADD/SUB/MUL arithmetic operations are performed using FMA					1

▶ops.cpp: 6220 - 1.98 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)
Run orig_default						Run icx_default						Run aocc_1						Run icx_6
Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6220-6220 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6229-6230 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6238-6245					Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6220-6220 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6229-6230 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6238-6245					Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6220-6220 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6229-6229 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6238-6245					Loop Source Regions
1463	0.02	0.00	0.54	6.67	7.5	1734	0.01	0.01	0.58	15.56	9.17	1560	0.01	0.01	0.86	0	6.25

Sum on 1 analyzed binary loop (libggml-cpu.so - 1463)						Sum on 1 analyzed binary loop (libggml-cpu.so - 1734)						Sum on 1 analyzed binary loop (libggml-cpu.so - 1560)						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis					Count	Analysis					Count	Analysis					Count	Analysis	Count
Loop Computation Issues						Loop Computation Issues						Loop Computation Issues
Presence of expensive FP instructions					1	Presence of expensive FP instructions					1	Presence of expensive FP instructions					1
Less than 10% of the FP ADD/SUB/MUL arithmetic operations are performed using FMA					1	Less than 10% of the FP ADD/SUB/MUL arithmetic operations are performed using FMA					1	Less than 10% of the FP ADD/SUB/MUL arithmetic operations are performed using FMA					1
Presence of a large number of scalar integer instructions					1	Presence of a large number of scalar integer instructions					0	Presence of a large number of scalar integer instructions					1
Control Flow Issues						Control Flow Issues						Control Flow Issues
Presence of calls					1	Presence of calls					1	Presence of calls					1
Data Access Issues						Data Access Issues						Data Access Issues
More than 20% of the loads are accessing the stack					1	More than 20% of the loads are accessing the stack					1	More than 20% of the loads are accessing the stack					1
Vectorization Roadblocks						Vectorization Roadblocks						Vectorization Roadblocks
Presence of calls					1	Presence of calls					1	Presence of calls					1

▶repack.cpp: 1074 - 1.67 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)
Run orig_default						Run icx_default						Run aocc_1						Run icx_6
Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/repack.cpp: 1074-1074 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/repack.cpp: 1311-1315					Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/repack.cpp: 1074-1074 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/repack.cpp: 1311-1315					Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/repack.cpp: 1074-1074 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/repack.cpp: 1311-1315					Loop Source Regions
233	0.25	0.00	0.56	37.5	19.86	257	0.27	0.01	0.60	43.33	32.81	232	0.23	0.00	0.50	37.5	19.86

Sum on 1 analyzed binary loop (libggml-cpu.so - 233)						Sum on 1 analyzed binary loop (libggml-cpu.so - 257)						Sum on 1 analyzed binary loop (libggml-cpu.so - 232)						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis					Count	Analysis					Count	Analysis					Count	Analysis	Count
Loop Computation Issues						Loop Computation Issues						Loop Computation Issues
Presence of a large number of scalar integer instructions					1	Presence of a large number of scalar integer instructions					1	Presence of a large number of scalar integer instructions					1
Data Access Issues						Data Access Issues						Data Access Issues
Presence of constant non-unit stride data access					0	Presence of constant non-unit stride data access					1	Presence of constant non-unit stride data access					0
Presence of indirect access					0	Presence of indirect access					1	Presence of indirect access					0
Presence of expensive instructions: scatter/gather					0	Presence of expensive instructions: scatter/gather					1	Presence of expensive instructions: scatter/gather					0
Presence of special instructions executing on a single port					1	Presence of special instructions executing on a single port					1	Presence of special instructions executing on a single port					1
More than 20% of the loads are accessing the stack					1	More than 20% of the loads are accessing the stack					1	More than 20% of the loads are accessing the stack					1
Vectorization Roadblocks						Vectorization Roadblocks						Vectorization Roadblocks
Presence of constant non-unit stride data access						Presence of constant non-unit stride data access					1	Presence of constant non-unit stride data access
Presence of indirect access						Presence of indirect access					1	Presence of indirect access
Inefficient Vectorization						Inefficient Vectorization						Inefficient Vectorization
Presence of expensive instructions: scatter/gather					0	Presence of expensive instructions: scatter/gather					1	Presence of expensive instructions: scatter/gather					0
Presence of special instructions executing on a single port					1	Presence of special instructions executing on a single port					1	Presence of special instructions executing on a single port					1

▶ops.cpp: 4325 - 1.57 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)
Run orig_default						Run icx_default						Run aocc_1						Run icx_6
Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 4325-4326					Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 4325-4326					Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 4325-4326					Loop Source Regions
1196	0.01	0.00	0.48	0	7.81	1418	0.01	0.00	0.47	0	7.81	1278	0.01	0.00	0.62	100	62.5

Sum on 1 analyzed binary loop (libggml-cpu.so - 1196)						Sum on 1 analyzed binary loop (libggml-cpu.so - 1418)						Sum on 1 analyzed binary loop (libggml-cpu.so - 1278)						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis					Count	Analysis					Count	Analysis					Count	Analysis	Count
Loop Computation Issues						Loop Computation Issues						Loop Computation Issues
Less than 10% of the FP ADD/SUB/MUL arithmetic operations are performed using FMA					1	Less than 10% of the FP ADD/SUB/MUL arithmetic operations are performed using FMA					1	Less than 10% of the FP ADD/SUB/MUL arithmetic operations are performed using FMA					1

▶<unknown>: 0 - 1.24 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)
Run orig_default						Run icx_default						Run aocc_1						Run icx_6
Loop Source Regions						Loop Source Regions						Loop Source Regions						Loop Source Regions
2640	0.00	0.00	0.01	0	0	2189	0.00	0.00	0.01	0	0	2786	0.01	0.00	0.02	0	0	4113	0.01	0.00	0.00	0	0
2458	0.00	0.00	0.01	0	0	2392	0.00	0.00	0.01	0	0	2537	0.00	0.00	0.01	0	0	3939	0.01	0.00	0.00	0	0
2741	0.01	0.00	0.03	0	0	1023	0.00	0.00	0.01	0	0	2888	0.01	0.00	0.03	0	0	4339	0.01	0.00	0.00	0	0
2638	0.00	0.00	0.01	0	0	2395	0.01	0.00	0.03	0	0	2783	0.00	0.00	0.01	0	0	3823	0.01	0.00	0.00	0	0
2738	0.00	0.00	0.01	0	0	2504	0.00	0.00	0.01	0	0	2563	0.00	0.00	0.01	0	0	4122	0.01	0.00	0.00	0	0
276	0.00	0.00	0.01	0	0	2291	0.01	0.00	0.02	0	0	1472	0.00	0.00	0.01	0	0	4128	0.01	0.00	0.00	0	0
99	0.00	0.00	0.02	0	0	2298	0.00	0.00	0.01	0	0	99	0.00	0.00	0.01	0	0	4116	0.02	0.00	0.00	0	0
1197	0.00	0.00	0.07	0	0	866	0.00	0.00	0.09	0	0	1279	0.00	0.00	0.04	0	0	646	0.03	0.00	0.00	0	0
1731	0.00	0.00	0.03	0	0	124	0.01	0.00	0.08	0	0	812	0.00	0.00	0.10	0	0	307	0.01	0.00	0.00	0	0
984	0.00	0.00	0.01	0	0	1412	0.00	0.00	0.08	0	0	1811	0.00	0.00	0.10	0	0	638	0.00	0.00	0.00	0	0
188	0.00	0.00	0.01	0	0	401	0.00	0.00	0.01	0	0	1832	0.00	0.00	0.01	0	0	132	0.00	0.00	0.00	0	0
						2094	0.00	0.00	0.01	0	0	2691	0.00	0.00	0.01	0	0	105	0.01	0.00	0.00	0	0
						2111	0.00	0.00	0.01	0	0	1806	0.00	0.00	0.01	0	0	893	0.01	0.00	0.01	0	0
						2099	0.00	0.00	0.07	0	0							631	0.02	0.00	0.03	0	0
																		2844	0.01	0.00	0.01	0	0
																		3296	0.01	0.00	0.00	0	0
																		116	0.01	0.00	0.00	0	0
																		3292	0.00	0.00	0.00	0	0
																		494	0.01	0.00	0.03	0	0
																		109	0.00	0.00	0.00	0	0
																		2689	0.00	0.00	0.00	0	0
																		2444	0.01	0.00	0.01	0	0
																		2855	0.02	0.00	0.02	0	0
																		1635	0.02	0.00	0.03	0	0
																		3	0.01	0.00	0.01	0	0
																		3309	0.00	0.00	0.01	0	0
																		2442	0.00	0.00	0.00	0	0

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis					Count	Analysis					Count	Analysis					Count	Analysis					Count

▶vec.h: 491 - 1.01 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)
Run orig_default						Run icx_default						Run aocc_1						Run icx_6
Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 491-497					Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 491-497					Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 491-497					Loop Source Regions
1724	0.01	0.00	0.40	100	75	2109	0.01	0.00	0.36	100	75	1825	0.01	0.00	0.25	100	75

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis					Count	Analysis					Count	Analysis					Count	Analysis	Count

▶quants.c: 682 - 1.01 %

ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)
Run orig_default		Run icx_default		Run aocc_1		Run icx_6
Loop Source Regions		Loop Source Regions		Loop Source Regions		Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/quants.c: 682-682 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/arch/x86/quants.c: 690-695
						3699	0.14	0.12	1.01	93.02	21.37

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		Sum on 1 analyzed binary loop (libggml-cpu.so - 3699)
Analysis	Count	Analysis	Count	Analysis	Count	Analysis					Count
						Loop Computation Issues
						Less than 10% of the FP ADD/SUB/MUL arithmetic operations are performed using FMA					1
						Data Access Issues
						Presence of indirect access					1
						Presence of special instructions executing on a single port					1
						Vectorization Roadblocks
						Presence of indirect access					1
						Inefficient Vectorization
						Presence of special instructions executing on a single port					1

▶binary-ops.cpp: 18 - 0.95 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)
Run orig_default						Run icx_default						Run aocc_1						Run icx_6
Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/binary-ops.cpp: 18-18 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/binary-ops.cpp: 31-32					Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/binary-ops.cpp: 18-18 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/binary-ops.cpp: 31-32					Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/binary-ops.cpp: 18-18 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/binary-ops.cpp: 31-32					Loop Source Regions
485	0.01	0.00	0.36	0	6.25	558	0.01	0.00	0.30	0	6.25	483	0.01	0.00	0.29	0	6.25

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis					Count	Analysis					Count	Analysis					Count	Analysis	Count

▶ops.cpp: 6446 - 0.85 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)
Run orig_default						Run icx_default						Run aocc_1						Run icx_6
Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6446-6447 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6456-6456					Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6446-6457					Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 6446-6457					Loop Source Regions
1457	0.01	0.00	0.17	75	19.53	1707	0.01	0.00	0.35	0	6.25	1554	0.01	0.00	0.33	0	6.25

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis					Count	Analysis					Count	Analysis					Count	Analysis	Count

▶ggml-cpu.c: 3204 - 0.44 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)
Run orig_default						Run icx_default						Run aocc_1						Run icx_6
Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c: 3204-3207					Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c: 3204-3207					Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c: 3204-3207					Loop Source Regions
5	0.00	0.00	0.10	100	100	6	0.00	0.00	0.13	100	100	5	0.01	0.00	0.20	100	100

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis					Count	Analysis					Count	Analysis					Count	Analysis	Count

▶vec.h: 508 - 0.31 %

ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)
Run orig_default		Run icx_default		Run aocc_1		Run icx_6
Loop Source Regions		Loop Source Regions		Loop Source Regions		Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/simd-mappings.h: 130-130 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/./ggml-impl.h: 346-346 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/./ggml-impl.h: 389-389 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/./ggml-impl.h: 399-404 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.h: 508-509
						3306	0.07	0.04	0.31	85.05	20.79

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		Sum on 1 analyzed binary loop (libggml-cpu.so - 3306)
Analysis	Count	Analysis	Count	Analysis	Count	Analysis					Count
						Loop Computation Issues
						Less than 10% of the FP ADD/SUB/MUL arithmetic operations are performed using FMA					1
						Data Access Issues
						Presence of indirect access					1
						Presence of special instructions executing on a single port					1
						Vectorization Roadblocks
						Presence of indirect access					1
						Inefficient Vectorization
						Presence of special instructions executing on a single port					1

▶vec.cpp: 331 - 0.15 %

ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)
Run orig_default		Run icx_default		Run aocc_1		Run icx_6
Loop Source Regions		Loop Source Regions		Loop Source Regions		Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/simd-mappings.h: 130-130 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.cpp: 331-332
						1621	0.04	0.02	0.15	5.88	8.82

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		Sum on 1 analyzed binary loop (libggml-cpu.so - 1621)
Analysis	Count	Analysis	Count	Analysis	Count	Analysis					Count
						Loop Computation Issues
						Less than 10% of the FP ADD/SUB/MUL arithmetic operations are performed using FMA					1
						Data Access Issues
						Presence of indirect access					1
						Vectorization Roadblocks
						Presence of indirect access					1

▶vec.cpp: 311 - 0.12 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)
Run orig_default						Run icx_default		Run aocc_1		Run icx_6
Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/vec.cpp: 311-316					Loop Source Regions		Loop Source Regions		Loop Source Regions
762	0.00	0.00	0.12	100	66.67

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis					Count	Analysis	Count	Analysis	Count	Analysis	Count

▶ops.cpp: 8885 - 0.11 %

ASM Loop ID	Max Time Over Threads (s)	Time w.r.t. Wall Time (s)	Cov (%)	Vect. Ratio (%)	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)	ASM Loop ID	Vector Length Use (%)
Run orig_default						Run icx_default		Run aocc_1		Run icx_6
Loop Source Regions	/beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/simd-mappings.h: 130-130 /beegfs/hackathon/users/eoseret/qaas_runs_test/gmz17.benchmarkcenter.megware.com/176-988-7916/llama.cpp/build/llama.cpp/ggml/src/ggml-cpu/ops.cpp: 8885-8886					Loop Source Regions		Loop Source Regions		Loop Source Regions
1710	0.00	0.00	0.11	0	6.25

No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.						No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.		No Optimizer analysis found for any assembly loop. More loops can be analyzed using option --optimizer-loop-count.
Analysis					Count	Analysis	Count	Analysis	Count	Analysis	Count

Report Configuration

Loops

▶repack.cpp: 125 - 126.40 %

▶repack.cpp: 153 - 18.76 %

▶repack.cpp: 190 - 4.08 %

▶vec.h: 1084 - 3.12 %

▶quants.c: 2150 - 2.53 %

▶binary-ops.cpp: 10 - 2.41 %

▶ops.cpp: 6220 - 1.98 %

▶repack.cpp: 1074 - 1.67 %

▶ops.cpp: 4325 - 1.57 %

▶<unknown>: 0 - 1.24 %

▶vec.h: 491 - 1.01 %

▶quants.c: 682 - 1.01 %

▶binary-ops.cpp: 18 - 0.95 %

▶ops.cpp: 6446 - 0.85 %

▶ggml-cpu.c: 3204 - 0.44 %

▶vec.h: 508 - 0.31 %

▶vec.cpp: 331 - 0.15 %

▶vec.cpp: 311 - 0.12 %

▶ops.cpp: 8885 - 0.11 %