OV - exec - Topology

Software Topology

▼Scalability - 1x1

Number processes: 1 Number nodes: 1 Run Command: <executable> -m meta-llama-3.1-8b-instruct-Q8_0.gguf -no-cnv -t 64 -n 512 -p "what is a LLM?" --seed 0MPI Command: mpirun -n <number_processes> --bind-to none --report-bindings Run Directory: /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-18-66/175-768-6804/llama.cpp/run/oneview_runs/multicore/armclang_4/oneview_run_1757689479OMP_PROC_BIND: spreadOMP_DISPLAY_AFFINITY: TRUEOMP_AFFINITY_FORMAT: 'OMP: pid %P tid %i thread %n bound to OS proc set {%A}'OMP_DISPLAY_ENV: TRUEOMP_PLACES: threadsOMP_NUM_THREADS: 1

ID	Observed Processes	Observed Threads	Time(s)	Elapsed Time (s)	Active Time (%)	Start (after process) (s)	End (before process) (s)	Maximum Time on the Same CPU (s)
►Node ip-172-31-18-66+	1	64	16.06
►Process 28628+		64	16.06
○Thread 28628			16.06	16.99	94.52	0.00	0.00	16.19
○Thread 28695			15.58	16.20	96.18	0.78	0.01	16.10
○Thread 28696			15.68	16.20	96.77	0.78	0.01	16.10
○Thread 28697			15.62	16.20	96.43	0.78	0.01	16.10
○Thread 28698			15.75	16.20	97.23	0.78	0.01	16.10
○Thread 28699			15.54	16.20	95.91	0.78	0.01	16.09
○Thread 28700			15.55	16.20	95.97	0.78	0.01	16.10
○Thread 28701			15.61	16.20	96.37	0.78	0.01	16.10
○Thread 28702			15.64	16.20	96.53	0.78	0.01	16.10
○Thread 28703			15.68	16.20	96.80	0.78	0.01	16.08
○Thread 28704			15.74	16.20	97.14	0.78	0.01	16.10
○Thread 28705			15.55	16.20	96.00	0.78	0.01	16.10
○Thread 28706			15.67	16.20	96.71	0.78	0.01	16.10
○Thread 28707			15.53	16.20	95.85	0.78	0.01	16.10
○Thread 28708			15.49	16.20	95.63	0.78	0.01	16.10
○Thread 28709			15.49	16.20	95.63	0.78	0.01	16.10
○Thread 28710			15.78	16.20	97.39	0.78	0.01	16.10
○Thread 28711			15.65	16.20	96.59	0.78	0.01	16.10
○Thread 28712			15.43	16.20	95.23	0.78	0.01	16.10
○Thread 28713			15.59	16.20	96.25	0.78	0.01	16.09
○Thread 28714			15.69	16.20	96.87	0.78	0.01	16.10
○Thread 28715			15.64	16.20	96.56	0.78	0.01	16.10
○Thread 28716			15.60	16.20	96.29	0.78	0.01	16.09
○Thread 28717			15.51	16.20	95.76	0.78	0.01	16.09
○Thread 28718			15.77	16.20	97.37	0.78	0.01	16.10
○Thread 28719			15.56	16.20	96.07	0.78	0.01	16.10
○Thread 28720			15.50	16.20	95.70	0.78	0.01	16.09
○Thread 28721			15.58	16.20	96.19	0.78	0.01	16.10
○Thread 28722			15.67	16.20	96.75	0.78	0.01	16.10
○Thread 28723			15.55	16.20	95.98	0.78	0.01	16.10
○Thread 28724			15.50	16.20	95.67	0.78	0.01	16.10
○Thread 28725			15.55	16.20	96.01	0.78	0.01	16.10
○Thread 28726			15.81	16.20	97.62	0.78	0.01	16.10
○Thread 28727			15.52	16.20	95.86	0.78	0.01	16.10
○Thread 28728			15.53	16.20	95.92	0.78	0.01	16.10
○Thread 28729			15.61	16.20	96.35	0.78	0.01	16.10
○Thread 28730			15.68	16.20	96.78	0.78	0.01	16.10
○Thread 28731			15.54	16.20	95.95	0.78	0.01	16.10
○Thread 28732			15.51	16.20	95.77	0.78	0.01	16.09
○Thread 28733			15.53	16.20	95.89	0.78	0.01	16.10
○Thread 28734			15.73	16.20	97.09	0.78	0.01	16.10
○Thread 28735			15.85	16.20	97.84	0.78	0.01	16.10
○Thread 28736			15.55	16.20	95.98	0.78	0.01	16.10
○Thread 28737			15.68	16.20	96.82	0.78	0.01	16.09
○Thread 28738			15.86	16.20	97.90	0.78	0.01	16.10
○Thread 28739			15.53	16.20	95.89	0.78	0.01	16.10
○Thread 28740			15.52	16.20	95.80	0.78	0.01	16.10
○Thread 28741			15.73	16.20	97.13	0.78	0.01	16.09
○Thread 28742			15.65	16.20	96.63	0.78	0.01	16.10
○Thread 28743			15.50	16.20	95.68	0.78	0.01	16.10
○Thread 28744			15.73	16.19	97.13	0.78	0.01	16.10
○Thread 28745			15.64	16.19	96.54	0.78	0.01	16.10
○Thread 28746			15.73	16.19	97.10	0.78	0.01	16.10
○Thread 28747			15.77	16.19	97.35	0.78	0.01	16.09
○Thread 28748			15.64	16.19	96.58	0.78	0.01	16.10
○Thread 28749			15.58	16.19	96.17	0.78	0.01	16.10
○Thread 28750			15.62	16.19	96.42	0.78	0.01	16.10
○Thread 28751			15.62	16.19	96.42	0.78	0.01	16.10
○Thread 28752			15.59	16.19	96.24	0.78	0.01	16.10
○Thread 28753			15.54	16.19	95.93	0.78	0.01	16.09
○Thread 28754			15.61	16.19	96.36	0.78	0.01	16.09
○Thread 28755			15.60	16.19	96.33	0.78	0.01	16.10
○Thread 28756			15.60	16.19	96.30	0.78	0.01	16.10
○Thread 28757			15.42	16.19	95.19	0.78	0.01	16.09

▶Scalability - 1x2

Number processes: 1 Number nodes: 1 Run Command: <executable> -m meta-llama-3.1-8b-instruct-Q8_0.gguf -no-cnv -t 64 -n 512 -p "what is a LLM?" --seed 0MPI Command: mpirun -n <number_processes> --bind-to none --report-bindings Run Directory: /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-18-66/175-768-6804/llama.cpp/run/oneview_runs/multicore/armclang_4/oneview_run_1757689479OMP_NUM_THREADS: 2OMP_PROC_BIND: spreadOMP_DISPLAY_AFFINITY: TRUEOMP_AFFINITY_FORMAT: 'OMP: pid %P tid %i thread %n bound to OS proc set {%A}'OMP_DISPLAY_ENV: TRUEOMP_PLACES: threads

ID	Observed Processes	Observed Threads	Time(s)	Elapsed Time (s)	Active Time (%)	Start (after process) (s)	End (before process) (s)	Maximum Time on the Same CPU (s)
►Node ip-172-31-18-66+	1	64	16.16
►Process 28789+		64	16.16
○Thread 28789			16.16	17.04	94.86	0.00	0.00	16.23
○Thread 28856			15.56	16.24	95.79	0.78	0.01	16.15
○Thread 28857			15.76	16.24	96.99	0.78	0.01	16.14
○Thread 28858			15.56	16.24	95.79	0.78	0.01	16.15
○Thread 28859			15.71	16.24	96.71	0.78	0.01	16.14
○Thread 28860			15.74	16.24	96.90	0.78	0.01	16.15
○Thread 28861			15.47	16.24	95.23	0.78	0.01	16.15
○Thread 28862			15.43	16.24	94.99	0.78	0.01	16.15
○Thread 28863			15.80	16.24	97.24	0.78	0.01	16.14
○Thread 28864			15.76	16.24	97.02	0.78	0.01	16.14
○Thread 28865			15.67	16.24	96.44	0.78	0.01	16.14
○Thread 28866			15.68	16.24	96.53	0.78	0.01	16.13
○Thread 28867			15.88	16.24	97.76	0.78	0.01	16.14
○Thread 28868			15.58	16.24	95.91	0.78	0.01	16.14
○Thread 28869			15.63	16.24	96.19	0.78	0.01	16.14
○Thread 28870			15.61	16.24	96.07	0.78	0.01	16.15
○Thread 28871			15.68	16.24	96.53	0.78	0.01	16.15
○Thread 28872			15.69	16.24	96.59	0.78	0.01	16.13
○Thread 28873			15.47	16.24	95.21	0.78	0.01	16.14
○Thread 28874			15.64	16.24	96.29	0.78	0.01	16.15
○Thread 28875			15.66	16.24	96.38	0.78	0.01	16.14
○Thread 28876			15.77	16.24	97.09	0.78	0.01	16.15
○Thread 28877			15.60	16.24	96.04	0.78	0.01	16.14
○Thread 28878			15.57	16.24	95.86	0.78	0.01	16.15
○Thread 28879			15.70	16.24	96.63	0.78	0.01	16.14
○Thread 28880			15.78	16.24	97.12	0.78	0.01	16.15
○Thread 28881			15.64	16.24	96.32	0.78	0.01	16.15
○Thread 28882			15.85	16.24	97.55	0.78	0.01	16.14
○Thread 28883			15.65	16.24	96.35	0.78	0.01	16.15
○Thread 28884			15.67	16.24	96.47	0.78	0.01	16.14
○Thread 28885			15.69	16.24	96.60	0.78	0.01	16.15
○Thread 28886			15.71	16.24	96.72	0.78	0.01	16.15
○Thread 28887			15.78	16.24	97.12	0.78	0.01	16.13
○Thread 28888			15.78	16.24	97.12	0.78	0.01	16.15
○Thread 28889			15.64	16.24	96.29	0.78	0.01	16.14
○Thread 28890			15.65	16.24	96.32	0.78	0.01	16.15
○Thread 28891			15.74	16.24	96.91	0.78	0.01	16.14
○Thread 28892			15.51	16.24	95.49	0.78	0.01	16.15
○Thread 28893			15.61	16.24	96.08	0.78	0.01	16.15
○Thread 28894			15.58	16.24	95.89	0.78	0.01	16.15
○Thread 28895			15.66	16.24	96.39	0.78	0.01	16.15
○Thread 28896			15.80	16.24	97.28	0.78	0.01	16.14
○Thread 28897			15.75	16.24	96.94	0.78	0.01	16.13
○Thread 28898			15.81	16.24	97.31	0.78	0.01	16.14
○Thread 28899			15.75	16.24	96.97	0.79	0.01	16.14
○Thread 28900			15.62	16.24	96.17	0.79	0.01	16.15
○Thread 28901			15.63	16.24	96.23	0.79	0.01	16.14
○Thread 28902			15.84	16.24	97.53	0.79	0.01	16.14
○Thread 28903			15.74	16.24	96.88	0.79	0.01	16.15
○Thread 28904			15.43	16.24	95.00	0.79	0.01	16.15
○Thread 28905			15.74	16.24	96.88	0.79	0.01	16.14
○Thread 28906			15.75	16.24	96.94	0.79	0.01	16.15
○Thread 28907			15.70	16.24	96.64	0.79	0.01	16.15
○Thread 28908			15.58	16.24	95.93	0.79	0.01	16.15
○Thread 28909			15.52	16.24	95.56	0.79	0.01	16.15
○Thread 28910			15.52	16.24	95.53	0.79	0.01	16.15
○Thread 28911			15.64	16.24	96.27	0.79	0.01	16.14
○Thread 28912			15.70	16.24	96.64	0.79	0.01	16.14
○Thread 28913			15.69	16.24	96.58	0.79	0.01	16.15
○Thread 28914			15.74	16.24	96.89	0.79	0.01	16.14
○Thread 28915			15.62	16.24	96.18	0.79	0.01	16.14
○Thread 28916			15.71	16.24	96.70	0.79	0.01	16.15
○Thread 28917			15.59	16.24	95.99	0.79	0.01	16.15
○Thread 28918			15.57	16.24	95.90	0.79	0.01	16.15

▶Scalability - 1x4

Number processes: 1 Number nodes: 1 Run Command: <executable> -m meta-llama-3.1-8b-instruct-Q8_0.gguf -no-cnv -t 64 -n 512 -p "what is a LLM?" --seed 0MPI Command: mpirun -n <number_processes> --bind-to none --report-bindings Run Directory: /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-18-66/175-768-6804/llama.cpp/run/oneview_runs/multicore/armclang_4/oneview_run_1757689479OMP_NUM_THREADS: 4OMP_PROC_BIND: spreadOMP_DISPLAY_AFFINITY: TRUEOMP_AFFINITY_FORMAT: 'OMP: pid %P tid %i thread %n bound to OS proc set {%A}'OMP_DISPLAY_ENV: TRUEOMP_PLACES: threads

ID	Observed Processes	Observed Threads	Time(s)	Elapsed Time (s)	Active Time (%)	Start (after process) (s)	End (before process) (s)	Maximum Time on the Same CPU (s)
►Node ip-172-31-18-66+	1	64	16.09
►Process 28947+		64	16.09
○Thread 28947			16.09	17.07	94.24	0.00	0.00	16.27
○Thread 29014			15.67	16.28	96.23	0.78	0.01	16.19
○Thread 29015			15.66	16.28	96.14	0.78	0.01	16.18
○Thread 29016			15.58	16.28	95.68	0.78	0.01	16.18
○Thread 29017			15.84	16.28	97.24	0.78	0.01	16.19
○Thread 29018			15.49	16.28	95.09	0.78	0.01	16.19
○Thread 29019			15.59	16.28	95.71	0.78	0.01	16.18
○Thread 29020			15.64	16.28	96.02	0.78	0.01	16.18
○Thread 29021			15.65	16.28	96.08	0.78	0.01	16.18
○Thread 29022			15.72	16.28	96.54	0.78	0.01	16.19
○Thread 29023			15.70	16.28	96.39	0.78	0.01	16.19
○Thread 29024			15.60	16.28	95.80	0.78	0.01	16.18
○Thread 29025			15.56	16.28	95.53	0.78	0.01	16.19
○Thread 29026			15.73	16.28	96.60	0.78	0.01	16.19
○Thread 29027			15.63	16.28	95.99	0.78	0.01	16.19
○Thread 29028			15.52	16.28	95.31	0.78	0.01	16.19
○Thread 29029			15.75	16.28	96.73	0.78	0.01	16.19
○Thread 29030			15.60	16.28	95.81	0.78	0.01	16.19
○Thread 29031			15.60	16.28	95.81	0.78	0.01	16.19
○Thread 29032			15.59	16.28	95.71	0.78	0.01	16.19
○Thread 29033			15.58	16.28	95.68	0.78	0.01	16.18
○Thread 29034			15.60	16.28	95.78	0.78	0.01	16.19
○Thread 29035			15.53	16.28	95.35	0.78	0.01	16.18
○Thread 29036			15.71	16.28	96.45	0.78	0.01	16.18
○Thread 29037			15.83	16.28	97.22	0.78	0.01	16.18
○Thread 29038			15.72	16.28	96.51	0.78	0.01	16.19
○Thread 29039			15.55	16.28	95.47	0.78	0.01	16.19
○Thread 29040			15.67	16.28	96.21	0.78	0.01	16.18
○Thread 29041			15.67	16.28	96.24	0.78	0.01	16.19
○Thread 29042			15.40	16.28	94.58	0.78	0.01	16.19
○Thread 29043			15.55	16.28	95.50	0.78	0.01	16.18
○Thread 29044			15.63	16.28	95.99	0.78	0.01	16.18
○Thread 29045			15.91	16.28	97.68	0.78	0.01	16.18
○Thread 29046			15.51	16.28	95.23	0.78	0.01	16.18
○Thread 29047			15.52	16.28	95.29	0.78	0.01	16.19
○Thread 29048			15.65	16.28	96.12	0.78	0.01	16.19
○Thread 29049			15.64	16.28	96.03	0.78	0.01	16.19
○Thread 29050			15.73	16.28	96.61	0.78	0.01	16.19
○Thread 29051			15.56	16.28	95.57	0.78	0.01	16.19
○Thread 29052			15.53	16.28	95.38	0.78	0.01	16.19
○Thread 29053			15.85	16.28	97.32	0.78	0.01	16.19
○Thread 29054			15.73	16.28	96.58	0.78	0.01	16.19
○Thread 29055			15.74	16.28	96.64	0.78	0.01	16.19
○Thread 29056			15.79	16.28	96.95	0.78	0.01	16.19
○Thread 29057			15.79	16.28	96.95	0.78	0.01	16.18
○Thread 29058			15.54	16.28	95.42	0.78	0.01	16.19
○Thread 29059			15.55	16.28	95.51	0.78	0.01	16.19
○Thread 29060			15.53	16.28	95.39	0.78	0.01	16.18
○Thread 29061			15.93	16.28	97.81	0.78	0.01	16.18
○Thread 29062			15.44	16.28	94.83	0.78	0.01	16.19
○Thread 29063			15.69	16.28	96.37	0.78	0.01	16.19
○Thread 29064			15.52	16.28	95.33	0.78	0.01	16.19
○Thread 29065			15.67	16.28	96.25	0.78	0.01	16.19
○Thread 29066			15.71	16.28	96.46	0.78	0.01	16.19
○Thread 29067			15.62	16.28	95.91	0.78	0.01	16.19
○Thread 29068			15.71	16.28	96.46	0.78	0.01	16.19
○Thread 29069			15.78	16.28	96.89	0.78	0.01	16.18
○Thread 29070			15.79	16.28	96.99	0.78	0.01	16.19
○Thread 29071			15.69	16.28	96.37	0.78	0.01	16.19
○Thread 29072			15.63	16.28	95.97	0.78	0.01	16.19
○Thread 29073			15.87	16.28	97.45	0.78	0.01	16.19
○Thread 29074			15.66	16.28	96.16	0.78	0.01	16.19
○Thread 29075			15.82	16.28	97.14	0.78	0.01	16.19
○Thread 29076			15.81	16.28	97.08	0.78	0.01	16.18

▶Scalability - 1x8

Number processes: 1 Number nodes: 1 Run Command: <executable> -m meta-llama-3.1-8b-instruct-Q8_0.gguf -no-cnv -t 64 -n 512 -p "what is a LLM?" --seed 0MPI Command: mpirun -n <number_processes> --bind-to none --report-bindings Run Directory: /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-18-66/175-768-6804/llama.cpp/run/oneview_runs/multicore/armclang_4/oneview_run_1757689479OMP_NUM_THREADS: 8OMP_PROC_BIND: spreadOMP_DISPLAY_AFFINITY: TRUEOMP_AFFINITY_FORMAT: 'OMP: pid %P tid %i thread %n bound to OS proc set {%A}'OMP_DISPLAY_ENV: TRUEOMP_PLACES: threads

ID	Observed Processes	Observed Threads	Time(s)	Elapsed Time (s)	Active Time (%)	Start (after process) (s)	End (before process) (s)	Maximum Time on the Same CPU (s)
►Node ip-172-31-18-66+	1	64	16.12
►Process 29105+		64	16.12
○Thread 29105			16.12	17.01	94.77	0.00	0.00	16.21
○Thread 29172			15.50	16.22	95.56	0.78	0.01	16.11
○Thread 29173			15.66	16.22	96.52	0.78	0.01	16.11
○Thread 29174			15.54	16.22	95.81	0.78	0.01	16.10
○Thread 29175			15.85	16.22	97.72	0.78	0.01	16.10
○Thread 29176			15.52	16.22	95.69	0.78	0.01	16.11
○Thread 29177			15.57	16.22	95.97	0.78	0.01	16.11
○Thread 29178			15.69	16.22	96.71	0.78	0.01	16.11
○Thread 29179			15.83	16.22	97.57	0.78	0.01	16.10
○Thread 29180			15.51	16.22	95.63	0.78	0.01	16.11
○Thread 29181			15.55	16.22	95.85	0.78	0.01	16.11
○Thread 29182			15.75	16.22	97.08	0.78	0.01	16.11
○Thread 29183			15.55	16.22	95.88	0.78	0.01	16.10
○Thread 29184			15.51	16.22	95.60	0.78	0.01	16.11
○Thread 29185			15.73	16.22	96.96	0.78	0.01	16.11
○Thread 29186			15.62	16.22	96.31	0.78	0.01	16.11
○Thread 29187			15.70	16.22	96.80	0.78	0.01	16.11
○Thread 29188			15.76	16.22	97.14	0.78	0.01	16.11
○Thread 29189			15.67	16.22	96.62	0.78	0.01	16.11
○Thread 29190			15.64	16.22	96.43	0.78	0.01	16.11
○Thread 29191			15.71	16.22	96.84	0.78	0.01	16.10
○Thread 29192			15.53	16.22	95.76	0.78	0.01	16.11
○Thread 29193			15.56	16.22	95.91	0.78	0.01	16.11
○Thread 29194			15.68	16.22	96.68	0.78	0.01	16.11
○Thread 29195			15.78	16.22	97.30	0.78	0.01	16.10
○Thread 29196			15.62	16.22	96.31	0.78	0.01	16.11
○Thread 29197			15.61	16.22	96.25	0.78	0.01	16.11
○Thread 29198			15.58	16.22	96.07	0.78	0.01	16.11
○Thread 29199			15.58	16.22	96.04	0.78	0.01	16.11
○Thread 29200			15.67	16.22	96.62	0.78	0.01	16.10
○Thread 29201			15.61	16.22	96.25	0.78	0.01	16.11
○Thread 29202			15.57	16.22	95.98	0.78	0.01	16.11
○Thread 29203			15.86	16.22	97.79	0.78	0.01	16.10
○Thread 29204			15.62	16.22	96.32	0.78	0.01	16.11
○Thread 29205			15.51	16.22	95.67	0.78	0.01	16.11
○Thread 29206			15.53	16.22	95.76	0.78	0.01	16.11
○Thread 29207			15.65	16.22	96.47	0.78	0.01	16.11
○Thread 29208			15.45	16.22	95.27	0.78	0.01	16.11
○Thread 29209			15.62	16.22	96.29	0.78	0.01	16.11
○Thread 29210			15.76	16.22	97.15	0.78	0.01	16.11
○Thread 29211			15.70	16.22	96.81	0.78	0.01	16.11
○Thread 29212			15.54	16.22	95.79	0.78	0.01	16.11
○Thread 29213			15.59	16.22	96.13	0.78	0.01	16.11
○Thread 29214			15.67	16.22	96.60	0.78	0.01	16.11
○Thread 29215			15.72	16.22	96.94	0.78	0.01	16.10
○Thread 29216			15.47	16.22	95.39	0.78	0.01	16.10
○Thread 29217			15.50	16.22	95.61	0.78	0.01	16.11
○Thread 29218			15.62	16.22	96.29	0.78	0.01	16.11
○Thread 29219			15.74	16.22	97.03	0.78	0.01	16.11
○Thread 29220			15.62	16.22	96.35	0.78	0.01	16.11
○Thread 29221			15.66	16.22	96.54	0.78	0.01	16.11
○Thread 29222			15.58	16.22	96.07	0.78	0.01	16.11
○Thread 29223			15.64	16.22	96.44	0.78	0.01	16.11
○Thread 29224			15.70	16.22	96.82	0.78	0.01	16.11
○Thread 29225			15.59	16.22	96.14	0.78	0.01	16.11
○Thread 29226			15.68	16.22	96.69	0.78	0.01	16.11
○Thread 29227			15.84	16.22	97.65	0.78	0.01	16.11
○Thread 29228			15.65	16.22	96.51	0.78	0.01	16.11
○Thread 29229			15.48	16.22	95.43	0.78	0.01	16.11
○Thread 29230			15.61	16.22	96.26	0.78	0.01	16.11
○Thread 29231			15.64	16.22	96.42	0.78	0.01	16.10
○Thread 29232			15.59	16.22	96.14	0.78	0.01	16.11
○Thread 29233			15.57	16.22	96.02	0.78	0.01	16.11
○Thread 29234			15.65	16.22	96.54	0.78	0.01	16.11

▶Scalability - 1x16

Number processes: 1 Number nodes: 1 Run Command: <executable> -m meta-llama-3.1-8b-instruct-Q8_0.gguf -no-cnv -t 64 -n 512 -p "what is a LLM?" --seed 0MPI Command: mpirun -n <number_processes> --bind-to none --report-bindings Run Directory: /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-18-66/175-768-6804/llama.cpp/run/oneview_runs/multicore/armclang_4/oneview_run_1757689479OMP_NUM_THREADS: 16OMP_PROC_BIND: spreadOMP_DISPLAY_AFFINITY: TRUEOMP_AFFINITY_FORMAT: 'OMP: pid %P tid %i thread %n bound to OS proc set {%A}'OMP_DISPLAY_ENV: TRUEOMP_PLACES: threads

ID	Observed Processes	Observed Threads	Time(s)	Elapsed Time (s)	Active Time (%)	Start (after process) (s)	End (before process) (s)	Maximum Time on the Same CPU (s)
►Node ip-172-31-18-66+	1	64	16.14
►Process 29263+		64	16.14
○Thread 29263			16.14	17.08	94.48	0.00	0.00	16.27
○Thread 29330			15.50	16.28	95.19	0.79	0.01	16.18
○Thread 29331			15.66	16.28	96.17	0.79	0.01	16.18
○Thread 29332			15.69	16.28	96.36	0.79	0.01	16.18
○Thread 29333			15.72	16.28	96.51	0.79	0.01	16.17
○Thread 29334			15.54	16.28	95.40	0.79	0.01	16.18
○Thread 29335			15.48	16.28	95.04	0.79	0.01	16.18
○Thread 29336			15.41	16.28	94.61	0.79	0.01	16.17
○Thread 29337			15.76	16.28	96.76	0.79	0.01	16.18
○Thread 29338			15.59	16.28	95.74	0.79	0.01	16.18
○Thread 29339			15.55	16.28	95.50	0.79	0.01	16.18
○Thread 29340			15.79	16.28	96.97	0.79	0.01	16.18
○Thread 29341			15.68	16.28	96.30	0.79	0.01	16.18
○Thread 29342			15.66	16.28	96.18	0.79	0.01	16.18
○Thread 29343			15.55	16.28	95.50	0.79	0.01	16.18
○Thread 29344			15.61	16.28	95.87	0.79	0.01	16.18
○Thread 29345			15.77	16.28	96.82	0.79	0.01	16.18
○Thread 29346			15.67	16.28	96.24	0.79	0.01	16.18
○Thread 29347			15.68	16.28	96.30	0.79	0.01	16.18
○Thread 29348			15.65	16.28	96.12	0.79	0.01	16.18
○Thread 29349			15.78	16.28	96.92	0.79	0.01	16.18
○Thread 29350			15.56	16.28	95.56	0.79	0.01	16.18
○Thread 29351			15.50	16.28	95.17	0.79	0.01	16.18
○Thread 29352			15.62	16.28	95.96	0.79	0.01	16.18
○Thread 29353			15.73	16.28	96.61	0.79	0.01	16.18
○Thread 29354			15.80	16.28	97.04	0.79	0.01	16.18
○Thread 29355			15.69	16.28	96.33	0.79	0.01	16.18
○Thread 29356			15.72	16.28	96.52	0.79	0.01	16.18
○Thread 29357			15.57	16.28	95.60	0.79	0.01	16.18
○Thread 29358			15.52	16.28	95.32	0.79	0.01	16.18
○Thread 29359			15.64	16.28	96.06	0.79	0.01	16.18
○Thread 29360			15.59	16.28	95.75	0.79	0.01	16.18
○Thread 29361			15.96	16.28	98.03	0.79	0.01	16.18
○Thread 29362			15.75	16.28	96.77	0.79	0.01	16.18
○Thread 29363			15.50	16.28	95.17	0.79	0.01	16.18
○Thread 29364			15.63	16.28	96.00	0.79	0.01	16.18
○Thread 29365			15.71	16.28	96.49	0.79	0.01	16.18
○Thread 29366			15.58	16.28	95.69	0.79	0.01	16.18
○Thread 29367			15.58	16.28	95.69	0.79	0.01	16.18
○Thread 29368			15.77	16.28	96.83	0.79	0.01	16.18
○Thread 29369			15.67	16.28	96.22	0.79	0.01	16.18
○Thread 29370			15.51	16.28	95.26	0.79	0.01	16.18
○Thread 29371			15.66	16.28	96.19	0.79	0.01	16.17
○Thread 29372			15.53	16.28	95.39	0.79	0.01	16.18
○Thread 29373			15.59	16.28	95.73	0.79	0.01	16.18
○Thread 29374			15.57	16.28	95.63	0.79	0.01	16.18
○Thread 29375			15.76	16.28	96.77	0.79	0.01	16.18
○Thread 29376			15.65	16.28	96.13	0.79	0.01	16.17
○Thread 29377			15.86	16.28	97.39	0.79	0.01	16.18
○Thread 29378			15.53	16.28	95.42	0.79	0.01	16.18
○Thread 29379			15.45	16.28	94.87	0.79	0.01	16.18
○Thread 29380			15.53	16.28	95.36	0.79	0.01	16.18
○Thread 29381			15.66	16.28	96.16	0.79	0.01	16.18
○Thread 29382			15.56	16.28	95.58	0.79	0.01	16.18
○Thread 29383			15.64	16.28	96.04	0.79	0.01	16.17
○Thread 29384			15.69	16.28	96.41	0.79	0.01	16.18
○Thread 29385			15.60	16.28	95.79	0.79	0.01	16.18
○Thread 29386			15.60	16.28	95.79	0.79	0.01	16.18
○Thread 29387			15.69	16.28	96.34	0.79	0.01	16.17
○Thread 29388			15.58	16.28	95.70	0.79	0.01	16.18
○Thread 29389			15.60	16.28	95.79	0.79	0.01	16.18
○Thread 29390			15.77	16.28	96.84	0.79	0.01	16.17
○Thread 29391			15.55	16.28	95.52	0.79	0.01	16.18
○Thread 29392			15.54	16.28	95.42	0.79	0.01	16.18

▶Scalability - 1x24

Number processes: 1 Number nodes: 1 Run Command: <executable> -m meta-llama-3.1-8b-instruct-Q8_0.gguf -no-cnv -t 64 -n 512 -p "what is a LLM?" --seed 0MPI Command: mpirun -n <number_processes> --bind-to none --report-bindings Run Directory: /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-18-66/175-768-6804/llama.cpp/run/oneview_runs/multicore/armclang_4/oneview_run_1757689479OMP_NUM_THREADS: 24OMP_PROC_BIND: spreadOMP_DISPLAY_AFFINITY: TRUEOMP_AFFINITY_FORMAT: 'OMP: pid %P tid %i thread %n bound to OS proc set {%A}'OMP_DISPLAY_ENV: TRUEOMP_PLACES: threads

ID	Observed Processes	Observed Threads	Time(s)	Elapsed Time (s)	Active Time (%)	Start (after process) (s)	End (before process) (s)	Maximum Time on the Same CPU (s)
►Node ip-172-31-18-66+	1	64	16.17
►Process 29421+		64	16.17
○Thread 29421			16.17	17.14	94.33	0.00	0.00	16.33
○Thread 29488			15.69	16.34	95.97	0.78	0.01	16.25
○Thread 29489			15.84	16.34	96.91	0.78	0.01	16.24
○Thread 29490			15.75	16.34	96.36	0.78	0.01	16.25
○Thread 29491			15.88	16.34	97.16	0.78	0.01	16.25
○Thread 29492			15.57	16.34	95.26	0.78	0.01	16.25
○Thread 29493			15.64	16.34	95.66	0.78	0.01	16.24
○Thread 29494			15.58	16.34	95.33	0.78	0.01	16.25
○Thread 29495			15.74	16.34	96.27	0.78	0.01	16.25
○Thread 29496			15.43	16.34	94.38	0.78	0.01	16.24
○Thread 29497			15.65	16.34	95.76	0.78	0.01	16.24
○Thread 29498			15.56	16.34	95.21	0.78	0.01	16.25
○Thread 29499			15.84	16.34	96.89	0.78	0.01	16.25
○Thread 29500			15.66	16.34	95.79	0.78	0.01	16.25
○Thread 29501			15.76	16.34	96.40	0.78	0.01	16.25
○Thread 29502			15.63	16.34	95.63	0.78	0.01	16.24
○Thread 29503			15.84	16.34	96.92	0.78	0.01	16.24
○Thread 29504			15.62	16.34	95.57	0.78	0.01	16.24
○Thread 29505			15.70	16.34	96.09	0.78	0.01	16.25
○Thread 29506			15.55	16.34	95.12	0.78	0.01	16.24
○Thread 29507			15.65	16.34	95.73	0.78	0.01	16.24
○Thread 29508			15.70	16.34	96.03	0.78	0.01	16.24
○Thread 29509			15.69	16.34	95.97	0.78	0.01	16.25
○Thread 29510			15.51	16.34	94.87	0.78	0.01	16.25
○Thread 29511			15.69	16.34	96.01	0.78	0.01	16.24
○Thread 29512			15.61	16.34	95.52	0.78	0.01	16.25
○Thread 29513			15.62	16.34	95.58	0.78	0.01	16.24
○Thread 29514			15.73	16.34	96.22	0.78	0.01	16.25
○Thread 29515			15.61	16.34	95.52	0.78	0.01	16.25
○Thread 29516			15.57	16.34	95.24	0.78	0.01	16.25
○Thread 29517			15.68	16.34	95.92	0.78	0.01	16.25
○Thread 29518			15.75	16.34	96.37	0.78	0.01	16.25
○Thread 29519			15.85	16.34	96.96	0.78	0.01	16.24
○Thread 29520			15.77	16.34	96.50	0.78	0.01	16.25
○Thread 29521			15.71	16.34	96.13	0.78	0.01	16.25
○Thread 29522			15.73	16.34	96.22	0.78	0.01	16.25
○Thread 29523			15.84	16.34	96.90	0.78	0.01	16.25
○Thread 29524			15.54	16.34	95.09	0.79	0.01	16.25
○Thread 29525			15.61	16.34	95.49	0.79	0.01	16.25
○Thread 29526			15.75	16.34	96.38	0.79	0.01	16.25
○Thread 29527			15.76	16.34	96.41	0.79	0.01	16.25
○Thread 29528			15.74	16.34	96.32	0.79	0.01	16.25
○Thread 29529			15.83	16.34	96.84	0.79	0.01	16.25
○Thread 29530			15.82	16.34	96.81	0.79	0.01	16.25
○Thread 29531			15.87	16.34	97.08	0.79	0.01	16.25
○Thread 29532			15.62	16.34	95.55	0.79	0.01	16.24
○Thread 29533			15.87	16.34	97.11	0.79	0.01	16.25
○Thread 29534			15.66	16.34	95.80	0.79	0.01	16.25
○Thread 29535			15.88	16.34	97.15	0.79	0.01	16.25
○Thread 29536			15.80	16.34	96.66	0.79	0.01	16.25
○Thread 29537			15.77	16.34	96.50	0.79	0.01	16.24
○Thread 29538			15.70	16.34	96.08	0.79	0.01	16.25
○Thread 29539			15.93	16.34	97.45	0.79	0.01	16.25
○Thread 29540			15.67	16.34	95.89	0.79	0.01	16.24
○Thread 29541			15.49	16.34	94.79	0.79	0.01	16.24
○Thread 29542			15.64	16.34	95.68	0.79	0.01	16.25
○Thread 29543			15.89	16.34	97.24	0.79	0.01	16.24
○Thread 29544			15.77	16.34	96.51	0.79	0.01	16.24
○Thread 29545			15.63	16.34	95.65	0.79	0.01	16.24
○Thread 29546			15.87	16.34	97.09	0.79	0.01	16.25
○Thread 29547			15.74	16.34	96.29	0.79	0.01	16.25
○Thread 29548			15.61	16.34	95.53	0.79	0.01	16.25
○Thread 29549			15.65	16.34	95.74	0.79	0.01	16.25
○Thread 29550			15.64	16.34	95.71	0.79	0.01	16.25

▶Scalability - 1x32

Number processes: 1 Number nodes: 1 Run Command: <executable> -m meta-llama-3.1-8b-instruct-Q8_0.gguf -no-cnv -t 64 -n 512 -p "what is a LLM?" --seed 0MPI Command: mpirun -n <number_processes> --bind-to none --report-bindings Run Directory: /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-18-66/175-768-6804/llama.cpp/run/oneview_runs/multicore/armclang_4/oneview_run_1757689479OMP_NUM_THREADS: 32OMP_PROC_BIND: spreadOMP_DISPLAY_AFFINITY: TRUEOMP_AFFINITY_FORMAT: 'OMP: pid %P tid %i thread %n bound to OS proc set {%A}'OMP_DISPLAY_ENV: TRUEOMP_PLACES: threads

ID	Observed Processes	Observed Threads	Time(s)	Elapsed Time (s)	Active Time (%)	Start (after process) (s)	End (before process) (s)	Maximum Time on the Same CPU (s)
►Node ip-172-31-18-66+	1	64	16.08
►Process 29579+		64	16.08
○Thread 29579			16.08	17.10	93.98	0.00	0.00	16.30
○Thread 29646			15.58	16.31	95.52	0.78	0.01	16.21
○Thread 29647			15.72	16.31	96.38	0.78	0.01	16.21
○Thread 29648			15.81	16.31	96.90	0.78	0.01	16.21
○Thread 29649			15.80	16.31	96.87	0.78	0.01	16.21
○Thread 29650			15.79	16.31	96.81	0.78	0.01	16.21
○Thread 29651			15.89	16.31	97.42	0.78	0.01	16.21
○Thread 29652			15.80	16.31	96.84	0.78	0.01	16.21
○Thread 29653			15.90	16.31	97.48	0.78	0.01	16.21
○Thread 29654			15.51	16.31	95.06	0.78	0.01	16.21
○Thread 29655			15.65	16.31	95.92	0.78	0.01	16.21
○Thread 29656			15.70	16.31	96.23	0.78	0.01	16.21
○Thread 29657			15.75	16.31	96.56	0.78	0.01	16.21
○Thread 29658			15.59	16.31	95.58	0.78	0.01	16.21
○Thread 29659			15.56	16.31	95.37	0.78	0.01	16.21
○Thread 29660			15.65	16.31	95.92	0.78	0.01	16.21
○Thread 29661			15.78	16.31	96.75	0.78	0.01	16.21
○Thread 29662			15.64	16.31	95.86	0.78	0.01	16.21
○Thread 29663			15.62	16.31	95.74	0.78	0.01	16.21
○Thread 29664			15.71	16.31	96.32	0.78	0.01	16.21
○Thread 29665			15.70	16.31	96.23	0.78	0.01	16.21
○Thread 29666			15.74	16.31	96.47	0.78	0.01	16.21
○Thread 29667			15.70	16.31	96.26	0.78	0.01	16.21
○Thread 29668			15.77	16.31	96.69	0.78	0.01	16.21
○Thread 29669			15.86	16.31	97.24	0.78	0.01	16.21
○Thread 29670			15.75	16.31	96.57	0.78	0.01	16.21
○Thread 29671			15.79	16.31	96.81	0.78	0.01	16.21
○Thread 29672			15.59	16.31	95.59	0.78	0.01	16.21
○Thread 29673			15.77	16.31	96.69	0.78	0.01	16.21
○Thread 29674			15.65	16.31	95.92	0.78	0.01	16.21
○Thread 29675			15.70	16.31	96.23	0.78	0.01	16.21
○Thread 29676			15.61	16.31	95.68	0.78	0.01	16.21
○Thread 29677			15.86	16.31	97.27	0.78	0.01	16.21
○Thread 29678			15.72	16.31	96.36	0.78	0.01	16.21
○Thread 29679			15.57	16.31	95.47	0.78	0.01	16.21
○Thread 29680			15.74	16.31	96.48	0.78	0.01	16.21
○Thread 29681			15.72	16.31	96.36	0.79	0.01	16.21
○Thread 29682			15.56	16.31	95.38	0.79	0.01	16.21
○Thread 29683			15.71	16.31	96.33	0.79	0.01	16.21
○Thread 29684			15.73	16.31	96.45	0.79	0.01	16.21
○Thread 29685			15.61	16.31	95.71	0.79	0.01	16.21
○Thread 29686			15.68	16.31	96.17	0.79	0.01	16.21
○Thread 29687			15.56	16.31	95.41	0.79	0.01	16.21
○Thread 29688			15.82	16.31	96.97	0.79	0.01	16.21
○Thread 29689			15.66	16.31	96.02	0.79	0.01	16.21
○Thread 29690			15.77	16.31	96.67	0.79	0.01	16.21
○Thread 29691			15.63	16.31	95.81	0.79	0.01	16.21
○Thread 29692			15.51	16.31	95.07	0.79	0.01	16.21
○Thread 29693			15.80	16.31	96.88	0.79	0.01	16.21
○Thread 29694			15.60	16.31	95.66	0.79	0.01	16.21
○Thread 29695			15.41	16.31	94.49	0.79	0.01	16.21
○Thread 29696			15.53	16.31	95.20	0.79	0.01	16.21
○Thread 29697			15.80	16.31	96.88	0.79	0.01	16.20
○Thread 29698			15.65	16.31	95.96	0.79	0.01	16.21
○Thread 29699			15.58	16.31	95.50	0.79	0.01	16.21
○Thread 29700			15.59	16.31	95.60	0.79	0.01	16.21
○Thread 29701			15.90	16.31	97.50	0.79	0.01	16.21
○Thread 29702			15.55	16.31	95.32	0.79	0.01	16.21
○Thread 29703			15.58	16.31	95.57	0.79	0.01	16.21
○Thread 29704			15.68	16.31	96.15	0.79	0.01	16.21
○Thread 29705			15.94	16.31	97.71	0.79	0.01	16.21
○Thread 29706			15.76	16.31	96.61	0.79	0.01	16.21
○Thread 29707			15.65	16.31	95.97	0.79	0.01	16.21
○Thread 29708			15.77	16.31	96.73	0.79	0.01	16.21

▶Scalability - 1x40

Number processes: 1 Number nodes: 1 Run Command: <executable> -m meta-llama-3.1-8b-instruct-Q8_0.gguf -no-cnv -t 64 -n 512 -p "what is a LLM?" --seed 0MPI Command: mpirun -n <number_processes> --bind-to none --report-bindings Run Directory: /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-18-66/175-768-6804/llama.cpp/run/oneview_runs/multicore/armclang_4/oneview_run_1757689479OMP_NUM_THREADS: 40OMP_PROC_BIND: spreadOMP_DISPLAY_AFFINITY: TRUEOMP_AFFINITY_FORMAT: 'OMP: pid %P tid %i thread %n bound to OS proc set {%A}'OMP_DISPLAY_ENV: TRUEOMP_PLACES: threads

ID	Observed Processes	Observed Threads	Time(s)	Elapsed Time (s)	Active Time (%)	Start (after process) (s)	End (before process) (s)	Maximum Time on the Same CPU (s)
►Node ip-172-31-18-66+	1	64	16.18
►Process 29737+		64	16.18
○Thread 29737			16.18	17.10	94.60	0.00	0.00	16.29
○Thread 29804			15.57	16.31	95.49	0.78	0.01	16.18
○Thread 29805			15.75	16.31	96.59	0.78	0.01	16.19
○Thread 29806			15.60	16.31	95.64	0.78	0.01	16.19
○Thread 29807			15.86	16.31	97.27	0.78	0.01	16.19
○Thread 29808			15.68	16.31	96.16	0.78	0.01	16.19
○Thread 29809			15.75	16.31	96.56	0.78	0.01	16.19
○Thread 29810			15.73	16.31	96.44	0.78	0.01	16.19
○Thread 29811			15.78	16.31	96.78	0.78	0.01	16.19
○Thread 29812			15.62	16.31	95.80	0.78	0.01	16.18
○Thread 29813			15.64	16.31	95.92	0.78	0.01	16.19
○Thread 29814			15.63	16.30	95.86	0.78	0.01	16.19
○Thread 29815			15.77	16.30	96.69	0.78	0.01	16.19
○Thread 29816			15.79	16.30	96.84	0.78	0.01	16.19
○Thread 29817			15.83	16.30	97.09	0.78	0.01	16.19
○Thread 29818			15.74	16.30	96.51	0.78	0.01	16.19
○Thread 29819			15.70	16.30	96.26	0.78	0.01	16.19
○Thread 29820			15.72	16.30	96.41	0.78	0.01	16.19
○Thread 29821			15.59	16.30	95.59	0.78	0.01	16.19
○Thread 29822			15.58	16.30	95.53	0.78	0.01	16.19
○Thread 29823			15.84	16.30	97.12	0.78	0.01	16.19
○Thread 29824			15.73	16.30	96.45	0.78	0.01	16.19
○Thread 29825			15.71	16.30	96.32	0.78	0.01	16.19
○Thread 29826			15.74	16.30	96.51	0.78	0.01	16.19
○Thread 29827			15.85	16.30	97.21	0.78	0.01	16.19
○Thread 29828			15.62	16.30	95.77	0.78	0.01	16.19
○Thread 29829			15.66	16.30	96.05	0.78	0.01	16.19
○Thread 29830			15.60	16.30	95.65	0.78	0.01	16.19
○Thread 29831			15.74	16.30	96.54	0.78	0.01	16.19
○Thread 29832			15.67	16.30	96.11	0.78	0.01	16.19
○Thread 29833			15.59	16.30	95.59	0.78	0.01	16.19
○Thread 29834			15.62	16.30	95.78	0.78	0.01	16.18
○Thread 29835			15.90	16.30	97.52	0.79	0.01	16.19
○Thread 29836			15.70	16.30	96.27	0.79	0.01	16.19
○Thread 29837			15.59	16.30	95.59	0.79	0.01	16.18
○Thread 29838			15.62	16.30	95.78	0.79	0.01	16.19
○Thread 29839			15.66	16.30	96.05	0.79	0.01	16.19
○Thread 29840			15.59	16.30	95.62	0.79	0.01	16.19
○Thread 29841			15.61	16.30	95.75	0.79	0.01	16.19
○Thread 29842			15.60	16.30	95.69	0.79	0.01	16.19
○Thread 29843			15.64	16.30	95.90	0.79	0.01	16.19
○Thread 29844			15.64	16.30	95.90	0.79	0.01	16.19
○Thread 29845			15.79	16.30	96.85	0.79	0.01	16.19
○Thread 29846			15.61	16.30	95.75	0.79	0.01	16.19
○Thread 29847			15.78	16.30	96.79	0.79	0.01	16.19
○Thread 29848			15.68	16.30	96.15	0.79	0.01	16.19
○Thread 29849			15.65	16.30	95.99	0.79	0.01	16.19
○Thread 29850			15.77	16.30	96.70	0.79	0.01	16.19
○Thread 29851			15.79	16.30	96.82	0.79	0.01	16.19
○Thread 29852			15.63	16.30	95.87	0.79	0.01	16.19
○Thread 29853			15.75	16.30	96.58	0.79	0.01	16.18
○Thread 29854			15.58	16.30	95.54	0.79	0.01	16.19
○Thread 29855			15.61	16.30	95.75	0.79	0.01	16.18
○Thread 29856			15.75	16.30	96.61	0.79	0.01	16.19
○Thread 29857			15.57	16.30	95.51	0.79	0.01	16.19
○Thread 29858			15.67	16.30	96.12	0.79	0.01	16.19
○Thread 29859			15.71	16.30	96.37	0.79	0.01	16.19
○Thread 29860			15.57	16.30	95.51	0.79	0.01	16.19
○Thread 29861			15.65	16.30	95.97	0.79	0.01	16.19
○Thread 29862			15.67	16.30	96.12	0.79	0.01	16.19
○Thread 29863			15.63	16.30	95.88	0.79	0.01	16.19
○Thread 29864			15.56	16.30	95.45	0.79	0.01	16.19
○Thread 29865			15.59	16.30	95.63	0.79	0.01	16.19
○Thread 29866			15.59	16.30	95.63	0.79	0.01	16.19

▶Scalability - 1x48

Number processes: 1 Number nodes: 1 Run Command: <executable> -m meta-llama-3.1-8b-instruct-Q8_0.gguf -no-cnv -t 64 -n 512 -p "what is a LLM?" --seed 0MPI Command: mpirun -n <number_processes> --bind-to none --report-bindings Run Directory: /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-18-66/175-768-6804/llama.cpp/run/oneview_runs/multicore/armclang_4/oneview_run_1757689479OMP_NUM_THREADS: 48OMP_PROC_BIND: spreadOMP_DISPLAY_AFFINITY: TRUEOMP_AFFINITY_FORMAT: 'OMP: pid %P tid %i thread %n bound to OS proc set {%A}'OMP_DISPLAY_ENV: TRUEOMP_PLACES: threads

ID	Observed Processes	Observed Threads	Time(s)	Elapsed Time (s)	Active Time (%)	Start (after process) (s)	End (before process) (s)	Maximum Time on the Same CPU (s)
►Node ip-172-31-18-66+	1	64	16.20
►Process 29895+		64	16.20
○Thread 29895			16.20	17.08	94.82	0.00	0.00	16.27
○Thread 29962			15.58	16.28	95.70	0.79	0.01	16.18
○Thread 29963			15.70	16.28	96.41	0.79	0.01	16.18
○Thread 29964			15.57	16.28	95.61	0.79	0.01	16.17
○Thread 29965			15.74	16.28	96.66	0.79	0.01	16.17
○Thread 29966			15.68	16.28	96.32	0.79	0.01	16.18
○Thread 29967			15.72	16.28	96.57	0.79	0.01	16.18
○Thread 29968			15.77	16.28	96.87	0.79	0.01	16.18
○Thread 29969			15.71	16.28	96.48	0.79	0.01	16.18
○Thread 29970			15.56	16.28	95.56	0.79	0.01	16.18
○Thread 29971			15.60	16.28	95.80	0.79	0.01	16.18
○Thread 29972			15.70	16.28	96.42	0.79	0.01	16.17
○Thread 29973			15.53	16.28	95.40	0.79	0.01	16.18
○Thread 29974			15.56	16.28	95.59	0.79	0.01	16.18
○Thread 29975			15.57	16.28	95.65	0.79	0.01	16.18
○Thread 29976			15.65	16.28	96.14	0.79	0.01	16.18
○Thread 29977			15.76	16.28	96.82	0.79	0.01	16.17
○Thread 29978			15.64	16.28	96.05	0.79	0.01	16.18
○Thread 29979			15.68	16.28	96.33	0.79	0.01	16.17
○Thread 29980			15.57	16.28	95.62	0.79	0.01	16.18
○Thread 29981			15.71	16.28	96.48	0.79	0.01	16.18
○Thread 29982			15.78	16.28	96.91	0.80	0.01	16.18
○Thread 29983			15.58	16.28	95.71	0.80	0.01	16.18
○Thread 29984			15.57	16.28	95.62	0.80	0.01	16.18
○Thread 29985			15.83	16.28	97.22	0.80	0.01	16.18
○Thread 29986			15.64	16.28	96.05	0.80	0.01	16.18
○Thread 29987			15.66	16.28	96.21	0.80	0.01	16.18
○Thread 29988			15.84	16.28	97.28	0.80	0.01	16.18
○Thread 29989			15.70	16.28	96.45	0.80	0.01	16.18
○Thread 29990			15.63	16.28	96.02	0.80	0.01	16.18
○Thread 29991			15.60	16.28	95.84	0.80	0.01	16.18
○Thread 29992			15.88	16.28	97.56	0.80	0.01	16.17
○Thread 29993			15.83	16.28	97.22	0.80	0.01	16.18
○Thread 29994			15.60	16.28	95.84	0.80	0.01	16.18
○Thread 29995			15.75	16.28	96.76	0.80	0.01	16.18
○Thread 29996			15.64	16.28	96.09	0.80	0.01	16.17
○Thread 29997			15.87	16.28	97.47	0.80	0.01	16.18
○Thread 29998			15.79	16.28	96.98	0.80	0.01	16.18
○Thread 29999			15.68	16.28	96.30	0.80	0.01	16.18
○Thread 30000			15.58	16.28	95.69	0.80	0.01	16.17
○Thread 30001			15.85	16.28	97.38	0.80	0.01	16.18
○Thread 30002			15.55	16.28	95.51	0.80	0.01	16.17
○Thread 30003			15.70	16.28	96.46	0.80	0.01	16.17
○Thread 30004			15.53	16.28	95.38	0.80	0.01	16.17
○Thread 30005			15.74	16.28	96.73	0.80	0.01	16.17
○Thread 30006			15.60	16.28	95.81	0.80	0.01	16.18
○Thread 30007			15.58	16.28	95.72	0.80	0.01	16.17
○Thread 30008			15.76	16.28	96.83	0.80	0.01	16.18
○Thread 30009			15.84	16.28	97.32	0.80	0.01	16.18
○Thread 30010			15.59	16.28	95.75	0.80	0.01	16.18
○Thread 30011			15.59	16.28	95.78	0.80	0.01	16.18
○Thread 30012			15.56	16.28	95.63	0.80	0.01	16.18
○Thread 30013			15.62	16.28	95.97	0.80	0.01	16.17
○Thread 30014			15.70	16.28	96.46	0.80	0.01	16.18
○Thread 30015			15.63	16.28	96.00	0.80	0.01	16.17
○Thread 30016			15.70	16.28	96.46	0.80	0.01	16.18
○Thread 30017			15.70	16.28	96.43	0.80	0.01	16.18
○Thread 30018			15.64	16.28	96.06	0.80	0.01	16.18
○Thread 30019			15.63	16.28	96.00	0.80	0.01	16.18
○Thread 30020			15.82	16.28	97.20	0.80	0.01	16.18
○Thread 30021			15.88	16.28	97.54	0.80	0.01	16.18
○Thread 30022			15.60	16.28	95.85	0.80	0.01	16.18
○Thread 30023			15.67	16.28	96.25	0.80	0.01	16.18
○Thread 30024			15.60	16.28	95.85	0.80	0.01	16.18

▶Scalability - 1x56

Number processes: 1 Number nodes: 1 Run Command: <executable> -m meta-llama-3.1-8b-instruct-Q8_0.gguf -no-cnv -t 64 -n 512 -p "what is a LLM?" --seed 0MPI Command: mpirun -n <number_processes> --bind-to none --report-bindings Run Directory: /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-18-66/175-768-6804/llama.cpp/run/oneview_runs/multicore/armclang_4/oneview_run_1757689479OMP_NUM_THREADS: 56OMP_PROC_BIND: spreadOMP_DISPLAY_AFFINITY: TRUEOMP_AFFINITY_FORMAT: 'OMP: pid %P tid %i thread %n bound to OS proc set {%A}'OMP_DISPLAY_ENV: TRUEOMP_PLACES: threads

ID	Observed Processes	Observed Threads	Time(s)	Elapsed Time (s)	Active Time (%)	Start (after process) (s)	End (before process) (s)	Maximum Time on the Same CPU (s)
►Node ip-172-31-18-66+	1	64	16.08
►Process 30053+		64	16.08
○Thread 30053			16.08	17.07	94.20	0.00	0.00	16.26
○Thread 30120			15.72	16.28	96.55	0.78	0.01	16.16
○Thread 30121			15.72	16.28	96.58	0.78	0.01	16.16
○Thread 30122			15.56	16.28	95.57	0.78	0.01	16.16
○Thread 30123			15.82	16.28	97.20	0.78	0.01	16.16
○Thread 30124			15.76	16.28	96.83	0.78	0.01	16.16
○Thread 30125			15.75	16.28	96.77	0.78	0.01	16.16
○Thread 30126			15.71	16.28	96.50	0.78	0.01	16.16
○Thread 30127			15.84	16.28	97.32	0.78	0.01	16.16
○Thread 30128			15.74	16.28	96.68	0.78	0.01	16.16
○Thread 30129			15.74	16.28	96.68	0.78	0.01	16.16
○Thread 30130			15.73	16.28	96.62	0.78	0.01	16.16
○Thread 30131			15.72	16.28	96.59	0.78	0.01	16.16
○Thread 30132			15.61	16.28	95.88	0.78	0.01	16.16
○Thread 30133			15.65	16.27	96.13	0.78	0.01	16.16
○Thread 30134			15.63	16.27	96.04	0.78	0.01	16.16
○Thread 30135			15.84	16.27	97.33	0.78	0.01	16.16
○Thread 30136			15.63	16.27	96.01	0.78	0.01	16.16
○Thread 30137			15.72	16.27	96.56	0.78	0.01	16.16
○Thread 30138			15.56	16.27	95.58	0.78	0.01	16.16
○Thread 30139			15.76	16.27	96.81	0.78	0.01	16.16
○Thread 30140			15.79	16.27	97.02	0.78	0.01	16.15
○Thread 30141			15.60	16.27	95.86	0.78	0.01	16.16
○Thread 30142			15.64	16.27	96.13	0.78	0.01	16.16
○Thread 30143			15.74	16.27	96.72	0.78	0.01	16.16
○Thread 30144			15.81	16.27	97.15	0.78	0.01	16.16
○Thread 30145			15.66	16.27	96.19	0.78	0.01	16.16
○Thread 30146			15.70	16.27	96.47	0.78	0.01	16.16
○Thread 30147			15.83	16.27	97.27	0.78	0.01	16.16
○Thread 30148			15.70	16.27	96.44	0.78	0.01	16.16
○Thread 30149			15.67	16.27	96.26	0.78	0.01	16.16
○Thread 30150			15.66	16.27	96.23	0.78	0.01	16.16
○Thread 30151			15.87	16.27	97.49	0.78	0.01	16.16
○Thread 30152			15.68	16.27	96.35	0.78	0.01	16.16
○Thread 30153			15.70	16.27	96.47	0.78	0.01	16.15
○Thread 30154			15.60	16.27	95.86	0.78	0.01	16.16
○Thread 30155			15.76	16.27	96.84	0.78	0.01	16.16
○Thread 30156			15.60	16.27	95.86	0.78	0.01	16.16
○Thread 30157			15.64	16.27	96.08	0.78	0.01	16.16
○Thread 30158			15.56	16.27	95.62	0.78	0.01	16.15
○Thread 30159			15.79	16.27	97.00	0.78	0.01	16.16
○Thread 30160			15.59	16.27	95.80	0.78	0.01	16.16
○Thread 30161			15.69	16.27	96.42	0.78	0.01	16.16
○Thread 30162			15.58	16.27	95.71	0.78	0.01	16.16
○Thread 30163			15.67	16.27	96.26	0.78	0.01	16.16
○Thread 30164			15.60	16.27	95.86	0.78	0.01	16.16
○Thread 30165			15.57	16.27	95.68	0.78	0.01	16.15
○Thread 30166			15.55	16.27	95.59	0.78	0.01	16.16
○Thread 30167			15.83	16.27	97.25	0.78	0.01	16.16
○Thread 30168			15.63	16.27	96.05	0.78	0.01	16.16
○Thread 30169			15.63	16.27	96.05	0.78	0.01	16.16
○Thread 30170			15.66	16.27	96.20	0.78	0.01	16.16
○Thread 30171			15.79	16.27	97.03	0.78	0.01	16.16
○Thread 30172			15.58	16.27	95.71	0.78	0.01	16.16
○Thread 30173			15.60	16.27	95.84	0.78	0.01	16.16
○Thread 30174			15.53	16.27	95.44	0.78	0.01	16.16
○Thread 30175			15.75	16.27	96.79	0.78	0.01	16.16
○Thread 30176			15.59	16.27	95.81	0.78	0.01	16.16
○Thread 30177			15.71	16.27	96.51	0.78	0.01	16.16
○Thread 30178			15.60	16.27	95.87	0.78	0.01	16.16
○Thread 30179			15.75	16.27	96.79	0.78	0.01	16.16
○Thread 30180			15.60	16.27	95.87	0.78	0.01	16.16
○Thread 30181			15.76	16.27	96.85	0.78	0.01	16.15
○Thread 30182			15.68	16.27	96.33	0.78	0.01	16.16

▶Scalability - 1x64

Number processes: 1 Number nodes: 1 Run Command: <executable> -m meta-llama-3.1-8b-instruct-Q8_0.gguf -no-cnv -t 64 -n 512 -p "what is a LLM?" --seed 0MPI Command: mpirun -n <number_processes> --bind-to none --report-bindings Run Directory: /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-18-66/175-768-6804/llama.cpp/run/oneview_runs/multicore/armclang_4/oneview_run_1757689479OMP_NUM_THREADS: 64OMP_PROC_BIND: spreadOMP_DISPLAY_AFFINITY: TRUEOMP_AFFINITY_FORMAT: 'OMP: pid %P tid %i thread %n bound to OS proc set {%A}'OMP_DISPLAY_ENV: TRUEOMP_PLACES: threads

ID	Observed Processes	Observed Threads	Time(s)	Elapsed Time (s)	Active Time (%)	Start (after process) (s)	End (before process) (s)	Maximum Time on the Same CPU (s)
►Node ip-172-31-18-66+	1	64	16.06
►Process 30212+		64	16.06
○Thread 30212			16.06	17.06	94.13	0.00	0.00	16.26
○Thread 30279			15.65	16.27	96.18	0.78	0.01	16.17
○Thread 30280			15.71	16.27	96.52	0.78	0.01	16.17
○Thread 30281			15.56	16.27	95.63	0.78	0.01	16.17
○Thread 30282			15.89	16.27	97.63	0.78	0.01	16.17
○Thread 30283			15.51	16.27	95.32	0.78	0.01	16.16
○Thread 30284			15.55	16.27	95.54	0.78	0.01	16.17
○Thread 30285			15.65	16.27	96.15	0.78	0.01	16.17
○Thread 30286			15.59	16.27	95.79	0.78	0.01	16.17
○Thread 30287			15.73	16.27	96.65	0.78	0.01	16.17
○Thread 30288			15.60	16.27	95.85	0.78	0.01	16.17
○Thread 30289			15.60	16.27	95.88	0.78	0.01	16.17
○Thread 30290			15.86	16.27	97.45	0.78	0.01	16.17
○Thread 30291			15.56	16.27	95.60	0.78	0.01	16.17
○Thread 30292			15.64	16.27	96.13	0.78	0.01	16.17
○Thread 30293			15.45	16.27	94.93	0.78	0.01	16.17
○Thread 30294			15.83	16.27	97.29	0.78	0.01	16.17
○Thread 30295			15.42	16.27	94.78	0.78	0.01	16.17
○Thread 30296			15.69	16.27	96.40	0.78	0.01	16.17
○Thread 30297			15.65	16.27	96.16	0.78	0.01	16.17
○Thread 30298			15.87	16.27	97.51	0.78	0.01	16.17
○Thread 30299			15.69	16.27	96.41	0.78	0.01	16.17
○Thread 30300			15.76	16.27	96.84	0.78	0.01	16.17
○Thread 30301			15.66	16.27	96.22	0.78	0.01	16.17
○Thread 30302			15.88	16.27	97.61	0.78	0.01	16.17
○Thread 30303			15.64	16.27	96.10	0.78	0.01	16.17
○Thread 30304			15.60	16.27	95.88	0.78	0.01	16.17
○Thread 30305			15.68	16.27	96.38	0.78	0.01	16.16
○Thread 30306			15.61	16.27	95.95	0.78	0.01	16.17
○Thread 30307			15.75	16.27	96.81	0.78	0.01	16.17
○Thread 30308			15.69	16.27	96.41	0.78	0.01	16.17
○Thread 30309			15.73	16.27	96.69	0.78	0.01	16.17
○Thread 30310			15.68	16.27	96.38	0.78	0.01	16.17
○Thread 30311			15.55	16.27	95.55	0.78	0.01	16.17
○Thread 30312			15.62	16.27	96.01	0.78	0.01	16.17
○Thread 30313			15.73	16.27	96.66	0.78	0.01	16.17
○Thread 30314			15.68	16.27	96.35	0.78	0.01	16.17
○Thread 30315			15.58	16.27	95.77	0.78	0.01	16.16
○Thread 30316			15.56	16.27	95.67	0.78	0.01	16.17
○Thread 30317			15.76	16.27	96.84	0.78	0.01	16.17
○Thread 30318			15.70	16.27	96.47	0.78	0.01	16.17
○Thread 30319			15.66	16.27	96.26	0.78	0.01	16.17
○Thread 30320			15.52	16.27	95.40	0.78	0.01	16.17
○Thread 30321			15.56	16.27	95.64	0.78	0.01	16.17
○Thread 30322			15.66	16.27	96.23	0.78	0.01	16.17
○Thread 30323			15.50	16.27	95.28	0.78	0.01	16.17
○Thread 30324			15.60	16.27	95.86	0.78	0.01	16.17
○Thread 30325			15.53	16.27	95.43	0.78	0.01	16.16
○Thread 30326			15.97	16.27	98.14	0.78	0.01	16.17
○Thread 30327			15.52	16.27	95.37	0.78	0.01	16.17
○Thread 30328			15.47	16.27	95.06	0.78	0.01	16.17
○Thread 30329			15.67	16.27	96.29	0.78	0.01	16.16
○Thread 30330			15.62	16.27	95.99	0.78	0.01	16.17
○Thread 30331			15.67	16.27	96.29	0.78	0.01	16.17
○Thread 30332			15.46	16.27	95.00	0.78	0.01	16.17
○Thread 30333			15.72	16.27	96.63	0.78	0.01	16.17
○Thread 30334			15.61	16.27	95.96	0.78	0.01	16.17
○Thread 30335			15.73	16.27	96.69	0.78	0.01	16.17
○Thread 30336			15.67	16.27	96.36	0.78	0.01	16.17
○Thread 30337			15.80	16.27	97.12	0.78	0.01	16.17
○Thread 30338			15.68	16.27	96.39	0.78	0.01	16.17
○Thread 30339			15.67	16.27	96.30	0.78	0.01	16.17
○Thread 30340			15.68	16.27	96.39	0.78	0.01	16.15
○Thread 30341			15.66	16.27	96.27	0.78	0.01	16.17

Report Configuration