* [MAQAO] Info: Detected 1 Lprof instances in ip-172-31-18-66.
If this is incorrect, rerun with number-processes-per-node=X
[0m{"n_kv_max": 16384, "n_batch": 2048, "n_ubatch": 512, "flash_attn": -1, "is_pp_shared": 0, "n_gpu_layers": -1, "n_threads": 64, "n_threads_batch": 64, "pp": 0, "tg": 128, "pl": 16, "n_kv": 2048, "t_pp": 0.000001, "speed_pp": 0.000000, "t_tg": 6.445174, "speed_tg": 317.757111, "t": 6.445175, "speed": 317.757080}
Your experiment path is /home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-18-66/176-138-1719/llama.cpp/run/oneview_runs/defaults/gcc/oneview_results_1761381982/tools/lprof_npsu_run_0
To display your profiling results:
#####################################################################################################################################################################################################################
# LEVEL | REPORT | COMMAND #
#####################################################################################################################################################################################################################
# Functions | Cluster-wide | maqao lprof -df xp=/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-18-66/176-138-1719/llama.cpp/run/oneview_runs/defaults/gcc/oneview_results_1761381982/tools/lprof_npsu_run_0 #
# Functions | Per-node | maqao lprof -df -dn xp=/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-18-66/176-138-1719/llama.cpp/run/oneview_runs/defaults/gcc/oneview_results_1761381982/tools/lprof_npsu_run_0 #
# Functions | Per-process | maqao lprof -df -dp xp=/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-18-66/176-138-1719/llama.cpp/run/oneview_runs/defaults/gcc/oneview_results_1761381982/tools/lprof_npsu_run_0 #
# Functions | Per-thread | maqao lprof -df -dt xp=/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-18-66/176-138-1719/llama.cpp/run/oneview_runs/defaults/gcc/oneview_results_1761381982/tools/lprof_npsu_run_0 #
# Loops | Cluster-wide | maqao lprof -dl xp=/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-18-66/176-138-1719/llama.cpp/run/oneview_runs/defaults/gcc/oneview_results_1761381982/tools/lprof_npsu_run_0 #
# Loops | Per-node | maqao lprof -dl -dn xp=/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-18-66/176-138-1719/llama.cpp/run/oneview_runs/defaults/gcc/oneview_results_1761381982/tools/lprof_npsu_run_0 #
# Loops | Per-process | maqao lprof -dl -dp xp=/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-18-66/176-138-1719/llama.cpp/run/oneview_runs/defaults/gcc/oneview_results_1761381982/tools/lprof_npsu_run_0 #
# Loops | Per-thread | maqao lprof -dl -dt xp=/home/eoseret/Tools/QaaS/qaas_runs/ip-172-31-18-66/176-138-1719/llama.cpp/run/oneview_runs/defaults/gcc/oneview_results_1761381982/tools/lprof_npsu_run_0 #
#####################################################################################################################################################################################################################
