* [MAQAO] Info: Detected 4 Lprof instances in krakenngpu05.cluster.
If this is incorrect, rerun with number-processes-per-node=X
[0m __ ______ _____ __ ________ _
/ / / _ | __ / /____ || |
/ / /| |_) | |__) | / / / /_| | _____ __
/ / / / | _ <| ___/ / / / / _` |/ _ / /
/ ____ / | |_) | | / / / (_| | __/ V /
/_/ _/ |____/|_| / /_/ __,_|___| _/
Using branch :
Version date : Mon, 18 Nov 2024 11:40:50 +0100
Commit : b58af1ea20
MPI processes : 4
Computation #1/1
Compilation info : mpif90 -g -Mpreprocess -O3 -fastsse -Munroll -byteswapio -tp=px -acc=gpu -Minfo=accel -Minline -I/softs/local_pgi/phdf5/1.8.20_pgi204_zen/include -DHAS_PMETIS -I/softs/local_pgi/parmetis/403_r64_pgi201_px/include
Compilation wrapper info : nvfortran -I/home/logiciels/nvidia/hpc_sdk/Linux_x86_64/24.1/comm_libs/12.3/hpcx/hpcx-2.17.1/ompi/include -I/home/logiciels/nvidia/hpc_sdk/Linux_x86_64/24.1/comm_libs/12.3/hpcx/hpcx-2.17.1/ompi/lib -L/home/logiciels/nvidia/hpc_sdk/Linux_x86_64/24.1/comm_libs/12.3/hpcx/hpcx-2.17.1/ompi/lib -rpath /home/logiciels/nvidia/hpc_sdk/Linux_x86_64/24.1/comm_libs/12.3/hpcx/hpcx-2.17.1/ompi/lib -lmpi_usempif08 -lmpi_usempi_ignore_tkr -lmpi_mpifh -lmpi
Compilation user : neto
Compilation date : 2025-03-06 13:53:10
Compilation MPI version : mpirun (Open MPI) 4.1.7a1
AVBP version : 7.15.0
Reading input file version : 7.15.0
----> Reading run parameters : .//run.params
----> Using NATURAL reordering
----> command.dat file API is enabled
----> GPU DIRECT ENABLED
----> Pressure gradient scaling (PGS) computation with PGS factor. Check the resulting maximum Mach number in your solution! psg_factor is equal to: 3.00000E-01
----> Using Lax Wendroff
with UNCLOSED boundary terms
----> Using colin_species viscosity model
----> Temporals are activated and full balances are computed
Number of liquid species is 1
TPF Lagrangian calculation
----> Using sponge layer(s)
________________________________________________________________________
| Sponge layer: 1 |
| Lowest point: -3.00000E+00 -3.00000E+00 -0.10000D+00 |
| Highest point: -1.70000E-01 3.00000E+00 0.30000D+01 |
|_______________________________________________________________________|
________________________________________________________________________
| Sponge layer: 2 |
| Lowest point: 1.70000E-01 -3.00000E+00 -0.10000D+00 |
| Highest point: 3.00000E+00 3.00000E+00 0.30000D+01 |
|_______________________________________________________________________|
________________________________________________________________________
| Sponge layer: 3 |
| Lowest point: -3.00000E+00 -3.00000E+00 -0.10000D+00 |
| Highest point: 3.00000E+00 -1.70000E-01 0.30000D+01 |
|_______________________________________________________________________|
________________________________________________________________________
| Sponge layer: 4 |
| Lowest point: -3.00000E+00 1.70000E-01 -0.10000D+00 |
| Highest point: 3.00000E+00 3.00000E+00 0.30000D+01 |
|_______________________________________________________________________|
---> Using reactive sponge layer(s) - box type
________________________________________________________________________
| Reactive sponge1layer: |
| Lowest point: -5.00000E+00 -5.00000E+00 0.10000D+00 |
| Highest point: 5.00000E+00 5.00000E+00 0.50000D+01 |
|_______________________________________________________________________|
>>>>> WARNING
>>>>> FIMUR inner radius is imposed --> Ptcl injection velocity is computed from it and the mass flow rate
>>>>> WARNING
>>>>> Specifier 'transport = computed' is deprecated since version 7.14. Please use 'transport = simplified' instead (simplified transport model).
>>>>> WARNING
>>>>> You are using PEA chemistry fitting on fuel oxidation and CO-CO2 equilibrium reactions.
----> Reading mesh : .//../MESH/mesh_coarse.mesh.h5
Meshfile signature: f4cc21ed9b6f241ffd69620f7641ada5
----> el2part file found: el2part_4.h5
Use existing partitioning
>> Reading ...took 0.961s
----> Initialize the solution writers (4 writers)
----> Reading boundary conditions in asciibound file : .//../MESH/mesh.asciiBound
----> Reading boundary conditions in Lagrangian asciibound file : .//../COMMON/asciiBound_EL.key
_______________________________________________________________________________________
| Boundary patches (no reordering) |
|______________________________________________________________________________________|
| Patch number Patch name Boundary condition |
| ------------ ---------- ------------------ |
| 1 Inlet_air INLET_RELAX_RHOUN_T_Y |
| 2 Outlet OUTLET_RELAX_P_3D |
| 3 Fond_chambre WALL_NOSLIP_ADIAB |
| 4 Tubes_inf WALL_NOSLIP_ADIAB |
| 5 Swirler WALL_NOSLIP_ADIAB |
| 6 Venturi WALL_NOSLIP_ADIAB |
| 7 Wall_inlet_fuel WALL_NOSLIP_ADIAB |
|______________________________________________________________________________________|
______________________________________________________________
| Info on initial grid |
|_____________________________________________________________|
| number of dimensions : 3 |
| number of nodes : 11727776 |
| number of cells : 68168592 |
| - tetrahedra : 68168592 |
| number of cell per group : 1000000 |
| number of boundary nodes : 200789 |
| number of periodic nodes : 0 |
| number of axi-periodic nodes : 0 |
|_____________________________________________________________|
| After partitioning |
|_____________________________________________________________|
| number of nodes : 11871635 |
| extra nodes due to partitioning : 143859 [+ 1.23‰] |
|_____________________________________________________________|
______________________________________________________________
| Partitioning Quality |
|_____________________________________________________________|
| Maximum number of neighbors : 3.00 |
| Average number of neighbors : 3.00 |
| Maximum number of exchange nodes : 83729.00 |
| Average number of exchange nodes : 71713.50 |
|_____________________________________________________________|
----> Reading initial solution : .//./SOLUT/last_solution.h5
----> Reading took 2.930s
______________________________________________________________
| Info on chemistry |
|_____________________________________________________________|
| Kinetic scheme : C7H16-AIR-2S_DP |
| |
| Chemical reaction #1 |
| fthick : 1.00000000E+00 |
| Preexponential / fthick [SI] : 1.40000000E+08 |
| Activation temperature [K] : 1.45936519E+04 |
| |
| Chemical reaction #2 |
| fthick : 1.00000000E+00 |
| Preexponential / fthick [SI] : 5.00000000E+06 |
| Activation temperature [K] : 1.05678169E+04 |
|_____________________________________________________________|
______________________________________________________________
| Info on initial solution |
|_____________________________________________________________|
| number of Navier-Stokes equations : 5 |
| number of species : 6 |
| number of reactions : 2 |
| number of tpf equations : 0 |
| number of fictive species : 0 |
| initial iteration : 5231359 |
| initial time : 3.28222102E-01 |
|_____________________________________________________________|
----> Reading solutbound : .//../SOLUTBOUND/GRC_coarse.solutBound.h5
- Using 7.X format
----> Reading took 0.004s
----> Initialising metrics
----> Total volume of the mesh [m3] : 3.26791741E+01
----> Smallest cell volume [m3] : 2.68019202E-13
---> Initialise cell group structure
----> Cell group structure took 28.868s
----> Reading initial ptcl solution for subset monspray : ./SOLUT/last_solution_ptcl.h5
Meshfile signature in ptcl solution : f4cc21ed9b6f241ffd69620f7641ada5
Total number of particles found : 156940
----> Boundary MPIs: 3
----> Reading probe coordinates file : .//../COMMON/record.dat
number of probes : 19
----> Writing probe reference file : ./TEMPORAL//probefile.dat_full
______________________________________________________________
| Probe name Coordinates |
|_____________________________________________________________|
| Middle_2 -6.78165E-05 4.58037E-06 9.87281E-03 |
| Middle_3 -5.17741E-05 -6.46622E-06 1.50778E-02 |
| Middle_4 -6.34262E-05 -9.08581E-05 2.00143E-02 |
| Middle_5 -8.32460E-05 -1.21194E-04 2.49816E-02 |
| Middle_6 -4.58833E-06 4.26769E-05 2.99693E-02 |
| Middle_7 -4.94215E-05 -1.26657E-04 3.50171E-02 |
| BellowFlame_mX -1.49967E-02 -6.62176E-06 1.49824E-02 |
| BellowFlame_pX 1.49790E-02 -1.55280E-04 1.49853E-02 |
| BellowFlame_mY 2.24094E-05 -1.49535E-02 1.49553E-02 |
| BellowFlame_far_mX-3.96055E-02 1.96073E-04 1.47486E-02 |
| BellowFlame_far_mY-2.25099E-05 -3.98401E-02 1.44982E-02 |
| outlet_top 5.42093E-03 2.81871E-02 2.00857E+00 |
| BellowFlame_far_pX 3.95271E-02 1.43171E-04 1.51214E-02 |
| BellowFlame_far_pY 3.78847E-04 3.97983E-02 1.51021E-02 |
| Middle_8 1.29940E-06 -4.39426E-05 3.99265E-02 |
| Middle_9 5.22543E-05 9.19650E-05 5.00695E-02 |
| Middle_10 -6.42530E-05 -7.04890E-05 6.00099E-02 |
| Middle_1 -2.43084E-05 5.47309E-05 5.04925E-03 |
| BellowFlame_pY -5.92594E-05 1.49866E-02 1.49649E-02 |
|_____________________________________________________________|
----> End pre-processing.
________________________________________________________________________________________________________
***** GPU memory (used/total): 19954 MB / 24051 MB | Cell per group: 1000000
----> Starts the temporal loop.
Iteration # Time-step [s] Total time [s] Iter/sec [s-1]
5231360 1.146973071003E-07 3.282222167305E-01 4.484561876010E-01
5231409 1.151933990595E-07 3.282278490743E-01 7.055891092874E-01
5231459 1.157035789394E-07 3.282336222419E-01 7.041613517403E-01
----> Lagrangian solution stored in file : ./SOLUT/solut_ptcl_monspray_05231459.h5
Number of particles : 157040
----> Solution stored in file : ./SOLUT/solut_05231459.h5
***** GPU memory (used/total): 20432 MB / 24051 MB | Cell per group: 1000000
____________________________________________________________________________________________
| Integral values for boundary patches: mass fluxes (gas) and areas |
| (instantaneous values, last iteration) |
|___________________________________________________________________________________________|
| Patch number Patch name Mass flux Area |
| ------------ ---------- --------- ---- |
| 1 Inlet_air 0.0000E+00 5.6519E-03 |
| 2 Outlet 0.0000E+00 5.8808E+01 |
| 3 Fond_chambre 0.0000E+00 5.2774E-02 |
| 4 Tubes_inf 0.0000E+00 2.8398E-02 |
| 5 Swirler 0.0000E+00 1.1089E-02 |
| 6 Venturi 0.0000E+00 4.8857E-03 |
| 7 Wall_inlet_fuel 0.0000E+00 6.3596E-05 |
|___________________________________________________________________________________________|
----> End computation.
________________________________________________________________________________________________________
____________________________________________________________________________________________
| 4 MPI tasks with GPU Elapsed real time [s] [s.cores] [h.cores] |
|___________________________________________________________________________________________|
| AVBP : 1803.53 7.2141E+03 2.0039E+00 |
| Temporal loop : 149.87 5.9949E+02 1.6653E-01 |
| Per simulated second : 1.3010E+07 5.2038E+07 1.4455E+04 |
| Per iteration : 1.4987 5.9949E+00 |
|-------------------------------------------------------------------------------------------|
| RCT [s.mpi/node/it] : 5.11171947E-07 |
|___________________________________________________________________________________________|
----> Initial physical time : 3.28222102E-01
Initial iteration : 5231359
Initial timestep : 1.14697307E-07
----> Final physical time : 3.28233622E-01
Final iteration : 5231459
Final timestep : 1.15703579E-07
----> Simulated physical time : 1.15202086E-05
Simulated iterations : 100
________________________________________________________________________________________________________
TIMERS
________________________________________________________________________________________________________
Prints relevant timers and breaks down percentage regarding reference timers.
> The 'Total slave simulation' time corresponds to the 1st level, and is measured by slave_timer (sum of pre temporal loop, temporal loop and post temporal loop).
> The 'Computation' time corresponds to the time integration loops, and is measured by rungekutta_timer.
> Levels are depicted using [X.Y.Z. ...] lists. The number of entry in the list corresponds to the level.
> References to the upper level is made to compute the contribution of one sub-level to its parent level.
> The times displayed are those of the master processor.
> For each timer, the minimum, maximum and mean values for all processors are also shown in the 3 right-hand columns.
> A json file 'timers.json' containing all the data is also available in the temporal output directory.
----- 1st level timers
time [s] | relative to [ min [s] mean [s] max [s] ]
| tot. slave [%] [ ]
> [0] Total slave simulation : 1.8035E+03 | 100.00% [ 1.8035E+03 1.8036E+03 1.8037E+03 ]
----- 2nd level timers
time [s] | relative to [ min [s] mean [s] max [s] ]
| tot. slave [%] [ ]
> > [0.1] Pre temporal loop : 1.6536E+03 | 91.69% [ 1.6535E+03 1.6535E+03 1.6536E+03 ]
> > [0.2] Temporal loop : 1.4987E+02 | 8.31% [ 1.4987E+02 1.4995E+02 1.5005E+02 ]
> > [0.2a] Temporal loop without IO : 1.4249E+02 | 7.90% [ 1.4266E+02 1.4264E+02 1.4262E+02 ]
> > [0.3] Post temporal loop : 4.8266E-02 | 0.00% [ 4.5169E-02 4.6606E-02 4.8266E-02 ]
> > [0.4] Point to Point communications : 1.5045E+01 | 0.83% [ 3.1536E+00 8.3198E+00 1.5045E+01 ]
----- 3rd level timers
time [s] | relative to | relative to [ min [s] mean [s] max [s] ]
| tot. slave [%] | upper level [%] [ ]
> > [0.1] Pre temporal loop : 1.6536E+03 | 91.69% [ 1.6535E+03 1.6535E+03 1.6536E+03 ]
> > > [0.1.1] Build online postprocessing objects : 0.0000E+00 | 0.00% | 0.00% [ 0.0000E+00 0.0000E+00 0.0000E+00 ]
> > [0.2] Temporal loop : 1.4987E+02 | 8.31% [ 1.4987E+02 1.4995E+02 1.5005E+02 ]
> > > [0.2.1] Computation : 1.4132E+02 | 7.84% | 94.30% [ 1.4116E+02 1.4138E+02 1.4166E+02 ]
> > > [0.2.2] Temporal post-processing : 1.0903E+00 | 0.06% | 0.73% [ 9.1896E-01 1.0158E+00 1.0903E+00 ]
> > > [0.2.3] Instantaneous solution post-processing : 6.2904E+00 | 0.35% | 4.20% [ 6.2904E+00 6.3011E+00 6.3330E+00 ]
> > > [0.2.4] Average solution post-processing : 0.0000E+00 | 0.00% | 0.00% [ 0.0000E+00 0.0000E+00 0.0000E+00 ]
> > > [0.2.5] Online post-processing compute and storage : 0.0000E+00 | 0.00% | 0.00% [ 0.0000E+00 0.0000E+00 0.0000E+00 ]
----- 4th level timers: focus on Computation level (rungekutta_timer)
time [s] | relative to | relative to | relative to [ min [s] mean [s] max [s] ]
| tot. slave [%] | computation [%]| upper level [%][ ]
> > > [0.2.1] Computation : 1.4132E+02 | 7.84% | 100.00% [ 1.4116E+02 1.4138E+02 1.4166E+02 ]
> > > > [0.2.1.1] Convective scheme : 9.0054E+00 | 0.50% | 6.37% | 6.37% [ 9.0054E+00 9.5169E+00 9.8753E+00 ]
> > > > [0.2.1.2] Diffusion operator : 3.5028E+01 | 1.94% | 24.79% | 24.79% [ 3.5110E+01 3.7105E+01 3.8454E+01 ]
> > > > [0.2.1.4] Time-step calculation : 4.4668E+00 | 0.25% | 3.16% | 3.16% [ 4.4340E+00 4.4458E+00 4.4668E+00 ]
> > > > [0.2.1.5] Transport calculation : 3.4747E-01 | 0.02% | 0.25% | 0.25% [ 3.4747E-01 3.6580E-01 3.7589E-01 ]
> > > > [0.2.1.6] Thermo calculation : 5.6197E-01 | 0.03% | 0.40% | 0.40% [ 5.6197E-01 5.9627E-01 6.2070E-01 ]
> > > > [0.2.1.7] Gradient calculation : 1.3719E+01 | 0.76% | 9.71% | 9.71% [ 1.3691E+01 1.3706E+01 1.3719E+01 ]
> > > > [0.2.1.8] Boundary : 1.0810E+00 | 0.06% | 0.76% | 0.76% [ 6.4657E-01 1.0458E+00 1.5110E+00 ]
> > > > [0.2.1.9] Turbulent viscosity model : 3.1136E+00 | 0.17% | 2.20% | 2.20% [ 3.0428E+00 3.0726E+00 3.1136E+00 ]
> > > > [0.2.1.10] Combustion (source term + TFLES + efcy + efcy I0) : 7.3098E-01 | 0.04% | 0.52% | 0.52% [ 7.3098E-01 7.7530E-01 8.0080E-01 ]
> > > > > [0.2.1.10.1] Chemical source terms calculation : 7.3098E-01 | 0.04% | 0.52% | 100.00% [ 7.3098E-01 7.7530E-01 8.0080E-01 ]
> > > > > [0.2.1.10.2] TFLES model calculation : 0.0000E+00 | 0.00% | 0.00% | 0.00% [ 0.0000E+00 0.0000E+00 0.0000E+00 ]
> > > > > [0.2.1.10.3] Efficiency function calculation : 0.0000E+00 | 0.00% | 0.00% | 0.00% [ 0.0000E+00 0.0000E+00 0.0000E+00 ]
> > > > > [0.2.1.10.4] Efficiency I0 function calculation : 0.0000E+00 | 0.00% | 0.00% | 0.00% [ 0.0000E+00 0.0000E+00 0.0000E+00 ]
> > > > [0.2.1.11] Artificial viscosity : 2.5479E+01 | 1.41% | 18.03% | 18.03% [ 2.5479E+01 2.6940E+01 2.8079E+01 ]
> > > > [0.2.1.12] Lagrangian solver : 1.7481E+01 | 0.97% | 12.37% | 12.37% [ 1.7452E+01 1.7624E+01 1.7840E+01 ]
> > > > [0.2.1.17] Source terms : 0.0000E+00 | 0.00% | 0.00% | 0.00% [ 0.0000E+00 0.0000E+00 0.0000E+00 ]
----- 5th level timers: focus on Lagrangian level (lagrangian_timer)
time [s] | relative to | relative to | relative to [ min [s] mean [s] max [s] ]
| tot. slave [%] | computation [%]| lagrangian [%] [ ]
> > > > [0.2.1.12] Lagrangian solver : 1.7481E+01 | 0.97% | 12.37% | 100.00% [ 1.7452E+01 1.7624E+01 1.7840E+01 ]
> > > > > [0.2.1.12.1] Physical treatment : 9.2163E+00 | 0.51% | 6.52% | 52.72% [ 6.5562E+00 8.6851E+00 9.7724E+00 ]
> > > > > > [0.2.1.12.1.1] Initialisation (interp weights) : 4.9000E-01 | 0.03% | 0.35% | 2.80% [ 1.8730E-01 3.6484E-01 4.9000E-01 ]
> > > > > > [0.2.1.12.1.2] Secondary breakup model : 0.0000E+00 | 0.00% | 0.00% | 0.00% [ 0.0000E+00 0.0000E+00 0.0000E+00 ]
> > > > > > [0.2.1.12.1.3] Drag model : 8.7525E-01 | 0.05% | 0.62% | 5.01% [ 3.5476E-01 6.6155E-01 8.7525E-01 ]
> > > > > > [0.2.1.12.1.4] Film model : 0.0000E+00 | 0.00% | 0.00% | 0.00% [ 0.0000E+00 0.0000E+00 0.0000E+00 ]
> > > > > > [0.2.1.12.1.5] Evaporation model : 4.0750E+00 | 0.23% | 2.88% | 23.31% [ 1.9606E+00 3.1915E+00 4.0750E+00 ]
> > > > > > [0.2.1.12.1.6] Soot model : 0.0000E+00 | 0.00% | 0.00% | 0.00% [ 0.0000E+00 0.0000E+00 0.0000E+00 ]
> > > > > > [0.2.1.12.1.7] Two-way coupling : 4.1401E+00 | 0.23% | 2.93% | 23.68% [ 4.1401E+00 4.3220E+00 4.4713E+00 ]
> > > > > > [0.2.1.12.1.8] Time advancement : 5.7307E-02 | 0.00% | 0.04% | 0.33% [ 2.4966E-02 4.3910E-02 5.7307E-02 ]
> > > > > > [0.2.1.12.1.9] EL2EE : 1.2419E-01 | 0.01% | 0.09% | 0.71% [ 8.1127E-02 1.0765E-01 1.2419E-01 ]
> > > > > > [0.2.1.12.1.10] Automatic-PAMELA: compute diam. and inj. + 0.0000E+00 | 0.00% | 0.00% | 0.00% [ 0.0000E+00 0.0000E+00 0.0000E+00 ]
> > > > > > > [0.2.1.12.1.10.1] Automatic-PAMELA: compute diameter and 0.0000E+00 | 0.00% | 0.00% | 0.00% [ 0.0000E+00 0.0000E+00 0.0000E+00 ]
> > > > > > > [0.2.1.12.1.10.2] Automatic-PAMELA: compute vorticity th 0.0000E+00 | 0.00% | 0.00% | 0.00% [ 0.0000E+00 0.0000E+00 0.0000E+00 ]
> > > > > > [0.2.1.12.1.11] Update arrays : 4.7341E-01 | 0.03% | 0.33% | 2.71% [ 3.7307E-01 4.1246E-01 4.7341E-01 ]
> > > > > [0.2.1.12.2] Algo treatment : 2.2946E+00 | 0.13% | 1.62% | 13.13% [ 1.4598E+00 2.6180E+00 4.6679E+00 ]
> > > > > [0.2.1.12.3] Injection : 4.1215E-03 | 0.00% | 0.00% | 0.02% [ 7.9460E-04 2.4376E-03 4.1215E-03 ]
> > > > > [0.2.1.12.4] Sorting particles : 0.0000E+00 | 0.00% | 0.00% | 0.00% [ 0.0000E+00 0.0000E+00 0.0000E+00 ]
> > > > > [0.2.1.12.5] Merging-splitting particles : 0.0000E+00 | 0.00% | 0.00% | 0.00% [ 0.0000E+00 0.0000E+00 0.0000E+00 ]
> > > > > [0.2.1.12.6] Soot inception : 0.0000E+00 | 0.00% | 0.00% | 0.00% [ 0.0000E+00 0.0000E+00 0.0000E+00 ]
----> End of AVBP session
----> Found 3 warning messages for this computation, check your output file!
***** Memory usage (system): Max: 22734.078 MB (rank:1) Min: 20800.566 MB (rank:0) Ave: 21991.204 MB Std: 730.188 MB
***** Maximum memory (mod_alloc) : 2139435156 B ( 2.040324E+03 MB)
Your experiment path is /scratch/exter/neto/CRSB_2STEP_68M/RUN/maqao_2025-07-04_16-37-28/tools/lprof_npsu_run_0
To display your profiling results:
###################################################################################################################################################
# LEVEL | REPORT | COMMAND #
###################################################################################################################################################
# Functions | Cluster-wide | maqao lprof -df xp=/scratch/exter/neto/CRSB_2STEP_68M/RUN/maqao_2025-07-04_16-37-28/tools/lprof_npsu_run_0 #
# Functions | Per-node | maqao lprof -df -dn xp=/scratch/exter/neto/CRSB_2STEP_68M/RUN/maqao_2025-07-04_16-37-28/tools/lprof_npsu_run_0 #
# Functions | Per-process | maqao lprof -df -dp xp=/scratch/exter/neto/CRSB_2STEP_68M/RUN/maqao_2025-07-04_16-37-28/tools/lprof_npsu_run_0 #
# Functions | Per-thread | maqao lprof -df -dt xp=/scratch/exter/neto/CRSB_2STEP_68M/RUN/maqao_2025-07-04_16-37-28/tools/lprof_npsu_run_0 #
# Loops | Cluster-wide | maqao lprof -dl xp=/scratch/exter/neto/CRSB_2STEP_68M/RUN/maqao_2025-07-04_16-37-28/tools/lprof_npsu_run_0 #
# Loops | Per-node | maqao lprof -dl -dn xp=/scratch/exter/neto/CRSB_2STEP_68M/RUN/maqao_2025-07-04_16-37-28/tools/lprof_npsu_run_0 #
# Loops | Per-process | maqao lprof -dl -dp xp=/scratch/exter/neto/CRSB_2STEP_68M/RUN/maqao_2025-07-04_16-37-28/tools/lprof_npsu_run_0 #
# Loops | Per-thread | maqao lprof -dl -dt xp=/scratch/exter/neto/CRSB_2STEP_68M/RUN/maqao_2025-07-04_16-37-28/tools/lprof_npsu_run_0 #
###################################################################################################################################################
