* [MAQAO] Info: Detected 76 Lprof instances in node202.
If this is incorrect, rerun with number-processes-per-node=X
__ ______ _____
/\ \ / / _ \| __ \
/ \ \ / /| |_) | |__) |
/ /\ \ \/ / | _ <| ___/
/ ____ \ / | |_) | |
/_/ \_\/ |____/|_|
Using branch :
Version date : Mon, 7 Apr 2025 11:37:25 +0200
Commit : 99e3e6b5a2
MPI processes : 76
Solver type: fluid
Computation #1/1
Compilation info : mpiifort -g -O3 -fpp -traceback -fno-alias -ip -assume byterecl -convert big_endian -align -march=core-avx2 -fma -axCORE-AVX2 -I/softs/local_intel/phdf5/1.8.20/include -DHAS_PMETIS -I/softs/local_intel/parmetis/403_64/include -DPARMETIS4 -DMETIS5 -DHAS_PTSCOTCH -I/softs/local_intel/ptscotch/6.0.5a/include
Compilation wrapper info : ifort-I/softs/intel/oneapi/mpi/2021.10.0//include-I/softs/intel/oneapi/mpi/2021.10.0/include-L/softs/intel/oneapi/mpi/2021.10.0/lib/release-L/softs/intel/oneapi/mpi/2021.10.0/lib-Xlinker--enable-new-dtags-Xlinker-rpath-Xlinker/softs/intel/oneapi/mpi/2021.10.0/lib/release-Xlinker-rpath-Xlinker/softs/intel/oneapi/mpi/2021.10.0/lib-lmpifort-lmpi-ldl-lrt-lpthread
Compilation user : camus
Compilation date : 2025-06-19 15:35:42
Compilation MPI version : Intel\(R\)MPILibraryforLinux*OS,Version2021.10Build20230619\(id:c2e19c2f3e\)
AVBP version : 7.16.0
----> Reading run parameters : .//./run.params
----> Using NATURAL reordering
----> command.dat file API is enabled
----> Pressure gradient scaling (PGS) computation with PGS factor. Check the resulting maximum Mach number in your solution! psg_factor is equal to: 3.00000E-01
----> Using Lax Wendroff
with UNCLOSED boundary terms
----> Using colin_species viscosity model
----> Temporals are activated and full balances are computed
Number of liquid species is 1
TPF Lagrangian calculation
----> Using sponge layer(s)
________________________________________________________________________
| Sponge layer: 1 |
| Lowest point: -3.00000E+00 -3.00000E+00 -0.10000D+00 |
| Highest point: -1.70000E-01 3.00000E+00 0.30000D+01 |
|_______________________________________________________________________|
________________________________________________________________________
| Sponge layer: 2 |
| Lowest point: 1.70000E-01 -3.00000E+00 -0.10000D+00 |
| Highest point: 3.00000E+00 3.00000E+00 0.30000D+01 |
|_______________________________________________________________________|
________________________________________________________________________
| Sponge layer: 3 |
| Lowest point: -3.00000E+00 -3.00000E+00 -0.10000D+00 |
| Highest point: 3.00000E+00 -1.70000E-01 0.30000D+01 |
|_______________________________________________________________________|
________________________________________________________________________
| Sponge layer: 4 |
| Lowest point: -3.00000E+00 1.70000E-01 -0.10000D+00 |
| Highest point: 3.00000E+00 3.00000E+00 0.30000D+01 |
|_______________________________________________________________________|
---> Using reactive sponge layer(s) - box type
________________________________________________________________________
| Reactive sponge1layer: |
| Lowest point: -5.00000E+00 -5.00000E+00 0.10000D+00 |
| Highest point: 5.00000E+00 5.00000E+00 0.50000D+01 |
|_______________________________________________________________________|
>>>>> WARNING
>>>>> FIMUR inner radius is imposed --> Ptcl injection velocity is computed from it and the mass flow rate
>>>>> WARNING
>>>>> Specifier 'transport = computed' is deprecated since version 7.14. Please use 'transport = simplified' instead (simplified transport model).
>>>>> WARNING
>>>>> You are using PEA chemistry fitting on fuel oxidation and CO-CO2 equilibrium reactions.
----> Reading mesh : .//../MESH/mesh_coarse.mesh.h5
Meshfile signature: f4cc21ed9b6f241ffd69620f7641ada5
----> el2part file found: el2part_76.h5
Use existing partitioning
>> Reading ...took 0.095s
----> Initialize the solution writers (76 writers)
>>>>> WARNING
>>>>> No instantaneous solution storage required: the calculation of additional variables is deactivated.
----> Reading boundary conditions in asciibound file : .//../MESH/mesh.asciiBound
----> Reading boundary conditions in Lagrangian asciibound file : .//../COMMON/asciiBound_EL.key
_______________________________________________________________________________________
| Boundary patches (no reordering) |
|______________________________________________________________________________________|
| Patch number Patch name Boundary condition |
| ------------ ---------- ------------------ |
| 1 Inlet_air INLET_RELAX_RHOUN_T_Y |
| 2 Outlet OUTLET_RELAX_P_3D |
| 3 Fond_chambre WALL_NOSLIP_ADIAB |
| 4 Tubes_inf WALL_NOSLIP_ADIAB |
| 5 Swirler WALL_NOSLIP_ADIAB |
| 6 Venturi WALL_NOSLIP_ADIAB |
| 7 Wall_inlet_fuel WALL_NOSLIP_ADIAB |
|______________________________________________________________________________________|
______________________________________________________________
| Info on initial grid |
|_____________________________________________________________|
| number of dimensions : 3 |
| number of nodes : 11727776 |
| number of cells : 68168592 |
| - tetrahedra : 68168592 |
| number of cell per group : 100 |
| number of boundary nodes : 200789 |
| number of periodic nodes : 0 |
| number of axi-periodic nodes : 0 |
|_____________________________________________________________|
| After partitioning |
|_____________________________________________________________|
| number of nodes : 12417553 |
| extra nodes due to partitioning : 689777 [+ 5.88‰] |
|_____________________________________________________________|
______________________________________________________________
| Partitioning Quality |
|_____________________________________________________________|
| Maximum number of neighbors : 19.00 |
| Average number of neighbors : 12.29 |
| Maximum number of exchange nodes : 23683.00 |
| Average number of exchange nodes : 17861.04 |
|_____________________________________________________________|
----> Reading initial solution : .//./SOLUT/last_solution.h5
----> Reading took 1.259s
______________________________________________________________
| Info on chemistry |
|_____________________________________________________________|
| Kinetic scheme : C7H16-AIR-2S_DP |
| |
| Chemical reaction #1 |
| fthick : 1.00000000E+00 |
| Preexponential / fthick [SI] : 1.40000000E+08 |
| Activation temperature [K] : 1.45936519E+04 |
| |
| Chemical reaction #2 |
| fthick : 1.00000000E+00 |
| Preexponential / fthick [SI] : 5.00000000E+06 |
| Activation temperature [K] : 1.05678169E+04 |
|_____________________________________________________________|
______________________________________________________________
| Info on initial solution |
|_____________________________________________________________|
| number of Navier-Stokes equations : 5 |
| number of species : 6 |
| number of reactions : 2 |
| number of tpf equations : 0 |
| number of fictive species : 0 |
| initial iteration : 5231177 |
| initial time : 3.28201405E-01 |
|_____________________________________________________________|
----> Reading solutbound : .//../SOLUTBOUND/GRC_coarse.solutBound.h5
- Using 7.X format
----> Reading took 0.017s
----> Initialising metrics
----> Total volume of the mesh [m3] : 3.26791741E+01
----> Smallest cell volume [m3] : 2.68019202E-13
---> Initialise cell group structure
----> Cell group structure took 21.846s
----> Reading initial ptcl solution for subset monspray : ./SOLUT/last_solution_ptcl.h5
Meshfile signature in ptcl solution : f4cc21ed9b6f241ffd69620f7641ada5
Total number of particles found : 156802
----> Boundary MPIs: 19
----> Reading probe coordinates file : .//../COMMON/record.dat
number of probes : 19
----> Writing probe reference file : ./TEMPORAL//probefile.dat_full
______________________________________________________________
| Probe name Coordinates |
|_____________________________________________________________|
| BellowFlame_far_mY-2.25099E-05 -3.98401E-02 1.44982E-02 |
| BellowFlame_mX -1.49967E-02 -6.62176E-06 1.49824E-02 |
| BellowFlame_mY 2.24094E-05 -1.49535E-02 1.49553E-02 |
| Middle_1 -2.43084E-05 5.47309E-05 5.04925E-03 |
| Middle_8 1.29940E-06 -4.39426E-05 3.99265E-02 |
| BellowFlame_far_mX-3.96055E-02 1.96073E-04 1.47486E-02 |
| Middle_4 -6.34262E-05 -9.08581E-05 2.00143E-02 |
| BellowFlame_pY -5.92594E-05 1.49866E-02 1.49649E-02 |
| Middle_5 -8.32460E-05 -1.21194E-04 2.49816E-02 |
| Middle_6 -4.58833E-06 4.26769E-05 2.99693E-02 |
| Middle_7 -4.94215E-05 -1.26657E-04 3.50171E-02 |
| BellowFlame_pX 1.49790E-02 -1.55280E-04 1.49853E-02 |
| Middle_9 5.22543E-05 9.19650E-05 5.00695E-02 |
| Middle_2 -6.78165E-05 4.58037E-06 9.87281E-03 |
| Middle_3 -5.17741E-05 -6.46622E-06 1.50778E-02 |
| BellowFlame_far_pX 3.95271E-02 1.43171E-04 1.51214E-02 |
| BellowFlame_far_pY 3.78847E-04 3.97983E-02 1.51021E-02 |
| Middle_10 -6.42530E-05 -7.04890E-05 6.00099E-02 |
| outlet_top 5.42093E-03 2.81871E-02 2.00857E+00 |
|_____________________________________________________________|
----> End pre-processing.
________________________________________________________________________________________________________
----> Starts the temporal loop.
Iteration # Time-step [s] Total time [s] Iter/sec [s-1]
5231178 1.128981121516E-07 3.282015176375E-01 3.557921423965E-01
5231227 1.131187730331E-07 3.282070544809E-01 4.260623546983E-01
5231277 1.138398383516E-07 3.282127269088E-01 4.264243679419E-01
----> Lagrangian solution stored in file : ./SOLUT/solut_ptcl_monspray_05231277.h5
Number of particles : 156854
----> Solution stored in file : ./SOLUT/solut.h5
____________________________________________________________________________________________
| Integral values for boundary patches: mass fluxes (gas) and areas |
| (instantaneous values, last iteration) |
|___________________________________________________________________________________________|
| Patch number Patch name Mass flux Area |
| ------------ ---------- --------- ---- |
| 1 Inlet_air 5.9826E-03 5.6519E-03 |
| 2 Outlet 1.9239E+01 5.8808E+01 |
| 3 Fond_chambre 0.0000E+00 5.2774E-02 |
| 4 Tubes_inf 0.0000E+00 2.8398E-02 |
| 5 Swirler 0.0000E+00 1.1089E-02 |
| 6 Venturi 0.0000E+00 4.8857E-03 |
| 7 Wall_inlet_fuel 0.0000E+00 6.3596E-05 |
|___________________________________________________________________________________________|
----> End computation.
________________________________________________________________________________________________________
____________________________________________________________________________________________
| 76 MPI tasks Elapsed real time [s] [s.cores] [h.cores] |
|___________________________________________________________________________________________|
| AVBP : 345.16 2.6232E+04 7.2867E+00 |
| Temporal loop : 241.19 1.8331E+04 5.0919E+00 |
| Per simulated second : 2.1303E+07 1.6190E+09 4.4973E+05 |
| Per iteration : 2.4119 1.8331E+02 |
|-------------------------------------------------------------------------------------------|
| RCT [s.mpi/node/it] : 1.56302281E-05 |
|___________________________________________________________________________________________|
----> Initial physical time : 3.28201405E-01
Initial iteration : 5231177
Initial timestep : 1.12898112E-07
----> Final physical time : 3.28212727E-01
Final iteration : 5231277
Final timestep : 1.13839838E-07
----> Simulated physical time : 1.13221694E-05
Simulated iterations : 100
________________________________________________________________________________________________________
TIMERS
________________________________________________________________________________________________________
Prints relevant timers and breaks down percentage regarding reference timers.
> The 'Total slave simulation' time corresponds to the 1st level, and is measured by slave_timer (sum of pre temporal loop, temporal loop and post temporal loop).
> The 'Computation' time corresponds to the time integration loops, and is measured by rungekutta_timer.
> Levels are depicted using [X.Y.Z. ...] lists. The number of entry in the list corresponds to the level.
> References to the upper level is made to compute the contribution of one sub-level to its parent level.
> The times displayed are those of the master processor.
> For each timer, the minimum, maximum and mean values for all processors are also shown in the 3 right-hand columns.
> A json file 'timers.json' containing all the data is also available in the temporal output directory.
----- 1st level timers
time [s] | relative to [ min [s] mean [s] max [s] ]
| tot. slave [%] [ ]
> [0] Total slave simulation : 3.4516E+02 | 100.00% [ 3.4501E+02 3.4513E+02 3.4524E+02 ]
----- 2nd level timers
time [s] | relative to [ min [s] mean [s] max [s] ]
| tot. slave [%] [ ]
> > [0.1] Pre temporal loop : 1.0367E+02 | 30.04% [ 1.0365E+02 1.0366E+02 1.0367E+02 ]
> > [0.2] Temporal loop : 2.4119E+02 | 69.88% [ 2.4119E+02 2.4119E+02 2.4119E+02 ]
> > [0.2a] Temporal loop without IO : 2.3441E+02 | 67.91% [ 2.3448E+02 2.3444E+02 2.3438E+02 ]
> > [0.3] Post temporal loop : 2.9445E-01 | 0.09% [ 1.5406E-01 2.7496E-01 3.9087E-01 ]
> > [0.4] Point to Point communications : 2.0478E+01 | 5.93% [ 2.3470E+00 1.3173E+01 5.8406E+01 ]
----- 3rd level timers
time [s] | relative to | relative to [ min [s] mean [s] max [s] ]
| tot. slave [%] | upper level [%] [ ]
> > [0.1] Pre temporal loop : 1.0367E+02 | 30.04% [ 1.0365E+02 1.0366E+02 1.0367E+02 ]
> > > [0.1.1] Build online postprocessing objects : 0.0000E+00 | 0.00% | 0.00% [ 0.0000E+00 0.0000E+00 0.0000E+00 ]
> > [0.2] Temporal loop : 2.4119E+02 | 69.88% [ 2.4119E+02 2.4119E+02 2.4119E+02 ]
> > > [0.2.1] Computation : 2.3339E+02 | 67.62% | 96.76% [ 2.3159E+02 2.3247E+02 2.3447E+02 ]
> > > [0.2.2] Temporal post-processing : 6.5698E-01 | 0.19% | 0.27% [ 5.8244E-01 6.0800E-01 6.5698E-01 ]
> > > [0.2.3] Instantaneous solution post-processing : 6.1291E+00 | 1.78% | 2.54% [ 6.1249E+00 6.1397E+00 6.1535E+00 ]
> > > [0.2.4] Average solution post-processing : 0.0000E+00 | 0.00% | 0.00% [ 0.0000E+00 0.0000E+00 0.0000E+00 ]
> > > [0.2.5] Online post-processing compute and storage : 0.0000E+00 | 0.00% | 0.00% [ 0.0000E+00 0.0000E+00 0.0000E+00 ]
----- 4th level timers: focus on Computation level (rungekutta_timer)
time [s] | relative to | relative to | relative to [ min [s] mean [s] max [s] ]
| tot. slave [%] | computation [%]| upper level [%][ ]
> > > [0.2.1] Computation : 2.3339E+02 | 67.62% | 100.00% [ 2.3159E+02 2.3247E+02 2.3447E+02 ]
> > > > [0.2.1.1] Convective scheme : 9.9718E+00 | 2.89% | 4.27% | 4.27% [ 7.9380E+00 1.0153E+01 1.0788E+01 ]
> > > > [0.2.1.2] Diffusion operator : 5.4559E+01 | 15.81% | 23.38% | 23.38% [ 4.3208E+01 5.5755E+01 5.8540E+01 ]
> > > > [0.2.1.4] Time-step calculation : 9.0265E+00 | 2.62% | 3.87% | 3.87% [ 8.9385E+00 9.3726E+00 1.0486E+01 ]
> > > > [0.2.1.5] Transport calculation : 2.3834E+00 | 0.69% | 1.02% | 1.02% [ 1.7626E+00 2.2687E+00 2.4577E+00 ]
> > > > [0.2.1.6] Thermo calculation : 3.1135E+00 | 0.90% | 1.33% | 1.33% [ 2.1075E+00 2.9892E+00 3.2015E+00 ]
> > > > [0.2.1.7] Gradient calculation : 2.3931E+01 | 6.93% | 10.25% | 10.25% [ 2.2845E+01 2.3692E+01 2.4741E+01 ]
> > > > [0.2.1.8] Boundary : 3.2063E+00 | 0.93% | 1.37% | 1.37% [ 9.0297E-01 1.8896E+00 5.7390E+00 ]
> > > > [0.2.1.9] Turbulent viscosity model : 1.7098E+01 | 4.95% | 7.33% | 7.33% [ 1.6733E+01 1.7403E+01 1.9275E+01 ]
> > > > [0.2.1.10] Combustion (source term + TFLES + efcy + efcy I0) : 7.8986E+00 | 2.29% | 3.38% | 3.38% [ 6.1433E+00 7.7293E+00 8.5326E+00 ]
> > > > > [0.2.1.10.1] Chemical source terms calculation : 7.8986E+00 | 2.29% | 3.38% | 100.00% [ 6.1433E+00 7.7293E+00 8.5326E+00 ]
> > > > > [0.2.1.10.2] TFLES model calculation : 0.0000E+00 | 0.00% | 0.00% | 0.00% [ 0.0000E+00 0.0000E+00 0.0000E+00 ]
> > > > > [0.2.1.10.3] Efficiency function calculation : 0.0000E+00 | 0.00% | 0.00% | 0.00% [ 0.0000E+00 0.0000E+00 0.0000E+00 ]
> > > > > [0.2.1.10.4] Efficiency I0 function calculation : 0.0000E+00 | 0.00% | 0.00% | 0.00% [ 0.0000E+00 0.0000E+00 0.0000E+00 ]
> > > > [0.2.1.11] Artificial viscosity : 4.0508E+01 | 11.74% | 17.36% | 17.36% [ 3.2603E+01 4.1719E+01 4.4168E+01 ]
> > > > [0.2.1.12] Lagrangian solver : 6.6248E+00 | 1.92% | 2.84% | 2.84% [ 6.3124E+00 7.8537E+00 1.1120E+01 ]
> > > > [0.2.1.17] Source terms : 0.0000E+00 | 0.00% | 0.00% | 0.00% [ 0.0000E+00 0.0000E+00 0.0000E+00 ]
----- 5th level timers: focus on Lagrangian level (lagrangian_timer)
time [s] | relative to | relative to | relative to [ min [s] mean [s] max [s] ]
| tot. slave [%] | computation [%]| lagrangian [%] [ ]
> > > > [0.2.1.12] Lagrangian solver : 6.6248E+00 | 1.92% | 2.84% | 100.00% [ 6.3124E+00 7.8537E+00 1.1120E+01 ]
> > > > > [0.2.1.12.1] Physical treatment : 6.7336E-01 | 0.20% | 0.29% | 10.16% [ 8.6735E-02 1.0025E+00 3.1821E+00 ]
> > > > > > [0.2.1.12.1.1] Initialisation (interp weights) : 8.2768E-02 | 0.02% | 0.04% | 1.25% [ 0.0000E+00 1.2992E-01 4.1803E-01 ]
> > > > > > [0.2.1.12.1.2] Secondary breakup model : 0.0000E+00 | 0.00% | 0.00% | 0.00% [ 0.0000E+00 0.0000E+00 0.0000E+00 ]
> > > > > > [0.2.1.12.1.3] Drag model : 1.3052E-01 | 0.04% | 0.06% | 1.97% [ 0.0000E+00 2.0618E-01 6.8350E-01 ]
> > > > > > [0.2.1.12.1.4] Film model : 0.0000E+00 | 0.00% | 0.00% | 0.00% [ 0.0000E+00 0.0000E+00 0.0000E+00 ]
> > > > > > [0.2.1.12.1.5] Evaporation model : 2.5488E-01 | 0.07% | 0.11% | 3.85% [ 0.0000E+00 4.0989E-01 1.5550E+00 ]
> > > > > > [0.2.1.12.1.6] Soot model : 0.0000E+00 | 0.00% | 0.00% | 0.00% [ 0.0000E+00 0.0000E+00 0.0000E+00 ]
> > > > > > [0.2.1.12.1.7] Two-way coupling : 1.0678E+00 | 0.31% | 0.46% | 16.12% [ 7.6802E-01 1.0428E+00 1.2245E+00 ]
> > > > > > [0.2.1.12.1.8] Time advancement : 2.1791E-02 | 0.01% | 0.01% | 0.33% [ 0.0000E+00 3.2696E-02 1.1312E-01 ]
> > > > > > [0.2.1.12.1.9] EL2EE : 1.1149E-02 | 0.00% | 0.00% | 0.17% [ 4.2388E-03 1.4693E-02 2.5938E-02 ]
> > > > > > [0.2.1.12.1.10] Automatic-PAMELA: compute diam. and inj. + 0.0000E+00 | 0.00% | 0.00% | 0.00% [ 0.0000E+00 0.0000E+00 0.0000E+00 ]
> > > > > > > [0.2.1.12.1.10.1] Automatic-PAMELA: compute diameter and 0.0000E+00 | 0.00% | 0.00% | 0.00% [ 0.0000E+00 0.0000E+00 0.0000E+00 ]
> > > > > > > [0.2.1.12.1.10.2] Automatic-PAMELA: compute vorticity th 0.0000E+00 | 0.00% | 0.00% | 0.00% [ 0.0000E+00 0.0000E+00 0.0000E+00 ]
> > > > > > [0.2.1.12.1.11] Update arrays : 4.2304E-01 | 0.12% | 0.18% | 6.39% [ 9.2533E-02 3.0632E-01 4.3407E-01 ]
> > > > > [0.2.1.12.2] Algo treatment : 4.1929E+00 | 1.21% | 1.80% | 63.29% [ 1.4570E+00 5.2299E+00 8.9530E+00 ]
> > > > > [0.2.1.12.3] Injection : 2.1026E-03 | 0.00% | 0.00% | 0.03% [ 1.9043E-03 3.4528E-03 6.9517E-02 ]
> > > > > [0.2.1.12.4] Sorting particles : 0.0000E+00 | 0.00% | 0.00% | 0.00% [ 0.0000E+00 0.0000E+00 0.0000E+00 ]
> > > > > [0.2.1.12.5] Merging-splitting particles : 0.0000E+00 | 0.00% | 0.00% | 0.00% [ 0.0000E+00 0.0000E+00 0.0000E+00 ]
> > > > > [0.2.1.12.6] Soot inception : 0.0000E+00 | 0.00% | 0.00% | 0.00% [ 0.0000E+00 0.0000E+00 0.0000E+00 ]
----> End of AVBP session
----> Found 4 warning messages for this computation, check your output file!
***** Memory usage (system): Max: 3062.598 MB (rank:42) Min: 1350.922 MB (rank:56) Ave: 1872.324 MB Std: 404.368 MB
***** Maximum memory (mod_alloc) : 738376280 B ( 7.041705E+02 MB)
[MAQAO] Info: 75/76 lprof instances finished
[MAQAO] Info: Detected stop signals that could make lprof alter execution. In case of issues, rerun with lprof-params="-verbose" for more information.
Your experiment path is /scratch/exter/camus/DATASET/CRSB_2STEP_68M/RUN/crsb_mpi76_iter100_icelake/tools/lprof_npsu_run_0
To display your profiling results:
#############################################################################################################################################################
# LEVEL | REPORT | COMMAND #
#############################################################################################################################################################
# Functions | Cluster-wide | maqao lprof -df xp=/scratch/exter/camus/DATASET/CRSB_2STEP_68M/RUN/crsb_mpi76_iter100_icelake/tools/lprof_npsu_run_0 #
# Functions | Per-node | maqao lprof -df -dn xp=/scratch/exter/camus/DATASET/CRSB_2STEP_68M/RUN/crsb_mpi76_iter100_icelake/tools/lprof_npsu_run_0 #
# Functions | Per-process | maqao lprof -df -dp xp=/scratch/exter/camus/DATASET/CRSB_2STEP_68M/RUN/crsb_mpi76_iter100_icelake/tools/lprof_npsu_run_0 #
# Functions | Per-thread | maqao lprof -df -dt xp=/scratch/exter/camus/DATASET/CRSB_2STEP_68M/RUN/crsb_mpi76_iter100_icelake/tools/lprof_npsu_run_0 #
# Loops | Cluster-wide | maqao lprof -dl xp=/scratch/exter/camus/DATASET/CRSB_2STEP_68M/RUN/crsb_mpi76_iter100_icelake/tools/lprof_npsu_run_0 #
# Loops | Per-node | maqao lprof -dl -dn xp=/scratch/exter/camus/DATASET/CRSB_2STEP_68M/RUN/crsb_mpi76_iter100_icelake/tools/lprof_npsu_run_0 #
# Loops | Per-process | maqao lprof -dl -dp xp=/scratch/exter/camus/DATASET/CRSB_2STEP_68M/RUN/crsb_mpi76_iter100_icelake/tools/lprof_npsu_run_0 #
# Loops | Per-thread | maqao lprof -dl -dt xp=/scratch/exter/camus/DATASET/CRSB_2STEP_68M/RUN/crsb_mpi76_iter100_icelake/tools/lprof_npsu_run_0 #
#############################################################################################################################################################
