* [MAQAO] Info: Detected 76 Lprof instances in node210.
If this is incorrect, rerun with number-processes-per-node=X
__ ______ _____
/\ \ / / _ \| __ \
/ \ \ / /| |_) | |__) |
/ /\ \ \/ / | _ <| ___/
/ ____ \ / | |_) | |
/_/ \_\/ |____/|_|
Using branch :
Version date : Mon, 7 Apr 2025 11:37:25 +0200
Commit : 99e3e6b5a2
MPI processes : 76
Solver type: fluid
Computation #1/1
Compilation info : mpiifort -g -O3 -fpp -traceback -fno-alias -ip -assume byterecl -convert big_endian -align -march=core-avx2 -fma -axCORE-AVX2 -I/softs/local_intel/phdf5/1.8.20/include -DHAS_PMETIS -I/softs/local_intel/parmetis/403_64/include -DPARMETIS4 -DMETIS5 -DHAS_PTSCOTCH -I/softs/local_intel/ptscotch/6.0.5a/include
Compilation wrapper info : ifort-I/softs/intel/oneapi/mpi/2021.10.0//include-I/softs/intel/oneapi/mpi/2021.10.0/include-L/softs/intel/oneapi/mpi/2021.10.0/lib/release-L/softs/intel/oneapi/mpi/2021.10.0/lib-Xlinker--enable-new-dtags-Xlinker-rpath-Xlinker/softs/intel/oneapi/mpi/2021.10.0/lib/release-Xlinker-rpath-Xlinker/softs/intel/oneapi/mpi/2021.10.0/lib-lmpifort-lmpi-ldl-lrt-lpthread
Compilation user : camus
Compilation date : 2025-06-19 15:35:42
Compilation MPI version : Intel\(R\)MPILibraryforLinux*OS,Version2021.10Build20230619\(id:c2e19c2f3e\)
AVBP version : 7.16.0
----> Reading run parameters : .//./run.params
----> Using NATURAL reordering
----> command.dat file API is enabled
----> Pressure gradient scaling (PGS) computation with PGS factor. Check the resulting maximum Mach number in your solution! psg_factor is equal to: 3.00000E-01
----> Using Lax Wendroff
with UNCLOSED boundary terms
----> Using colin_species viscosity model
----> Temporals are activated and full balances are computed
Number of liquid species is 1
TPF Lagrangian calculation
----> Using sponge layer(s)
________________________________________________________________________
| Sponge layer: 1 |
| Lowest point: -3.00000E+00 -3.00000E+00 -0.10000D+00 |
| Highest point: -1.70000E-01 3.00000E+00 0.30000D+01 |
|_______________________________________________________________________|
________________________________________________________________________
| Sponge layer: 2 |
| Lowest point: 1.70000E-01 -3.00000E+00 -0.10000D+00 |
| Highest point: 3.00000E+00 3.00000E+00 0.30000D+01 |
|_______________________________________________________________________|
________________________________________________________________________
| Sponge layer: 3 |
| Lowest point: -3.00000E+00 -3.00000E+00 -0.10000D+00 |
| Highest point: 3.00000E+00 -1.70000E-01 0.30000D+01 |
|_______________________________________________________________________|
________________________________________________________________________
| Sponge layer: 4 |
| Lowest point: -3.00000E+00 1.70000E-01 -0.10000D+00 |
| Highest point: 3.00000E+00 3.00000E+00 0.30000D+01 |
|_______________________________________________________________________|
---> Using reactive sponge layer(s) - box type
________________________________________________________________________
| Reactive sponge1layer: |
| Lowest point: -5.00000E+00 -5.00000E+00 0.10000D+00 |
| Highest point: 5.00000E+00 5.00000E+00 0.50000D+01 |
|_______________________________________________________________________|
>>>>> WARNING
>>>>> FIMUR inner radius is imposed --> Ptcl injection velocity is computed from it and the mass flow rate
>>>>> WARNING
>>>>> Specifier 'transport = computed' is deprecated since version 7.14. Please use 'transport = simplified' instead (simplified transport model).
>>>>> WARNING
>>>>> You are using PEA chemistry fitting on fuel oxidation and CO-CO2 equilibrium reactions.
----> Reading mesh : .//../MESH/mesh_coarse.mesh.h5
Meshfile signature: f4cc21ed9b6f241ffd69620f7641ada5
----> el2part file found: el2part_76.h5
Use existing partitioning
>> Reading ...took 0.230s
----> Initialize the solution writers (76 writers)
>>>>> WARNING
>>>>> No instantaneous solution storage required: the calculation of additional variables is deactivated.
----> Reading boundary conditions in asciibound file : .//../MESH/mesh.asciiBound
----> Reading boundary conditions in Lagrangian asciibound file : .//../COMMON/asciiBound_EL.key
_______________________________________________________________________________________
| Boundary patches (no reordering) |
|______________________________________________________________________________________|
| Patch number Patch name Boundary condition |
| ------------ ---------- ------------------ |
| 1 Inlet_air INLET_RELAX_RHOUN_T_Y |
| 2 Outlet OUTLET_RELAX_P_3D |
| 3 Fond_chambre WALL_NOSLIP_ADIAB |
| 4 Tubes_inf WALL_NOSLIP_ADIAB |
| 5 Swirler WALL_NOSLIP_ADIAB |
| 6 Venturi WALL_NOSLIP_ADIAB |
| 7 Wall_inlet_fuel WALL_NOSLIP_ADIAB |
|______________________________________________________________________________________|
______________________________________________________________
| Info on initial grid |
|_____________________________________________________________|
| number of dimensions : 3 |
| number of nodes : 11727776 |
| number of cells : 68168592 |
| - tetrahedra : 68168592 |
| number of cell per group : 100 |
| number of boundary nodes : 200789 |
| number of periodic nodes : 0 |
| number of axi-periodic nodes : 0 |
|_____________________________________________________________|
| After partitioning |
|_____________________________________________________________|
| number of nodes : 12417553 |
| extra nodes due to partitioning : 689777 [+ 5.88‰] |
|_____________________________________________________________|
______________________________________________________________
| Partitioning Quality |
|_____________________________________________________________|
| Maximum number of neighbors : 19.00 |
| Average number of neighbors : 12.29 |
| Maximum number of exchange nodes : 23683.00 |
| Average number of exchange nodes : 17861.04 |
|_____________________________________________________________|
----> Reading initial solution : .//./SOLUT/last_solution.h5
----> Reading took 1.289s
______________________________________________________________
| Info on chemistry |
|_____________________________________________________________|
| Kinetic scheme : C7H16-AIR-2S_DP |
| |
| Chemical reaction #1 |
| fthick : 1.00000000E+00 |
| Preexponential / fthick [SI] : 1.40000000E+08 |
| Activation temperature [K] : 1.45936519E+04 |
| |
| Chemical reaction #2 |
| fthick : 1.00000000E+00 |
| Preexponential / fthick [SI] : 5.00000000E+06 |
| Activation temperature [K] : 1.05678169E+04 |
|_____________________________________________________________|
______________________________________________________________
| Info on initial solution |
|_____________________________________________________________|
| number of Navier-Stokes equations : 5 |
| number of species : 6 |
| number of reactions : 2 |
| number of tpf equations : 0 |
| number of fictive species : 0 |
| initial iteration : 5231177 |
| initial time : 3.28201405E-01 |
|_____________________________________________________________|
----> Reading solutbound : .//../SOLUTBOUND/GRC_coarse.solutBound.h5
- Using 7.X format
----> Reading took 0.019s
----> Initialising metrics
----> Total volume of the mesh [m3] : 3.26791741E+01
----> Smallest cell volume [m3] : 2.68019202E-13
---> Initialise cell group structure
----> Cell group structure took 21.720s
----> Reading initial ptcl solution for subset monspray : ./SOLUT/last_solution_ptcl.h5
Meshfile signature in ptcl solution : f4cc21ed9b6f241ffd69620f7641ada5
Total number of particles found : 156802
----> Boundary MPIs: 19
----> Reading probe coordinates file : .//../COMMON/record.dat
number of probes : 19
----> Writing probe reference file : ./TEMPORAL//probefile.dat_full
______________________________________________________________
| Probe name Coordinates |
|_____________________________________________________________|
| BellowFlame_far_mY-2.25099E-05 -3.98401E-02 1.44982E-02 |
| BellowFlame_mX -1.49967E-02 -6.62176E-06 1.49824E-02 |
| BellowFlame_mY 2.24094E-05 -1.49535E-02 1.49553E-02 |
| Middle_1 -2.43084E-05 5.47309E-05 5.04925E-03 |
| Middle_8 1.29940E-06 -4.39426E-05 3.99265E-02 |
| BellowFlame_far_mX-3.96055E-02 1.96073E-04 1.47486E-02 |
| Middle_4 -6.34262E-05 -9.08581E-05 2.00143E-02 |
| BellowFlame_pY -5.92594E-05 1.49866E-02 1.49649E-02 |
| Middle_5 -8.32460E-05 -1.21194E-04 2.49816E-02 |
| Middle_6 -4.58833E-06 4.26769E-05 2.99693E-02 |
| Middle_7 -4.94215E-05 -1.26657E-04 3.50171E-02 |
| BellowFlame_pX 1.49790E-02 -1.55280E-04 1.49853E-02 |
| Middle_9 5.22543E-05 9.19650E-05 5.00695E-02 |
| Middle_2 -6.78165E-05 4.58037E-06 9.87281E-03 |
| Middle_3 -5.17741E-05 -6.46622E-06 1.50778E-02 |
| BellowFlame_far_pX 3.95271E-02 1.43171E-04 1.51214E-02 |
| BellowFlame_far_pY 3.78847E-04 3.97983E-02 1.51021E-02 |
| Middle_10 -6.42530E-05 -7.04890E-05 6.00099E-02 |
| outlet_top 5.42093E-03 2.81871E-02 2.00857E+00 |
|_____________________________________________________________|
----> End pre-processing.
________________________________________________________________________________________________________
----> Starts the temporal loop.
Iteration # Time-step [s] Total time [s] Iter/sec [s-1]
5231178 1.128981121516E-07 3.282015176375E-01 3.510748917367E-01
5231227 1.131187730331E-07 3.282070544809E-01 4.263994986693E-01
5231277 1.138398383516E-07 3.282127269088E-01 4.266816986633E-01
5231327 1.144368758225E-07 3.282184359909E-01 4.266417276066E-01
5231377 1.148609357497E-07 3.282241680314E-01 4.267715737207E-01
5231427 1.153910897600E-07 3.282299244399E-01 4.273333347985E-01
5231477 1.158518721296E-07 3.282357063241E-01 4.269414549831E-01
5231527 1.162284683713E-07 3.282415084253E-01 4.269737857006E-01
5231577 1.166960070604E-07 3.282473315397E-01 4.267714273204E-01
5231627 1.171080934132E-07 3.282531765360E-01 4.267932478287E-01
5231677 1.175279713325E-07 3.282590424861E-01 4.267374444512E-01
----> Lagrangian solution stored in file : ./SOLUT/solut_ptcl_monspray_05231677.h5
Number of particles : 157171
----> Solution stored in file : ./SOLUT/solut.h5
____________________________________________________________________________________________
| Integral values for boundary patches: mass fluxes (gas) and areas |
| (instantaneous values, last iteration) |
|___________________________________________________________________________________________|
| Patch number Patch name Mass flux Area |
| ------------ ---------- --------- ---- |
| 1 Inlet_air 5.9819E-03 5.6519E-03 |
| 2 Outlet 2.0811E+01 5.8808E+01 |
| 3 Fond_chambre 0.0000E+00 5.2774E-02 |
| 4 Tubes_inf 0.0000E+00 2.8398E-02 |
| 5 Swirler 0.0000E+00 1.1089E-02 |
| 6 Venturi 0.0000E+00 4.8857E-03 |
| 7 Wall_inlet_fuel 0.0000E+00 6.3596E-05 |
|___________________________________________________________________________________________|
----> End computation.
________________________________________________________________________________________________________
____________________________________________________________________________________________
| 76 MPI tasks Elapsed real time [s] [s.cores] [h.cores] |
|___________________________________________________________________________________________|
| AVBP : 1283.06 9.7512E+04 2.7087E+01 |
| Temporal loop : 1178.38 8.9557E+04 2.4877E+01 |
| Per simulated second : 2.0445E+07 1.5538E+09 4.3161E+05 |
| Per iteration : 2.3568 1.7911E+02 |
|-------------------------------------------------------------------------------------------|
| RCT [s.mpi/node/it] : 1.52726550E-05 |
|___________________________________________________________________________________________|
----> Initial physical time : 3.28201405E-01
Initial iteration : 5231177
Initial timestep : 1.12898112E-07
----> Final physical time : 3.28259042E-01
Final iteration : 5231677
Final timestep : 1.17527971E-07
----> Simulated physical time : 5.76377468E-05
Simulated iterations : 500
________________________________________________________________________________________________________
TIMERS
________________________________________________________________________________________________________
Prints relevant timers and breaks down percentage regarding reference timers.
> The 'Total slave simulation' time corresponds to the 1st level, and is measured by slave_timer (sum of pre temporal loop, temporal loop and post temporal loop).
> The 'Computation' time corresponds to the time integration loops, and is measured by rungekutta_timer.
> Levels are depicted using [X.Y.Z. ...] lists. The number of entry in the list corresponds to the level.
> References to the upper level is made to compute the contribution of one sub-level to its parent level.
> The times displayed are those of the master processor.
> For each timer, the minimum, maximum and mean values for all processors are also shown in the 3 right-hand columns.
> A json file 'timers.json' containing all the data is also available in the temporal output directory.
----- 1st level timers
time [s] | relative to [ min [s] mean [s] max [s] ]
| tot. slave [%] [ ]
> [0] Total slave simulation : 1.2831E+03 | 100.00% [ 1.2829E+03 1.2831E+03 1.2832E+03 ]
----- 2nd level timers
time [s] | relative to [ min [s] mean [s] max [s] ]
| tot. slave [%] [ ]
> > [0.1] Pre temporal loop : 1.0437E+02 | 8.13% [ 1.0436E+02 1.0436E+02 1.0437E+02 ]
> > [0.2] Temporal loop : 1.1784E+03 | 91.84% [ 1.1784E+03 1.1784E+03 1.1784E+03 ]
> > [0.2a] Temporal loop without IO : 1.1694E+03 | 91.14% [ 1.1695E+03 1.1695E+03 1.1694E+03 ]
> > [0.3] Post temporal loop : 3.0027E-01 | 0.02% [ 1.3867E-01 3.0737E-01 4.7669E-01 ]
> > [0.4] Point to Point communications : 9.4463E+01 | 7.36% [ 1.1346E+01 6.4876E+01 2.9049E+02 ]
----- 3rd level timers
time [s] | relative to | relative to [ min [s] mean [s] max [s] ]
| tot. slave [%] | upper level [%] [ ]
> > [0.1] Pre temporal loop : 1.0437E+02 | 8.13% [ 1.0436E+02 1.0436E+02 1.0437E+02 ]
> > > [0.1.1] Build online postprocessing objects : 0.0000E+00 | 0.00% | 0.00% [ 0.0000E+00 0.0000E+00 0.0000E+00 ]
> > [0.2] Temporal loop : 1.1784E+03 | 91.84% [ 1.1784E+03 1.1784E+03 1.1784E+03 ]
> > > [0.2.1] Computation : 1.1643E+03 | 90.74% | 98.80% [ 1.1552E+03 1.1595E+03 1.1695E+03 ]
> > > [0.2.2] Temporal post-processing : 2.2730E+00 | 0.18% | 0.19% [ 2.1697E+00 2.2121E+00 2.2730E+00 ]
> > > [0.2.3] Instantaneous solution post-processing : 6.6721E+00 | 0.52% | 0.57% [ 6.6662E+00 6.6870E+00 6.7006E+00 ]
> > > [0.2.4] Average solution post-processing : 0.0000E+00 | 0.00% | 0.00% [ 0.0000E+00 0.0000E+00 0.0000E+00 ]
> > > [0.2.5] Online post-processing compute and storage : 0.0000E+00 | 0.00% | 0.00% [ 0.0000E+00 0.0000E+00 0.0000E+00 ]
----- 4th level timers: focus on Computation level (rungekutta_timer)
time [s] | relative to | relative to | relative to [ min [s] mean [s] max [s] ]
| tot. slave [%] | computation [%]| upper level [%][ ]
> > > [0.2.1] Computation : 1.1643E+03 | 90.74% | 100.00% [ 1.1552E+03 1.1595E+03 1.1695E+03 ]
> > > > [0.2.1.1] Convective scheme : 4.9771E+01 | 3.88% | 4.27% | 4.27% [ 3.9760E+01 5.0736E+01 5.3087E+01 ]
> > > > [0.2.1.2] Diffusion operator : 2.7220E+02 | 21.21% | 23.38% | 23.38% [ 2.1615E+02 2.7830E+02 2.9148E+02 ]
> > > > [0.2.1.4] Time-step calculation : 4.5011E+01 | 3.51% | 3.87% | 3.87% [ 4.4980E+01 4.6093E+01 5.0968E+01 ]
> > > > [0.2.1.5] Transport calculation : 1.2154E+01 | 0.95% | 1.04% | 1.04% [ 9.4339E+00 1.1941E+01 1.2465E+01 ]
> > > > [0.2.1.6] Thermo calculation : 1.5652E+01 | 1.22% | 1.34% | 1.34% [ 1.0604E+01 1.4931E+01 1.5963E+01 ]
> > > > [0.2.1.7] Gradient calculation : 1.1951E+02 | 9.31% | 10.26% | 10.26% [ 1.1512E+02 1.1859E+02 1.2332E+02 ]
> > > > [0.2.1.8] Boundary : 1.5338E+01 | 1.20% | 1.32% | 1.32% [ 4.0794E+00 9.2262E+00 2.8398E+01 ]
> > > > [0.2.1.9] Turbulent viscosity model : 8.5346E+01 | 6.65% | 7.33% | 7.33% [ 8.3293E+01 8.6449E+01 9.2456E+01 ]
> > > > [0.2.1.10] Combustion (source term + TFLES + efcy + efcy I0) : 4.2015E+01 | 3.27% | 3.61% | 3.61% [ 3.0556E+01 3.9334E+01 4.3761E+01 ]
> > > > > [0.2.1.10.1] Chemical source terms calculation : 4.2015E+01 | 3.27% | 3.61% | 100.00% [ 3.0556E+01 3.9334E+01 4.3761E+01 ]
> > > > > [0.2.1.10.2] TFLES model calculation : 0.0000E+00 | 0.00% | 0.00% | 0.00% [ 0.0000E+00 0.0000E+00 0.0000E+00 ]
> > > > > [0.2.1.10.3] Efficiency function calculation : 0.0000E+00 | 0.00% | 0.00% | 0.00% [ 0.0000E+00 0.0000E+00 0.0000E+00 ]
> > > > > [0.2.1.10.4] Efficiency I0 function calculation : 0.0000E+00 | 0.00% | 0.00% | 0.00% [ 0.0000E+00 0.0000E+00 0.0000E+00 ]
> > > > [0.2.1.11] Artificial viscosity : 2.0681E+02 | 16.12% | 17.76% | 17.76% [ 1.6204E+02 2.0863E+02 2.2035E+02 ]
> > > > [0.2.1.12] Lagrangian solver : 3.3576E+01 | 2.62% | 2.88% | 2.88% [ 3.0680E+01 3.7032E+01 5.4577E+01 ]
> > > > [0.2.1.17] Source terms : 0.0000E+00 | 0.00% | 0.00% | 0.00% [ 0.0000E+00 0.0000E+00 0.0000E+00 ]
----- 5th level timers: focus on Lagrangian level (lagrangian_timer)
time [s] | relative to | relative to | relative to [ min [s] mean [s] max [s] ]
| tot. slave [%] | computation [%]| lagrangian [%] [ ]
> > > > [0.2.1.12] Lagrangian solver : 3.3576E+01 | 2.62% | 2.88% | 100.00% [ 3.0680E+01 3.7032E+01 5.4577E+01 ]
> > > > > [0.2.1.12.1] Physical treatment : 4.0529E+00 | 0.32% | 0.35% | 12.07% [ 4.0897E-01 5.3434E+00 1.6432E+01 ]
> > > > > > [0.2.1.12.1.1] Initialisation (interp weights) : 5.5844E-01 | 0.04% | 0.05% | 1.66% [ 0.0000E+00 7.2305E-01 2.2089E+00 ]
> > > > > > [0.2.1.12.1.2] Secondary breakup model : 0.0000E+00 | 0.00% | 0.00% | 0.00% [ 0.0000E+00 0.0000E+00 0.0000E+00 ]
> > > > > > [0.2.1.12.1.3] Drag model : 8.0873E-01 | 0.06% | 0.07% | 2.41% [ 0.0000E+00 1.0989E+00 3.4825E+00 ]
> > > > > > [0.2.1.12.1.4] Film model : 0.0000E+00 | 0.00% | 0.00% | 0.00% [ 0.0000E+00 0.0000E+00 0.0000E+00 ]
> > > > > > [0.2.1.12.1.5] Evaporation model : 1.3887E+00 | 0.11% | 0.12% | 4.14% [ 0.0000E+00 2.1137E+00 8.0718E+00 ]
> > > > > > [0.2.1.12.1.6] Soot model : 0.0000E+00 | 0.00% | 0.00% | 0.00% [ 0.0000E+00 0.0000E+00 0.0000E+00 ]
> > > > > > [0.2.1.12.1.7] Two-way coupling : 5.3219E+00 | 0.41% | 0.46% | 15.85% [ 3.9299E+00 5.1941E+00 6.0149E+00 ]
> > > > > > [0.2.1.12.1.8] Time advancement : 1.2542E-01 | 0.01% | 0.01% | 0.37% [ 0.0000E+00 1.7056E-01 5.5771E-01 ]
> > > > > > [0.2.1.12.1.9] EL2EE : 1.2542E-02 | 0.00% | 0.00% | 0.04% [ 5.0216E-03 1.5561E-02 2.5992E-02 ]
> > > > > > [0.2.1.12.1.10] Automatic-PAMELA: compute diam. and inj. + 0.0000E+00 | 0.00% | 0.00% | 0.00% [ 0.0000E+00 0.0000E+00 0.0000E+00 ]
> > > > > > > [0.2.1.12.1.10.1] Automatic-PAMELA: compute diameter and 0.0000E+00 | 0.00% | 0.00% | 0.00% [ 0.0000E+00 0.0000E+00 0.0000E+00 ]
> > > > > > > [0.2.1.12.1.10.2] Automatic-PAMELA: compute vorticity th 0.0000E+00 | 0.00% | 0.00% | 0.00% [ 0.0000E+00 0.0000E+00 0.0000E+00 ]
> > > > > > [0.2.1.12.1.11] Update arrays : 2.2410E+00 | 0.17% | 0.19% | 6.67% [ 4.0463E-01 1.4553E+00 2.2410E+00 ]
> > > > > [0.2.1.12.2] Algo treatment : 2.0637E+01 | 1.61% | 1.77% | 61.47% [ 6.3707E+00 2.3813E+01 4.3572E+01 ]
> > > > > [0.2.1.12.3] Injection : 1.1549E-02 | 0.00% | 0.00% | 0.03% [ 8.8478E-03 1.6676E-02 3.1183E-01 ]
> > > > > [0.2.1.12.4] Sorting particles : 0.0000E+00 | 0.00% | 0.00% | 0.00% [ 0.0000E+00 0.0000E+00 0.0000E+00 ]
> > > > > [0.2.1.12.5] Merging-splitting particles : 0.0000E+00 | 0.00% | 0.00% | 0.00% [ 0.0000E+00 0.0000E+00 0.0000E+00 ]
> > > > > [0.2.1.12.6] Soot inception : 0.0000E+00 | 0.00% | 0.00% | 0.00% [ 0.0000E+00 0.0000E+00 0.0000E+00 ]
----> End of AVBP session
----> Found 4 warning messages for this computation, check your output file!
***** Memory usage (system): Max: 3475.727 MB (rank:42) Min: 1432.336 MB (rank:31) Ave: 2214.848 MB Std: 529.484 MB
***** Maximum memory (mod_alloc) : 738376280 B ( 7.041705E+02 MB)
[MAQAO] Info: 75/76 lprof instances finished
[MAQAO] Info: Detected stop signals that could make lprof alter execution. In case of issues, rerun with lprof-params="-verbose" for more information.
Your experiment path is /scratch/exter/camus/DATASET/CRSB_2STEP_68M/RUN/crsb_mpi76_iter500_icelake/tools/lprof_npsu_run_0
To display your profiling results:
#############################################################################################################################################################
# LEVEL | REPORT | COMMAND #
#############################################################################################################################################################
# Functions | Cluster-wide | maqao lprof -df xp=/scratch/exter/camus/DATASET/CRSB_2STEP_68M/RUN/crsb_mpi76_iter500_icelake/tools/lprof_npsu_run_0 #
# Functions | Per-node | maqao lprof -df -dn xp=/scratch/exter/camus/DATASET/CRSB_2STEP_68M/RUN/crsb_mpi76_iter500_icelake/tools/lprof_npsu_run_0 #
# Functions | Per-process | maqao lprof -df -dp xp=/scratch/exter/camus/DATASET/CRSB_2STEP_68M/RUN/crsb_mpi76_iter500_icelake/tools/lprof_npsu_run_0 #
# Functions | Per-thread | maqao lprof -df -dt xp=/scratch/exter/camus/DATASET/CRSB_2STEP_68M/RUN/crsb_mpi76_iter500_icelake/tools/lprof_npsu_run_0 #
# Loops | Cluster-wide | maqao lprof -dl xp=/scratch/exter/camus/DATASET/CRSB_2STEP_68M/RUN/crsb_mpi76_iter500_icelake/tools/lprof_npsu_run_0 #
# Loops | Per-node | maqao lprof -dl -dn xp=/scratch/exter/camus/DATASET/CRSB_2STEP_68M/RUN/crsb_mpi76_iter500_icelake/tools/lprof_npsu_run_0 #
# Loops | Per-process | maqao lprof -dl -dp xp=/scratch/exter/camus/DATASET/CRSB_2STEP_68M/RUN/crsb_mpi76_iter500_icelake/tools/lprof_npsu_run_0 #
# Loops | Per-thread | maqao lprof -dl -dt xp=/scratch/exter/camus/DATASET/CRSB_2STEP_68M/RUN/crsb_mpi76_iter500_icelake/tools/lprof_npsu_run_0 #
#############################################################################################################################################################
