sh: module: line 1: syntax error: unexpected end of file
sh: error importing function definition for `module'
sh: ml: line 1: syntax error: unexpected end of file
sh: error importing function definition for `ml'
sh: _module_raw: line 1: syntax error: unexpected end of file
sh: error importing function definition for `_module_raw'
sh: which: line 1: syntax error: unexpected end of file
sh: error importing function definition for `which'
/bin/sh: module: line 1: syntax error: unexpected end of file
/bin/sh: error importing function definition for `module'
/bin/sh: ml: line 1: syntax error: unexpected end of file
/bin/sh: error importing function definition for `ml'
/bin/sh: _module_raw: line 1: syntax error: unexpected end of file
/bin/sh: error importing function definition for `_module_raw'
/bin/sh: which: line 1: syntax error: unexpected end of file
/bin/sh: error importing function definition for `which'
sh: module: line 1: syntax error: unexpected end of file
sh: error importing function definition for `module'
sh: ml: line 1: syntax error: unexpected end of file
sh: error importing function definition for `ml'
sh: _module_raw: line 1: syntax error: unexpected end of file
sh: error importing function definition for `_module_raw'
sh: which: line 1: syntax error: unexpected end of file
sh: error importing function definition for `which'
sh: module: line 1: syntax error: unexpected end of file
sh: error importing function definition for `module'
sh: ml: line 1: syntax error: unexpected end of file
sh: error importing function definition for `ml'
sh: _module_raw: line 1: syntax error: unexpected end of file
sh: error importing function definition for `_module_raw'
sh: which: line 1: syntax error: unexpected end of file
sh: error importing function definition for `which'
* Info: Detected 2 Lprof instances in ins01.benchmarkcenter.megware.com: processes-per-node/ppn set accordingly.
If this is incorrect, rerun with an explicit value for this setting
* Info: Selecting the 'perf-high-ppn' engine for node ins01.benchmarkcenter.megware.com
* Info: "ref-cycles" not supported on ins01.benchmarkcenter.megware.com: fallback to "cpu-clock"
* Warning: Found no event able to derive walltime: prepending cpu-clock
* Info: Process launched (host ins01.benchmarkcenter.megware.com, process 244766)
* Info: Process launched (host ins01.benchmarkcenter.megware.com, process 244767)---
Devices:
0: Host CPU
CloverLeaf:
- Ver.: 2.000
- Deck: clover.in
- Out: clover.out
- Profiler: deck-specified
MPI:
- Enabled: true
- Total ranks: 2
- Header device-awareness (CUDA-awareness): unknown
- Runtime device-awareness (CUDA-awareness): unknown
- Host-Device halo exchange staging buffer: true
Model:
- Name: OpenMP (CPU)
- Execution: Host
# ----
Output: |+1
Output file clover.out opened. All output will go there.
Using input: `clover.in`
Problem initialised and generated
Launching hydro
Step 1 time 0 control sound timestep 0.000385161 1,1 x 0 y 0
Wall clock 0.572403
Average time per cell 2.42616e-09
Step time per cell 2.42616e-09
Step 2 time 0.000385161 control sound timestep 0.000235099 1,1 x 0 y 0
Wall clock 1.14359
Average time per cell 2.42359e-09
Step time per cell 2.42061e-09
Step 3 time 0.000620261 control sound timestep 0.000298723 1,1 x 0 y 0
Wall clock 1.71683
Average time per cell 2.42562e-09
Step time per cell 2.42944e-09
Step 4 time 0.000918984 control sound timestep 0.000314746 1,1 x 0 y 0
Wall clock 2.28929
Average time per cell 2.42581e-09
Step time per cell 2.42608e-09
Step 5 time 0.00123373 control sound timestep 0.000346361 1,1 x 0 y 0
Wall clock 2.86048
Average time per cell 2.42485e-09
Step time per cell 2.42075e-09
Step 6 time 0.00158009 control sound timestep 0.00034558 1,1 x 0 y 0
Wall clock 3.43191
Average time per cell 2.42439e-09
Step time per cell 2.42179e-09
Step 7 time 0.00192567 control sound timestep 0.000352154 1,1 x 0 y 0
Wall clock 4.00441
Average time per cell 2.4247e-09
Step time per cell 2.42634e-09
Step 8 time 0.00227782 control sound timestep 0.000370384 1,1 x 0 y 0
Wall clock 4.57594
Average time per cell 2.42442e-09
Step time per cell 2.42216e-09
Step 9 time 0.00264821 control sound timestep 0.000366391 1,1 x 0 y 0
Wall clock 5.14716
Average time per cell 2.42406e-09
Step time per cell 2.42093e-09
Step 10 time 0.0030146 control sound timestep 0.000363789 1,1 x 0 y 0
Wall clock 5.75351
Average time per cell 2.43865e-09
Step time per cell 2.56975e-09
Step 11 time 0.00337839 control sound timestep 0.000361224 1,1 x 0 y 0
Wall clock 6.32395
Average time per cell 2.43676e-09
Step time per cell 2.41774e-09
Step 12 time 0.00373961 control sound timestep 0.000359796 1,1 x 0 y 0
Wall clock 6.89507
Average time per cell 2.43543e-09
Step time per cell 2.42049e-09
Step 13 time 0.00409941 control sound timestep 0.000360678 1,1 x 0 y 0
Wall clock 7.46747
Average time per cell 2.43471e-09
Step time per cell 2.42584e-09
Step 14 time 0.00446009 control sound timestep 0.000362113 1,1 x 0 y 0
Wall clock 8.03837
Average time per cell 2.43365e-09
Step time per cell 2.41958e-09
Step 15 time 0.0048222 control sound timestep 0.000362661 1,1 x 0 y 0
Wall clock 8.60983
Average time per cell 2.43288e-09
Step time per cell 2.42176e-09
Step 16 time 0.00518486 control sound timestep 0.000362812 1,1 x 0 y 0
Wall clock 9.1823
Average time per cell 2.43248e-09
Step time per cell 2.42624e-09
Step 17 time 0.00554767 control sound timestep 0.000362988 1,1 x 0 y 0
Wall clock 9.75337
Average time per cell 2.43178e-09
Step time per cell 2.42024e-09
Step 18 time 0.00591066 control sound timestep 0.000363082 1,1 x 0 y 0
Wall clock 10.3248
Average time per cell 2.43123e-09
Step time per cell 2.42168e-09
Step 19 time 0.00627374 control sound timestep 0.000363112 1,1 x 0 y 0
Wall clock 10.8975
Average time per cell 2.43103e-09
Step time per cell 2.42714e-09
Step 20 time 0.00663686 control sound timestep 0.00036317 1,1 x 0 y 0
Wall clock 11.4996
Average time per cell 2.43709e-09
Step time per cell 2.55188e-09
Step 21 time 0.00700003 control sound timestep 0.000363365 1,1 x 0 y 0
Wall clock 12.0698
Average time per cell 2.43611e-09
Step time per cell 2.41647e-09
Step 22 time 0.00736339 control sound timestep 0.00036347 1,1 x 0 y 0
Wall clock 12.6412
Average time per cell 2.43548e-09
Step time per cell 2.42185e-09
Step 23 time 0.00772686 control sound timestep 0.000363513 1,1 x 0 y 0
Wall clock 13.2129
Average time per cell 2.43494e-09
Step time per cell 2.423e-09
Step 24 time 0.00809037 control sound timestep 0.000363629 1,1 x 0 y 0
Wall clock 13.7839
Average time per cell 2.43433e-09
Step time per cell 2.41981e-09
Step 25 time 0.008454 control sound timestep 0.000363732 1,1 x 0 y 0
Wall clock 14.355
Average time per cell 2.43378e-09
Step time per cell 2.42035e-09
Step 26 time 0.00881773 control sound timestep 0.000363825 1,1 x 0 y 0
Wall clock 14.926
Average time per cell 2.43325e-09
Step time per cell 2.41967e-09
Step 27 time 0.00918156 control sound timestep 0.000363914 1,1 x 0 y 0
Wall clock 15.4969
Average time per cell 2.43276e-09
Step time per cell 2.41982e-09
Step 28 time 0.00954547 control sound timestep 0.000363943 1,1 x 0 y 0
Wall clock 16.068
Average time per cell 2.43232e-09
Step time per cell 2.42028e-09
Step 29 time 0.00990942 control sound timestep 0.000363973 1,1 x 0 y 0
Wall clock 16.6405
Average time per cell 2.43213e-09
Step time per cell 2.42644e-09
Step 30 time 0.0102734 control sound timestep 0.000363988 1,1 x 0 y 0
Wall clock 17.2422
Average time per cell 2.43607e-09
Step time per cell 2.55018e-09
Step 31 time 0.0106374 control sound timestep 0.000364002 1,1 x 0 y 0
Wall clock 17.813
Average time per cell 2.43552e-09
Step time per cell 2.4189e-09
Step 32 time 0.0110014 control sound timestep 0.000364043 1,1 x 0 y 0
Wall clock 18.3847
Average time per cell 2.43514e-09
Step time per cell 2.42291e-09
Step 33 time 0.0113654 control sound timestep 0.000364085 1,1 x 0 y 0
Wall clock 18.9555
Average time per cell 2.43466e-09
Step time per cell 2.41909e-09
Step 34 time 0.0117295 control sound timestep 0.000364133 1,1 x 0 y 0
Wall clock 19.5266
Average time per cell 2.43425e-09
Step time per cell 2.4204e-09
Step 35 time 0.0120936 control sound timestep 0.000364198 1,1 x 0 y 0
Wall clock 20.0996
Average time per cell 2.43409e-09
Step time per cell 2.42844e-09
Step 36 time 0.0124578 control sound timestep 0.000364259 1,1 x 0 y 0
Wall clock 20.6708
Average time per cell 2.43373e-09
Step time per cell 2.42072e-09
Step 37 time 0.0128221 control sound timestep 0.000364318 1,1 x 0 y 0
Wall clock 21.2424
Average time per cell 2.43343e-09
Step time per cell 2.42264e-09
Step 38 time 0.0131864 control sound timestep 0.000364383 1,1 x 0 y 0
Wall clock 21.8145
Average time per cell 2.43321e-09
Step time per cell 2.4246e-09
Step 39 time 0.0135508 control sound timestep 0.000364422 1,1 x 0 y 0
Wall clock 22.3856
Average time per cell 2.43289e-09
Step time per cell 2.42047e-09
Step 40 time 0.0139152 control sound timestep 0.000364431 1,1 x 0 y 0
Wall clock 22.9878
Average time per cell 2.43588e-09
Step time per cell 2.55215e-09
Step 41 time 0.0142797 control sound timestep 0.000364435 1,1 x 0 y 0
Wall clock 23.5598
Average time per cell 2.43559e-09
Step time per cell 2.42418e-09
Step 42 time 0.0146441 control sound timestep 0.000364445 1,1 x 0 y 0
Wall clock 24.131
Average time per cell 2.43525e-09
Step time per cell 2.42099e-09
Step 43 time 0.0150085 control sound timestep 0.000364471 1,1 x 0 y 0
Wall clock 24.7024
Average time per cell 2.43494e-09
Step time per cell 2.4217e-09
Step 44 time 0.015373 control sound timestep 0.000364495 1,1 x 0 y 0
Wall clock 25.2748
Average time per cell 2.43474e-09
Step time per cell 2.4258e-09
Step 45 time 0.0157375 control sound timestep 0.000364518 1,1 x 0 y 0
Wall clock 25.846
Average time per cell 2.43443e-09
Step time per cell 2.42055e-09
Step 46 time 0.016102 control sound timestep 0.000364543 1,1 x 0 y 0
Wall clock 26.4176
Average time per cell 2.43418e-09
Step time per cell 2.42272e-09
Step 47 time 0.0164666 control sound timestep 0.000364585 1,1 x 0 y 0
Wall clock 26.9921
Average time per cell 2.4342e-09
Step time per cell 2.4349e-09
Step 48 time 0.0168311 control sound timestep 0.000364628 1,1 x 0 y 0
Wall clock 27.5636
Average time per cell 2.43396e-09
Step time per cell 2.42201e-09
Step 49 time 0.0171958 control sound timestep 0.000364667 1,1 x 0 y 0
Wall clock 28.1353
Average time per cell 2.43374e-09
Step time per cell 2.42294e-09
Step 50 time 0.0175604 control sound timestep 0.000364708 1,1 x 0 y 0
Wall clock 28.7379
Average time per cell 2.43614e-09
Step time per cell 2.55386e-09
Step 51 time 0.0179251 control sound timestep 0.000364758 1,1 x 0 y 0
Wall clock 29.3084
Average time per cell 2.43579e-09
Step time per cell 2.41769e-09
Step 52 time 0.0182899 control sound timestep 0.000364817 1,1 x 0 y 0
Wall clock 29.8793
Average time per cell 2.43548e-09
Step time per cell 2.41959e-09
Step 53 time 0.0186547 control sound timestep 0.000364826 1,1 x 0 y 0
Wall clock 30.4526
Average time per cell 2.43538e-09
Step time per cell 2.42977e-09
Step 54 time 0.0190195 control sound timestep 0.00036483 1,1 x 0 y 0
Wall clock 31.0239
Average time per cell 2.43512e-09
Step time per cell 2.42139e-09
Step 55 time 0.0193844 control sound timestep 0.000364831 1,1 x 0 y 0
Wall clock 31.5956
Average time per cell 2.4349e-09
Step time per cell 2.42264e-09
Step 56 time 0.0197492 control sound timestep 0.000364846 1,1 x 0 y 0
Wall clock 32.1674
Average time per cell 2.4347e-09
Step time per cell 2.42361e-09
Step 57 time 0.0201141 control sound timestep 0.000364866 1,1 x 0 y 0
Wall clock 32.7386
Average time per cell 2.43446e-09
Step time per cell 2.42094e-09
Step 58 time 0.0204789 control sound timestep 0.000364884 1,1 x 0 y 0
Wall clock 33.31
Average time per cell 2.43424e-09
Step time per cell 2.42143e-09
Step 59 time 0.0208438 control sound timestep 0.000364902 1,1 x 0 y 0
Wall clock 33.8817
Average time per cell 2.43405e-09
Step time per cell 2.42285e-09
Step 60 time 0.0212087 control sound timestep 0.000364922 1,1 x 0 y 0
Wall clock 34.4853
Average time per cell 2.43613e-09
Step time per cell 2.55809e-09
Step 61 time 0.0215736 control sound timestep 0.000364956 1,1 x 0 y 0
Wall clock 35.0557
Average time per cell 2.43583e-09
Step time per cell 2.41777e-09
Step 62 time 0.0219386 control sound timestep 0.000364991 1,1 x 0 y 0
Wall clock 35.6282
Average time per cell 2.43568e-09
Step time per cell 2.42631e-09
Step 63 time 0.0223036 control sound timestep 0.000365022 1,1 x 0 y 0
Wall clock 36.2002
Average time per cell 2.4355e-09
Step time per cell 2.42414e-09
Step 64 time 0.0226686 control sound timestep 0.000365056 1,1 x 0 y 0
Wall clock 36.7719
Average time per cell 2.4353e-09
Step time per cell 2.42264e-09
Step 65 time 0.0230337 control sound timestep 0.000365098 1,1 x 0 y 0
Wall clock 37.3453
Average time per cell 2.43523e-09
Step time per cell 2.43019e-09
Step 66 time 0.0233988 control sound timestep 0.000365146 1,1 x 0 y 0
Wall clock 37.9179
Average time per cell 2.43511e-09
Step time per cell 2.42689e-09
Step 67 time 0.0237639 control sound timestep 0.000365166 1,1 x 0 y 0
Wall clock 38.4894
Average time per cell 2.43491e-09
Step time per cell 2.42195e-09
Step 68 time 0.0241291 control sound timestep 0.000365169 1,1 x 0 y 0
Wall clock 39.0613
Average time per cell 2.43475e-09
Step time per cell 2.42383e-09
Step 69 time 0.0244942 control sound timestep 0.000365167 1,1 x 0 y 0
Wall clock 39.6352
Average time per cell 2.43472e-09
Step time per cell 2.43218e-09
Step 70 time 0.0248594 control sound timestep 0.000365177 1,1 x 0 y 0
Wall clock 40.2374
Average time per cell 2.43641e-09
Step time per cell 2.55234e-09
Step 71 time 0.0252246 control sound timestep 0.000365194 1,1 x 0 y 0
Wall clock 40.8085
Average time per cell 2.43619e-09
Step time per cell 2.42061e-09
Step 72 time 0.0255898 control sound timestep 0.000365209 1,1 x 0 y 0
Wall clock 41.3819
Average time per cell 2.4361e-09
Step time per cell 2.42986e-09
Step 73 time 0.025955 control sound timestep 0.000365223 1,1 x 0 y 0
Wall clock 41.9536
Average time per cell 2.43592e-09
Step time per cell 2.42292e-09
Step 74 time 0.0263202 control sound timestep 0.000365239 1,1 x 0 y 0
Wall clock 42.5261
Average time per cell 2.4358e-09
Step time per cell 2.42651e-09
Step 75 time 0.0266854 control sound timestep 0.000365263 1,1 x 0 y 0
Wall clock 43.1001
Average time per cell 2.43576e-09
Step time per cell 2.43256e-09
Step 76 time 0.0270507 control sound timestep 0.000365294 1,1 x 0 y 0
Wall clock 43.6737
Average time per cell 2.4357e-09
Step time per cell 2.4308e-09
Step 77 time 0.027416 control sound timestep 0.000365322 1,1 x 0 y 0
Wall clock 44.2454
Average time per cell 2.43554e-09
Step time per cell 2.42303e-09
Step 78 time 0.0277813 control sound timestep 0.000365349 1,1 x 0 y 0
Wall clock 44.8177
Average time per cell 2.43541e-09
Step time per cell 2.42557e-09
Step 79 time 0.0281467 control sound timestep 0.000365381 1,1 x 0 y 0
Wall clock 45.3893
Average time per cell 2.43525e-09
Step time per cell 2.42238e-09
Step 80 time 0.0285121 control sound timestep 0.000365421 1,1 x 0 y 0
Wall clock 45.991
Average time per cell 2.43669e-09
Step time per cell 2.5501e-09
Step 81 time 0.0288775 control sound timestep 0.000365457 1,1 x 0 y 0
Wall clock 46.5646
Average time per cell 2.43662e-09
Step time per cell 2.43092e-09
Step 82 time 0.0292429 control sound timestep 0.000365459 1,1 x 0 y 0
Wall clock 47.1357
Average time per cell 2.43643e-09
Step time per cell 2.42073e-09
Step 83 time 0.0296084 control sound timestep 0.000365461 1,1 x 0 y 0
Wall clock 47.7087
Average time per cell 2.43634e-09
Step time per cell 2.4283e-09
Step 84 time 0.0299738 control sound timestep 0.000365461 1,1 x 0 y 0
Wall clock 48.2814
Average time per cell 2.43623e-09
Step time per cell 2.42712e-09
Step 85 time 0.0303393 control sound timestep 0.000365475 1,1 x 0 y 0
Wall clock 48.853
Average time per cell 2.43607e-09
Step time per cell 2.42224e-09
Step 86 time 0.0307048 control sound timestep 0.000365488 1,1 x 0 y 0
Wall clock 49.4245
Average time per cell 2.43591e-09
Step time per cell 2.42235e-09
Step 87 time 0.0310703 control sound timestep 0.0003655 1,1 x 0 y 0
Wall clock 50.0279
First step overhead 0
Result:
- Problem: none
- Outcome: PASSED
* Info: Process finished (host ins01.benchmarkcenter.megware.com, process 244767)
* Warning: (host ins01.benchmarkcenter.megware.com, process 244767) Observed more threads (97) than expected (96): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=97.
* Info: Process finished (host ins01.benchmarkcenter.megware.com, process 244766)
* Warning: (host ins01.benchmarkcenter.megware.com, process 244766) Observed more threads (97) than expected (96): in case of high IO overhead or suspicious profile, rerun with maximum-threads-per-process=97.
sh: module: line 1: syntax error: unexpected end of file
sh: error importing function definition for `module'
sh: ml: line 1: syntax error: unexpected end of file
sh: error importing function definition for `ml'
sh: _module_raw: line 1: syntax error: unexpected end of file
sh: error importing function definition for `_module_raw'
sh: which: line 1: syntax error: unexpected end of file
sh: error importing function definition for `which'
sh: module: line 1: syntax error: unexpected end of file
sh: error importing function definition for `module'
sh: ml: line 1: syntax error: unexpected end of file
sh: error importing function definition for `ml'
sh: _module_raw: line 1: syntax error: unexpected end of file
sh: error importing function definition for `_module_raw'
sh: which: line 1: syntax error: unexpected end of file
sh: error importing function definition for `which'
sh: module: line 1: syntax error: unexpected end of file
sh: error importing function definition for `module'
sh: ml: line 1: syntax error: unexpected end of file
sh: error importing function definition for `ml'
sh: _module_raw: line 1: syntax error: unexpected end of file
sh: error importing function definition for `_module_raw'
sh: which: line 1: syntax error: unexpected end of file
sh: error importing function definition for `which'
sh: module: line 1: syntax error: unexpected end of file
sh: error importing function definition for `module'
sh: ml: line 1: syntax error: unexpected end of file
sh: error importing function definition for `ml'
sh: _module_raw: line 1: syntax error: unexpected end of file
sh: error importing function definition for `_module_raw'
sh: which: line 1: syntax error: unexpected end of file
sh: error importing function definition for `which'
sh: module: line 1: syntax error: unexpected end of file
sh: error importing function definition for `module'
sh: ml: line 1: syntax error: unexpected end of file
sh: error importing function definition for `ml'
sh: _module_raw: line 1: syntax error: unexpected end of file
sh: error importing function definition for `_module_raw'
sh: which: line 1: syntax error: unexpected end of file
sh: error importing function definition for `which'
sh: module: line 1: syntax error: unexpected end of file
sh: error importing function definition for `module'
sh: ml: line 1: syntax error: unexpected end of file
sh: error importing function definition for `ml'
sh: _module_raw: line 1: syntax error: unexpected end of file
sh: error importing function definition for `_module_raw'
sh: which: line 1: syntax error: unexpected end of file
sh: error importing function definition for `which'
Your experiment path is /beegfs/hackathon/users/eoseret/qaas_runs/170-854-8685/intel/CloverLeafCXX/run/oneview_runs/compilers/gcc_6/oneview_results_1708556066/tools/lprof_npsu_run_0
To display your profiling results:
#########################################################################################################################################################################################################################
# LEVEL | REPORT | COMMAND #
#########################################################################################################################################################################################################################
# Functions | Cluster-wide | maqao lprof -df xp=/beegfs/hackathon/users/eoseret/qaas_runs/170-854-8685/intel/CloverLeafCXX/run/oneview_runs/compilers/gcc_6/oneview_results_1708556066/tools/lprof_npsu_run_0 #
# Functions | Per-node | maqao lprof -df -dn xp=/beegfs/hackathon/users/eoseret/qaas_runs/170-854-8685/intel/CloverLeafCXX/run/oneview_runs/compilers/gcc_6/oneview_results_1708556066/tools/lprof_npsu_run_0 #
# Functions | Per-process | maqao lprof -df -dp xp=/beegfs/hackathon/users/eoseret/qaas_runs/170-854-8685/intel/CloverLeafCXX/run/oneview_runs/compilers/gcc_6/oneview_results_1708556066/tools/lprof_npsu_run_0 #
# Functions | Per-thread | maqao lprof -df -dt xp=/beegfs/hackathon/users/eoseret/qaas_runs/170-854-8685/intel/CloverLeafCXX/run/oneview_runs/compilers/gcc_6/oneview_results_1708556066/tools/lprof_npsu_run_0 #
# Loops | Cluster-wide | maqao lprof -dl xp=/beegfs/hackathon/users/eoseret/qaas_runs/170-854-8685/intel/CloverLeafCXX/run/oneview_runs/compilers/gcc_6/oneview_results_1708556066/tools/lprof_npsu_run_0 #
# Loops | Per-node | maqao lprof -dl -dn xp=/beegfs/hackathon/users/eoseret/qaas_runs/170-854-8685/intel/CloverLeafCXX/run/oneview_runs/compilers/gcc_6/oneview_results_1708556066/tools/lprof_npsu_run_0 #
# Loops | Per-process | maqao lprof -dl -dp xp=/beegfs/hackathon/users/eoseret/qaas_runs/170-854-8685/intel/CloverLeafCXX/run/oneview_runs/compilers/gcc_6/oneview_results_1708556066/tools/lprof_npsu_run_0 #
# Loops | Per-thread | maqao lprof -dl -dt xp=/beegfs/hackathon/users/eoseret/qaas_runs/170-854-8685/intel/CloverLeafCXX/run/oneview_runs/compilers/gcc_6/oneview_results_1708556066/tools/lprof_npsu_run_0 #
#########################################################################################################################################################################################################################