Demo Taylor-Green vortex (snek5000-tgv solver)#
Snek5000 repository contains a simple example solver for the Taylor-Green vortex flow. We are going to show how it can be used on a very small and short simulation.
Run a simulation by executing a script#
We will run the simulation by executing the script docs/examples/scripts/tuto_tgv.py, which contains:
from snek5000_tgv.solver import Simul
params = Simul.create_default_params()
params.output.sub_directory = "examples_snek/tuto"
params.oper.nx = params.oper.ny = params.oper.nz = 8
params.oper.elem.order = params.oper.elem.order_out = 8
params.oper.nproc_min = 2
params.nek.velocity.residual_tol = 1e-07
params.nek.pressure.residual_tol = 1e-05
params.nek.general.end_time = 10
params.nek.general.dt = -1
params.nek.general.target_cfl = 1.4
params.nek.general.extrapolation = "OIFS"
params.nek.general.write_control = "runTime"
params.nek.general.write_interval = 2.0
params.output.spatial_means.write_interval = 0.5
sim = Simul(params)
sim.make.exec("run_fg", nproc=2)
In normal life, we would just execute this script with something like
python tuto_tgv.py.
command = "python3 examples/scripts/tuto_tgv.py"
However, in this notebook, we need a bit more code. How we execute this command is very specific to these tutorials written as notebooks so you can just look at the output of this cell.
Show code cell source
from subprocess import run, PIPE, STDOUT
from time import perf_counter
print("Running the script tuto_tgv.py... (It can take few minutes.)")
t_start = perf_counter()
process = run(
command.split(), check=True, text=True, stdout=PIPE, stderr=STDOUT
)
print(f"Script executed in {perf_counter() - t_start:.2f} s")
lines = process.stdout.split("\n")
Running the script tuto_tgv.py... (It can take few minutes.)
Script executed in 180.88 s
The simulation is done! We are going to look at its output (which is now in a variable
lines). However, be prepared to get something long because Nek5000 is very verbose.
For readability of this tutorial, the output is hidden by default (click to show it).
Let us first look at the first lines, until the beginning of the time stepping:
index_step2 = 0
for line in lines:
if line.startswith("Step 2, t= "):
break
index_step2 += 1
print("\n".join(lines[:index_step2+20]))
Show code cell output
INFO: session_id: 0
INFO: Writing params files... /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/tgv.par, params_simul.xml, info_solver.xml
INFO: sim: <class 'snek5000_tgv.solver.SimulTGV'>
sim.oper: <class 'snek5000.operators.Operators'>
sim.output.print_stdout: <class 'snek5000.output.print_stdout.PrintStdOut'>
sim.output.phys_fields: <class 'snek5000.output.phys_fields.PhysFields'>
sim.output.history_points: <class 'snek5000.output.history_points.HistoryPoints'>
sim.output.remaining_clock_time: <class 'snek5000.output.remaining_clock_time.RemainingClockTime'>
sim.output.spatial_means: <class 'snek5000.output.spatial_means.SpatialMeans'>
sim.output: <class 'snek5000_tgv.output.OutputTGV'>
sim.make: <class 'snek5000.make.Make'>
INFO: Writing box file... /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/tgv.box
INFO: Writing SIZE file... /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/SIZE
Changing to shadow directory: /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52
Building DAG of jobs...
Using shell: /usr/bin/bash
Provided cores: 1 (use --cores to define parallelism)
Rules claiming more threads will be scaled down.
Job stats:
job count
-------------------------- -------
compile 1
internal_generate_box 1
internal_generate_makefile 1
internal_generate_map 1
internal_generate_session 1
internal_move_box 1
run_fg 1
total 7
Select jobs to execute...
[Sun Mar 3 01:33:52 2024]
rule internal_generate_box:
input: tgv.box, /home/docs/Nek5000/bin/genbox
output: box.re2
jobid: 2
reason: Missing output files: box.re2
resources: tmpdir=/tmp
input file name:
-3 spatial dimension (dim<0 will create box.re2)
2 number of fields
T T F 2 2.0000000000000000
1 i1#
1 i1#
1 i1#
1 i1#
1 i1#
1 i1#
1 i1#
1 i1#
1 i1#
1 i1#
1 i1#
1 i1#
1 i1#
1 i1#
1 i1#
1 i1#
1 i1#
1 i1#
Box
-8 -8 -8 nelx nely nelz
Reading 512 = 8 8 8 elements for box 1.
Reading 2 =
0.0000 6.2832 1.0000 x0 x1 ratio
0.0000 6.2832 1.0000 y0 y1 ratio
0.0000 6.2832 1.0000 z0 z1 ratio
P ,P ,P ,P ,P ,P Velocity BCs
Beginning construction of box.re2
512 elements will be created for 1 boxes.
[Sun Mar 3 01:33:52 2024]
Finished job 2.
1 of 7 steps (14%) done
Select jobs to execute...
[Sun Mar 3 01:33:52 2024]
rule internal_move_box:
input: box.re2
output: tgv.re2
jobid: 1
reason: Missing output files: tgv.re2; Input files updated by another job: box.re2
resources: tmpdir=/tmp
[Sun Mar 3 01:33:52 2024]
Finished job 1.
2 of 7 steps (29%) done
Select jobs to execute...
[Sun Mar 3 01:33:52 2024]
rule internal_generate_map:
input: tgv.re2, /home/docs/Nek5000/bin/genmap
output: tgv.ma2
jobid: 3
reason: Missing output files: tgv.ma2; Input files updated by another job: tgv.re2
resources: tmpdir=/tmp, tolerance=0.01
Input .rea / .re2 name:
reading tgv.re2
Input mesh tolerance (default 0.2):
NOTE: smaller is better, but generous is more forgiving for bad meshes.
reading mesh data ...
start locglob_lexico: 8 512 4096 1.0000000000000000E-002
locglob: 1 1 4096
locglob: 2 9 4096
locglob: 3 81 4096
locglob: 1 729 4096
locglob: 2 729 4096
locglob: 3 729 4096
locglob: 1 729 4096
locglob: 2 729 4096
locglob: 3 729 4096
done locglob_lexico: 729 729 4096 8
start periodic vtx: 512 729
1 1 5 3 0.00000000E+00 1 shift
1 3 5 3 0.00000000E+00 2 shift
1 5 5 3 0.00000000E+00 3 shift
done: 93.8%
done: 94.7%
done: 95.7%
done: 96.7%
done: 97.7%
done: 98.6%
done: 99.6%
done rec_bisect
writing tgv.ma2
[Sun Mar 3 01:33:52 2024]
Finished job 3.
3 of 7 steps (43%) done
Select jobs to execute...
[Sun Mar 3 01:33:52 2024]
rule internal_generate_makefile:
input: tgv.re2, tgv.ma2, tgv.usr, /home/docs/Nek5000/bin/nekconfig
output: makefile, .state
jobid: 6
reason: Missing output files: makefile; Input files updated by another job: tgv.ma2, tgv.re2
resources: tmpdir=/tmp
generating makefile ... done
[Sun Mar 3 01:33:53 2024]
Finished job 6.
4 of 7 steps (57%) done
Select jobs to execute...
[Sun Mar 3 01:33:53 2024]
rule internal_generate_session:
input: tgv.re2, tgv.ma2, tgv.par
output: SESSION.NAME
jobid: 4
reason: Missing output files: SESSION.NAME; Input files updated by another job: tgv.ma2, tgv.re2
resources: tmpdir=/tmp
Building DAG of jobs...
Using shell: /usr/bin/bash
Provided cores: 1 (use --cores to define parallelism)
Rules claiming more threads will be scaled down.
Select jobs to execute...
[Sun Mar 3 01:33:54 2024]
Finished job 4.
5 of 7 steps (71%) done
Select jobs to execute...
[Sun Mar 3 01:33:54 2024]
rule compile:
input: SIZE, tgv.usr, makefile_usr.inc, makefile, /home/docs/Nek5000/3rd_party/gslib/lib/libgs.a, /home/docs/Nek5000/3rd_party/blasLapack/libblasLapack.a
output: nek5000
jobid: 5
reason: Missing output files: nek5000; Input files updated by another job: makefile
resources: tmpdir=/tmp
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/drive1.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/drive1.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/drive2.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/drive2.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/plan5.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/plan5.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/plan4.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/plan4.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/bdry.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/bdry.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/coef.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/coef.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/conduct.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/conduct.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/connect1.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/connect1.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/connect2.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/connect2.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/dssum.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/dssum.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/eigsolv.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/eigsolv.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/gauss.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/gauss.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/genxyz.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/genxyz.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/navier1.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/navier1.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/makeq.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/makeq.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/navier0.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/navier0.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/navier2.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/navier2.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/navier3.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/navier3.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/navier4.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/navier4.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/prepost.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/prepost.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/speclib.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/speclib.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/map2.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/map2.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/mvmesh.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/mvmesh.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/ic.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/ic.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/gfldr.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/gfldr.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/ssolv.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/ssolv.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/planx.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/planx.o
mpif77 -c -O3 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/math.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/math.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/mxm_wrapper.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/mxm_wrapper.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/hmholtz.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/hmholtz.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/subs1.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/subs1.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/subs2.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/subs2.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/gmres.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/gmres.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/hsmg.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/hsmg.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/convect.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/convect.o
mpif77 -c -O0 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/convect2.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/convect2.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/induct.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/induct.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/perturb.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/perturb.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/navier5.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/navier5.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/navier6.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/navier6.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/navier7.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/navier7.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/navier8.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/navier8.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/fast3d.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/fast3d.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/fasts.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/fasts.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/calcz.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/calcz.o
mpicc -c -O2 -march=native -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/byte.c -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/byte.o
mpicc -c -O2 -march=native -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/chelpers.c -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/chelpers.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/byte_mpi.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/byte_mpi.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/postpro.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/postpro.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/interp.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/interp.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/cvode_driver.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/cvode_driver.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/multimesh.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/multimesh.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/vprops.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/vprops.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/makeq_aux.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/makeq_aux.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/papi.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/papi.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/3rd_party/nek_in_situ.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/nek_in_situ.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/reader_rea.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/reader_rea.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/reader_par.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/reader_par.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/reader_re2.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/reader_re2.o
mpicc -c -O2 -march=native -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/3rd_party/finiparser.c -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/finiparser.o
mpicc -c -O2 -march=native -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/3rd_party/iniparser.c -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/iniparser.o
mpicc -c -O2 -march=native -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/3rd_party/dictionary.c -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/dictionary.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/hpf.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/hpf.o
mpicc -c -O2 -march=native -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj -I/home/docs/Nek5000/3rd_party/gslib/include /home/docs/Nek5000/core/fcrs.c -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/fcrs.o
mpicc -c -O2 -march=native -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj -I/home/docs/Nek5000/3rd_party/gslib/include /home/docs/Nek5000/core/crs_xxt.c -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/crs_xxt.o
mpicc -c -O2 -march=native -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj -I/home/docs/Nek5000/3rd_party/gslib/include /home/docs/Nek5000/core/crs_amg.c -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/crs_amg.o
mpicc -c -O2 -march=native -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj -I/home/docs/Nek5000/3rd_party/gslib/include /home/docs/Nek5000/core/experimental/fem_amg_preco.c -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/fem_amg_preco.o
mpicc -c -O2 -march=native -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj -I/home/docs/Nek5000/3rd_party/gslib/include /home/docs/Nek5000/core/experimental/crs_hypre.c -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/crs_hypre.o
mpicc -c -O2 -march=native -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj -I/home/docs/Nek5000/3rd_party/gslib/include /home/docs/Nek5000/core/partitioner.c -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/partitioner.o
mpif77 -c -O3 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/mxm_std.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/mxm_std.o
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/comm_mpi.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/comm_mpi.o
mpif77 -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj -c /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/tgv.f -o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/tgv.o
done
mpif77 -c -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj /home/docs/Nek5000/core/drive.f
mpif77 -O2 -cpp -fdefault-real-8 -fdefault-double-8 -w -std=legacy -march=native -mcmodel=medium -std=legacy -w -DMPI -DUNDERSCORE -DGLOBAL_LONG_LONG -DTIMER -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52 -I/home/docs/Nek5000/core -I./ -I/home/docs/Nek5000/core/experimental -I/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj -o nek5000 drive.o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/tgv.o /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/obj/libnek5000.a -L/home/docs/Nek5000/3rd_party/blasLapack -lblasLapack -L/home/docs/Nek5000/3rd_party/gslib/lib -lgs -Wl,--allow-multiple-definition
#############################################################
# Compilation successful! #
#############################################################
text data bss dec hex filename
1741447 38356 727962240 729742043 2b7efadb nek5000
[Sun Mar 3 01:34:30 2024]
Finished job 5.
6 of 7 steps (86%) done
Select jobs to execute...
[Sun Mar 3 01:34:30 2024]
rule run_fg:
input: tgv.re2, tgv.ma2, tgv.par, SESSION.NAME, nek5000
output: logs/run_2024-03-03T01-33-52.log
jobid: 0
reason: Missing output files: logs/run_2024-03-03T01-33-52.log; Input files updated by another job: tgv.ma2, nek5000, SESSION.NAME, tgv.re2
resources: tmpdir=/tmp, nproc=2
Log file:
/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52/logs/run_2024-03-03T01-33-52.log
/----------------------------------------------------------\\
| _ __ ______ __ __ ______ ____ ____ ____ |
| / | / // ____// //_/ / ____/ / __ \\/ __ \\/ __ \\ |
| / |/ // __/ / ,< /___ \\ / / / // / / // / / / |
| / /| // /___ / /| | ____/ / / /_/ // /_/ // /_/ / |
| /_/ |_//_____//_/ |_|/_____/ \\___/ \\___/ \\___/ |
| |
|----------------------------------------------------------|
| |
| COPYRIGHT (c) 2008-2020 UCHICAGO ARGONNE, LLC |
| Version: 20.0-dev |
| Web: https://nek5000.mcs.anl.gov |
| |
\\----------------------------------------------------------/
Number of MPI ranks : 2
Reading ./session_00/tgv.par
general = [(null)]
general:stopat = [endTime]
general:endtime = [10]
general:dt = [-1]
general:timestepper = [bdf2]
general:extrapolation = [OIFS]
general:targetcfl = [1.4]
general:writecontrol = [runTime]
general:writeinterval = [2.0]
general:numsteps = [1]
general:variabledt = [yes]
general:filtering = [none]
general:filtermodes = [2]
general:filtercutoffratio = [0.65]
general:filterweight = [12.0]
general:writedoubleprecision = [yes]
general:dealiasing = [yes]
general:optlevel = [2]
general:loglevel = [2]
general:userparam01 = [6.283185307179586]
general:userparam10 = [100]
general:userparam11 = [0.5]
general:userparam12 = [5.0]
problemtype = [(null)]
problemtype:equation = [incompNS]
problemtype:variableproperties = [no]
problemtype:stressformulation = [no]
pressure = [(null)]
pressure:residualtol = [1e-05]
pressure:residualproj = [yes]
pressure:writetofieldfile = [yes]
pressure:preconditioner = [semg_xxt]
velocity = [(null)]
velocity:residualtol = [1e-07]
velocity:density = [1]
velocity:viscosity = [-1600]
velocity:residualproj = [no]
velocity:writetofieldfile = [yes]
reading ./session_00/tgv.re2
hdr:#v002 512 3 512 hdr
partioning elements to MPI ranks
reading mesh
readp_re2_mesh:pack/cr/unpack : 0.50E-04 0.80E-04 0.17E-04
readp_re2_mesh:byte_read_mpi : 0.57E-04
reading boundary faces 384 for ifield 1
readp_re2_bc:pack/cr/unpack : 0.58E-05 0.13E-04 0.89E-05
readp_re2_bc:byte_read_mpi : 0.12E-04
done :: read .re2 file 0.46E-02 sec
Reading ./session_00/tgv.ma2
done :: partioning 0.51361E-02 sec
reading mesh
readp_re2_mesh:pack/cr/unpack : 0.93E-05 0.12E-03 0.15E-04
readp_re2_mesh:byte_read_mpi : 0.19E-04
reading boundary faces 384 for ifield 1
readp_re2_bc:pack/cr/unpack : 0.41E-05 0.19E-04 0.91E-05
readp_re2_bc:byte_read_mpi : 0.64E-05
done :: read .re2 file 0.11E-02 sec
nelgt/nelgv/lelt: 512 512 256
lx1/lx2/lx3/lxd: 8 8 8 12
RK4 substeps: 1
setup mesh topology
Right-handed check complete for 512 elements. OK.
setvert3d: 8 65024 175616 65024 65024
gs_setup: 6272 unique labels shared
pairwise times (avg, min, max): 9.96485e-06 9.9635e-06 9.9662e-06
crystal router : 1.21824e-05 1.21788e-05 1.21861e-05
all reduce : 2.60398e-05 2.60267e-05 2.60529e-05
used all_to_all method: pairwise
handle bytes (avg, min, max): 968444 968444 968444
buffer bytes (avg, min, max): 100352 100352 100352
setupds time 2.8384E-02 seconds 0 8 65024 512
nElements max/min/bal: 256 256 1.00
nMessages max/min/avg: 1 1 1.00
msgSize max/min/avg: 6272 6272 6272.00
msgSizeSum max/min/avg: 6272 6272 6272.00
max multiplicity 8
done :: setup mesh topology
call usrdat
done :: usrdat
generate geometry data
done :: generate geometry data
call usrdat2
done :: usrdat2
8.8818E-16 8.8818E-16 8.8818E-16 8.8818E-16 8.8818E-16 8.8818E-16 xyz repair 1
0.0000E+00 0.0000E+00 0.0000E+00 0.0000E+00 0.0000E+00 0.0000E+00 xyz repair 2
0.0000E+00 0.0000E+00 0.0000E+00 0.0000E+00 0.0000E+00 0.0000E+00 xyz repair 3
0.0000E+00 0.0000E+00 0.0000E+00 0.0000E+00 0.0000E+00 0.0000E+00 xyz repair 4
regenerate geometry data 1
done :: regenerate geometry data 1
verify mesh topology
0.0000000000000000 6.2831999999999999 Xrange
0.0000000000000000 6.2831999999999999 Yrange
0.0000000000000000 6.2831999999999999 Zrange
done :: verify mesh topology
mesh metrics:
GLL grid spacing min/max : 5.04E-02 1.64E-01
scaled Jacobian min/max/avg: 1.00E+00 1.00E+00 1.00E+00
aspect ratio min/max/avg: 1.00E+00 1.00E+00 1.00E+00
IFTRAN = T
IFFLOW = T
IFHEAT = F
IFSPLIT = T
IFLOMACH = F
IFUSERVP = F
IFUSERMV = F
IFPERT = F
IFADJ = F
IFSTRS = F
IFCHAR = T
IFCYCLIC = F
IFAXIS = F
IFMVBD = F
IFMELT = F
IFNEKNEK = F
IFNEKNEKC = F
IFSYNC = F
IFVCOR = T
IFINTQ = F
IFGEOM = F
IFSURT = F
IFWCNO = F
IFTMSH for field 1 = F
IFADVC for field 1 = T
IFNONL for field 1 = F
Dealiasing enabled, nxd= 12
Estimated eigenvalues
EIGAA = 0.24999883078660279
EIGGA = 6344.2205330389206
EIGAE = 0.24999883078660282
EIGAS = 8.3333333333333343E-002
EIGGE = 6344.2205330389206
EIGGS = 2.0000000000000000
initialize pressure solver
mg_nx: 1 3 7
mg_ny: 1 3 7
mg_nz: 1 3 7
gs_setup: 128 unique labels shared
pairwise times (avg, min, max): 1.84095e-06 1.8156e-06 1.8663e-06
crystal router : 1.18065e-06 1.1426e-06 1.2187e-06
all reduce : 1.87225e-06 1.8599e-06 1.8846e-06
used all_to_all method: crystal router
handle bytes (avg, min, max): 28564 28564 28564
buffer bytes (avg, min, max): 4096 4096 4096
setupds time 9.8938E-04 seconds 1 2 512 512
setvert3d: 4 9728 13824 9728 9728
gs_setup: 1152 unique labels shared
pairwise times (avg, min, max): 7.07975e-06 7.0365e-06 7.123e-06
crystal router : 6.4813e-06 6.444e-06 6.5186e-06
all reduce : 9.43805e-06 9.4167e-06 9.4594e-06
used all_to_all method: crystal router
handle bytes (avg, min, max): 233364 233364 233364
buffer bytes (avg, min, max): 36864 36864 36864
setupds time 7.1886E-03 seconds 2 4 9728 512
setvert3d: 4 9728 13824 9728 9728
gs_setup: 1152 unique labels shared
pairwise times (avg, min, max): 5.31605e-06 5.2881e-06 5.344e-06
crystal router : 4.93325e-06 4.9223e-06 4.9442e-06
all reduce : 8.9894e-06 8.9242e-06 9.0546e-06
used all_to_all method: crystal router
handle bytes (avg, min, max): 233364 233364 233364
buffer bytes (avg, min, max): 36864 36864 36864
setupds time 6.5872E-03 seconds 3 4 9728 512
setvert3d: 6 31232 64000 31232 31232
gs_setup: 3200 unique labels shared
pairwise times (avg, min, max): 8.4066e-06 8.406e-06 8.4072e-06
crystal router : 8.2957e-06 8.2718e-06 8.3196e-06
all reduce : 1.7697e-05 1.76408e-05 1.77531e-05
used all_to_all method: crystal router
handle bytes (avg, min, max): 647060 647060 647060
buffer bytes (avg, min, max): 102400 102400 102400
setupds time 1.4100E-02 seconds 4 6 31232 512
regenerate geometry data 1
done :: regenerate geometry data 1
h1_mg_nx: 1 3 7
h1_mg_ny: 1 3 7
h1_mg_nz: 1 3 7
gs_setup: 128 unique labels shared
pairwise times (avg, min, max): 1.9284e-06 1.9079e-06 1.9489e-06
crystal router : 1.78e-06 1.7762e-06 1.7838e-06
all reduce : 2.05465e-06 2.0403e-06 2.069e-06
used all_to_all method: crystal router
handle bytes (avg, min, max): 28564 28564 28564
buffer bytes (avg, min, max): 4096 4096 4096
setupds time 9.7612E-04 seconds 5 2 512 512
setvert3d: 4 9728 13824 9728 9728
gs_setup: 1152 unique labels shared
pairwise times (avg, min, max): 1.07586e-05 1.06986e-05 1.08187e-05
crystal router : 7.4614e-06 7.4399e-06 7.4829e-06
all reduce : 9.24585e-06 9.1766e-06 9.3151e-06
used all_to_all method: crystal router
handle bytes (avg, min, max): 233364 233364 233364
buffer bytes (avg, min, max): 36864 36864 36864
setupds time 7.6294E-03 seconds 6 4 9728 512
setvert3d: 4 9728 13824 9728 9728
gs_setup: 1152 unique labels shared
pairwise times (avg, min, max): 5.78715e-06 5.7716e-06 5.8027e-06
crystal router : 7.81625e-06 7.8061e-06 7.8264e-06
all reduce : 1.00746e-05 1.00691e-05 1.00801e-05
used all_to_all method: pairwise
handle bytes (avg, min, max): 177916 177916 177916
buffer bytes (avg, min, max): 18432 18432 18432
setupds time 6.5691E-03 seconds 7 4 9728 512
setvert3d: 6 31232 64000 31232 31232
gs_setup: 3200 unique labels shared
pairwise times (avg, min, max): 9.70315e-06 9.6698e-06 9.7365e-06
crystal router : 7.0944e-06 7.0922e-06 7.0966e-06
all reduce : 1.86714e-05 1.8634e-05 1.87089e-05
used all_to_all method: crystal router
handle bytes (avg, min, max): 647060 647060 647060
buffer bytes (avg, min, max): 102400 102400 102400
setupds time 1.2873E-02 seconds 8 6 31232 512
setvert3d: 8 65024 175616 65024 65024
gs_setup: 6272 unique labels shared
pairwise times (avg, min, max): 1.25389e-05 1.25386e-05 1.25391e-05
crystal router : 1.45643e-05 1.44538e-05 1.46748e-05
all reduce : 2.62303e-05 2.62113e-05 2.62493e-05
used all_to_all method: pairwise
handle bytes (avg, min, max): 968444 968444 968444
buffer bytes (avg, min, max): 100352 100352 100352
setupds time 2.6377E-02 seconds 9 8 65024 512
setvert3d: 10 111104 373248 111104 111104
gs_setup: 10368 unique labels shared
pairwise times (avg, min, max): 1.36187e-05 1.35949e-05 1.36426e-05
crystal router : 1.51012e-05 1.51006e-05 1.51017e-05
all reduce : 3.75871e-05 3.7564e-05 3.76102e-05
used all_to_all method: pairwise
handle bytes (avg, min, max): 1.60332e+06 1603324 1603324
buffer bytes (avg, min, max): 165888 165888 165888
setupds time 4.4861E-02 seconds 10 10 111104 512
setup h1 coarse grid, nx_crs= 2
gs_setup: 128 unique labels shared
pairwise times (avg, min, max): 1.7985e-06 1.7914e-06 1.8056e-06
crystal router : 1.4715e-06 1.456e-06 1.487e-06
all reduce : 2.0682e-06 2.0678e-06 2.0686e-06
used all_to_all method: crystal router
handle bytes (avg, min, max): 28564 28564 28564
buffer bytes (avg, min, max): 4096 4096 4096
done :: setup h1 coarse grid 4.7112118000000036E-002 sec
call usrdat3
done :: usrdat3
set initial conditions
nekuic (1) for ifld 1
call nekuic for vel
xyz min 0.0000 0.0000 0.0000
uvwpt min -1.0000 -1.0000 0.0000 0.0000 0.0000
xyz max 6.2832 6.2832 6.2832
uvwpt max 1.0000 1.0000 0.0000 0.0000 0.0000
done :: set initial conditions
call userchk
done :: userchk
gridpoints unique/tot: 175616 262144
dofs vel/pr: 175616 175616
Initialization successfully completed 0.76147 sec
Starting time loop ...
DT/DTCFL/DTFS/DTINIT 0.705E-01 0.705E-01 0.000E+00 0.100E+01
Step 1, t= 7.0514701E-02, DT= 7.0514701E-02, C= 1.400 0.0000E+00 0.0000E+00
Solving for fluid
1 1.00000E-05 2.52360E-02 2.90119E-02 8.69851E-01 1 Divergence
2 1.00000E-05 1.96682E-02 2.90119E-02 6.77936E-01 1 Divergence
3 1.00000E-05 4.90290E-03 2.90119E-02 1.68996E-01 1 Divergence
4 1.00000E-05 9.83124E-04 2.90119E-02 3.38870E-02 1 Divergence
5 1.00000E-05 2.97185E-04 2.90119E-02 1.02436E-02 1 Divergence
6 1.00000E-05 8.08661E-05 2.90119E-02 2.78735E-03 1 Divergence
7 1.00000E-05 1.99279E-05 2.90119E-02 6.86889E-04 1 Divergence
8 1.00000E-05 5.84148E-06 2.90119E-02 2.01348E-04 1 Divergence
1 PRES gmres 8 5.8415E-06 2.9012E-02 1.0000E-05 1.1050E-01 1.8455E-01 F
1 Hmholtz VELX 1 6.2719E-02 6.2500E-04 1.0000E-07 1.4181E+01 F
1 Hmholtz VELX 2 1.4356E-03 6.2500E-04 1.0000E-07 1.4181E+01 F
1 Hmholtz VELX 3 4.5884E-05 6.2500E-04 1.0000E-07 1.4181E+01 F
1 Hmholtz VELX 4 1.9981E-06 6.2500E-04 1.0000E-07 1.4181E+01 F
1 Hmholtz VELX 5 7.6937E-08 6.2500E-04 1.0000E-07 1.4181E+01 F
1 Hmholtz VELX 4 7.6937E-08 6.2719E-02 1.0000E-07
1 Hmholtz VELY 1 6.2719E-02 6.2500E-04 1.0000E-07 1.4181E+01 F
1 Hmholtz VELY 2 1.4356E-03 6.2500E-04 1.0000E-07 1.4181E+01 F
1 Hmholtz VELY 3 4.5884E-05 6.2500E-04 1.0000E-07 1.4181E+01 F
1 Hmholtz VELY 4 1.9981E-06 6.2500E-04 1.0000E-07 1.4181E+01 F
1 Hmholtz VELY 5 7.6937E-08 6.2500E-04 1.0000E-07 1.4181E+01 F
1 Hmholtz VELY 4 7.6937E-08 6.2719E-02 1.0000E-07
1 Hmholtz VELZ 1 8.8340E-02 6.2500E-04 1.0000E-07 1.4181E+01 F
1 Hmholtz VELZ 2 2.0220E-03 6.2500E-04 1.0000E-07 1.4181E+01 F
1 Hmholtz VELZ 3 6.4629E-05 6.2500E-04 1.0000E-07 1.4181E+01 F
1 Hmholtz VELZ 4 2.8144E-06 6.2500E-04 1.0000E-07 1.4181E+01 F
1 Hmholtz VELZ 5 1.0837E-07 6.2500E-04 1.0000E-07 1.4181E+01 F
1 Hmholtz VELZ 6 6.2106E-09 6.2500E-04 1.0000E-07 1.4181E+01 F
1 Hmholtz VELZ 5 6.2106E-09 8.8340E-02 1.0000E-07
L1/L2 DIV(V) -5.4386E-19 1.1544E-05
L1/L2 QTL 0.0000E+00 0.0000E+00
L1/L2 DIV(V)-QTL -5.4386E-19 1.1544E-05
1 Fluid done 7.0515E-02 3.8628E-01
Step 2, t= 1.4102940E-01, DT= 7.0514701E-02, C= 1.398 7.0724E-01 7.0724E-01
Solving for fluid
2 PRES gmres 5 3.1277E-06 3.7775E-04 1.0000E-05 6.5103E-02 1.0237E-01 F
2 Hmholtz VELX 4 2.5189E-08 9.3788E-02 1.0000E-07
2 Hmholtz VELY 4 2.5189E-08 9.3788E-02 1.0000E-07
2 Hmholtz VELZ 4 3.5489E-08 1.3213E-01 1.0000E-07
L1/L2 DIV(V) 9.0707E-20 5.2770E-06
L1/L2 QTL 0.0000E+00 0.0000E+00
L1/L2 DIV(V)-QTL 9.0707E-20 5.2770E-06
2 Fluid done 1.4103E-01 2.8651E-01
Step 3, t= 2.1154410E-01, DT= 7.0514701E-02, C= 1.397 1.4366E+00 7.2936E-01
Solving for fluid
3 PRES gmres 5 4.3838E-06 4.8295E-04 1.0000E-05 6.4524E-02 1.0221E-01 F
3 Hmholtz VELX 4 2.5213E-08 9.3874E-02 1.0000E-07
3 Hmholtz VELY 4 2.5213E-08 9.3874E-02 1.0000E-07
3 Hmholtz VELZ 4 3.5424E-08 1.3187E-01 1.0000E-07
L1/L2 DIV(V) -8.4517E-19 5.8739E-06
L1/L2 QTL 0.0000E+00 0.0000E+00
L1/L2 DIV(V)-QTL -8.4517E-19 5.8739E-06
3 Fluid done 2.1154E-01 2.8902E-01
And then at the last lines, from the end of the time stepping:
index_final_step = 0
for line in lines[::-1]:
if line.startswith(" Final time step ="):
break
index_final_step -= 1
print("\n".join(lines[index_final_step-10:]))
Show code cell output
189 PRES gmres 6 5.1840E-06 2.0008E-02 1.0000E-05 7.8100E-02 1.2333E-01 F
189 Hmholtz VELX 4 4.6718E-08 4.8531E-01 1.0000E-07
189 Hmholtz VELY 4 4.6718E-08 4.8531E-01 1.0000E-07
189 Hmholtz VELZ 4 4.8170E-08 5.2882E-01 1.0000E-07
L1/L2 DIV(V) 5.3692E-17 2.2517E-01
L1/L2 QTL 0.0000E+00 0.0000E+00
L1/L2 DIV(V)-QTL 5.3692E-17 2.2517E-01
WARNING: DIV(V)-QTL too large!
189 Fluid done 9.9932E+00 3.3050E-01
Final time step = 6.7923831005973767E-003
Solving for fluid
190 Project PRES 3.1354E+00 1.1510E+01 3.6709E+00 8 8
190 PRES gmres 8 6.3968E-06 1.9908E-01 1.0000E-05 1.0386E-01 1.6595E-01 F
190 Hmholtz VELX 3 1.5445E-08 3.9761E-01 1.0000E-07
190 Hmholtz VELY 3 1.5445E-08 3.9761E-01 1.0000E-07
190 Hmholtz VELZ 3 1.5898E-08 4.3548E-01 1.0000E-07
L1/L2 DIV(V) 5.1398E-17 1.8640E-01
L1/L2 QTL 0.0000E+00 0.0000E+00
L1/L2 DIV(V)-QTL 5.1398E-17 1.8640E-01
WARNING: DIV(V)-QTL too large!
190 Fluid done 1.0000E+01 3.5829E-01
190 1.0000E+01 Write checkpoint
FILE:./session_00/tgv0.f00005
min/max: 0.0000 6.2832 0.0000 6.2832 0.0000 6.2832
min/max: -0.93992 0.93937 -0.93992 0.93936 -1.2602 1.2630
min/max: -0.59962 0.65044
190 1.0000E+01 done :: Write checkpoint
file size = 147.E-04GB
avg data-throughput = 0.8GB/s
io-nodes = 2
end of time-step loop
runtime statistics:
init time 0.76146971099999994 5.4258094162313690E-003
prep time 5 9.5607027999989214E-002 6.8124247791681071E-004
pres time 190 33.370703949999992 0.23778106614430961
crsl time 821 9.0065086000208794E-002 6.4175368321855812E-004
crsl min 8.8620734999977913E-002
crsl max 9.0065086000208794E-002
crsl avg 8.9342910500093353E-002
hmhz time 570 34.513508001000034 0.24592405186160149
eslv time 0 0.0000000000000000 0.0000000000000000
makf time 73.238881704999969 0.52185951489440696
makq time 0.0000000000000000 0.0000000000000000
proj time 7.0413369250001949 5.0172648548753238E-002
usvp time 192 6.5687823999944106E-002 4.6805487971752786E-004
usfq time 0 1.6934381300000232 1.2066497746171507E-002
usbc time 379 1.0722771019999835 7.6404499257105652E-003
usbc min 1.0722771019999835
usbc max 1.1453379279999913
usb avg 1.1088075149999874
uchk time 0.19701114100016071 1.4037917575701944E-003
mltd time 570 1.3958683150000497 9.9461808367927139E-003
cdtp time 570 0.78938923999987320 5.6247484431630095E-003
axhm time 5625 16.724424042999960 0.11916893888581144
advc time 190 70.644605949000010 0.50337414952548110
mxmf time 0.0000000000000000 0.0000000000000000
adc3 time 0.0000000000000000 0.0000000000000000
col2 time 0.0000000000000000 0.0000000000000000
col3 time 0.0000000000000000 0.0000000000000000
a2s2 time 0.0000000000000000 0.0000000000000000
add2 time 0.0000000000000000 0.0000000000000000
invc time 0.0000000000000000 0.0000000000000000
tgop time 17009 0.55964198499859652 3.9876973542862298E-003
dadd time 0 2.0546754389999364 1.4640473787965519E-002
vdss time 571 0.71082678899997154 5.0649561359447882E-003
vdss min 0.68669531699995479
vdss max 0.71082678899997154
vdss avg 0.69876105299996316
dsum time 5700 2.4023498100001306 1.7117807881107370E-002
dsum min 2.3742500080004576
dsum max 2.4023498100001306
dsum avg 2.3882999090002941
ddsl time 0 0.0000000000000000 0.0000000000000000
# nid tusbc tdadd tcrsl tvdss tdsum tgop qqq F
0 1.0723E+00 2.0547E+00 9.0065E-02 7.1083E-01 2.4023E+00 5.5964E-01 qqq
1 1.1453E+00 2.0362E+00 8.8621E-02 6.8670E-01 2.3743E+00 5.1599E-01 qqq
run successful: dying ...
total elapsed time : 1.41213E+02 sec
total solver time w/o IO : 1.40247E+02 sec
time/timestep : 7.38140E-01 sec
avg throughput per timestep : 1.18959E+05 gridpts/CPUs
total max memory usage : 6.06777E-01 GB
/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52
[Sun Mar 3 01:36:52 2024]
Finished job 0.
7 of 7 steps (100%) done
Complete log: .snakemake/log/2024-03-03T013352.640375.snakemake.log
path_run: /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52
To “load the simulation”, i.e. to recreate a simulation object, we now need to extract from the output the path of the directory of the simulation. This is also very specific to these tutorials, so you don’t need to focus on this code. In real life, we can just read the log to know where the data has been saved.
Show code cell source
path_run = None
for line in lines:
if "path_run: " in line:
path_run = line.split("path_run: ")[1].split(" ", 1)[0]
break
if path_run is None:
raise RuntimeError
path_run
'/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52'
Load the simulation#
We can now load the simulation and process the output.
from snek5000 import load
sim = load(path_run)
path_run: /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52
INFO: session_id: 0
INFO: sim: <class 'snek5000_tgv.solver.SimulTGV'>
sim.oper: <class 'snek5000.operators.Operators'>
sim.output.print_stdout: <class 'snek5000.output.print_stdout.PrintStdOut'>
sim.output.phys_fields: <class 'snek5000.output.phys_fields.PhysFields'>
sim.output.history_points: <class 'snek5000.output.history_points.HistoryPoints'>
sim.output.remaining_clock_time: <class 'snek5000.output.remaining_clock_time.RemainingClockTime'>
sim.output.spatial_means: <class 'snek5000.output.spatial_means.SpatialMeans'>
sim.output: <class 'snek5000_tgv.output.OutputTGV'>
sim.make: <class 'snek5000.make.Make'>
Quickly start IPython and load a simulation
The command snek-ipy-load can be used to start a IPython session and load the
simulation saved in the current directory.
How long was the run?#
snek5000-tgv saves a file remaining_clock_time.csv during the simulation. It can be
read manually,
!cat {path_run}/remaining_clock_time.csv
it,equation_times,dt,delta_clock_times,remaining_equation_times,remaining_clock_times
0, 0.0000000 , 1.0000000 , 0.0000000 ,nan,nan
1,0.70514701E-01,0.70514701E-01, 1.5210940 , 9.9294853 , 214.19194
2,0.14102940 ,0.70514701E-01,0.77408500 , 9.8589706 , 108.22823
14,0.98720582 ,0.70514701E-01, 8.3727760 , 9.0127942 , 89.180111
22, 1.5513234 ,0.70514701E-01, 5.4918560 , 8.4486766 , 82.250429
42, 2.9251711 ,0.58365917E-01, 13.914927 , 7.0748289 , 71.656946
57, 3.8006598 ,0.58365917E-01, 10.617672 , 6.1993402 , 75.183788
83, 5.3181737 ,0.58365917E-01, 18.706479 , 4.6818263 , 57.713138
105, 6.4715776 ,0.23906679E-01, 16.434880 , 3.5284224 , 50.276576
136, 7.6317721 ,0.39466172E-01, 23.363227 , 2.3682279 , 47.689800
165, 8.7990565 ,0.46070645E-01, 21.827921 , 1.2009435 , 22.457338
190, 10.000000 ,0.67923831E-02, 19.174349 , 0.0000000 , 0.0000000
and there is also an object sim.output.remaining_clock_time to load and plot these
data (which is especially useful during the simulation!):
sim.output.remaining_clock_time.plot()
Mean clock time per time step: 0.802 s
Parse, load and plot information contained in the Nek5000 log#
The object sim.output.print_stdout (see
snek5000.output.print_stdout.PrintStdOut) contains utilities to represent
information contained in the Nek5000 log. For example, one can do:
log_data = sim.output.print_stdout.load()
log_data
| t | dt | CFL | pres_it | pres_div | pres_div0 | pres_tol | pres_etime | pres_etime1 | |
|---|---|---|---|---|---|---|---|---|---|
| it | |||||||||
| 1.0 | 0.070515 | 0.070515 | 1.400 | 8.0 | 0.000006 | 0.029012 | 0.00001 | 0.110500 | 0.18455 |
| 2.0 | 0.141029 | 0.070515 | 1.398 | 5.0 | 0.000003 | 0.000378 | 0.00001 | 0.065103 | 0.10237 |
| 3.0 | 0.211544 | 0.070515 | 1.397 | 5.0 | 0.000004 | 0.000483 | 0.00001 | 0.064524 | 0.10221 |
| 4.0 | 0.282059 | 0.070515 | 1.395 | 5.0 | 0.000005 | 0.000541 | 0.00001 | 0.064426 | 0.10287 |
| 5.0 | 0.352574 | 0.070515 | 1.392 | 5.0 | 0.000005 | 0.000606 | 0.00001 | 0.064687 | 0.10234 |
| ... | ... | ... | ... | ... | ... | ... | ... | ... | ... |
| 185.0 | 9.794182 | 0.055285 | 1.502 | 6.0 | 0.000003 | 0.008834 | 0.00001 | 0.077778 | 0.12306 |
| 186.0 | 9.849467 | 0.055285 | 1.513 | 6.0 | 0.000003 | 0.007422 | 0.00001 | 0.080019 | 0.12823 |
| 187.0 | 9.904752 | 0.055285 | 1.459 | 5.0 | 0.000008 | 0.006278 | 0.00001 | 0.065953 | 0.10362 |
| 188.0 | 9.948980 | 0.044228 | 1.491 | 7.0 | 0.000003 | 0.032300 | 0.00001 | 0.093591 | 0.14810 |
| 189.0 | 9.993208 | 0.044228 | 1.441 | 6.0 | 0.000005 | 0.020008 | 0.00001 | 0.078100 | 0.12333 |
189 rows × 9 columns
and plot useful figures with
sim.output.print_stdout.plot_dt_cfl()
and
sim.output.print_stdout.plot_nb_iterations()
Visualize spatial means data#
In subroutine userchk of tgv.usr.f, the time stamp, kinetic energy and enstrophy are
output in a file spatial_means.csv. The data can be loaded with
df = sim.output.spatial_means.load()
df.head()
| time | energy | enstrophy | |
|---|---|---|---|
| 0 | 0.070515 | 0.124773 | 0.374512 |
| 1 | 0.564118 | 0.124451 | 0.385976 |
| 2 | 1.057721 | 0.124221 | 0.419261 |
| 3 | 1.551323 | 0.123958 | 0.479489 |
| 4 | 2.044926 | 0.123637 | 0.574664 |
Reference data#
import pandas as pd
ref = pd.read_csv(
"examples/snek5000-tgv/ref_data_spectral_code.csv",
sep=" ",
names=("time", "ref:energy", "ref:dE/dt", "ref:enstrophy"),
comment="#"
)
ref.head()
| time | ref:energy | ref:dE/dt | ref:enstrophy | |
|---|---|---|---|---|
| 0 | 0.00 | 0.125000 | 0.000469 | 0.375000 |
| 1 | 0.01 | 0.124995 | 0.000469 | 0.374990 |
| 2 | 0.02 | 0.124991 | 0.000469 | 0.374987 |
| 3 | 0.03 | 0.124986 | 0.000469 | 0.374993 |
| 4 | 0.04 | 0.124981 | 0.000469 | 0.375006 |
Result#
sim.output.spatial_means.plot(logy=True, colormap="Accent")
import matplotlib.pyplot as plt
ax = plt.gca()
ref.plot(
"time",
["ref:energy", "ref:enstrophy"],
ax=ax,
style="--",
logy=True,
colormap="Accent"
)
ax.set(
title=f"Taylor-Green vortex: evolution of K.E. and enstrophy. Re={-sim.params.nek.velocity.viscosity}"
)
ax.figure.tight_layout()
/tmp/ipykernel_3665/149631164.py:17: UserWarning: The figure layout has changed to tight
ax.figure.tight_layout()
Restart to run further#
We see that our first simulation was clearly too short. We can use the command line tool
snek-restart (see the How to page dedicated to restart) to
continue the simulation from the last saved file (--use-start-from -1):
print("Running the restart command...")
t_start = perf_counter()
lines = !snek-restart {sim.path_run} --use-start-from -1 --add-to-end-time 4
print(f"Command executed in {perf_counter() - t_start:.2f} s")
Running the restart command...
Command executed in 52.76 s
Let’s look at the end of the output of this command:
print("\n".join(lines[-120:]))
Show code cell output
61 PRES gmres 4 9.0073E-06 2.0465E-03 1.0000E-05 5.7395E-02 8.4113E-02 F
61 Hmholtz VELX 5 7.9906E-09 2.0020E-01 1.0000E-07
61 Hmholtz VELY 5 7.9906E-09 2.0020E-01 1.0000E-07
61 Hmholtz VELZ 5 9.7927E-09 1.9874E-01 1.0000E-07
L1/L2 DIV(V) -3.0953E-18 1.6627E-01
L1/L2 QTL 0.0000E+00 0.0000E+00
L1/L2 DIV(V)-QTL -3.0953E-18 1.6627E-01
WARNING: DIV(V)-QTL too large!
61 Fluid done 1.3864E+01 3.0689E-01
Step 62, t= 1.3965261E+01, DT= 1.0147541E-01, C= 1.300 4.6884E+01 7.4631E-01
Solving for fluid
62 Project PRES 1.4125E-01 6.1215E-01 4.3339E+00 8 8
62 PRES gmres 5 8.7856E-06 8.9682E-03 1.0000E-05 7.0670E-02 1.0509E-01 F
62 Hmholtz VELX 5 1.5474E-08 2.0425E-01 1.0000E-07
62 Hmholtz VELY 5 1.5474E-08 2.0425E-01 1.0000E-07
62 Hmholtz VELZ 5 1.9796E-08 2.0334E-01 1.0000E-07
L1/L2 DIV(V) -1.3456E-17 1.6877E-01
L1/L2 QTL 0.0000E+00 0.0000E+00
L1/L2 DIV(V)-QTL -1.3456E-17 1.6877E-01
WARNING: DIV(V)-QTL too large!
62 Fluid done 1.3965E+01 3.3112E-01
Final time step = 3.4738634134200197E-002
Solving for fluid
63 Project PRES 3.1862E-01 1.4639E+00 4.5943E+00 8 8
63 PRES gmres 6 7.3972E-06 2.0230E-02 1.0000E-05 8.6551E-02 1.2906E-01 F
63 Hmholtz VELX 4 1.0404E-08 1.6432E-01 1.0000E-07
63 Hmholtz VELY 4 1.0404E-08 1.6432E-01 1.0000E-07
63 Hmholtz VELZ 4 1.2799E-08 1.6366E-01 1.0000E-07
L1/L2 DIV(V) -1.5297E-17 1.5004E-01
L1/L2 QTL 0.0000E+00 0.0000E+00
L1/L2 DIV(V)-QTL -1.5297E-17 1.5004E-01
WARNING: DIV(V)-QTL too large!
63 Fluid done 1.4000E+01 3.3904E-01
63 1.4000E+01 Write checkpoint
FILE:./session_01/tgv0.f00002
min/max: 0.0000 6.2832 0.0000 6.2832 0.0000 6.2832
min/max: -0.71934 0.71884 -0.71965 0.71915 -0.69198 0.68791
min/max: -0.99884E-01 0.20793
63 1.4000E+01 done :: Write checkpoint
file size = 147.E-04GB
avg data-throughput = 0.2GB/s
io-nodes = 4
end of time-step loop
runtime statistics:
init time 0.96424160100000000 1.9894029813158597E-002
prep time 2 0.13044893800000779 2.6913950393507571E-003
pres time 63 12.381580025999988 0.25545415372640901
crsl time 336 6.6415069999955278E-002 1.3702617489764635E-003
crsl min 6.6415069999955278E-002
crsl max 0.21100498299998804
crsl avg 0.13859421824996687
hmhz time 189 13.371128162999964 0.27587030266524026
eslv time 0 0.0000000000000000 0.0000000000000000
makf time 24.009893323000011 0.49536706680478487
makq time 0.0000000000000000 0.0000000000000000
proj time 2.1231762370000169 4.3804925356532319E-002
usvp time 65 1.1857975999989057E-002 2.4465126564011567E-004
usfq time 0 0.31570739800000691 6.5136086034177070E-003
usbc time 125 0.69276932600001606 1.4293070959387186E-002
usbc min 0.64857676499999162
usbc max 0.72918527500001651
usb avg 0.68414521100000081
uchk time 5.9897491999990393E-002 1.2357924511299293E-003
mltd time 189 0.25109800700000240 5.1806012436117176E-003
cdtp time 189 0.13285430300003820 2.7410220238871081E-003
axhm time 2055 3.2249713520000629 6.6536930326107802E-002
advc time 63 23.381398338000004 0.48240009052410604
mxmf time 0.0000000000000000 0.0000000000000000
adc3 time 0.0000000000000000 0.0000000000000000
col2 time 0.0000000000000000 0.0000000000000000
col3 time 0.0000000000000000 0.0000000000000000
a2s2 time 0.0000000000000000 0.0000000000000000
add2 time 0.0000000000000000 0.0000000000000000
invc time 0.0000000000000000 0.0000000000000000
tgop time 6137 5.7801322809998954 0.11925447294843725
dadd time 0 2.3695868390001706 4.8888817046525285E-002
vdss time 190 0.91671176500000429 1.8913404238180470E-002
vdss min 0.89785370199999304
vdss max 0.94013468299998548
vdss avg 0.91955217349999985
dsum time 2154 2.6341021569999992 5.4346241427373709E-002
dsum min 2.6341021569999992
dsum max 3.0994805799999403
dsum avg 2.8908911872499954
ddsl time 0 0.0000000000000000 0.0000000000000000
# nid tusbc tdadd tcrsl tvdss tdsum tgop qqq F
0 6.9277E-01 2.3696E+00 6.6415E-02 9.1671E-01 2.6341E+00 5.7801E+00 qqq
1 6.4858E-01 2.4666E+00 1.5473E-01 9.2351E-01 3.0995E+00 5.6279E+00 qqq
2 7.2919E-01 2.3995E+00 1.2223E-01 8.9785E-01 2.7429E+00 5.8864E+00 qqq
3 6.6605E-01 2.4535E+00 2.1100E-01 9.4013E-01 3.0871E+00 5.3677E+00 qqq
run successful: dying ...
total elapsed time : 4.95501E+01 sec
total solver time w/o IO : 4.83384E+01 sec
time/timestep : 7.67277E-01 sec
avg throughput per timestep : 5.72205E+04 gridpts/CPUs
total max memory usage : 6.98827E-01 GB
/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52
[Sun Mar 3 01:37:49 2024]
Finished job 0.
2 of 2 steps (100%) done
Complete log: .snakemake/log/2024-03-03T013657.537693.snakemake.log
Namespace(add_to_end_time=4.0, end_time=None, modify_params=None, nb_mpi_procs=4, new_dir_results=False, num_steps=None, only_check=False, only_init=False, path='/home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52', session_id=None, skip_verify_contents=False, use_checkpoint=None, use_start_from='-1')
path_run: /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52
# To visualize with IPython:
cd /home/docs/Sim_data/examples_snek/tuto/tgv_run_8x8x8_V2pix2pix2pi_2024-03-03_01-33-52; snek-ipy-load
The results of the new simulation were saved in a directory session_01
sorted(p.name for p in sim.path_run.iterdir())
['.snakemake',
'.state',
'SESSION.NAME',
'SIZE',
'Snakefile',
'build.log',
'config_simul.yml',
'info_solver.xml',
'logs',
'makefile',
'makefile_usr.inc',
'map_user_params.json',
'nek5000',
'obj',
'params_simul.xml',
'remaining_clock_time.csv',
'session_00',
'session_01',
'spatial_means.csv',
'tgv.box',
'tgv.log',
'tgv.ma2',
'tgv.nek5000',
'tgv.par',
'tgv.re2',
'tgv.usr']
which contains:
sorted(p.name for p in (sim.path_run / "session_01").iterdir())
['init_state.restart',
'tgv.ma2',
'tgv.par',
'tgv.re2',
'tgv0.f00001',
'tgv0.f00002']
The log files of the simulations are saved in logs:
paths_log = sorted(sim.path_run.glob("logs/*"))
[p.name for p in paths_log]
['run_2024-03-03T01-33-52.log', 'run_2024-03-03T01-36-57.log']
Let’s get the spatial means data from the second simulation:
df_new = sim.output.spatial_means.load()
df_new = df_new[df_new.time > df.time.max()]
We finally plot the new points!
df_new.plot("time", ["energy", "enstrophy"], ax=ax, logy=True, colormap="Accent", style=".-")
ax.figure
Note that we use for this tutorial very small and coarse simulations, which explain the differences between our results and the reference!
Let us see what gives the remaining_clock_time plot after the second simulation:
sim.output.remaining_clock_time.plot()
Mean clock time per time step: 0.705 s
