|
Welcome,
Guest
|
TOPIC: Simulation terminated after few hours
Simulation terminated after few hours 6 years 13 hours ago #32118
|
Hi,
I'm trying to run telemac 3D simulation on the cluster using 20 processor. After 15 hours of simulation, it stopped with no obvious reasons. I've tried that couple of times and it kept terminating around same time (14-17 hours of simulation). When I run the telemac 2D for the same mesh and same number of processors, it works fine. The problem is only when I run telemac 3D. Any thoughts? Thanks, Mohammed |
|
The administrator has disabled public write access.
|
Simulation terminated after few hours 6 years 12 hours ago #32119
|
Start: Mon 19 Nov 11:20:47 GMT 2018
Loading Options and Configurations
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
_ _ _
| | (_) (_)
_ _ _ __ | | __ _ __ ___ __ __ _ __ _ __ ___ __ __ _ ___ _ ___ _ __
| | | || '_ \ | |/ /| '_ \ / _ \ \ \ /\ / /| '_ \ | '__| / _ \\ \ / /| |/ __|| | / _ \ | '_ \
| |_| || | | || < | | | || (_) | \ V V / | | | | | | | __/ \ V / | |\__ \| || (_) || | | |
\__,_||_| |_||_|\_\|_| |_| \___/ \_/\_/ |_| |_| |_| \___| \_/ |_||___/|_| \___/ |_| |_|
... parsing configuration file: /opt/telemac/v7p3r1//configs/systel.gfort.cfg
Running your CAS file for:
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
+> configuration: gfortranHPC
+> Gfortran compiler 4.9.2 with open_mpi for a debian 8
+> root: /opt/telemac/v7p3r1
+> directory /home/ma211/OWHS/T/
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
... reading the main module dictionary
... processing the main CAS file(s)
+> running in English
... handling temporary directories
... checking coupling between codes
... checking parallelisation
... first pass at updating all input files
copying: gridES /home/ma211/OWHS/T/T3DBDD
copying: uv.ES2008.out /home/ma211/OWHS/T/T3DBB2
copying: OWHS_3D.cas /home/ma211/OWHS/T/T3DCAS
copying: HSnTEC.slf /home/ma211/OWHS/T/T3DGEO
copying: hf.ES2008.out /home/ma211/OWHS/T/T3DBB1
copying: HSnTEC.cli /home/ma211/OWHS/T/T3DCLI
copying: telemac3d.dico /home/ma211/OWHS/T/T3DDICO
... modifying run command to MPI instruction
... modifying run command to PARTEL instruction
... partitioning base files (geo, conlim, sections, zones and weirs)
+> /opt/telemac/v7p3r1/builds/gfortranHPC/bin/partel < PARTEL.PAR >> partel_T3DGEO.log
STOP 0
... splitting / copying other input files
duplicating: T3DBDD
duplicating: T3DBB2
duplicating: T3DBB1
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
... Your simulation is almost ready for launch. You need to compile your executable with the option -x (--compileonly)
My work is done
Loading Options and Configurations
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
_ _ _
| | (_) (_)
_ _ _ __ | | __ _ __ ___ __ __ _ __ _ __ ___ __ __ _ ___ _ ___ _ __
| | | || '_ \ | |/ /| '_ \ / _ \ \ \ /\ / /| '_ \ | '__| / _ \\ \ / /| |/ __|| | / _ \ | '_ \
| |_| || | | || < | | | || (_) | \ V V / | | | | | | | __/ \ V / | |\__ \| || (_) || | | |
\__,_||_| |_||_|\_\|_| |_| \___/ \_/\_/ |_| |_| |_| \___| \_/ |_||___/|_| \___/ |_| |_|
... parsing configuration file: /opt/telemac/v7p3r1//configs/systel.gfort.cfg
Running your CAS file for:
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
+> configuration: gfortranHPC
+> Gfortran compiler 4.9.2 with open_mpi for a debian 8
+> root: /opt/telemac/v7p3r1
+> directory /home/ma211/OWHS/T/
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
... reading the main module dictionary
... processing the main CAS file(s)
+> running in English
... handling temporary directories
... checking coupling between codes
... checking parallelisation
... checking the executable
copying: telemac3d /home/ma211/OWHS/T/out_telemac3d
... modifying run command to MPI instruction
... handling sortie file(s)
Running your simulation(s) :
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
mpirun --prefix /usr/lib64/openmpi -np 20 /home/ma211/OWHS/T/out_telemac3d
node18.21986hfi_wait_for_device: The /dev/hfi1_0 device failed to appear after 15.0 seconds: Connection timed out
node18.21996hfi_wait_for_device: The /dev/hfi1_0 device failed to appear after 15.0 seconds: Connection timed out
node18.21992hfi_wait_for_device: The /dev/hfi1_0 device failed to appear after 15.0 seconds: Connection timed out
node18.21988hfi_wait_for_device: The /dev/hfi1_0 device failed to appear after 15.0 seconds: Connection timed out
node18.22000hfi_wait_for_device: The /dev/hfi1_0 device failed to appear after 15.0 seconds: Connection timed out
node18.22005hfi_wait_for_device: The /dev/hfi1_0 device failed to appear after 15.0 seconds: Connection timed out
node18.21990hfi_wait_for_device: The /dev/hfi1_0 device failed to appear after 15.0 seconds: Connection timed out
node18.21991hfi_wait_for_device: The /dev/hfi1_0 device failed to appear after 15.0 seconds: Connection timed out
node18.21998hfi_wait_for_device: The /dev/hfi1_0 device failed to appear after 15.0 seconds: Connection timed out
node18.21989hfi_wait_for_device: The /dev/hfi1_0 device failed to appear after 15.0 seconds: Connection timed out
node18.21994hfi_wait_for_device: The /dev/hfi1_0 device failed to appear after 15.0 seconds: Connection timed out
node18.22003hfi_wait_for_device: The /dev/hfi1_0 device failed to appear after 15.0 seconds: Connection timed out
node18.21987hfi_wait_for_device: The /dev/hfi1_0 device failed to appear after 15.0 seconds: Connection timed out
node18.22010hfi_wait_for_device: The /dev/hfi1_0 device failed to appear after 15.0 seconds: Connection timed out
node18.22015hfi_wait_for_device: The /dev/hfi1_0 device failed to appear after 15.0 seconds: Connection timed out
node18.22016hfi_wait_for_device: The /dev/hfi1_0 device failed to appear after 15.0 seconds: Connection timed out
node18.22011hfi_wait_for_device: The /dev/hfi1_0 device failed to appear after 15.0 seconds: Connection timed out
node18.22018hfi_wait_for_device: The /dev/hfi1_0 device failed to appear after 15.0 seconds: Connection timed out
node18.22008hfi_wait_for_device: The /dev/hfi1_0 device failed to appear after 15.0 seconds: Connection timed out
node18.22013hfi_wait_for_device: The /dev/hfi1_0 device failed to appear after 15.0 seconds: Connection timed out
MASTER PROCESSOR NUMBER 0 OF THE GROUP OF 20
EXECUTABLE FILE: /home/ma211/OWHS/T//A.EXE
BARRIER PASSED
LISTING OF TELEMAC3D------------------------------------------------------------------------------
TTTTT EEEEE L EEEEE M M AAAAA CCCCC
T E L E MM MM A A C
T EEE L EEE M M M AAAAA C
T E L E M M A A C
T EEEEE LLLLL EEEEE M M A A CCCCC
3D VERSION V7P3 FORTRAN 2003
~^~^~^~^~^~^~^~^~^~^~^^~^~^~^~^~^~
~ ~
\ ' o '
/\ o \ o
>=)'> ' /\ '
\/ \ >=)'> ~
/ /\ \/
~ >=)'> / .
\/ )
/ (
~ ) )
} ~ ( ( (
{ ) ) )
} } . ( ( (
{ { /^^^^^^^^^^^^
^^^^^^^^^\ /
^^^^^^^^^
********************************************
* LECDON: *
* BEFORE CALLING DAMOCLES *
********************************************
WARNING IN DICTIONARY:
FOR KEYWORD: VARIABLES FOR 3D GRAPHIC PRINTOUTS
THE NUMBER OF DEFAULT VALUES 1 IS DIFFERENT FROM THE DECLARED SIZE 4
WARNING IN DICTIONARY:
FOR KEYWORD: VARIABLES FOR 2D GRAPHIC PRINTOUTS
THE NUMBER OF DEFAULT VALUES 1 IS DIFFERENT FROM THE DECLARED SIZE 4
WARNING IN DICTIONARY:
FOR KEYWORD: SCHEME OPTION FOR ADVECTION OF TRACERS
THE NUMBER OF DEFAULT VALUES 1 IS DIFFERENT FROM THE DECLARED SIZE 2
********************************************
* LECDON: *
* AFTER CALLING DAMOCLES *
* CHECKING OF DATA READ *
* IN THE STEERING FILE *
********************************************
EXITING LECDON. NAME OF THE STUDY:
OW, HS, FW, CB
OPENING FILES FOR TELEMAC3D
- FILE /home/ma211/OWHS/T//T3DGEO00019-00000 OF TYPE BIG_ENDIAN
- FILE /home/ma211/OWHS/T//T3DGEO00019-00000 IS SINGLE PRECISION
POINT_TELEMAC3D: MEMORY ALLOCATION
READ_MESH_INFO: TITLE= HSnTEC
NUMBER OF ELEMENTS: 105325
NUMBER OF POINTS: 53595
FORMAT NOT INDICATED IN TITLE
MXPTEL (BIEF) : MAXIMUM NUMBER OF ELEMENTS AROUND A POINT: 31
MAXIMUM NUMBER OF POINTS AROUND A POINT: 32
(GLOBAL MESH)
SEGBOR (BIEF) : NUMBER OF BOUNDARY SEGMENTS = 1865
INCLUDING THOSE DUE TO DOMAIN DECOMPOSITION
CORRXY (BIEF):NO MODIFICATION OF COORDINATES
MESH: MESH2D ALLOCATED
READ_MESH_INFO: TITLE= HSnTEC
NUMBER OF ELEMENTS: 105325
NUMBER OF POINTS: 53595
FORMAT NOT INDICATED IN TITLE
MXPTEL (BIEF) : MAXIMUM NUMBER OF ELEMENTS AROUND A POINT: 31
MAXIMUM NUMBER OF POINTS AROUND A POINT: 32
(GLOBAL MESH)
SEGBOR (BIEF) : NUMBER OF BOUNDARY SEGMENTS = 1865
INCLUDING THOSE DUE TO DOMAIN DECOMPOSITION
CORRXY (BIEF):NO MODIFICATION OF COORDINATES
MESH: MESH3D ALLOCATED
2D MESH
-------
2D ELEMENT TYPE : 10
NUMBER OF 2D NODES : 53595
NUMBER OF 2D ELEMENTS : 105325
NUMBER OF 2D BOUNDARY NODES : 1429
3D MESH
-------
3D ELEMENT TYPE : 40
NUMBER OF 3D NODES : 375165
NUMBER OF 3D ELEMENTS : 631950
NUMBER OF LEVELS : 7
NUMBER OF BOUNDARY ELEMENTS : 8574
TOTAL NUMBER OF BOUNDARY NODES : 117193
INCLUDING LATERAL BOUNDARIES : 10003
SURFACE : 53595
BOTTOM : 53595
END OF MEMORY ALLOCATION
INBIEF (BIEF): NOT A VECTOR MACHINE (ACCORDING TO YOUR DATA)
CHECK: NO ERROR HAS BEEN DETECTED
STRCHE (BIEF): NO MODIFICATION OF FRICTION
NUMBER OF LIQUID BOUNDARIES: 1
INITIALISATION BASED ON TPXO:
C_ID( 1 ) = m2
C_ID( 2 ) = s2
C_ID( 3 ) = n2
C_ID( 4 ) = k2
C_ID( 5 ) = k1
C_ID( 6 ) = o1
C_ID( 7 ) = p1
C_ID( 8 ) = q1
C_ID( 9 ) = m4
C_ID( 10 ) = ms4
C_ID( 11 ) = mn4
- ACQUIRING LEVELS
- INTERPOLATING LEVELS
- ACQUIRING VELOCITIES
- INTERPOLATING VELOCITIES
END OF TPXO INITIALISATION
CONDIM: DYNAMIC PRESSURE INITIALISED TO ZERO
HYDROSTATIC PRESSURE INITIALISED TO ZERO.
================================================================================
ITERATION 0 TIME 0 D 0 H 0 MN 0.0000 S ( 0.0000 S)
================================================================================
--------------------------------------------------------------------------------
MASS BALANCE
INITIAL MASS OF WATER IN THE DOMAIN : 689088593365.42932
USING STREAMLINE VERSION 7.3 FOR CHARACTERISTICS
TELEMAC3D COUPLED WITH: NOTHING
================================================================================
ITERATION 3600 TIME 0 D 1 H 0 MN 0.0000 S ( 3600.0000 S)
================================================================================
--------------------------------------------------------------------------------
ADVECTION STEP
DIFFUSION OF WN
GMRES (BIEF) : 1 ITERATIONS, RELATIVE PRECISION: 0.1087353E-06
--------------------------------------------------------------------------------
PROPAGATION AND DIFFUSION WITH WAVE EQUATION
RESCJG (BIEF) : 25 ITERATIONS, RELATIVE PRECISION: 0.9815893E-06
POSITIVE DEPTHS OBTAINED IN 9 ITERATIONS
--------------------------------------------------------------------------------
DYNAMIC PRESSURE STAGE
GRACJG (BIEF) : 12 ITERATIONS, RELATIVE PRECISION: 0.3465284E-04
--------------------------------------------------------------------------------
VELOCITY PROJECTION STEP
--------------------------------------------------------------------------------
ADVECTION-DIFFUSION OF K-EPSILON OR OMEGA STEP
DIFFUSION OF AKN
GRACJG (BIEF) : 8 ITERATIONS, RELATIVE PRECISION: 0.7985092E-06
DIFFUSION OF EPN
GRACJG (BIEF) : 3 ITERATIONS, RELATIVE PRECISION: 0.2559632E-06
--------------------------------------------------------------------------------
MASS BALANCE
WATER
MASS AT THE PREVIOUS TIME STEP : 0.6906829E+12
MASS AT THE PRESENT TIME STEP : 0.6906833E+12
MASS LEAVING THE DOMAIN DURING THIS TIME STEP : -465801.5
ERROR ON THE MASS DURING THIS TIME STEP : -112.1969
FLUX BOUNDARY 1: 465801.5 M3/S ( >0 : ENTERING <0 : EXITING )
================================================================================
ITERATION 7200 TIME 0 D 2 H 0 MN 0.0000 S ( 7200.0000 S)
================================================================================
--------------------------------------------------------------------------------
ADVECTION STEP
DIFFUSION OF WN
GMRES (BIEF) : 1 ITERATIONS, RELATIVE PRECISION: 0.1030627E-06
--------------------------------------------------------------------------------
PROPAGATION AND DIFFUSION WITH WAVE EQUATION
RESCJG (BIEF) : 19 ITERATIONS, RELATIVE PRECISION: 0.9226245E-06
POSITIVE DEPTHS OBTAINED IN 9 ITERATIONS
--------------------------------------------------------------------------------
DYNAMIC PRESSURE STAGE
GRACJG (BIEF) : 8 ITERATIONS, RELATIVE PRECISION: 0.6031006E-04
--------------------------------------------------------------------------------
VELOCITY PROJECTION STEP
--------------------------------------------------------------------------------
ADVECTION-DIFFUSION OF K-EPSILON OR OMEGA STEP
DIFFUSION OF AKN
GRACJG (BIEF) : 8 ITERATIONS, RELATIVE PRECISION: 0.7597103E-06
DIFFUSION OF EPN
GRACJG (BIEF) : 2 ITERATIONS, RELATIVE PRECISION: 0.2238904E-06
--------------------------------------------------------------------------------
MASS BALANCE
WATER
MASS AT THE PREVIOUS TIME STEP : 0.6923657E+12
MASS AT THE PRESENT TIME STEP : 0.6923662E+12
MASS LEAVING THE DOMAIN DURING THIS TIME STEP : -470754.8
ERROR ON THE MASS DURING THIS TIME STEP : -153.8749
FLUX BOUNDARY 1: 470754.8 M3/S ( >0 : ENTERING <0 : EXITING )
================================================================================
ITERATION 10800 TIME 0 D 3 H 0 MN 0.0000 S ( 10800.0000 S)
================================================================================
--------------------------------------------------------------------------------
ADVECTION STEP
DIFFUSION OF WN
GMRES (BIEF) : 1 ITERATIONS, RELATIVE PRECISION: 0.3591455E-06
--------------------------------------------------------------------------------
PROPAGATION AND DIFFUSION WITH WAVE EQUATION
RESCJG (BIEF) : 19 ITERATIONS, RELATIVE PRECISION: 0.9520225E-06
POSITIVE DEPTHS OBTAINED IN 9 ITERATIONS
--------------------------------------------------------------------------------
DYNAMIC PRESSURE STAGE
GRACJG (BIEF) : 6 ITERATIONS, RELATIVE PRECISION: 0.5118279E-04
--------------------------------------------------------------------------------
VELOCITY PROJECTION STEP
--------------------------------------------------------------------------------
ADVECTION-DIFFUSION OF K-EPSILON OR OMEGA STEP
DIFFUSION OF AKN
GRACJG (BIEF) : 8 ITERATIONS, RELATIVE PRECISION: 0.4175469E-06
DIFFUSION OF EPN
GRACJG (BIEF) : 1 ITERATIONS, RELATIVE PRECISION: 0.1049908E-06
--------------------------------------------------------------------------------
MASS BALANCE
WATER
MASS AT THE PREVIOUS TIME STEP : 0.6936155E+12
MASS AT THE PRESENT TIME STEP : 0.6936157E+12
MASS LEAVING THE DOMAIN DURING THIS TIME STEP : -289073.6
ERROR ON THE MASS DURING THIS TIME STEP : -170.6279
FLUX BOUNDARY 1: 289073.6 M3/S ( >0 : ENTERING <0 : EXITING )
================================================================================
ITERATION 14400 TIME 0 D 4 H 0 MN 0.0000 S ( 14400.0000 S)
================================================================================
--------------------------------------------------------------------------------
ADVECTION STEP
DIFFUSION OF WN
GMRES (BIEF) : 1 ITERATIONS, RELATIVE PRECISION: 0.1052083E-06
--------------------------------------------------------------------------------
PROPAGATION AND DIFFUSION WITH WAVE EQUATION
RESCJG (BIEF) : 18 ITERATIONS, RELATIVE PRECISION: 0.8600260E-06
POSITIVE DEPTHS OBTAINED IN 9 ITERATIONS
--------------------------------------------------------------------------------
DYNAMIC PRESSURE STAGE
GRACJG (BIEF) : 9 ITERATIONS, RELATIVE PRECISION: 0.7247145E-04
--------------------------------------------------------------------------------
VELOCITY PROJECTION STEP
--------------------------------------------------------------------------------
ADVECTION-DIFFUSION OF K-EPSILON OR OMEGA STEP
DIFFUSION OF AKN
GRACJG (BIEF) : 4 ITERATIONS, RELATIVE PRECISION: 0.6608837E-06
DIFFUSION OF EPN
GRACJG (BIEF) : 2 ITERATIONS, RELATIVE PRECISION: 0.7511343E-07
--------------------------------------------------------------------------------
MASS BALANCE
WATER
MASS AT THE PREVIOUS TIME STEP : 0.6944250E+12
MASS AT THE PRESENT TIME STEP : 0.6944250E+12
MASS LEAVING THE DOMAIN DURING THIS TIME STEP : -41713.90
ERROR ON THE MASS DURING THIS TIME STEP : -89.67966
FLUX BOUNDARY 1: 41713.90 M3/S ( >0 : ENTERING <0 : EXITING )
================================================================================
ITERATION 18000 TIME 0 D 5 H 0 MN 0.0000 S ( 18000.0000 S)
================================================================================
--------------------------------------------------------------------------------
ADVECTION STEP
DIFFUSION OF WN
GMRES (BIEF) : 1 ITERATIONS, RELATIVE PRECISION: 0.6943599E-07
--------------------------------------------------------------------------------
PROPAGATION AND DIFFUSION WITH WAVE EQUATION
RESCJG (BIEF) : 14 ITERATIONS, RELATIVE PRECISION: 0.8917654E-06
POSITIVE DEPTHS OBTAINED IN 9 ITERATIONS
--------------------------------------------------------------------------------
DYNAMIC PRESSURE STAGE
GRACJG (BIEF) : 6 ITERATIONS, RELATIVE PRECISION: 0.4928325E-04
--------------------------------------------------------------------------------
VELOCITY PROJECTION STEP
--------------------------------------------------------------------------------
ADVECTION-DIFFUSION OF K-EPSILON OR OMEGA STEP
DIFFUSION OF AKN
GRACJG (BIEF) : 3 ITERATIONS, RELATIVE PRECISION: 0.2677307E-06
DIFFUSION OF EPN
GRACJG (BIEF) : 2 ITERATIONS, RELATIVE PRECISION: 0.2869048E-06
--------------------------------------------------------------------------------
MASS BALANCE
WATER
MASS AT THE PREVIOUS TIME STEP : 0.6941827E+12
MASS AT THE PRESENT TIME STEP : 0.6941825E+12
MASS LEAVING THE DOMAIN DURING THIS TIME STEP : 260537.6
ERROR ON THE MASS DURING THIS TIME STEP : -63.96925
FLUX BOUNDARY 1: -260537.6 M3/S ( >0 : ENTERING <0 : EXITING )
================================================================================
ITERATION 21600 TIME 0 D 6 H 0 MN 0.0000 S ( 21600.0000 S)
================================================================================
--------------------------------------------------------------------------------
ADVECTION STEP
DIFFUSION OF WN
GMRES (BIEF) : 1 ITERATIONS, RELATIVE PRECISION: 0.1172294E-06
--------------------------------------------------------------------------------
PROPAGATION AND DIFFUSION WITH WAVE EQUATION
RESCJG (BIEF) : 20 ITERATIONS, RELATIVE PRECISION: 0.9285801E-06
POSITIVE DEPTHS OBTAINED IN 9 ITERATIONS
--------------------------------------------------------------------------------
DYNAMIC PRESSURE STAGE
GRACJG (BIEF) : 7 ITERATIONS, RELATIVE PRECISION: 0.9042721E-04
--------------------------------------------------------------------------------
VELOCITY PROJECTION STEP
--------------------------------------------------------------------------------
ADVECTION-DIFFUSION OF K-EPSILON OR OMEGA STEP
DIFFUSION OF AKN
GRACJG (BIEF) : 5 ITERATIONS, RELATIVE PRECISION: 0.4026970E-06
DIFFUSION OF EPN
GRACJG (BIEF) : 3 ITERATIONS, RELATIVE PRECISION: 0.2601660E-06
--------------------------------------------------------------------------------
MASS BALANCE
WATER
MASS AT THE PREVIOUS TIME STEP : 0.6931531E+12
MASS AT THE PRESENT TIME STEP : 0.6931528E+12
MASS LEAVING THE DOMAIN DURING THIS TIME STEP : 292912.0
ERROR ON THE MASS DURING THIS TIME STEP : -6.273761
FLUX BOUNDARY 1: -292912.0 M3/S ( >0 : ENTERING <0 : EXITING )
================================================================================
ITERATION 25200 TIME 0 D 7 H 0 MN 0.0000 S ( 25200.0000 S)
================================================================================
--------------------------------------------------------------------------------
ADVECTION STEP
DIFFUSION OF WN
GMRES (BIEF) : 1 ITERATIONS, RELATIVE PRECISION: 0.3692963E-06
--------------------------------------------------------------------------------
PROPAGATION AND DIFFUSION WITH WAVE EQUATION
RESCJG (BIEF) : 17 ITERATIONS, RELATIVE PRECISION: 0.9105419E-06
POSITIVE DEPTHS OBTAINED IN 8 ITERATIONS
--------------------------------------------------------------------------------
DYNAMIC PRESSURE STAGE
GRACJG (BIEF) : 4 ITERATIONS, RELATIVE PRECISION: 0.8614390E-04
--------------------------------------------------------------------------------
VELOCITY PROJECTION STEP
--------------------------------------------------------------------------------
ADVECTION-DIFFUSION OF K-EPSILON OR OMEGA STEP
DIFFUSION OF AKN
GRACJG (BIEF) : 4 ITERATIONS, RELATIVE PRECISION: 0.4587384E-06
DIFFUSION OF EPN
GRACJG (BIEF) : 4 ITERATIONS, RELATIVE PRECISION: 0.9064662E-06
--------------------------------------------------------------------------------
MASS BALANCE
WATER
MASS AT THE PREVIOUS TIME STEP : 0.6923611E+12
MASS AT THE PRESENT TIME STEP : 0.6923605E+12
MASS LEAVING THE DOMAIN DURING THIS TIME STEP : 642511.2
ERROR ON THE MASS DURING THIS TIME STEP : -0.2075188
FLUX BOUNDARY 1: -642511.2 M3/S ( >0 : ENTERING <0 : EXITING )
================================================================================
ITERATION 28800 TIME 0 D 8 H 0 MN 0.0000 S ( 28800.0000 S)
================================================================================
--------------------------------------------------------------------------------
ADVECTION STEP
DIFFUSION OF WN
GMRES (BIEF) : 1 ITERATIONS, RELATIVE PRECISION: 0.2757433E-04
--------------------------------------------------------------------------------
PROPAGATION AND DIFFUSION WITH WAVE EQUATION
RESCJG (BIEF) : 36 ITERATIONS, RELATIVE PRECISION: 0.9969146E-06
POSITIVE DEPTHS OBTAINED IN 8 ITERATIONS
--------------------------------------------------------------------------------
DYNAMIC PRESSURE STAGE
GRACJG (BIEF) : 7 ITERATIONS, RELATIVE PRECISION: 0.8967323E-04
--------------------------------------------------------------------------------
VELOCITY PROJECTION STEP
--------------------------------------------------------------------------------
ADVECTION-DIFFUSION OF K-EPSILON OR OMEGA STEP
DIFFUSION OF AKN
GRACJG (BIEF) : 3 ITERATIONS, RELATIVE PRECISION: 0.6613182E-06
DIFFUSION OF EPN
GRACJG (BIEF) : 3 ITERATIONS, RELATIVE PRECISION: 0.1126646E-06
--------------------------------------------------------------------------------
MASS BALANCE
WATER
MASS AT THE PREVIOUS TIME STEP : 0.6900959E+12
MASS AT THE PRESENT TIME STEP : 0.6900951E+12
MASS LEAVING THE DOMAIN DURING THIS TIME STEP : 724119.1
ERROR ON THE MASS DURING THIS TIME STEP : -113.5737
FLUX BOUNDARY 1: -724119.1 M3/S ( >0 : ENTERING <0 : EXITING )
================================================================================
ITERATION 32400 TIME 0 D 9 H 0 MN 0.0000 S ( 32400.0000 S)
================================================================================
--------------------------------------------------------------------------------
ADVECTION STEP
DIFFUSION OF WN
GMRES (BIEF) : 1 ITERATIONS, RELATIVE PRECISION: 0.4143481E-05
--------------------------------------------------------------------------------
PROPAGATION AND DIFFUSION WITH WAVE EQUATION
RESCJG (BIEF) : 22 ITERATIONS, RELATIVE PRECISION: 0.8315930E-06
POSITIVE DEPTHS OBTAINED IN 8 ITERATIONS
--------------------------------------------------------------------------------
DYNAMIC PRESSURE STAGE
GRACJG (BIEF) : 8 ITERATIONS, RELATIVE PRECISION: 0.4012273E-04
--------------------------------------------------------------------------------
VELOCITY PROJECTION STEP
--------------------------------------------------------------------------------
ADVECTION-DIFFUSION OF K-EPSILON OR OMEGA STEP
DIFFUSION OF AKN
GRACJG (BIEF) : 2 ITERATIONS, RELATIVE PRECISION: 0.7998146E-06
DIFFUSION OF EPN
GRACJG (BIEF) : 2 ITERATIONS, RELATIVE PRECISION: 0.1900147E-06
--------------------------------------------------------------------------------
MASS BALANCE
WATER
MASS AT THE PREVIOUS TIME STEP : 0.6866477E+12
MASS AT THE PRESENT TIME STEP : 0.6866461E+12
MASS LEAVING THE DOMAIN DURING THIS TIME STEP : 1585998.
ERROR ON THE MASS DURING THIS TIME STEP : -90.36762
FLUX BOUNDARY 1: -1585998. M3/S ( >0 : ENTERING <0 : EXITING )
================================================================================
ITERATION 36000 TIME 0 D 10 H 0 MN 0.0000 S ( 36000.0000 S)
================================================================================
--------------------------------------------------------------------------------
ADVECTION STEP
DIFFUSION OF WN
GMRES (BIEF) : 1 ITERATIONS, RELATIVE PRECISION: 0.4931479E-05
--------------------------------------------------------------------------------
PROPAGATION AND DIFFUSION WITH WAVE EQUATION
RESCJG (BIEF) : 34 ITERATIONS, RELATIVE PRECISION: 0.9707662E-06
POSITIVE DEPTHS OBTAINED IN 7 ITERATIONS
--------------------------------------------------------------------------------
DYNAMIC PRESSURE STAGE
GRACJG (BIEF) : 6 ITERATIONS, RELATIVE PRECISION: 0.8906505E-04
--------------------------------------------------------------------------------
VELOCITY PROJECTION STEP
--------------------------------------------------------------------------------
ADVECTION-DIFFUSION OF K-EPSILON OR OMEGA STEP
DIFFUSION OF AKN
GRACJG (BIEF) : 4 ITERATIONS, RELATIVE PRECISION: 0.1143728E-06
DIFFUSION OF EPN
GRACJG (BIEF) : 4 ITERATIONS, RELATIVE PRECISION: 0.2123183E-06
--------------------------------------------------------------------------------
MASS BALANCE
WATER
MASS AT THE PREVIOUS TIME STEP : 0.6834819E+12
MASS AT THE PRESENT TIME STEP : 0.6834814E+12
MASS LEAVING THE DOMAIN DURING THIS TIME STEP : 519903.9
ERROR ON THE MASS DURING THIS TIME STEP : -75.64276
FLUX BOUNDARY 1: -519903.9 M3/S ( >0 : ENTERING <0 : EXITING )
================================================================================
ITERATION 39600 TIME 0 D 11 H 0 MN 0.0000 S ( 39600.0000 S)
================================================================================
--------------------------------------------------------------------------------
ADVECTION STEP
DIFFUSION OF WN
GMRES (BIEF) : 1 ITERATIONS, RELATIVE PRECISION: 0.1365648E-04
--------------------------------------------------------------------------------
PROPAGATION AND DIFFUSION WITH WAVE EQUATION
RESCJG (BIEF) : 41 ITERATIONS, RELATIVE PRECISION: 0.9318405E-06
POSITIVE DEPTHS OBTAINED IN 7 ITERATIONS
--------------------------------------------------------------------------------
DYNAMIC PRESSURE STAGE
GRACJG (BIEF) : 9 ITERATIONS, RELATIVE PRECISION: 0.7586278E-04
--------------------------------------------------------------------------------
VELOCITY PROJECTION STEP
--------------------------------------------------------------------------------
ADVECTION-DIFFUSION OF K-EPSILON OR OMEGA STEP
DIFFUSION OF AKN
GRACJG (BIEF) : 3 ITERATIONS, RELATIVE PRECISION: 0.2127109E-07
DIFFUSION OF EPN
GRACJG (BIEF) : 2 ITERATIONS, RELATIVE PRECISION: 0.2707451E-06
--------------------------------------------------------------------------------
MASS BALANCE
WATER
MASS AT THE PREVIOUS TIME STEP : 0.6861340E+12
MASS AT THE PRESENT TIME STEP : 0.6861344E+12
MASS LEAVING THE DOMAIN DURING THIS TIME STEP : -403428.2
ERROR ON THE MASS DURING THIS TIME STEP : -31.03340
FLUX BOUNDARY 1: 403428.2 M3/S ( >0 : ENTERING <0 : EXITING )
================================================================================
ITERATION 43200 TIME 0 D 12 H 0 MN 0.0000 S ( 43200.0000 S)
================================================================================
--------------------------------------------------------------------------------
ADVECTION STEP
DIFFUSION OF WN
GMRES (BIEF) : 1 ITERATIONS, RELATIVE PRECISION: 0.4877072E-05
--------------------------------------------------------------------------------
PROPAGATION AND DIFFUSION WITH WAVE EQUATION
RESCJG (BIEF) : 38 ITERATIONS, RELATIVE PRECISION: 0.9849749E-06
POSITIVE DEPTHS OBTAINED IN 7 ITERATIONS
--------------------------------------------------------------------------------
DYNAMIC PRESSURE STAGE
GRACJG (BIEF) : 7 ITERATIONS, RELATIVE PRECISION: 0.8908238E-04
--------------------------------------------------------------------------------
VELOCITY PROJECTION STEP
--------------------------------------------------------------------------------
ADVECTION-DIFFUSION OF K-EPSILON OR OMEGA STEP
DIFFUSION OF AKN
GRACJG (BIEF) : 3 ITERATIONS, RELATIVE PRECISION: 0.4080489E-06
DIFFUSION OF EPN
GRACJG (BIEF) : 3 ITERATIONS, RELATIVE PRECISION: 0.1755192E-06
--------------------------------------------------------------------------------
MASS BALANCE
WATER
MASS AT THE PREVIOUS TIME STEP : 0.6882979E+12
MASS AT THE PRESENT TIME STEP : 0.6882986E+12
MASS LEAVING THE DOMAIN DURING THIS TIME STEP : -682183.7
ERROR ON THE MASS DURING THIS TIME STEP : -0.3542436E-02
FLUX BOUNDARY 1: 682183.7 M3/S ( >0 : ENTERING <0 : EXITING )
================================================================================
ITERATION 46800 TIME 0 D 13 H 0 MN 0.0000 S ( 46800.0000 S)
================================================================================
--------------------------------------------------------------------------------
ADVECTION STEP
DIFFUSION OF WN
GMRES (BIEF) : 1 ITERATIONS, RELATIVE PRECISION: 0.4233970E-04
--------------------------------------------------------------------------------
PROPAGATION AND DIFFUSION WITH WAVE EQUATION
RESCJG (BIEF) : 40 ITERATIONS, RELATIVE PRECISION: 0.9019995E-06
POSITIVE DEPTHS OBTAINED IN 8 ITERATIONS
--------------------------------------------------------------------------------
DYNAMIC PRESSURE STAGE
GRACJG (BIEF) : 10 ITERATIONS, RELATIVE PRECISION: 0.8804027E-04
--------------------------------------------------------------------------------
VELOCITY PROJECTION STEP
--------------------------------------------------------------------------------
ADVECTION-DIFFUSION OF K-EPSILON OR OMEGA STEP
DIFFUSION OF AKN
GRACJG (BIEF) : 3 ITERATIONS, RELATIVE PRECISION: 0.5371137E-06
DIFFUSION OF EPN
GRACJG (BIEF) : 3 ITERATIONS, RELATIVE PRECISION: 0.2260894E-06
--------------------------------------------------------------------------------
MASS BALANCE
WATER
MASS AT THE PREVIOUS TIME STEP : 0.6926904E+12
MASS AT THE PRESENT TIME STEP : 0.6926931E+12
MASS LEAVING THE DOMAIN DURING THIS TIME STEP : -2694126.
ERROR ON THE MASS DURING THIS TIME STEP : -51.05462
FLUX BOUNDARY 1: 2694126. M3/S ( >0 : ENTERING <0 : EXITING )
================================================================================
ITERATION 50400 TIME 0 D 14 H 0 MN 0.0000 S ( 50400.0000 S)
================================================================================
--------------------------------------------------------------------------------
ADVECTION STEP
DIFFUSION OF WN
GMRES (BIEF) : 1 ITERATIONS, RELATIVE PRECISION: 0.2059630E-05
--------------------------------------------------------------------------------
PROPAGATION AND DIFFUSION WITH WAVE EQUATION
RESCJG (BIEF) : 13 ITERATIONS, RELATIVE PRECISION: 0.8985409E-06
POSITIVE DEPTHS OBTAINED IN 9 ITERATIONS
--------------------------------------------------------------------------------
DYNAMIC PRESSURE STAGE
GRACJG (BIEF) : 6 ITERATIONS, RELATIVE PRECISION: 0.9125431E-04
--------------------------------------------------------------------------------
VELOCITY PROJECTION STEP
--------------------------------------------------------------------------------
ADVECTION-DIFFUSION OF K-EPSILON OR OMEGA STEP
DIFFUSION OF AKN
GRACJG (BIEF) : 5 ITERATIONS, RELATIVE PRECISION: 0.7859762E-06
DIFFUSION OF EPN
GRACJG (BIEF) : 3 ITERATIONS, RELATIVE PRECISION: 0.2340571E-07
--------------------------------------------------------------------------------
MASS BALANCE
WATER
MASS AT THE PREVIOUS TIME STEP : 0.6939531E+12
MASS AT THE PRESENT TIME STEP : 0.6939533E+12
MASS LEAVING THE DOMAIN DURING THIS TIME STEP : -153212.2
ERROR ON THE MASS DURING THIS TIME STEP : -193.0866
FLUX BOUNDARY 1: 153212.2 M3/S ( >0 : ENTERING <0 : EXITING )
================================================================================
ITERATION 54000 TIME 0 D 15 H 0 MN 0.0000 S ( 54000.0000 S)
================================================================================
--------------------------------------------------------------------------------
ADVECTION STEP
DIFFUSION OF WN
GMRES (BIEF) : 1 ITERATIONS, RELATIVE PRECISION: 0.4794274E-04
--------------------------------------------------------------------------------
PROPAGATION AND DIFFUSION WITH WAVE EQUATION
RESCJG (BIEF) : 39 ITERATIONS, RELATIVE PRECISION: 0.9219177E-06
POSITIVE DEPTHS OBTAINED IN 8 ITERATIONS
--------------------------------------------------------------------------------
DYNAMIC PRESSURE STAGE
GRACJG (BIEF) : 12 ITERATIONS, RELATIVE PRECISION: 0.7497290E-04
--------------------------------------------------------------------------------
VELOCITY PROJECTION STEP
--------------------------------------------------------------------------------
ADVECTION-DIFFUSION OF K-EPSILON OR OMEGA STEP
DIFFUSION OF AKN
GRACJG (BIEF) : 7 ITERATIONS, RELATIVE PRECISION: 0.7999738E-06
DIFFUSION OF EPN
GRACJG (BIEF) : 6 ITERATIONS, RELATIVE PRECISION: 0.4741964E-06
--------------------------------------------------------------------------------
MASS BALANCE
WATER
MASS AT THE PREVIOUS TIME STEP : 0.6948725E+12
MASS AT THE PRESENT TIME STEP : 0.6948731E+12
MASS LEAVING THE DOMAIN DURING THIS TIME STEP : -572510.5
ERROR ON THE MASS DURING THIS TIME STEP : -287.7854
FLUX BOUNDARY 1: 572510.5 M3/S ( >0 : ENTERING <0 : EXITING )
================================================================================
ITERATION 57600 TIME 0 D 16 H 0 MN 0.0000 S ( 57600.0000 S)
================================================================================
--------------------------------------------------------------------------------
ADVECTION STEP
DIFFUSION OF WN
GMRES (BIEF) : 1 ITERATIONS, RELATIVE PRECISION: 0.6003522E-04
--------------------------------------------------------------------------------
PROPAGATION AND DIFFUSION WITH WAVE EQUATION
RESCJG (BIEF) : 39 ITERATIONS, RELATIVE PRECISION: 0.9587425E-06
POSITIVE DEPTHS OBTAINED IN 8 ITERATIONS
--------------------------------------------------------------------------------
DYNAMIC PRESSURE STAGE
GRACJG (BIEF) : 10 ITERATIONS, RELATIVE PRECISION: 0.8079823E-04
--------------------------------------------------------------------------------
VELOCITY PROJECTION STEP
--------------------------------------------------------------------------------
ADVECTION-DIFFUSION OF K-EPSILON OR OMEGA STEP
DIFFUSION OF AKN
GRACJG (BIEF) : 10 ITERATIONS, RELATIVE PRECISION: 0.5327741E-06
DIFFUSION OF EPN
GRACJG (BIEF) : 9 ITERATIONS, RELATIVE PRECISION: 0.2135031E-06
--------------------------------------------------------------------------------
MASS BALANCE
WATER
MASS AT THE PREVIOUS TIME STEP : 0.6971086E+12
MASS AT THE PRESENT TIME STEP : 0.6971082E+12
MASS LEAVING THE DOMAIN DURING THIS TIME STEP : 435789.5
ERROR ON THE MASS DURING THIS TIME STEP : -307.5725
FLUX BOUNDARY 1: -435789.5 M3/S ( >0 : ENTERING <0 : EXITING )
================================================================================
ITERATION 61200 TIME 0 D 17 H 0 MN 0.0000 S ( 61200.0000 S)
================================================================================
--------------------------------------------------------------------------------
ADVECTION STEP
DIFFUSION OF WN
GMRES (BIEF) : 2 ITERATIONS, RELATIVE PRECISION: 0.2988064E-04
--------------------------------------------------------------------------------
PROPAGATION AND DIFFUSION WITH WAVE EQUATION
RESCJG (BIEF) : 44 ITERATIONS, RELATIVE PRECISION: 0.8436051E-06
POSITIVE DEPTHS OBTAINED IN 8 ITERATIONS
--------------------------------------------------------------------------------
DYNAMIC PRESSURE STAGE
GRACJG (BIEF) : 16 ITERATIONS, RELATIVE PRECISION: 0.8593526E-04
--------------------------------------------------------------------------------
VELOCITY PROJECTION STEP
--------------------------------------------------------------------------------
ADVECTION-DIFFUSION OF K-EPSILON OR OMEGA STEP
DIFFUSION OF AKN
GRACJG (BIEF) : 11 ITERATIONS, RELATIVE PRECISION: 0.9873742E-06
DIFFUSION OF EPN
GRACJG (BIEF) : 10 ITERATIONS, RELATIVE PRECISION: 0.4742808E-06
--------------------------------------------------------------------------------
MASS BALANCE
WATER
MASS AT THE PREVIOUS TIME STEP : 0.7015726E+12
MASS AT THE PRESENT TIME STEP : 0.7015752E+12
MASS LEAVING THE DOMAIN DURING THIS TIME STEP : -2607935.
ERROR ON THE MASS DURING THIS TIME STEP : -119.5280
FLUX BOUNDARY 1: 2607935. M3/S ( >0 : ENTERING <0 : EXITING )
--------------------------------------------------------------------------
MPI_ABORT was invoked on rank 15 in communicator MPI_COMM_WORLD
with errorcode 2.
NOTE: invoking MPI_ABORT causes Open MPI to kill all MPI processes.
You may or may not see output from other processes, depending on
exactly when Open MPI kills them.
--------------------------------------------------------------------------
_____________
runcode::main:
:
|runCode: Fail to run
|mpirun --prefix /usr/lib64/openmpi -np 20 /home/ma211/OWHS/T/out_telemac3d
|~~~~~~~~~~~~~~~~~~
|
|~~~~~~~~~~~~~~~~~~
Loading Options and Configurations
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
_ _ _
| | (_) (_)
_ _ _ __ | | __ _ __ ___ __ __ _ __ _ __ ___ __ __ _ ___ _ ___ _ __
| | | || '_ \ | |/ /| '_ \ / _ \ \ \ /\ / /| '_ \ | '__| / _ \\ \ / /| |/ __|| | / _ \ | '_ \
| |_| || | | || < | | | || (_) | \ V V / | | | | | | | __/ \ V / | |\__ \| || (_) || | | |
\__,_||_| |_||_|\_\|_| |_| \___/ \_/\_/ |_| |_| |_| \___| \_/ |_||___/|_| \___/ |_| |_|
... parsing configuration file: /opt/telemac/v7p3r1//configs/systel.gfort.cfg
Running your CAS file for:
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
+> configuration: gfortranHPC
+> Gfortran compiler 4.9.2 with open_mpi for a debian 8
+> root: /opt/telemac/v7p3r1
+> directory /home/ma211/OWHS/T/
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
... reading the main module dictionary
... processing the main CAS file(s)
+> running in English
... handling temporary directories
... checking coupling between codes
... checking parallelisation
... handling sortie file(s)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
... merging separated result files
+> OWHS_3D.cas
collecting: T3DRST
STOP 0
collecting: T3DRES
STOP 0
collecting: T3DHYD
STOP 0
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
... handling result files
+> OWHS_3D.cas
moving: RESTART
moving: HSnTEC_Res3D.slf
moving: HSnTEC_Res2D.slf
My work is done
End: Thu 22 Nov 23:39:42 GMT 2018 |
|
The administrator has disabled public write access.
|
Simulation terminated after few hours 5 years 11 months ago #32135
|
Hi,
Have a look at the PE000-000.log in the temporary folder. I think the one for the processor 15 might contain the error message. |
|
There are 10 types of people in the world: those who understand binary, and those who don't.
The administrator has disabled public write access.
The following user(s) said Thank You: MohdAlaa
|
Moderators: pham
