Welcome, Guest
Username: Password: Remember me

TOPIC: Parallel implemetation

Parallel implemetation 8 years 3 months ago #23290

  • chelobarros
  • chelobarros's Avatar
hi, as always i have a dum question for the more advance users of telemac.
i can seen to set my config sheet properly to enable the parallel settings. it compile whit ut any errors and i can run cases without a problem as long as i dont use the parallel option in the cas file.

im pretty sure is something stupid like i did not put the correct path file to the mpich . since i dont know which one to use openmpi o mpich2. i already install both. could somebody tell where should i change my config setting to properly compile my opentelemac whit parallel options.

by the way i used the debian one but i run ubuntu 14 LTS.

thank you for the time.


kind regards ,
chelo.



File Attachment:

File Name: systel.cis-ubuntu_2016-08-01.cfg
File Size: 5 KB


File Attachment:

File Name: systel.cis-debian.cfg
File Size: 3 KB
The administrator has disabled public write access.

Parallel implemetation 8 years 3 months ago #23293

  • yugi
  • yugi's Avatar
  • OFFLINE
  • openTELEMAC Guru
  • Posts: 851
  • Thank you received: 244
Hi,

First i would suggest remove one of the two MPI installation they usually dont behave weel together. As to which one use there are no real difference for Telemac so which ever you prefer.

As for your configuration file i just change your libraries path.
Try the text below:
libs_partel:      /usr/lib/libmetis.a
libs_all       :    /home/chelobarros/OpenMPI/lib/libmpi.so.12.0.2
By:
libs_all:      /usr/lib/libmetis.a

mpif90 will take care of adding the library path to MPI.

Also be careful that this:
configs:    debgfopenmpi debgfortrans

means that if you do not use either:
- the environement variable USETELCFG=configName
- the option -c configName
Anyone of the configuration can be used when your run runcode.py or compileTELEMAC.py

Hope this helps.
There are 10 types of people in the world: those who understand binary, and those who don't.
The administrator has disabled public write access.
The following user(s) said Thank You: chelobarros

Parallel implemetation 8 years 3 months ago #23312

  • chelobarros
  • chelobarros's Avatar
thank you, i will try it and report back.

Greetings,
Chelo.
The administrator has disabled public write access.

Parallel implemetation 8 years 3 months ago #23332

  • chelobarros
  • chelobarros's Avatar
hi, i tried changing the bin directory and this happened.
"""
parsing configuration file: /home/chelobarros/v7p1r0/configs/systel.cis-debian.cfg


Running your CAS file for:
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

+> configuration: debgfortrans
+> root: /home/chelobarros/v7p1r0


~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~


... reading the main module dictionary

... processing the main CAS file(s)
+> running in English

... handling temporary directories

... checking coupling between codes

... checking parallelisation
_____________
runcode::main:
:
|runCAS: parallel inconsistency:
| +> you may be using an inappropriate configuration: debgfortrans
| +> or may be wishing for scalar mode while setting to 2 processors
"""

also, im really sorry to ask but i did not understand the part of being carefull whit the "configs: debgfopenmpi debgfortrans"

also i tried putting PARALLEL PROCESSORS = 1 , and it run just fine.

thank you for your time.

Grettings
Chelo.


File Attachment:

File Name: systel.cis-debian_2016-08-04.cfg
File Size: 3 KB
The administrator has disabled public write access.

Parallel implemetation 8 years 3 months ago #23334

  • josekdiaz
  • josekdiaz's Avatar
  • OFFLINE
  • Expert Boarder
  • Posts: 161
  • Thank you received: 48
Dear Chelo,

That message means you have several config. to compile or run telemac, and you are using a specific one called "debgfortrans", which, according to your cfg file attached,is for scalar mode processing (no parallel settings at all, only one processor or cpu used).

Like the Mugiwara crew member comment above, I also suspect that you didn't set up an env. variable for SYSTELCFG in your .bashrc file nor passing the argument "-c" with the name of a cfg. profile that has compiled with MPI capabilities.

So let's try this:
  • Check if you have a build with one of the following names (according to your cfg file): debgfopenmpi, debgfopenmpidbg , ubugfmpich2 (or something with mpi or mpich2); under your telemac folder, which I believe is: /home/chelobarros/v7p1r0/builds
  • If you do have a folder like that, when you call runcode.py please add the "-c THAT_FOLDERNAME"
  • If you dont have any of above names in that folder, you need to compile again a new build that has mpi or mpich2 support, if you intend to go parallel.

If that latter one is the case,assuming that you have your installation in "/home/chelobarros/v7p1r0/" I recommend you to:

Edit the bashrc profile of your ubuntu distro (be careful with this please)
gedit ~/.bashrc

Add opentelemac's python scripts to your path, in your case comething like:
export PATH="/home/chelobarros/v7p1r0/scripts/python27":$PATH

Create an alias for the SYSTELCFG (e.g. tele-ompi) (if you plan to use multiple telemacs builds or configs), note that I used the "systel.cis-debian_2016-08-04.cfg" file just as an example :
alias tele-ompi="export SYSTELCFG='/home/chelobarros/v7p1r0/configs/systel.cis-debian_2016-08-04.cfg'"

Save the bashrc file and close it and then relog your session or in the terminal type:
source ~/.bashrc

Try your setup:

This should be written every time you open a new terminal and want to use this cfg, in the example:
tele-ompi

And this should test the open your cfg file, close it after verify is the right one,
gedit $SYSTELCFG

Please take into account that you have in the "systel.cis-debian_2016-08-04.cfg" both "debgfopenmpi" and "debgfortrans", if you don't need the scalar setup, please remove the "debgfortrans" entry here:
# _____                              _______________________________
# ____/ TELEMAC Project Definitions /______________________________/
#
[Configurations]
configs:    debgfopenmpi debgfortrans

And in your terminal start the compilation process,
compileTELEMAC.py

After the compiling process, try an example case like bumpflu
cd /home/chelobarros/v7p1r0/examples/telemac2d/bumpflu
telemac2d.py t2d_bumpflu.cas

And verify it ends with "My work is done" message.

I hope this advice is helpful to you, regards

José D.
The administrator has disabled public write access.
The following user(s) said Thank You: chelobarros

Parallel implemetation 8 years 3 months ago #23337

  • chelobarros
  • chelobarros's Avatar
thank you. i already tried it and this happened.

"""Running your CAS file for:
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

+> configuration: debgfopenmpi
+> root: /home/chelobarros/v7p1r0


~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~


... reading the main module dictionary

... processing the main CAS file(s)
+> running in English

... handling temporary directories

... checking coupling between codes

... checking parallelisation

... first pass at copying all input files
copying: malla_inundacion_SLF_chelo.slf /home/chelobarros/Desktop/borrar/chelo.cas_2016-08-04-11h55min02s/T2DGEO
copying: BOTTOM_BC.cli /home/chelobarros/Desktop/borrar/chelo.cas_2016-08-04-11h55min02s/T2DCLI
re-copying: /home/chelobarros/Desktop/borrar/chelo.cas_2016-08-04-11h55min02s/T2DCAS
copying: telemac2d.dico /home/chelobarros/Desktop/borrar/chelo.cas_2016-08-04-11h55min02s/T2DDICO

... checking the executable
re-copying: telemac2d /home/chelobarros/Desktop/borrar/chelo.cas_2016-08-04-11h55min02s/out_telemac2d

... modifying run command to MPI instruction

... modifying run command to PARTEL instruction

... partitioning base files (geo, conlim, sections and zones)
+> /home/chelobarros/v7p1r0/builds/debgfopenmpi/bin/bin/partel < PARTEL.PAR >> partel_T2DGEO.log
/bin/sh: 1: /home/chelobarros/v7p1r0/builds/debgfopenmpi/bin/bin/partel: not found
runPartition:
|runPARTEL: Could not split your file T2DGEO (runcode=127) with the error as follows:
|
|... The following command failed for the reason above (or below)
|/home/chelobarros/v7p1r0/builds/debgfopenmpi/bin/bin/partel < PARTEL.PAR >> partel_T2DGEO.log
|
| You may have forgotten to compile PARTEL with the appropriate compiler directive
| (add -DHAVE_MPI to your cmd_obj in your configuration file).
|
|Here is the log:


"""
i do have the /home/chelobarros/v7p1r0/builds/debgfopenmpi folder.

i run my code like this
telemac2d.py chelo.cas -c debgfopenmpi



sorry for the trouble. but as you can see i do not have my coding habilities down yet .


grettings,
chelo.
The administrator has disabled public write access.

Parallel implemetation 8 years 3 months ago #23338

  • josekdiaz
  • josekdiaz's Avatar
  • OFFLINE
  • Expert Boarder
  • Posts: 161
  • Thank you received: 48
Dear Chelo,

Clearly there are some compilation issues with the partel command. Try compiling again adding the "clean" in the cfg file in the line:

#
[general]
modules: clean system -dredgesim
#


This will force the compilation of every file even if it already exist in the designated build folder.

Even if you already have a cfg file try creating a new one from scratch that contains only the build that you will use, double checking the paths and proper options (-DHAVE_MPI , using the mpi wrapper for gfortran, the correct include directories...etc).


Regards,

José D.
The administrator has disabled public write access.
The following user(s) said Thank You: chelobarros

Parallel implemetation 8 years 3 months ago #23339

  • chelobarros
  • chelobarros's Avatar
thank you i will.

greetings,
Chelo.
The administrator has disabled public write access.

Parallel implemetation 8 years 4 weeks ago #24104

  • Nemo
  • Nemo's Avatar
Hi Chelo,
did your problem has been solved?
Cause I have exactly the same as yours, I tried all suggestions, but still have the error for the partitioning.

Thank you
Jessie
The administrator has disabled public write access.

Parallel implemetation 8 years 3 weeks ago #24107

  • chelobarros
  • chelobarros's Avatar
hi, i haven’t really need it yet, but next week i will start my simulations so i will try i tell you how it goes.

greetings,
chelo.
The administrator has disabled public write access.
Moderators: borisb

The open TELEMAC-MASCARET template for Joomla!2.5, the HTML 4 version.