Welcome, Guest
Username: Password: Remember me
  • Page:
  • 1
  • 2

TOPIC: running v8p0r0 in parallel

running v8p0r0 in parallel 5 years 10 months ago #32498

  • olslewfoot
  • olslewfoot's Avatar
  • OFFLINE
  • Senior Boarder
  • Posts: 132
  • Thank you received: 3
Hi All
I have just installed and compiled the v8p0r0 version and am running some examples to start.
I'm running the m2_wave examples in telemac2d which is successful in scalar mode but when I specify > zero processor (parallel mode) I get an argument error in run_cas.py.
Can anyone help with solving this please.


... checking the executable
Traceback (most recent call last):
File "/gpfs/home/e088/opentelemac_80/v8p0r0/scripts/python3/runcode.py", line 288, in <module>
main(None)
File "/gpfs/home/e088/opentelemac_80/v8p0r0/scripts/python3/runcode.py", line 271, in main
run_study(cas_file, code_name, options)
File "/gpfs/home/e088/opentelemac_80/v8p0r0/scripts/python3/execution/run_cas.py", line 142, in run_study
run_hpc_cas(my_study, options)
File "/gpfs/home/e088/opentelemac_80/v8p0r0/scripts/python3/execution/run_cas.py", line 115, in run_hpc_cas
my_study.compile_exe(options.bypass)
TypeError: compile_exe() takes 1 positional argument but 2 were given
The administrator has disabled public write access.

running v8p0r0 in parallel 5 years 10 months ago #32499

  • yugi
  • yugi's Avatar
  • OFFLINE
  • openTELEMAC Guru
  • Posts: 851
  • Thank you received: 244
Could you post the command you used ?
There are 10 types of people in the world: those who understand binary, and those who don't.
The administrator has disabled public write access.

running v8p0r0 in parallel 5 years 10 months ago #32500

  • olslewfoot
  • olslewfoot's Avatar
  • OFFLINE
  • Senior Boarder
  • Posts: 132
  • Thank you received: 3
I used:
../v8p0r0/scripts/python3/runcode.py -c submpi telemac2d -s t2d_m2wave.cas

where submpi is the configuration 3 in HPC clusters and changed the cas to PARALLEL PROCESSORS=1
The administrator has disabled public write access.

running v8p0r0 in parallel 5 years 10 months ago #32510

  • yugi
  • yugi's Avatar
  • OFFLINE
  • openTELEMAC Guru
  • Posts: 851
  • Thank you received: 244
Hi,

Can you try by adding --ncsize=1 to your command.
That should solve the issue.
I think in my modifications i am not reading the number of parallel processor from the steering file anymore.
The python3 part is still evolving.
There are 10 types of people in the world: those who understand binary, and those who don't.
The administrator has disabled public write access.

running v8p0r0 in parallel 5 years 10 months ago #32511

  • olslewfoot
  • olslewfoot's Avatar
  • OFFLINE
  • Senior Boarder
  • Posts: 132
  • Thank you received: 3
I've tried with:

../v8p0r0/scripts/python3/runcode.py -c submpi --ncsize=1 telemac2d -s t2d_m2wave.cas and I get the same error.
The administrator has disabled public write access.

running v8p0r0 in parallel 5 years 10 months ago #32512

  • yugi
  • yugi's Avatar
  • OFFLINE
  • openTELEMAC Guru
  • Posts: 851
  • Thank you received: 244
I just tried and I do not have the error.
What version of python3 are you using ?
Could you post you configuration file as well ?
There are 10 types of people in the world: those who understand binary, and those who don't.
The administrator has disabled public write access.

running v8p0r0 in parallel 5 years 10 months ago #32514

  • olslewfoot
  • olslewfoot's Avatar
  • OFFLINE
  • Senior Boarder
  • Posts: 132
  • Thank you received: 3
Yugi

I'm using python 3.5.5 which is loaded with python anaconda 4.2.
I also have an earlier version of anaconda available (2.4.0) with python 3.5.

Attached is the config file.

Thanks
John
Attachments:
The administrator has disabled public write access.

running v8p0r0 in parallel 5 years 10 months ago #32527

  • yugi
  • yugi's Avatar
  • OFFLINE
  • openTELEMAC Guru
  • Posts: 851
  • Thank you received: 244
You can try adding "options: hpc" in the submpi part.
There are 10 types of people in the world: those who understand binary, and those who don't.
The administrator has disabled public write access.

running v8p0r0 in parallel 5 years 9 months ago #32668

  • olslewfoot
  • olslewfoot's Avatar
  • OFFLINE
  • Senior Boarder
  • Posts: 132
  • Thank you received: 3
Hi Yugi
I am still having difficulty getting the parallel runs to work.
but I still have problems getting the full compilation of the system - the APi compilation fails. I have three configs, one for scaler interactive jobs, and two for parallel through the queue - one of them without the merge (as per supplied configurations 1,3 and 4)

The compilation errors through python traceback are attached in file -
for 1: an KeyError in 'libs_all'

for 2 and 3: Missing keyword pyd_fcompiler in configuration file.

Could you possibly suggest the fixes for these please?

John
Attachments:
The administrator has disabled public write access.

running v8p0r0 in parallel 5 years 9 months ago #32671

  • yugi
  • yugi's Avatar
  • OFFLINE
  • openTELEMAC Guru
  • Posts: 851
  • Thank you received: 244
Fr the first one: had libs_all: (under general in your .cfg file)

As for 2 and 3 you are missing keywords mandatory for compiling the api in python3.
Below is what i use for our configuration:
f2py_name: f2py3
pyd_fcompiler: gfortran
There are 10 types of people in the world: those who understand binary, and those who don't.
The administrator has disabled public write access.
  • Page:
  • 1
  • 2
Moderators: borisb

The open TELEMAC-MASCARET template for Joomla!2.5, the HTML 4 version.