Welcome, Guest
Username: Password: Remember me

TOPIC: Parallelisation Partel and boundary files

Parallelisation Partel and boundary files 7 years 11 months ago #24505

  • MarkusR
  • MarkusR's Avatar
  • OFFLINE
  • Junior Boarder
  • Posts: 56
  • Thank you received: 1
Hello together,

I'm trying to test telemac for a very large domain using parallelisation. The domain has in total an amount of 20000000 elements with 10200051 nodes and 400100 nodes on the boundary.
The case worked in scalar mode using only 1 core, as well as for 2,16 and 32 cores in parallel mode. Using 64 nodes it was not possible to start the simulation due to an error message related to the subroutine leclim, responsible to read the boundary file.

The error comes from the module partel, which creates the boundary-files for each subdomain. It seems for me, that partel is not capable to write node ids, which are larger than 7 digits, maybe a result of reaching a defined size of an array? I attached the subboundary file, where the error occours first. In this file at line 6294 the program starts to write ******* instead of numbers and ******* can not be read by leclim of of curse. When i use an even larger domain the same error occurs already when i use 2 or 8 cores parallel.

Does anyone else have observed this error message before or an idea how to work around it? Unfortunately I could not find in the partel source the origin of this problem..

Best regards,
Markus
Attachments:
The administrator has disabled public write access.

Parallelisation Partel and boundary files 7 years 11 months ago #24508

  • yugi
  • yugi's Avatar
  • OFFLINE
  • openTELEMAC Guru
  • Posts: 851
  • Thank you received: 244
Hi,

which version are you using ?

If you are in v7p1 and after there is indeed a hard coded limitation that you can change by editing the file sources/utils/hermes/utils_serafin.F on line 2510

Where the format for the boundary file is written.

Hope it helps.
There are 10 types of people in the world: those who understand binary, and those who don't.
The administrator has disabled public write access.

Parallelisation Partel and boundary files 7 years 11 months ago #24514

  • MarkusR
  • MarkusR's Avatar
  • OFFLINE
  • Junior Boarder
  • Posts: 56
  • Thank you received: 1
Hi,

I'm using v6p3, and there is no hermes/utils_serfain. I have some problems to compile v7p1 on my windows desktop pc for parallel mode, so i could not test it with this version.

However, i checked the subroutine you mentioned but i dont get the idea which variable there is limited?

Best regards,
Markus
The administrator has disabled public write access.

Parallelisation Partel and boundary files 7 years 11 months ago #24515

  • yugi
  • yugi's Avatar
  • OFFLINE
  • openTELEMAC Guru
  • Posts: 851
  • Thank you received: 244
In v6p3 it should be in sources/utils/partel/partel.F
The format is on line 1231.
There are 10 types of people in the world: those who understand binary, and those who don't.
The administrator has disabled public write access.
The following user(s) said Thank You: MarkusR

Parallelisation Partel and boundary files 7 years 11 months ago #24516

  • MarkusR
  • MarkusR's Avatar
  • OFFLINE
  • Junior Boarder
  • Posts: 56
  • Thank you received: 1
Now i got it.
It worked exactly as you suggests: just set I7 to I8 for FMT4 and compile the module again.

Thanks a lot!
The administrator has disabled public write access.

Parallelisation Partel and boundary files 7 years 9 months ago #25037

  • Joanna
  • Joanna's Avatar
Hi!

I'm having the same problem as you Markus but can't find where or what to change in the f-file. I'm using 7.1.1, would really appreciate some help here :)

Attaching the utils_serafin.f




Joanna
Attachments:
The administrator has disabled public write access.

Parallelisation Partel and boundary files 7 years 9 months ago #25039

  • MarkusR
  • MarkusR's Avatar
  • OFFLINE
  • Junior Boarder
  • Posts: 56
  • Thank you received: 1
Hi,

i think for version 7.1.1 you also have to make the change in utils/partel/partel.f in line 975: FMT4=(I7) to I8 or 9 in oder to increase the number of digits.

Best regards,

Markus
The administrator has disabled public write access.

Parallelisation Partel and boundary files 7 years 9 months ago #25041

  • Joanna
  • Joanna's Avatar
I've tried to make the change in partel.f, without success. I have not made any changes to the utils_serafin.f since i don't know where to make the change, there is no line 2510..

Im starting to think i might have a different problem. Still related to parallelisation of the boundary though, since I can run the model on one processor..

Joanna
The administrator has disabled public write access.
Moderators: pham

The open TELEMAC-MASCARET template for Joomla!2.5, the HTML 4 version.