Welcome, Guest
Username: Password: Remember me

TOPIC: Re-collecting files using the option --merge

Re-collecting files using the option --merge 10 years 9 months ago #12127

  • amyrhulbakar
  • amyrhulbakar's Avatar
  • OFFLINE
  • Junior Boarder
  • Posts: 46
  • Thank you received: 4
Hello all,

I have sent a telemac2d test case to be run by a computer cluster using a job script. The result that I manage to have at the end of computations is only the temporary T2DRES. Could I know any additional script to be added within my config file or somewhere else, for the cluster to return the actual result *.slf? If the option --merge is the actual way to collect the result file, how could I use it? Related files are attached. Any recommendations are really appreciated.

Many thanks,
Amyrhul

File Attachment:

File Name: h3f6ac21.cfg
File Size: 2 KB

File Attachment:

File Name: hf0d1fe7.txt
File Size: 4 KB

File Attachment:

File Name: h82649f7.txt
File Size: 0 KB

File Attachment:

File Name: hd5fd49a.log
File Size: 45 KB
The administrator has disabled public write access.

Re-collecting files using the option --merge 10 years 8 months ago #12131

  • riadh
  • riadh's Avatar
Hello

The way used by Telemac to gather the result files generated by all processors it the GRETEL tool. In a very basic way, you can gather manually all the T2RES in all temporary folders and then run gretel (executable that you can find in the temporary file). I'm not aware how cluster manage the use of Gretel, however, waiting for a more effcient solution try this primitive way and it should work.

With my best regards

Riadh ATA
The administrator has disabled public write access.

Re-collecting files using the option --merge 10 years 8 months ago #12132

  • yugi
  • yugi's Avatar
  • OFFLINE
  • openTELEMAC Guru
  • Posts: 851
  • Thank you received: 244
Hi,

You do not need the merge in your case option as you are running with only one processor.

FYI:

The execution of runcode.py can be cut in four part:
runcode.py --split -wdir temp_dir module cas
Which will only create the temporary folder and partion the files if necessary
runcode.py -x -wdir temp_dir module cas
That will compile your User Fortran File
runcode.py --run -wdir temp_dir module cas
That will run the code
runcode.py --merge -wdir temp_dir module cas
That will merge the partionned files if necessary and will copy back all the results files

The few important points are that you need the option -wdir to give a name to your temporary folder and you should add the option --ncsize as well.

Hope it helps,
Yoann
There are 10 types of people in the world: those who understand binary, and those who don't.
The administrator has disabled public write access.
The following user(s) said Thank You: amyrhulbakar

Re-collecting files using the option --merge 10 years 8 months ago #12134

  • yugi
  • yugi's Avatar
  • OFFLINE
  • openTELEMAC Guru
  • Posts: 851
  • Thank you received: 244
I made a mistake and it seems I can not edit my post.

The option for the directory is -w and not -wdir.
There are 10 types of people in the world: those who understand binary, and those who don't.
The administrator has disabled public write access.

Re-collecting files using the option --merge 10 years 8 months ago #12184

  • amyrhulbakar
  • amyrhulbakar's Avatar
  • OFFLINE
  • Junior Boarder
  • Posts: 46
  • Thank you received: 4
Thank you Riadh and Yoann,

I tried the merge option and it's working. The temporary result T2DRES file will gone and replaced with *.slf file. In my case, I have only one T2DRES file though more than one node have been assigned.

Regards,
Amyrhul
The administrator has disabled public write access.
Moderators: borisb

The open TELEMAC-MASCARET template for Joomla!2.5, the HTML 4 version.