Welcome, Guest
Username: Password: Remember me
Forgot your password? Forgot your username? Create an account
Forum
Installation
Windows Version
Network installation of telemac v7p0r1
Flat Threaded
  • Page:
  • 1
  • 2

TOPIC: Network installation of telemac v7p0r1

Network installation of telemac v7p0r1 9 years 8 months ago #16147

  • cyamin
  • cyamin's Avatar
  • OFFLINE
  • openTELEMAC Guru
  • Posts: 997
  • Thank you received: 234
Hello,

I am trying to install telemac v7p0r1 on a network share so that the installation (configuration, python scripts, python installation) would be accessible from any workstation.

I already have a working portable python version over the network. I setup the paths in systel.cfg to point to the network share and compiled without any problem. However, when I try to run a simulation I get the following error:
|ProcessLIT: file does not exist: telemac2d.dico

I suppose the problem occurs when the script tries to recover the dico file from the installation folder on the network share. If I try to run the from the installation on the local harddrive, there is no problem.

I attach my systel.cfg file.

Any help would be appreciated.

Regards,
Costas
Attachments:
The administrator has disabled public write access.

Network installation of telemac v7p0r1 9 years 8 months ago #16149

  • sebourban
  • sebourban's Avatar
  • OFFLINE
  • Administrator
  • Principal Scientist
  • Posts: 814
  • Thank you received: 219
Hello,

Indeed it is because of the path convention (\\atlas\...). It is an interesting point and while we can sort it out in Python, the Fortran might not be easy.

What I recommend is that each time you open your terminal (I am assuming DOS on Windows) you automatically map a chosen drive letter (say T: for TELEMAC) to that area of the network. This way T:\... instead of \\... will work. (you can do mount on Linux, but I think it is less of a trouble there)

Hope this helps,
Sébastien.
The administrator has disabled public write access.
The following user(s) said Thank You: cyamin

Network installation of telemac v7p0r1 9 years 8 months ago #16152

  • cyamin
  • cyamin's Avatar
  • OFFLINE
  • openTELEMAC Guru
  • Posts: 997
  • Thank you received: 234
Hello Sebastian,

So far I was able to get away with working with UNC paths, as long as the telemac installation was on local harddrive. However, in order for recollection to work on my HPC scheduler, I had to keep a dummy copy of the installation on the network (mainly for accessing systel.cfg and python scripts), which is a mess to maintain and that is why I decided to put everything in one place.

I will try mapping a drive letter for the execution of the script only and see how it works. Thank you for your help.

Regards,
Costas
The administrator has disabled public write access.

Network installation of telemac v7p0r1 9 years 8 months ago #16156

  • cyamin
  • cyamin's Avatar
  • OFFLINE
  • openTELEMAC Guru
  • Posts: 997
  • Thank you received: 234
Hello Sebastian,

I have managed to launch the simulation, by specifying the root path in systel.cfg using a network map. Unfortunately, the node running the HPC Scheduler does not have the map and thus, when the recollection script on that node reads the root path from systel.cfg, it can't find the map. I also remembered that this was the reason I was using UNC paths in the first place.

The mapped drives are assigned at user logon, hence hpc scheduler that runs as a service, cannot obtain the maps. Unless I find a workaround for that, it seems like a dead end.

If it is possible to work out a solution for the python scripts, it would be grateful.

Regards,
Costas
The administrator has disabled public write access.

Network installation of telemac v7p0r1 9 years 8 months ago #16161

  • cyamin
  • cyamin's Avatar
  • OFFLINE
  • openTELEMAC Guru
  • Posts: 997
  • Thank you received: 234
Hello Sebastian,

I refined my configuration using drive maps only for root path and now I can launch AND recollect the results with the HPC, using the network installation only.

Thank you for your help.

Regards,
Costas
The administrator has disabled public write access.

Network installation of telemac v7p0r1 9 years 8 months ago #16166

  • sebourban
  • sebourban's Avatar
  • OFFLINE
  • Administrator
  • Principal Scientist
  • Posts: 814
  • Thank you received: 219
Thank for letting us know.

Best wishes,

Sébastien.
The administrator has disabled public write access.

Network installation of telemac v7p0r1 9 years 8 months ago #16193

  • cyamin
  • cyamin's Avatar
  • OFFLINE
  • openTELEMAC Guru
  • Posts: 997
  • Thank you received: 234
Dear Sebastien,

My best workaround for the UNC limitation is the -r option of the runcode.py script (very happy to have it discovered :laugh:). I used it to change the root to the UNC path just for the recollection command in the HPC script.

I have discovered that everything seems to work with UNC paths (compilation, recollection etc) except the initial steps of runcode.py. Doing some more research, it looks like there is a UNC limitation of os.path functions in python that does the harm (just for Windows of course!). Is this limitation critical, or could it be overcome?

Regards,
Costas
The administrator has disabled public write access.

Network installation of telemac v7p0r1 9 years 8 months ago #16348

  • cyamin
  • cyamin's Avatar
  • OFFLINE
  • openTELEMAC Guru
  • Posts: 997
  • Thank you received: 234
Hello Sebastien,

Having managed to run submit a job with the python/hpc_runcode setup (see Opentelemac and HPC Pack (MS-MPI, post #16346), I stumbled across the same problem with UNC paths. Now that the <py_runcode> is executed at the head node, I have to give UNC path to root in the config file, or else I get a '(mapped) directory not found' error as soon as the cfg file is parsed.

With UNC path at the root, I get the error mentioned in the first post (|ProcessLIT: file does not exist: telemac2d.dico). So, I am in a deadlock at the moment. Any help would be appreciated.

Regards,
Costas
The administrator has disabled public write access.

Network installation of telemac v7p0r1 9 years 8 months ago #16350

  • sebourban
  • sebourban's Avatar
  • OFFLINE
  • Administrator
  • Principal Scientist
  • Posts: 814
  • Thank you received: 219
Hello,

The -r <root> option should be passed on from the comand line you run on the main node to the parsing of the <py_runcode>. Maybe this helps ?

Also, I think I understand you problem -- do not have a solution yet -- can you share you latest cfg and what you run in your command line and what you set up as environment variables ?

Thank you,
Sébastien.
The administrator has disabled public write access.

Network installation of telemac v7p0r1 9 years 8 months ago #16353

  • cyamin
  • cyamin's Avatar
  • OFFLINE
  • openTELEMAC Guru
  • Posts: 997
  • Thank you received: 234
Using the -r within the <py_runcode> is the same as changing it in the cfg file, so it did not made any difference.

Here is my hpc config:
hpc_stdin:	@echo off
			set telemac_conf_dir=\\atlas\Company\DataDisk\NET\PROGRAM_FILES\opentelemac\v7p0r1\configs
			set telemac_dir=\\atlas\Company\DataDisk\NET\PROGRAM_FILES\opentelemac\v7p0r1\scripts\Python27
			set python_dir=\\atlas\Company\DataDisk\NET\PROGRAM_FILES\WinPython-64bit-2.7.6.4\python-2.7.6.amd64
			set telemac_root=\\atlas\Company\DataDisk\NET\PROGRAM_FILES\opentelemac\v7p0r1
			for /f "usebackq tokens=4 delims=. " %%i in (`job new /jobtemplate:Telemac /jobname:<jobname> /numnodes:<ncnode> /corespernode:<nctile> /nodegroup:sandybridge`) do set jobid=%%i
			job add %jobid% /name:"Code execution" /stdout:<wdir>\<jobname>_<time>_stdout.txt pushd <wdir> ^& ^ %python_dir%\Pythonw.exe %telemac_dir%\<py_runcode>
			::job add %jobid% /name:"Recollection & Cleanup" ^& ^
			 ::pushd <wdir>\.. ^& ^
			 ::%python_dir%\Pythonw.exe %telemac_dir%\<codename>.py -f <cfgfile> -r %telemac_root% -c <cfgname> -w <wdir> --merge <casFileName> ^& ^
			 ::rd /s/q <wdir>_<time>
			job submit /id:%jobid%
			exit
#
hpc_runcode:  ren <hpc_stdin> <hpc_stdin>.cmd & <hpc_stdin>.cmd
You can see that I set all the paths within the script so that I don't have to rely on environmental variables. I know that further down the road is the compiler issue, but I am taking one step at a time.

Regards,
Costas
The administrator has disabled public write access.
Flat Threaded
  • Page:
  • 1
  • 2
Moderators: borisb
Forum
Installation
Windows Version
Network installation of telemac v7p0r1

The open TELEMAC-MASCARET template for Joomla!2.5, the HTML 4 version.