The SSM environment : Différence entre versions

Un article de Informaticiens département des sciences de la Terre et l'atmosphère
Aller à: navigation, charcher
m (The "SSM environment")
m (Setup the SSM environment)
 
(20 révisions intermédiaires par le même utilisateur non affichées)
Ligne 7: Ligne 7:
 
Using the SSM environment means one now subscribes to domaines and packages using '''s.ssmuse.dot''' to aquire access to certain directories, scripts, binaries, etc.. This includes for example all tools to treat RPN files and the CRCM5 model itself. <br>In general the s.ssmuse.dot will add directories to your $PATH, $LD_LIBRARY_PATH, etc. and set some environment variables.  
 
Using the SSM environment means one now subscribes to domaines and packages using '''s.ssmuse.dot''' to aquire access to certain directories, scripts, binaries, etc.. This includes for example all tools to treat RPN files and the CRCM5 model itself. <br>In general the s.ssmuse.dot will add directories to your $PATH, $LD_LIBRARY_PATH, etc. and set some environment variables.  
  
To get a list of all the available domaines and packages type:<br>&nbsp;&nbsp;&nbsp; s.list_ssm_shortcuts<br><br>  
+
To get a list of all the available domaines and packages type:<br>&nbsp;&nbsp;&nbsp; s.list_ssm_shortcuts<br>
  
There is '''nothing''' you have '''to do on the UQAM servers'''. <br>But '''on guillimin and colosse you will have to do the little "setup" below''' once. Only then you can subscribe to one or more of these domaines and packages by typing for example:
+
Your own '''personal aliases, exports''', s.ssmuse.dot etc. for '''interactive''' use will go into the file<br>'''&nbsp;&nbsp;&nbsp; ~/.profile.d/.interactive_profile '''<br>which you will have to create.<br>
  
&nbsp;&nbsp;&nbsp; . s.ssmuse.dot diagtools difftools runtools vistools
+
There is '''nothing''' you have '''to do on the UQAM servers''' to set up the environment - it has already been set up at the creation of your account. <br>But '''on Compute Canada clusters you will have to do the little "setup" below''' once.
 +
<br>
 +
<br>
 +
 
 +
= <span id="Setup_to_use_new_environment" class="mw-headline">Setup the SSM environment</span>  =
 +
 
 +
To use the SSM environment on Compute Canada clusters you will first (and only once) have to do the following little "setup". <br>
 +
(I strongly suggest to '''use copy->paste'''!!! There are dots and spaces that are easy to miss when typing the commands by hand.)
 +
 
 +
If one or both of the following two files exist remove them or change their name, for example to: <br>
 +
'''&nbsp;&nbsp;&nbsp; mv ~/.bash_profile ~/.bash_profile-'''<br>
 +
'''&nbsp;&nbsp;&nbsp; mv ~/.bashrc ~/.bashrc-'''
  
I on guillimin added a line similar to this this to my .interactive_profile (see below).  
+
On Beluga, to use the old Beluga environment, create the file ~/.modulerc:<br>
 +
'''cat > ~/.modulerc <<+ <br>'''
 +
'''module-version StdEnv/2018.3 default<br>'''
 +
'''+<br>'''
  
On our UQAM servers it is in the .group_profile.  
+
Then create the file ~/.profile:<br>
 +
'''cat > ~/.profile <<+ <br>'''
 +
'''umask 022<br>'''
 +
'''type module 2>/dev/null 1>/dev/null || . /etc/profile<br>'''
 +
'''taskset -cp 0-128 \$\$<br>'''
 +
'''module swap intel/2018.3 gcc/7.3.0 2>/dev/null<br>'''
 +
'''. /home/armnssm/ssm-domains-base/ssm_10.151/etc/ssm.d/profile<br>'''
 +
'''. env-setup.dot<br>'''
 +
'''module list 2>&1 | grep '[()]'<br>'''
 +
'''+<br>'''
  
<br>
+
Log out and back in. <br>  
  
= <span id="Setup_to_use_new_environment" class="mw-headline">Setup the SSM environment</span> =
+
Then I suggest you create a link to our common '.group_profile'.<br>
 +
This will give you some basic aliases I find quite useful. Have a look at them if you like. <br>
 +
I will keep adding aliases and exports to this file.<br>
 +
'''&nbsp; &nbsp; ln -s ~winger/.published_profile.d/.group_profile&nbsp;&nbsp; ~/.profile.d/.group_profile'''<br><br>
  
To use the SSM environment you will first (and only once) have to do a little "setup":
+
Your own personal aliases, exports, s.ssmuse.dot etc. for '''interactive''' use will go into the file<br>
 +
'''&nbsp;&nbsp;&nbsp; ~/.profile.d/.interactive_profile '''<br>
 +
which you will have to create.<br>
  
#Create two links in your HOME<br>This part depends on the machine on which you are setting up the SSM environment.<br><br>On '''guillimin''':<br>'''&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; ln -s /sb/software/areas/armnssm/ssm-domains-base/setup/v_001&nbsp; ~/ECssm <br>&nbsp; &nbsp;&nbsp;&nbsp;&nbsp;&nbsp; ln -fs ECssm/dot-profile-setup_1.0_multi/bin/.profile&nbsp; ~/.profile'''<br>&nbsp;&nbsp;&nbsp; Change the name of two files (or remove them): <br>'''&nbsp; &nbsp;&nbsp;&nbsp;&nbsp;&nbsp; mv ~/.bash_profile ~/.bash_profile- <br>&nbsp; &nbsp;&nbsp;&nbsp;&nbsp;&nbsp; mv ~/.bashrc ~/.bashrc-'''<br>&nbsp;&nbsp;&nbsp; Log out and back in. <br><br>On '''st1/2/3''', '''skynet1/2/3'''and '''beluga''':<br>'''&nbsp; &nbsp;&nbsp;&nbsp;&nbsp;&nbsp; ln -s&nbsp; /unique/armnssm/ECssm/ssm-domains-base/setup/v_001&nbsp; ~/ECssm <br>&nbsp; &nbsp;&nbsp;&nbsp;&nbsp;&nbsp; ln -sf ECssm/multi/bin/.profile&nbsp; ~/.profile'''<br>&nbsp;&nbsp;&nbsp; Log out and back in. <br><br>On '''marvin''' the SSM environment does not exist. <br><br>
+
Then you either log out and back in again or source the new .profiles. <br>
#The file ''.profile_usr'' is not used anymore. It got replaced by several ''.something_profile'' files which all have to reside in your HOME in a directory called '''.profile.d'''.<br><br>I suggest you create a link to the '.group_profile'.<br>This will give you some basic aliases I find quite useful. Have a look at them if you like. <br>I will keep adding aliases and exports to this file.'''<br>&nbsp; &nbsp; ln -s ~winger/.published_profile.d/.group_profile&nbsp;&nbsp; ~/.profile.d/.group_profile'''<br><br>On '''st1/2/3''', '''skynet1/2/3''' and '''beluga''':<br>&nbsp;&nbsp;&nbsp; You should also add a link to the '.batch_profile':<br>'''&nbsp; &nbsp; ln -s ~winger/.published_profile.d/.batch_profile&nbsp;&nbsp; ~/.profile.d/.batch_profile'''<br><br>Your own personal aliases, exports, s.ssmuse.dot etc. for '''interactive''' use will go into the file<br>'''&nbsp;&nbsp;&nbsp; ~/.profile.d/.interactive_profile '''<br>which you will have to create.<br>If you already have the file ''.profile_usr''&nbsp; with your own aliases, exports, etc. you can copy them into this file.<br>Just make sure you do '''NOT''' copy a line in this file like this (or similar):<br>&nbsp;&nbsp;&nbsp; source&nbsp; /usr/local/usr_env/bashrc.tous<br>(You might have it in your ''.profile_usr'' on some of the UQAM servers. So please be careful.)<br><br>Since you now have to acquire packages with ''s.ssmuse.dot'' to get access to them I suggest you acquire the basic packages by default and add the following line to your ''~/.profile.d/.interactive_profile'':<br>&nbsp;&nbsp;&nbsp; On '''guillimin''':<br>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; '''. s.ssmuse.dot ovbin diagtools difftools runtools vistools pre_dot'''<br>&nbsp;&nbsp;&nbsp; On '''st1/2/3''', '''skynet1/2/3''' and '''beluga''':<br>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; The default '''s.ssmuse.dot''' command is included in the '''~/.profile.d/.group_profile'''<br>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; If you have other packages to acquire, add the corresponding&nbsp; '''s.ssmuse.dot''' t<br><br>Have a look at my .profile.d if you like (The files are hidden files, so do not forget the '-a'): <br>'''&nbsp; &nbsp; ls -al ~winger/.profile.d '''<br><br>Then you either log out and back in again or source the new .profiles. <br><br>
 
#On '''st1/2/3''' and '''skynet1/2/3''' you can always switch back to the old ARMNLIB environment but linking your ~/.profile back to the old target.<br>&nbsp;&nbsp;&nbsp; On '''st1/2/3''':<br>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; '''ln -sf /home/armnlib2/ssm/all/share/env_univ/.profile&nbsp; ~/.profile'''<br>&nbsp;&nbsp;&nbsp; On '''skynet1/2/3''':<br>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; '''ln -sf /home/armnlib/ssm/all/share/env_univ/.profile&nbsp;&nbsp; ~/.profile'''
 

Version actuelle datée du 16 de juin 2021 à 22:16

The "SSM environment"

The "SSM environment" is build on SSM, Simple Software Management.

The same SSM environment is available on guillimin and colosse as well as on the UQAM servers st1/2/3, skynet1/2/3, beluga, robert, zwack and glacier but not on marvin.

Using the SSM environment means one now subscribes to domaines and packages using s.ssmuse.dot to aquire access to certain directories, scripts, binaries, etc.. This includes for example all tools to treat RPN files and the CRCM5 model itself.
In general the s.ssmuse.dot will add directories to your $PATH, $LD_LIBRARY_PATH, etc. and set some environment variables.

To get a list of all the available domaines and packages type:
    s.list_ssm_shortcuts

Your own personal aliases, exports, s.ssmuse.dot etc. for interactive use will go into the file
    ~/.profile.d/.interactive_profile
which you will have to create.

There is nothing you have to do on the UQAM servers to set up the environment - it has already been set up at the creation of your account.
But on Compute Canada clusters you will have to do the little "setup" below once.

Setup the SSM environment

To use the SSM environment on Compute Canada clusters you will first (and only once) have to do the following little "setup".
(I strongly suggest to use copy->paste!!! There are dots and spaces that are easy to miss when typing the commands by hand.)

If one or both of the following two files exist remove them or change their name, for example to:
    mv ~/.bash_profile ~/.bash_profile-
    mv ~/.bashrc ~/.bashrc-

On Beluga, to use the old Beluga environment, create the file ~/.modulerc:
cat > ~/.modulerc <<+
module-version StdEnv/2018.3 default
+

Then create the file ~/.profile:
cat > ~/.profile <<+
umask 022
type module 2>/dev/null 1>/dev/null || . /etc/profile
taskset -cp 0-128 \$\$
module swap intel/2018.3 gcc/7.3.0 2>/dev/null
. /home/armnssm/ssm-domains-base/ssm_10.151/etc/ssm.d/profile
. env-setup.dot
module list 2>&1 | grep '[()]'
+

Log out and back in.

Then I suggest you create a link to our common '.group_profile'.
This will give you some basic aliases I find quite useful. Have a look at them if you like.
I will keep adding aliases and exports to this file.
    ln -s ~winger/.published_profile.d/.group_profile   ~/.profile.d/.group_profile

Your own personal aliases, exports, s.ssmuse.dot etc. for interactive use will go into the file
    ~/.profile.d/.interactive_profile
which you will have to create.

Then you either log out and back in again or source the new .profiles.