Getting started : Différence entre versions

Un article de Informaticiens département des sciences de la Terre et l'atmosphère
Aller à: navigation, charcher
m
m (Setting up the SSM environment on guillimin)
 
(16 révisions intermédiaires par le même utilisateur non affichées)
Ligne 1: Ligne 1:
{| width="100%" cellspacing="2" cellpadding="10" style="border: 0px none;"
+
{| cellspacing="2" cellpadding="10" width="100%" style="border: 0px none;"
 
|-
 
|-
 
| width="50%" valign="top" style="background: none repeat scroll 0% 0% rgb(238, 255, 255); border: 0px solid rgb(170, 170, 170);" |  
 
| width="50%" valign="top" style="background: none repeat scroll 0% 0% rgb(238, 255, 255); border: 0px solid rgb(170, 170, 170);" |  
Ligne 9: Ligne 9:
 
|}
 
|}
  
= Start running CRCM5 in new environment<br> =
+
= Setting up the SSM environment on guillimin<br> =
  
 
The "new environment" is build on SSM, <u>S</u>imple <u>S</u>oftware <u>M</u>anagement.  
 
The "new environment" is build on SSM, <u>S</u>imple <u>S</u>oftware <u>M</u>anagement.  
Ligne 29: Ligne 29:
 
To use the new environment you will first (and only once) have to do a little "setup":  
 
To use the new environment you will first (and only once) have to do a little "setup":  
  
#Create two links in your HOME:<br>'''&nbsp; &nbsp; cd '''<br>'''&nbsp; &nbsp; ln -fs ~winger/ssm-domains/setup/v_000 ECssm <br>&nbsp; &nbsp; ln -fs ECssm/dot-profile-setup_1.0_multi/bin/.profile'''<br>Change the name of two files (or remove them): <br>'''&nbsp; &nbsp; mv .bash_profile .bash_profile- <br>&nbsp; &nbsp; mv .bashrc .bashrc-'''<br>Log out and back in. <br><br>  
+
#Create two links in your HOME:<br>'''&nbsp; &nbsp; cd '''<br>'''&nbsp; &nbsp; ln -fs ~winger/ssm-domains/setup/v_001 ECssm <br>&nbsp; &nbsp; ln -fs ECssm/dot-profile-setup_1.0_multi/bin/.profile'''<br>Change the name of two files (or remove them): <br>'''&nbsp; &nbsp; mv .bash_profile .bash_profile- <br>&nbsp; &nbsp; mv .bashrc .bashrc-'''<br>Log out and back in. <br><br>  
#There is no ''.profile_usr'' anymore. It got replaced by several ''.something_profile'' files which all have to reside in your HOME in a directory called ''''.profile.d''''.<br>Have a look at my .profile.d: <br>'''&nbsp; &nbsp; ls -al ~winger/.profile.d '''<br><br>I suggest you link to the same group profiles I link to: <br>'''&nbsp; &nbsp; cd ~/.profile.d <br>&nbsp; &nbsp; ln -s ~winger/.published_profile.d/.group_profile <br>&nbsp; &nbsp; ln -s ~winger/.published_profile.d/.group0_profile '''<br>This will give you some basic aliases I find quite useful. Have a look at them if you like. <br><br>Your own personal aliases, exports, s.ssmuse.dot etc. for '''interactive''' use will go into the file<br>&nbsp;&nbsp;&nbsp; '''.interactive_profile '''<br>which you will have to create.<br><br>I am not sure yet if you will need a '.batch_profile' with the command 'umask 022'. Michel's default mask is fine, mine is not. That's why I put the 'umask 022'. <br><br>Then you either log out and back in again or source the new .profiles. <br><br>  
+
#There is no ''.profile_usr'' anymore. It got replaced by several ''.something_profile'' files which all have to reside in your HOME in a directory called ''''.profile.d''''.<br>Have a look at my .profile.d: <br>'''&nbsp; &nbsp; ls -al ~winger/.profile.d '''<br><br>I suggest you link to the same group profiles I link to: <br>'''&nbsp; &nbsp; cd ~/.profile.d <br>&nbsp; &nbsp; ln -s ~winger/.published_profile.d/.group_profile <br>&nbsp; &nbsp; ln -s ~winger/.published_profile.d/.group0_profile '''<br>This will give you some basic aliases I find quite useful. Have a look at them if you like. <br><br>Your own personal aliases, exports, s.ssmuse.dot etc. for '''interactive''' use will go into the file<br>&nbsp;&nbsp;&nbsp; '''.interactive_profile '''<br>which you will have to create.<br><br>Then you either log out and back in again or source the new .profiles. <br><br>  
#Start running as if you were on marvin or colosse using the old environment.<br>On guillimin you can spy on me of course:<br>You will need links similar to these ones:<br>&nbsp;&nbsp;&nbsp; '''ls -l ~winger/MODEL_EXEC_RUN'''<br>&nbsp;&nbsp;&nbsp; '''ls -l ~winger/listings'''<br>Executable directory example (Note: The names of the absolutes are slightly different now)<br>&nbsp; &nbsp; '''/home/winger/gem/v_3.3.3/Abs/Original'''<br>Config files example:<br>&nbsp; &nbsp; '''/home/winger/gem/v_3.3.3/Config/CORDEX/Africa_0.44deg_new_env'''<br>
+
#Allow 'ssh $TRUE_HOST' without typing password: <br> &nbsp; &nbsp; <span style="font-weight: bold;">cd ~/.ssh</span><br>Only if there is '''no(!)''' file 'id_rsa.pub' create it with:<br> <span style="font-weight: bold;">&nbsp;&nbsp; ssh-keygen</span>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; (press just 'Enter' whenever asked a question, 3 times) <br>then<br> &nbsp; &nbsp; <span style="font-weight: bold;">cat id_rsa.pub &gt;&gt; authorized_keys2</span> <br><br>
 +
#Create directories for running CRCM5.<br>Create directory/link for the execution directory (where the model will be running):<br>'''&nbsp;&nbsp;&nbsp; mkdir ~/MODEL_EXEC_RUN<br>&nbsp;&nbsp;&nbsp; cd ~/MODEL_EXEC_RUN<br>&nbsp;&nbsp;&nbsp; mkdir -p /sb/project/xgk-345-ab/${USER}/EXECDIR<br>&nbsp;&nbsp;&nbsp; ln -s /sb/project/xgk-345-ab/${USER}/EXECDIR localhost<br>&nbsp;&nbsp;&nbsp; ln -s /sb/project/xgk-345-ab/${USER}/EXECDIR guillimin<br>'''Create directory/link for the listings:<br>'''&nbsp;&nbsp;&nbsp; mkdir ~/listings<br>&nbsp;&nbsp;&nbsp; cd ~/listings<br>&nbsp;&nbsp;&nbsp; mkdir -p /sb/project/xgk-345-ab/${USER}/Listings<br>&nbsp;&nbsp;&nbsp; ln -s /sb/project/xgk-345-ab/${USER}/Listings localhost<br>&nbsp;&nbsp;&nbsp; ln -s /sb/project/xgk-345-ab/${USER}/Listings guillimin<br>'''<br>  
 +
#Set project name of which to use the core allocation<br>You will have to create a file in your HOME on guillimin which is called: <br>&nbsp; '''${HOME}/.CLUMEQ_accnt '''<br> <br>This file has to contain 1 variable called 'RAPid', set to the RAPid of the project under which you want to submit your job. <br>For people working for or having their account via Pierre Gauthier, Laxmi Sushama, René Laprise or Peter Yau you will have to set in the above file: <br>&nbsp; '''RAPid=xgk-345-ac '''<br> <br>Have a look at my file if you like: <br>&nbsp; ~winger/.CLUMEQ_accnt <br>
 +
#Open your HOME to the world<br>If you do want my or other help I suggest you open your HOME to the world:<br>&nbsp;&nbsp;&nbsp; '''chmod 755 /home/$USER'''<br>
  
 
<br> <br>
 
<br> <br>

Version actuelle datée du 7 d'août 2013 à 12:43

en construction(cette page s'adresse principalement aux développeurs)

under construction(this page is mainly for developers)

Setting up the SSM environment on guillimin

The "new environment" is build on SSM, Simple Software Management.

This means one now subscribes to domaines and packages using s.ssmuse.dot to aquire access to certain directories, scripts, binaries, etc. In general the s.ssmuse.dot will add directories to your $PATH, $LD_LIBRARY_PATH, etc and set some environment variables.

For interactive sessions I find the following packages very useful: diagtools, difftools, runtools, vistools, fulldev

But first you will have to do the little "setup" below, then you can subscribe to one or more of these packages by typing for example:

    . s.ssmuse.dot diagtools difftools runtools vistools fulldev

I added this line to my .interactive_profile (see below).


Setup to use new environment

To use the new environment you will first (and only once) have to do a little "setup":

  1. Create two links in your HOME:
        cd
        ln -fs ~winger/ssm-domains/setup/v_001 ECssm
        ln -fs ECssm/dot-profile-setup_1.0_multi/bin/.profile

    Change the name of two files (or remove them):
        mv .bash_profile .bash_profile-
        mv .bashrc .bashrc-

    Log out and back in.

  2. There is no .profile_usr anymore. It got replaced by several .something_profile files which all have to reside in your HOME in a directory called '.profile.d'.
    Have a look at my .profile.d:
        ls -al ~winger/.profile.d

    I suggest you link to the same group profiles I link to:
        cd ~/.profile.d
        ln -s ~winger/.published_profile.d/.group_profile
        ln -s ~winger/.published_profile.d/.group0_profile

    This will give you some basic aliases I find quite useful. Have a look at them if you like.

    Your own personal aliases, exports, s.ssmuse.dot etc. for interactive use will go into the file
        .interactive_profile
    which you will have to create.

    Then you either log out and back in again or source the new .profiles.

  3. Allow 'ssh $TRUE_HOST' without typing password:
        cd ~/.ssh
    Only if there is no(!) file 'id_rsa.pub' create it with:
       ssh-keygen         (press just 'Enter' whenever asked a question, 3 times)
    then
        cat id_rsa.pub >> authorized_keys2

  4. Create directories for running CRCM5.
    Create directory/link for the execution directory (where the model will be running):
        mkdir ~/MODEL_EXEC_RUN
        cd ~/MODEL_EXEC_RUN
        mkdir -p /sb/project/xgk-345-ab/${USER}/EXECDIR
        ln -s /sb/project/xgk-345-ab/${USER}/EXECDIR localhost
        ln -s /sb/project/xgk-345-ab/${USER}/EXECDIR guillimin
    Create directory/link for the listings:
        mkdir ~/listings
        cd ~/listings
        mkdir -p /sb/project/xgk-345-ab/${USER}/Listings
        ln -s /sb/project/xgk-345-ab/${USER}/Listings localhost
        ln -s /sb/project/xgk-345-ab/${USER}/Listings guillimin

  5. Set project name of which to use the core allocation
    You will have to create a file in your HOME on guillimin which is called:
      ${HOME}/.CLUMEQ_accnt

    This file has to contain 1 variable called 'RAPid', set to the RAPid of the project under which you want to submit your job.
    For people working for or having their account via Pierre Gauthier, Laxmi Sushama, René Laprise or Peter Yau you will have to set in the above file:
      RAPid=xgk-345-ac

    Have a look at my file if you like:
      ~winger/.CLUMEQ_accnt
  6. Open your HOME to the world
    If you do want my or other help I suggest you open your HOME to the world:
        chmod 755 /home/$USER