Set up model environment : Différence entre versions

Un article de Informaticiens département des sciences de la Terre et l'atmosphère
Aller à: navigation, charcher
m (Set up the model environment:)
m (Set up the model environment:)
Ligne 5: Ligne 5:
 
=== Set up the model environment:<br>  ===
 
=== Set up the model environment:<br>  ===
  
#Allow 'ssh $TRUE_HOST' without typing password: <br> &nbsp; &nbsp; <span style="font-weight: bold;">cd ~/.ssh</span><br>Only if there is '''no(!)''' file 'id_rsa.pub' create it with:<br> <span style="font-weight: bold;">&nbsp;&nbsp; ssh-keygen</span>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; (press just 'Enter' whenever asked a question, 3 times) <br>then<br> &nbsp; &nbsp; <span style="font-weight: bold;">cat id_rsa.pub &gt;&gt; authorized_keys</span><br><br>  
+
#Allow 'ssh $TRUE_HOST' without typing password: <br> &nbsp; &nbsp; <span style="font-weight: bold;">cd ~/.ssh</span><br>'''If''' the directory ~/.ssh does not exist execute the command:<br>&nbsp; &nbsp; <span style="font-weight: bold;">ssh localhost</span><br>Only if there is '''no(!)''' file 'id_rsa.pub' create it with:<br> <span style="font-weight: bold;">&nbsp;&nbsp; ssh-keygen</span>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; (press just 'Enter' whenever asked a question, 3 times) <br>then<br> &nbsp; &nbsp; <span style="font-weight: bold;">cat id_rsa.pub &gt;&gt; authorized_keys</span><br><br>  
 
#Only on '''guillimin''' create the "machine name" guillimin:<br><br>'''cat &gt;&gt; ~/.ssh/config &lt;&lt; EOF<br>#<br>Host guillimin<br>Hostname localhost<br>EOF<br><br>'''  
 
#Only on '''guillimin''' create the "machine name" guillimin:<br><br>'''cat &gt;&gt; ~/.ssh/config &lt;&lt; EOF<br>#<br>Host guillimin<br>Hostname localhost<br>EOF<br><br>'''  
 
#Create directories for running CRCM5:<br>This is different depending on the machine on which you are.<br><br>3.1 Create directory/link for the execution directory (where the model will be running):<br>&nbsp; &nbsp; &nbsp; &nbsp; '''mkdir ~/MODEL_EXEC_RUN'''<br><br>&nbsp;&nbsp;&nbsp; On '''guillimin''':<br>&nbsp;&nbsp; &nbsp;&nbsp; For people working for or having their account via '''Pierre Gauthier'''your project space is:<br>&nbsp; &nbsp;&nbsp; &nbsp; &nbsp; '''PROJECT_SPACE=/sf1/escer/gauthier'''<br>&nbsp; &nbsp; &nbsp; If you are with '''Laxmi Sushama'''your project space is:<br>&nbsp; &nbsp;&nbsp; &nbsp; &nbsp; '''PROJECT_SPACE=/gs/project/ugh-612-aa'''<br>&nbsp;&nbsp; &nbsp;&nbsp; If you are with '''René Laprise''' or '''Julie Theriault''' your project space is:<br>&nbsp; &nbsp; &nbsp;&nbsp; &nbsp; '''PROJECT_SPACE=/gs/project/bgx-133-aa'''<br>&nbsp; &nbsp;&nbsp;&nbsp; If you are with another PI, ask your PI for your project space.<br><br>&nbsp;&nbsp; On the '''UQAM servers''' set "PROJECT_SPACE" to the directory assigned to you by Katja or Nadjet.<br><br>&nbsp;&nbsp;&nbsp; Then create the following directory and symbolic link:<br>'''&nbsp; &nbsp;&nbsp; &nbsp;&nbsp; mkdir -p ${PROJECT_SPACE}/${USER}/EXECDIR<br>&nbsp; &nbsp; &nbsp; &nbsp; ln -s ${PROJECT_SPACE}/${USER}/EXECDIR ~/MODEL_EXEC_RUN/${TRUE_HOST}'''<br><br>3.2 Create directory/link for the listings:<br>While the model is running, all listing go into ~/listings/${TRUE_HOST}.<br> But at the end of each job all listings get zipped and transfered to [[Arch mach|arch mach]] in your [[Archdir|archdir]] as specified in your 'configexp.dot.cfg'.&nbsp; Unless, of course, something went wrong...<br> '''<br>&nbsp; &nbsp;&nbsp; &nbsp;&nbsp; mkdir -p ${PROJECT_SPACE}/${USER}/Listings ~/listings<br>&nbsp; &nbsp;&nbsp; &nbsp;&nbsp; ln -s ${PROJECT_SPACE}/${USER}/Listings ~/listings/${TRUE_HOST}'''<br><br><br>The following you only have to do on '''guillimin''':  
 
#Create directories for running CRCM5:<br>This is different depending on the machine on which you are.<br><br>3.1 Create directory/link for the execution directory (where the model will be running):<br>&nbsp; &nbsp; &nbsp; &nbsp; '''mkdir ~/MODEL_EXEC_RUN'''<br><br>&nbsp;&nbsp;&nbsp; On '''guillimin''':<br>&nbsp;&nbsp; &nbsp;&nbsp; For people working for or having their account via '''Pierre Gauthier'''your project space is:<br>&nbsp; &nbsp;&nbsp; &nbsp; &nbsp; '''PROJECT_SPACE=/sf1/escer/gauthier'''<br>&nbsp; &nbsp; &nbsp; If you are with '''Laxmi Sushama'''your project space is:<br>&nbsp; &nbsp;&nbsp; &nbsp; &nbsp; '''PROJECT_SPACE=/gs/project/ugh-612-aa'''<br>&nbsp;&nbsp; &nbsp;&nbsp; If you are with '''René Laprise''' or '''Julie Theriault''' your project space is:<br>&nbsp; &nbsp; &nbsp;&nbsp; &nbsp; '''PROJECT_SPACE=/gs/project/bgx-133-aa'''<br>&nbsp; &nbsp;&nbsp;&nbsp; If you are with another PI, ask your PI for your project space.<br><br>&nbsp;&nbsp; On the '''UQAM servers''' set "PROJECT_SPACE" to the directory assigned to you by Katja or Nadjet.<br><br>&nbsp;&nbsp;&nbsp; Then create the following directory and symbolic link:<br>'''&nbsp; &nbsp;&nbsp; &nbsp;&nbsp; mkdir -p ${PROJECT_SPACE}/${USER}/EXECDIR<br>&nbsp; &nbsp; &nbsp; &nbsp; ln -s ${PROJECT_SPACE}/${USER}/EXECDIR ~/MODEL_EXEC_RUN/${TRUE_HOST}'''<br><br>3.2 Create directory/link for the listings:<br>While the model is running, all listing go into ~/listings/${TRUE_HOST}.<br> But at the end of each job all listings get zipped and transfered to [[Arch mach|arch mach]] in your [[Archdir|archdir]] as specified in your 'configexp.dot.cfg'.&nbsp; Unless, of course, something went wrong...<br> '''<br>&nbsp; &nbsp;&nbsp; &nbsp;&nbsp; mkdir -p ${PROJECT_SPACE}/${USER}/Listings ~/listings<br>&nbsp; &nbsp;&nbsp; &nbsp;&nbsp; ln -s ${PROJECT_SPACE}/${USER}/Listings ~/listings/${TRUE_HOST}'''<br><br><br>The following you only have to do on '''guillimin''':  

Version depuis le 18 de septembre 2017 à 20:53

Set up the model environment

You have to do this only once.
But before you set up the model environment on guillimin or colosse, make sure you have set up the  SSM environment. If you have not done this already, click here for instructions.
On the UQAM servers this has already been done by Nadjet during the creation of your account.

Set up the model environment:

  1. Allow 'ssh $TRUE_HOST' without typing password:
        cd ~/.ssh
    If the directory ~/.ssh does not exist execute the command:
        ssh localhost
    Only if there is no(!) file 'id_rsa.pub' create it with:
       ssh-keygen         (press just 'Enter' whenever asked a question, 3 times)
    then
        cat id_rsa.pub >> authorized_keys

  2. Only on guillimin create the "machine name" guillimin:

    cat >> ~/.ssh/config << EOF
    #
    Host guillimin
    Hostname localhost
    EOF

  3. Create directories for running CRCM5:
    This is different depending on the machine on which you are.

    3.1 Create directory/link for the execution directory (where the model will be running):
            mkdir ~/MODEL_EXEC_RUN

        On guillimin:
          For people working for or having their account via Pierre Gauthieryour project space is:
             PROJECT_SPACE=/sf1/escer/gauthier
          If you are with Laxmi Sushamayour project space is:
             PROJECT_SPACE=/gs/project/ugh-612-aa
          If you are with René Laprise or Julie Theriault your project space is:
             PROJECT_SPACE=/gs/project/bgx-133-aa
          If you are with another PI, ask your PI for your project space.

       On the UQAM servers set "PROJECT_SPACE" to the directory assigned to you by Katja or Nadjet.

        Then create the following directory and symbolic link:
            mkdir -p ${PROJECT_SPACE}/${USER}/EXECDIR
            ln -s ${PROJECT_SPACE}/${USER}/EXECDIR ~/MODEL_EXEC_RUN/${TRUE_HOST}


    3.2 Create directory/link for the listings:
    While the model is running, all listing go into ~/listings/${TRUE_HOST}.
    But at the end of each job all listings get zipped and transfered to arch mach in your archdir as specified in your 'configexp.dot.cfg'.  Unless, of course, something went wrong...

            mkdir -p ${PROJECT_SPACE}/${USER}/Listings ~/listings
            ln -s ${PROJECT_SPACE}/${USER}/Listings ~/listings/${TRUE_HOST}



    The following you only have to do on guillimin:
  4. Set project name of which to use the core allocation:
    You will have to create a file in your HOME on guillimin which is called:
      ${HOME}/.CLUMEQ_accnt

    This file has to contain 1 variable called 'RAPid', set to the RAPid of the project under which you want to submit your job.

    For people working for or having their account via Pierre Gauthier you will have to set in the above file:
       RAPid=xgk-345-ae
    If you are with Laxmi Sushama set:
       RAPid=ugh-612-ac
    or if you are with René Laprise or Julie Theriault you will have to set:
       RAPid=bgx-133-ab
    If you are with another PI, ask your PI for the "job accounting number".

    Have a look at my file if you like:
      ~winger/.CLUMEQ_accnt