Set up model environment : Différence entre versions

Un article de Informaticiens département des sciences de la Terre et l'atmosphère
Aller à: navigation, charcher
m (Set up the model environment)
m (Set up the model environment)
Ligne 1: Ligne 1:
 
= Set up the model environment  =
 
= Set up the model environment  =
  
You have to do this only once. <br>But before you set up the model environment, make sure you have set up the ARMNLIB environment.<br>On '''marvin''' this is the "old" armnlib environment which you get automatically with your account. So here you have nothing to do.<br>On '''guillimin''' this is the [[The SSM environment|SSM environment]]. You do have to set this up yourself!!! If you have not done this already, click [[The SSM environment|here]] for instructions).  
+
You have to do this only once. <br>But before you set up the model environment on '''guillimin''' or '''colosse''', make sure you have set up the&nbsp; [[The SSM environment|SSM environment]]. On ou do have to set this up yourself!!! If you have not done this already, click [[The SSM environment|here]] for instructions).  
  
 
<br>  
 
<br>  
Ligne 8: Ligne 8:
 
#Create the "machine name" guillimin:<br>DO THIS&nbsp;ONLY&nbsp;ONCE&nbsp;!!!<br><br>'''cat &gt;&gt; ~/.ssh/config &lt;&lt; EOF<br>#<br>Host guillimin<br>Hostname localhost<br>EOF<br><br>'''  
 
#Create the "machine name" guillimin:<br>DO THIS&nbsp;ONLY&nbsp;ONCE&nbsp;!!!<br><br>'''cat &gt;&gt; ~/.ssh/config &lt;&lt; EOF<br>#<br>Host guillimin<br>Hostname localhost<br>EOF<br><br>'''  
 
#Create directories for running CRCM5:<br>This is different depending on the machine on which you are.<br><br>2.1 Create directory/link for the execution directory (where the model will be running):<br>&nbsp; &nbsp; &nbsp; &nbsp; '''mkdir ~/MODEL_EXEC_RUN'''<br><br>&nbsp;&nbsp;&nbsp; On '''guillimin''':<br>&nbsp;&nbsp;&nbsp; For people working for or having their account via '''Pierre Gauthier''' your project space is:<br>&nbsp; &nbsp;&nbsp; &nbsp; '''PROJECT_SPACE=/gs/project/xgk-345-aa'''<br>&nbsp;&nbsp;&nbsp;&nbsp; If you are with '''Laxmi Sushama''', '''René Laprise''' or '''Julie Theriault''' your project space is:<br>&nbsp; &nbsp;&nbsp; &nbsp; '''PROJECT_SPACE=/gs/project/ugh-612-aa'''<br>&nbsp;&nbsp;&nbsp; If you are with another PI, ask your PI for your project space.<br><br>'''&nbsp; &nbsp;&nbsp; &nbsp;&nbsp; mkdir -p ${PROJECT_SPACE}/${USER}/EXECDIR<br>&nbsp; &nbsp; &nbsp; &nbsp; ln -s ${PROJECT_SPACE}/${USER}/EXECDIR ~/MODEL_EXEC_RUN/localhost<br>&nbsp; &nbsp; &nbsp; &nbsp; ln -s ${PROJECT_SPACE}/${USER}/EXECDIR ~/MODEL_EXEC_RUN/guillimin<br><br>'''&nbsp;&nbsp;&nbsp; On '''marvin''':<br>'''&nbsp; &nbsp;&nbsp; &nbsp;&nbsp; mkdir -p /local/fiber1/${USER}/EXECDIR<br>&nbsp; &nbsp;&nbsp; &nbsp;&nbsp; ln -s /local/fiber1/${USER}/EXECDIR ~/MODEL_EXEC_RUN/headnode'''<br><br>2.2 Create directory/link for the listings:<br>While the model is running, all listing go into ~/listings/${TRUE_HOST}.<br> But at the end of each job all listings get zipped and transfered to&nbsp;[[Arch mach]] in your&nbsp;[[Archdir]] as specified in your 'configexp.dot.cfg'.&nbsp; Unless, of course, something went wrong...<br> <br>'''&nbsp; &nbsp;&nbsp; &nbsp;&nbsp; mkdir ~/listings<br><br>&nbsp;&nbsp;&nbsp; '''On '''guillimin''':'''<br>&nbsp; &nbsp;&nbsp; &nbsp;&nbsp; mkdir -p ${PROJECT_SPACE}/${USER}/Listings<br>&nbsp; &nbsp;&nbsp; &nbsp;&nbsp; ln -s ${PROJECT_SPACE}/${USER}/Listings ~/listings/localhost<br>&nbsp; &nbsp;&nbsp; &nbsp;&nbsp; ln -s ${PROJECT_SPACE}/${USER}/Listings ~/listings/guillimin<br><br>'''&nbsp;&nbsp;&nbsp; On '''marvin''':<br>'''&nbsp; &nbsp;&nbsp; &nbsp;&nbsp; mkdir -p /local/sata2/${USER}/Listings<br>&nbsp; &nbsp;&nbsp; &nbsp;&nbsp; ln -s /local/sata2/${USER}/Listings ~/listings/headnode'''<br><br>'''The following you only have to do on guillimin: '''  
 
#Create directories for running CRCM5:<br>This is different depending on the machine on which you are.<br><br>2.1 Create directory/link for the execution directory (where the model will be running):<br>&nbsp; &nbsp; &nbsp; &nbsp; '''mkdir ~/MODEL_EXEC_RUN'''<br><br>&nbsp;&nbsp;&nbsp; On '''guillimin''':<br>&nbsp;&nbsp;&nbsp; For people working for or having their account via '''Pierre Gauthier''' your project space is:<br>&nbsp; &nbsp;&nbsp; &nbsp; '''PROJECT_SPACE=/gs/project/xgk-345-aa'''<br>&nbsp;&nbsp;&nbsp;&nbsp; If you are with '''Laxmi Sushama''', '''René Laprise''' or '''Julie Theriault''' your project space is:<br>&nbsp; &nbsp;&nbsp; &nbsp; '''PROJECT_SPACE=/gs/project/ugh-612-aa'''<br>&nbsp;&nbsp;&nbsp; If you are with another PI, ask your PI for your project space.<br><br>'''&nbsp; &nbsp;&nbsp; &nbsp;&nbsp; mkdir -p ${PROJECT_SPACE}/${USER}/EXECDIR<br>&nbsp; &nbsp; &nbsp; &nbsp; ln -s ${PROJECT_SPACE}/${USER}/EXECDIR ~/MODEL_EXEC_RUN/localhost<br>&nbsp; &nbsp; &nbsp; &nbsp; ln -s ${PROJECT_SPACE}/${USER}/EXECDIR ~/MODEL_EXEC_RUN/guillimin<br><br>'''&nbsp;&nbsp;&nbsp; On '''marvin''':<br>'''&nbsp; &nbsp;&nbsp; &nbsp;&nbsp; mkdir -p /local/fiber1/${USER}/EXECDIR<br>&nbsp; &nbsp;&nbsp; &nbsp;&nbsp; ln -s /local/fiber1/${USER}/EXECDIR ~/MODEL_EXEC_RUN/headnode'''<br><br>2.2 Create directory/link for the listings:<br>While the model is running, all listing go into ~/listings/${TRUE_HOST}.<br> But at the end of each job all listings get zipped and transfered to&nbsp;[[Arch mach]] in your&nbsp;[[Archdir]] as specified in your 'configexp.dot.cfg'.&nbsp; Unless, of course, something went wrong...<br> <br>'''&nbsp; &nbsp;&nbsp; &nbsp;&nbsp; mkdir ~/listings<br><br>&nbsp;&nbsp;&nbsp; '''On '''guillimin''':'''<br>&nbsp; &nbsp;&nbsp; &nbsp;&nbsp; mkdir -p ${PROJECT_SPACE}/${USER}/Listings<br>&nbsp; &nbsp;&nbsp; &nbsp;&nbsp; ln -s ${PROJECT_SPACE}/${USER}/Listings ~/listings/localhost<br>&nbsp; &nbsp;&nbsp; &nbsp;&nbsp; ln -s ${PROJECT_SPACE}/${USER}/Listings ~/listings/guillimin<br><br>'''&nbsp;&nbsp;&nbsp; On '''marvin''':<br>'''&nbsp; &nbsp;&nbsp; &nbsp;&nbsp; mkdir -p /local/sata2/${USER}/Listings<br>&nbsp; &nbsp;&nbsp; &nbsp;&nbsp; ln -s /local/sata2/${USER}/Listings ~/listings/headnode'''<br><br>'''The following you only have to do on guillimin: '''  
#Set project name of which to use the core allocation:<br>You will have to create a file in your HOME on guillimin which is called: <br>&nbsp; '''${HOME}/.CLUMEQ_accnt '''<br> <br>This file has to contain 1 variable called 'RAPid', set to the RAPid of the project under which you want to submit your job. <br><br>For people working for or having their account via '''Pierre Gauthier''' you will have to set in the above file: <br>&nbsp;&nbsp; '''''RAPid=xgk-345-ae'''''<br> If you are with '''Laxmi Sushama''' set: <br> &nbsp;&nbsp; '''''RAPid=ugh-612-ac'''''<br>or if you are with '''René Laprise''' you will have to set:<br>''&nbsp;&nbsp; '''''RAPid=bgx-133-ab'''''<br>If you are with another PI, ask your PI for the "job accounting number".<br><br>Have a look at my file if you like: <br>&nbsp; ~winger/.CLUMEQ_accnt <br><br>
+
#Set project name of which to use the core allocation:<br>You will have to create a file in your HOME on guillimin which is called: <br>&nbsp; '''${HOME}/.CLUMEQ_accnt '''<br> <br>This file has to contain 1 variable called 'RAPid', set to the RAPid of the project under which you want to submit your job. <br><br>For people working for or having their account via '''Pierre Gauthier''' you will have to set in the above file: <br>&nbsp;&nbsp; '''''RAPid=xgk-345-ae'''''<br> If you are with '''Laxmi Sushama''' set: <br> &nbsp;&nbsp; '''''RAPid=ugh-612-ac'''''<br>or if you are with '''René Laprise''' you will have to set:<br>''&nbsp;&nbsp; '''''RAPid=bgx-133-ab'''''<br>If you are with another PI, ask your PI for the "job accounting number".<br><br>Have a look at my file if you like: <br>&nbsp; ~winger/.CLUMEQ_accnt <br><br>''
  
 
<br>
 
<br>

Version depuis le 14 de julliette 2016 à 13:42

Set up the model environment

You have to do this only once.
But before you set up the model environment on guillimin or colosse, make sure you have set up the  SSM environment. On ou do have to set this up yourself!!! If you have not done this already, click here for instructions).


  1. Allow 'ssh $TRUE_HOST' without typing password:
        cd ~/.ssh
    Only if there is no(!) file 'id_rsa.pub' create it with:
       ssh-keygen         (press just 'Enter' whenever asked a question, 3 times)
    then
        cat id_rsa.pub >> authorized_keys

  2. Create the "machine name" guillimin:
    DO THIS ONLY ONCE !!!

    cat >> ~/.ssh/config << EOF
    #
    Host guillimin
    Hostname localhost
    EOF

  3. Create directories for running CRCM5:
    This is different depending on the machine on which you are.

    2.1 Create directory/link for the execution directory (where the model will be running):
            mkdir ~/MODEL_EXEC_RUN

        On guillimin:
        For people working for or having their account via Pierre Gauthier your project space is:
           PROJECT_SPACE=/gs/project/xgk-345-aa
         If you are with Laxmi Sushama, René Laprise or Julie Theriault your project space is:
           PROJECT_SPACE=/gs/project/ugh-612-aa
        If you are with another PI, ask your PI for your project space.

            mkdir -p ${PROJECT_SPACE}/${USER}/EXECDIR
            ln -s ${PROJECT_SPACE}/${USER}/EXECDIR ~/MODEL_EXEC_RUN/localhost
            ln -s ${PROJECT_SPACE}/${USER}/EXECDIR ~/MODEL_EXEC_RUN/guillimin

        On marvin:
            mkdir -p /local/fiber1/${USER}/EXECDIR
            ln -s /local/fiber1/${USER}/EXECDIR ~/MODEL_EXEC_RUN/headnode


    2.2 Create directory/link for the listings:
    While the model is running, all listing go into ~/listings/${TRUE_HOST}.
    But at the end of each job all listings get zipped and transfered to Arch mach in your Archdir as specified in your 'configexp.dot.cfg'.  Unless, of course, something went wrong...

            mkdir ~/listings

       
    On guillimin:
            mkdir -p ${PROJECT_SPACE}/${USER}/Listings
            ln -s ${PROJECT_SPACE}/${USER}/Listings ~/listings/localhost
            ln -s ${PROJECT_SPACE}/${USER}/Listings ~/listings/guillimin

        On marvin:
            mkdir -p /local/sata2/${USER}/Listings
            ln -s /local/sata2/${USER}/Listings ~/listings/headnode


    The following you only have to do on guillimin:
  4. Set project name of which to use the core allocation:
    You will have to create a file in your HOME on guillimin which is called:
      ${HOME}/.CLUMEQ_accnt

    This file has to contain 1 variable called 'RAPid', set to the RAPid of the project under which you want to submit your job.

    For people working for or having their account via Pierre Gauthier you will have to set in the above file:
       RAPid=xgk-345-ae
    If you are with Laxmi Sushama set:
       RAPid=ugh-612-ac
    or if you are with René Laprise you will have to set:
       RAPid=bgx-133-ab
    If you are with another PI, ask your PI for the "job accounting number".

    Have a look at my file if you like:
      ~winger/.CLUMEQ_accnt