Difference between revisions of "8. Retrieve high-resolution nested ECMWF fields for FLEXPART"

From mn/geo/geoit
Jump to: navigation, search
Line 1: Line 1:
'''Choose c1a (not ecgate) upon login to access the supercomputer facility (HPCE)'''
+
Uses a number of fortran scripts which are run on MARS.
  
 +
More details are given in the documents on the webpage:
 +
http://transport.nilu.no/flexpart
 +
under Routines for retrieval of FLEXTRA/FLEXPART input data from ECMWF
  
'''Copy the following directory and files to your home directory on HPCE:'''
+
If retrieving a very small number of files this can be done on ECGATE, but for larger data sets it is recommended to use the supercomputer facilities (HPCE) when logging in (c2a)
  
flex_extract_ecgate_V4
 
  
(this directory you can find under Sabine's or Nina's user sbc/ or sb9/)
+
1. '''Copy the following directory and files to your home directory on HPCE:'''
  
 +
cp -r /home/ms/sbc/flex_extract_ecgate_V4/ YourDestination
  
'''List of files:'''
+
 
 +
'''List of files needed:'''
  
 
flex_ecmwf_91_finegrid_*
 
flex_ecmwf_91_finegrid_*
Line 20: Line 24:
  
 
submit*
 
submit*
 +
 +
source.tar
  
  
  
'''1. Edit the times in the file: seq_control.V4*'''
+
'''2. Edit the times in the file: seq_control.V4*'''
  
 
  ./seq_extract.V4 1990 1990 06 06 29 29 1
 
  ./seq_extract.V4 1990 1990 06 06 29 29 1
Line 30: Line 36:
  
  
'''2. In file flex_ecmwf_91_finegrid_* modify the following parameters:'''
+
'''3. In file flex_ecmwf_91_finegrid_* modify the following parameters:'''
  
 
  M_GRID 20 (resolution 0.2 deg, for resolution of e.g. 10 deg use 1000)
 
  M_GRID 20 (resolution 0.2 deg, for resolution of e.g. 10 deg use 1000)
Line 55: Line 61:
  
  
'''3. Change all paths to refer to your own user'''
+
'''4. Change all paths to refer to your own user'''
  
 
  grep sb9 *
 
  grep sb9 *
Line 62: Line 68:
  
  
'''4. Copy the template file flex_ecmwf_91_finegrid_* to extract_ecmwf_ftpbase'''
+
'''5. Copy the template file flex_ecmwf_91_finegrid_* to extract_ecmwf_ftpbase'''
  
 
  cp flex_ecmwf_91_finegrid_* extract_ecmwf_ftpbase
 
  cp flex_ecmwf_91_finegrid_* extract_ecmwf_ftpbase
  
  
'''5. Run the job:'''
+
'''6. Run the job:'''
 
  ./submit
 
  ./submit
  
  
'''6. Check your job:'''
+
'''7. Check your job:'''
  
 
  llq    to see your job in the queue  
 
  llq    to see your job in the queue  
Line 78: Line 84:
  
  
'''7. Get your files:'''
+
'''8. Get your files:'''
  
 
The retrieved files are automatically transferred to your ecgate account (via ECTRANS) and then to NILU by ftp.  
 
The retrieved files are automatically transferred to your ecgate account (via ECTRANS) and then to NILU by ftp.  

Revision as of 13:34, 18 February 2013

Uses a number of fortran scripts which are run on MARS.

More details are given in the documents on the webpage:

http://transport.nilu.no/flexpart
under Routines for retrieval of FLEXTRA/FLEXPART input data from ECMWF

If retrieving a very small number of files this can be done on ECGATE, but for larger data sets it is recommended to use the supercomputer facilities (HPCE) when logging in (c2a)


1. Copy the following directory and files to your home directory on HPCE:

cp -r /home/ms/sbc/flex_extract_ecgate_V4/ YourDestination


List of files needed:

flex_ecmwf_91_finegrid_*

extract_ecmwf_ftpbase

seq_extract.V4*

seq_control.V4*

submit*

source.tar


2. Edit the times in the file: seq_control.V4*

./seq_extract.V4 1990 1990 06 06 29 29 1

This extract the files from 1990 06 29 to 1990 06 29 - for 1 day!


3. In file flex_ecmwf_91_finegrid_* modify the following parameters:

M_GRID 20 (resolution 0.2 deg, for resolution of e.g. 10 deg use 1000)
M_LEFT -3600 (36 W)
M_LOWER 4000 (40 N)
M_UPPER 7600 (76 N)
M_RIGHT 3600 (36 E) 
M_FORMAT GRIB2 (GRIB1 or GRIB2)
DESTINATION nina (or another MS association set up on the web interface, e.g flexpart)
ECFSDIR ectmp:/${USER}/GRIM/ (directory name)
SOURCECODE /home/ms/no/sb9/flex_extract_ecgate_V4 (your username)


Notice:

M_GRID/90 must be a whole number

M_LOWER/M_GRID must be a whole number, same with the three other coordinates

(M_UPPER-M_LOWER) / M_GRID must equal a whole number

(M_LEFT-M_RIGHT) / M_GRID must equal a whole number


4. Change all paths to refer to your own user

grep sb9 *

to list all files containing the path with user sb9 which need to be changed.


5. Copy the template file flex_ecmwf_91_finegrid_* to extract_ecmwf_ftpbase

cp flex_ecmwf_91_finegrid_* extract_ecmwf_ftpbase


6. Run the job:

./submit


7. Check your job:

llq     to see your job in the queue 
llq -u sb9 to see only jobs for user sb9
eoj <jobid> 	provides details on the performance of a running job. (also automatically provided at end of job)


8. Get your files:

The retrieved files are automatically transferred to your ecgate account (via ECTRANS) and then to NILU by ftp. (NB: cannot ftp directly from HPCE, but must go via ecgate).

If you can’t find your files in your defined NILU-directory, check the directory you specified in flex_ecmwf_91_finegrid_* (ECFSDIR) for where it is temporarily stored on the ECWMF system. Then try ftp it over again using the ftp commands specified previously.




Back to ECMWF overview[1]