Difference between revisions of "8. Retrieve high-resolution nested ECMWF fields for FLEXPART"

Revision as of 14:53, 18 February 2013

Uses a number of fortran scripts which are run on MARS.

More details are given in the documents on the webpage:

http://transport.nilu.no/flexpart
under Routines for retrieval of FLEXTRA/FLEXPART input data from ECMWF

If retrieving a very small number of files this can be done on ECGATE, but for larger data sets it is recommended to use the supercomputer facilities (HPCE) when logging in (c2a)

1. Copy the following directory and files to your home directory on HPCE:

cp -r /home/ms/sbc/flex_extract_ecgate_V4/ YourDestination

List of files needed:

flex_ecmwf_91_finegrid_*

extract_ecmwf_ftpbase

seq_extract.V4*

seq_control.V4*

submit*

source.tar (contains Fortran90 source files and makefiles for the data processing to FLEXPART grid etc)

2. Edit the times in the file: seq_control.V4*

./seq_extract.V4 1990 1990 06 06 29 29 1

This extract the files from 1990 06 29 to 1990 06 29 - for 1 day!

3. In file flex_ecmwf_91_finegrid_* modify the following parameters:

M_GRID 20 (resolution 0.2 deg, for resolution of e.g. 10 deg use 1000)
M_LEFT -3600 (36 W)
M_LOWER 4000 (40 N)
M_UPPER 7600 (76 N)
M_RIGHT 3600 (36 E) 
M_FORMAT GRIB2 (GRIB1 or GRIB2)
DESTINATION nina (or another MS association set up on the web interface, e.g flexpart)
ECFSDIR ectmp:/${USER}/GRIM/ (directory name)
SOURCECODE /home/ms/no/sb9/flex_extract_ecgate_V4 (your username)

Notice:

M_GRID/90 must be a whole number

M_LOWER/M_GRID must be a whole number, same with the three other coordinates

(M_UPPER-M_LOWER) / M_GRID must equal a whole number

(M_LEFT-M_RIGHT) / M_GRID must equal a whole number

4. Change all paths to refer to your own user

grep sb9 *

to list all files containing the path with user sb9 which need to be changed.

5. Copy the template file flex_ecmwf_91_finegrid_* to extract_ecmwf_ftpbase

cp flex_ecmwf_91_finegrid_* extract_ecmwf_ftpbase

6. Run the job:

./submit

7. Check your job:

llq     to see your job in the queue 
llq -u sb9 to see only jobs for user sb9
eoj <jobid> 	provides details on the performance of a running job. (also automatically provided at end of job)

8. Get your files:

The retrieved files are automatically transferred to your ecgate account (via ECTRANS) and then to NILU by ftp. (NB: cannot ftp directly from HPCE, but must go via ecgate).

If you can’t find your files in your defined NILU-directory, check the directory you specified in flex_ecmwf_91_finegrid_* (ECFSDIR) for where it is temporarily stored on the ECWMF system. Then try ftp it over again using the ftp commands specified previously.

Back to ECMWF overview[1]