Difference between revisions of "7. Retrieve ECMWF fields for FLEXPART"

From mn/geo/geoit
Jump to: navigation, search
Line 17: Line 17:
 
  seq_extract.V4
 
  seq_extract.V4
 
  submit
 
  submit
  source.tar
+
  source.tar (contains Fortran90 source files and makefiles for the data processing to FLEXPART grid etc)
  
 
'''2. Edit the times in the file seq_control.V4:'''
 
'''2. Edit the times in the file seq_control.V4:'''

Revision as of 13:52, 18 February 2013

Uses a number of fortran scripts which are run on MARS.

More details are given in the documents on the webpage:

http://transport.nilu.no/flexpart
under Routines for retrieval of FLEXTRA/FLEXPART input data from ECMWF

If retrieving a small number of files this can be done on ECGATE, but for larger data sets it is recommended to use the supercomputer facilities (HPCE) when logging in (c2a)


1. Need to copy the following directory and files to your home directory on ecgate:

cp -r /home/ms/sbc/flex_extract_ecgate_V4/ YourDestination

List of files needed:

flex_ecmwf_91_global_1.0_ecgate
extract_ecmwf_ftpbase
seq_control.V4
seq_extract.V4
submit
source.tar (contains Fortran90 source files and makefiles for the data processing to FLEXPART grid etc)

2. Edit the times in the file seq_control.V4:

./seq_extract.V4 1990 1990 06 06 29 29 1
This extract the files from 1990 06 29 to 1990 06 29 - for 1 day!

3. Check that the file flex_ecmwf_91_global_1.0_ecgate contains the following:

-----------------------------------
BEGIN: modification of config file
-----------------------------------
cat <<EOF >CONTROL_ERA
DAY1 YYYYMMDD1
DAY2 YYYYMMDD2
DTIME 3
FORCE_EPS 0
FORCE_EI 0
FORCE_ERA 0
M_GRID 100  
M_LEFT -17800
M_LOWER -9000
M_UPPER 9000
M_RIGHT 18100
M_LEVEL 91
M_RESOL 255
M_GAUSS 1
M_ACCURACY 24
M_OMEGA 0
M_OMEGADIFF 0
M_SMOOTH 0
M_ADDPAR /27/28/173/186/187/188/235/139/39
M_FORMAT GRIB2
GATEWAY ecaccess.ecmwf.int
DESTINATION flexpart                                (or change to another of your MS associations)
ECSTORAGE 1
ECTRANS 1
ECFSDIR ectmp:/${USER}/oper_YYYY_MM/
MAILOPS ${USER}
MAILFAIL ${USER}
EXEDIR .
SOURCECODE /home/ms/no/sbc/flex_extract_ecgate_V4     (CHANGE TO YOUR USER!!)
EOF   
-----------------------------------
- END: modification of config file
-----------------------------------

4. Check and change all paths in all files to refer to your own user

grep sbc * 
to list all files containing the path with user sbc which need to be changed.
You will need to change in: submit, seq_control.V4, seq_extract.V4 and flex_ecmwf_91_global_1.0_ecgate 

5. Copy the template file flex_ecmwf_91_global_1.0_ecgate to extract_ecmwf_ftpbase

cp flex_ecmwf_91_global_1.0_ecgate extract_ecmwf_ftpbase

6. Run the job:

./submit

7. Check your job:

llq     to see your job in the queue 
llq -u sb9 to see only jobs for user sb9
eoj <jobid> 	provides details on the performance of a running job. (also automatically provided at end of job)


8. Get the files:

The retrieved files are automatically transferred to NILU via ftp using the MS association that you specified under "DESTINATION" and that exist under your account (check this under 2. Logging in and account settings).

If you cannot find your files in the defined NILU-directory, check the directory you specified in flex_ecmwf_91_global_1.0_ecgate * (ECFSDIR ectmp:/${USER}/oper_YYYY_MM/) for where it is temporarily stored on the ECWMF system. Then try ftp it over again using the ftp commands specified under 6. File transfer via ftp



Back to ECMWF overview[1]