Difference between revisions of "7. Retrieve ECMWF fields for FLEXPART"
Line 1: | Line 1: | ||
'''Uses a number of fortran scripts which are run on MARS.''' | '''Uses a number of fortran scripts which are run on MARS.''' | ||
+ | |||
+ | The procedure in short | ||
+ | - Retrieves the model output from ECMWF | ||
+ | - De-accumulates atmospheric flux data (FLXACC2 fortran code under source.tar) | ||
+ | - Calculates the vertical velocity from the continuity equation | ||
+ | - Prepares the met.files (ENyyyymmddhh) that can be used for FLEXPART. | ||
+ | |||
More details are given in the documents on the webpage: | More details are given in the documents on the webpage: |
Revision as of 15:33, 18 February 2013
Uses a number of fortran scripts which are run on MARS.
The procedure in short - Retrieves the model output from ECMWF - De-accumulates atmospheric flux data (FLXACC2 fortran code under source.tar) - Calculates the vertical velocity from the continuity equation - Prepares the met.files (ENyyyymmddhh) that can be used for FLEXPART.
More details are given in the documents on the webpage:
http://transport.nilu.no/flexpart under Routines for retrieval of FLEXTRA/FLEXPART input data from ECMWF
If retrieving a small number of files this can be done on ECGATE, but for larger data sets it is recommended to use the supercomputer facilities (HPCE) when logging in (c2a)
1. Need to copy the following directory and files to your home directory on ecgate:
cp -r /home/ms/sbc/flex_extract_ecgate_V4/ YourDestination
List of files needed:
flex_ecmwf_91_global_1.0_ecgate extract_ecmwf_ftpbase seq_control.V4 seq_extract.V4 submit source.tar (contains Fortran90 source files and makefiles for the data processing to FLEXPART grid etc)
2. Edit the times in the file seq_control.V4:
./seq_extract.V4 1990 1990 06 06 29 29 1 This extract the files from 1990 06 29 to 1990 06 29 - for 1 day!
3. Check that the file flex_ecmwf_91_global_1.0_ecgate contains the following:
----------------------------------- BEGIN: modification of config file ----------------------------------- cat <<EOF >CONTROL_ERA DAY1 YYYYMMDD1 DAY2 YYYYMMDD2 DTIME 3 FORCE_EPS 0 FORCE_EI 0 FORCE_ERA 0 M_GRID 100 M_LEFT -17800 M_LOWER -9000 M_UPPER 9000 M_RIGHT 18100 M_LEVEL 91 M_RESOL 255 M_GAUSS 1 M_ACCURACY 24 M_OMEGA 0 M_OMEGADIFF 0 M_SMOOTH 0 M_ADDPAR /27/28/173/186/187/188/235/139/39 M_FORMAT GRIB2 GATEWAY ecaccess.ecmwf.int DESTINATION flexpart (or change to another of your MS associations) ECSTORAGE 1 ECTRANS 1 ECFSDIR ectmp:/${USER}/oper_YYYY_MM/ MAILOPS ${USER} MAILFAIL ${USER} EXEDIR . SOURCECODE /home/ms/no/sbc/flex_extract_ecgate_V4 (CHANGE TO YOUR USER!!) EOF ----------------------------------- - END: modification of config file -----------------------------------
4. In the scripts, reference to the right ECMWF userID must be made.
Use the command
grep $USER *
to list all lines in the files containing a reference to the ECMWF userId and that should be set to your own user.
You will need to change in: submit, seq_control.V4, seq_extract.V4 and flex_ecmwf_91_global_1.0_ecgate
5. Copy the template file flex_ecmwf_91_global_1.0_ecgate to extract_ecmwf_ftpbase
cp flex_ecmwf_91_global_1.0_ecgate extract_ecmwf_ftpbase
6. Run the job:
./submit
7. Check your job:
llq to see all jobs in the queue llq -u $USER to see only jobs for your userID eoj <jobid> provides details on the performance of a running job. (also automatically provided at end of job)
You can also follow your execution on the Web access facilities on ECMWF
You will receive an email notifying the start of the script and the successful completion of the script.
You will also get a file finished.* in your directory indicating that the script successfully completed.
The scripts can take from a few minutes up to a few hours to complete, depending on the load of the MARS system.
8. Possible error messages:
LoadL_starter: The program, extract_ecmwf_ftp01.5046746, exited normally and returned an exit code of 1.
In the file *.out search for "exit" to find the line where exit code 1 is given. Here might be hints to find the error message.
9. Get the files:
The retrieved files are automatically transferred to NILU via ftp using the MS association that you specified under "DESTINATION" and that exist under your account (check this under 2. Logging in and account settings).
If you cannot find your files in the defined NILU-directory, check the directory you specified in flex_ecmwf_91_global_1.0_ecgate * (ECFSDIR ectmp:/${USER}/oper_YYYY_MM/) for where it is temporarily stored on the ECWMF system. Then try ftp it over again using the ftp commands specified under 6. File transfer via ftp
Back to ECMWF overview[1]