Difference between revisions of "9. Retrieve historical ECMWF fields (ERA40) for FLEXPART"

From mn/geo/geoit
Jump to: navigation, search
(Created page with "'''''Retrieving ECMWF historcal grid data (example for ERA_40):''''' 1) Make sure your ECtrans setup settings on: https://ecaccess.ecmwf.int/ is valid. 2) When ssh'ing onto u...")
 
Line 1: Line 1:
'''''Retrieving ECMWF historcal grid data (example for ERA_40):'''''
+
'''''Retrieving ECMWF historcal grid data (example for ERA_40 or ERA-INTERIM):'''''
  
 +
Under 7. Re
  
1) Make sure your ECtrans setup settings on: https://ecaccess.ecmwf.int/ is valid.
 
  
 
+
3. Check that the file flex_ecmwf_91_global_1.0_ecgate contains the following:
2) When ssh'ing onto username@eceaccess.ecmwf.int  Choose: ecgate
+
(for an overview over the parameters and what they mean - see bottom of page)
 
+
-----------------------------------
 
+
BEGIN: modification of config file
3) The files you need to extract ERA_40can be found e.g. '''/home/ms/no/sb1d/flex_extract_ecgate_V4''', copy this directory.
+
-----------------------------------
 
+
cat <<EOF >CONTROL_ERA
 
+
DAY1 YYYYMMDD1
4) The files that need editing is:
+
DAY2 YYYYMMDD2
 
+
DTIME 3
'''seq_extract.V4''' edit path
+
'''FORCE_EPS 0 '''(ENSEMBLE)
 
+
'''FORCE_EI 0''' (ERA-INTERIM)
'''seq_control.V4''' -executes seq_extract.V4 for the dates you put in.-Edit dates and path
+
'''FORCE_ERA 0''' (ERA-40)
 
+
M_GRID 100 
''./seq_extract.V4 1990 1990 06 06 20 31 1''
+
M_LEFT -17800
 
+
M_LOWER -9000
-start_year end_year start_month end_month start_day end_day 1=complete day(s)
+
M_UPPER 9000
 
+
M_RIGHT 18100
'''flex_ecmwf_91_global_ecgate_ERA-40'''
+
M_LEVEL 91
 
+
M_RESOL 255
- line 1592 edit path: echo "Finished Job" > /home/ms/no/'''sb1d'''/flex_extract_ecgate_V4/finished.PID
+
M_GAUSS 1
 
+
M_ACCURACY 24
'''submit''' edit path
+
M_OMEGA 0
 
+
M_OMEGADIFF 0
 
+
M_SMOOTH 179
5) cp '''flex_ecmwf_91_global_ecgate_ERA-40'''  extract_ecmwf_ftpbase
+
M_ADDPAR /27/28/173/186/187/188/235/139/39
 
+
M_FORMAT GRIB2
 
+
GATEWAY ecaccess.ecmwf.int
6) Start the job by ./submit
+
DESTINATION flexpart                                (or change to another of your MS associations)
 
+
ECSTORAGE 1
7) Check your job:
+
ECTRANS 1
llq to see your job in the queue
+
ECFSDIR ectmp:/${USER}/oper_YYYY_MM/
eoj <jobid> provides details on the performance of a running job. (also automatically provided at end of job)
+
MAILOPS ${USER}
 
+
MAILFAIL ${USER}
 
+
EXEDIR .
8) The retrieved files are automatically transferred to your ecgate account (via ECTRANS) and then to NILU by ftp. (NB: cannot ftp directly from HPCE, but must go via ecgate). If you can’t find your files in your defined NILU-directory, check the directory you specified in flex_ecmwf_91_finegrid_*  (ECFSDIR) for where it is temporarily stored on the ECWMF system. Then try ftp it over again using the ftp commands specified previously.
+
SOURCECODE /home/ms/no/sbc/flex_extract_ecgate_V4     (CHANGE TO YOUR USER!!)
 
+
EOF 
 
+
-----------------------------------
 
+
- END: modification of config file
 
+
-----------------------------------
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
% Choose c1a (not ecgate) upon login to access the supercomputer facility (HPCE)
 
 
 
%List of files:
 
%flex_ecmwf_91_finegrid_*
 
%extract_ecmwf_ftpbase
 
%seq_extract.V4*
 
%seq_control.V4*
 
%submit*
 
 
 
%1. Edit the times in the file: seq_control.V4*
 
%./seq_extract.V4 1990 1990 06 06 29 29 1
 
 
 
2. In file flex_ecmwf_91_finegrid_* modify the following parameters:
 
 
 
M_GRID 20 (resolution 0.2 deg, for resolution of e.g. 10 deg use 1000)
 
 
 
M_LEFT -3600 (36 W)
 
 
 
M_LOWER 4000 (40 N)
 
 
 
M_UPPER 7600 (76 N)
 
 
 
M_RIGHT 3600 (36 E)
 
 
 
M_FORMAT GRIB2 (GRIB1 or GRIB2)
 
 
 
DESTINATION nina (or another MS association set up on the web interface, e.g flexpart)
 
 
 
ECFSDIR ectmp:/${USER}/GRIM/ (directory name)
 
 
 
SOURCECODE /home/ms/no/sb9/flex_extract_ecgate_V4 (your username)
 
 
 
 
 
 
 
3. Change all paths to refer to your own user
 
grep sb9 *
 
to list all files containing the path with user sb9 which need to be changed.
 
 
 
4. Copy the template file flex_ecmwf_91_finegrid_* to extract_ecmwf_ftpbase
 
 
 
5. Run the job:
 
./submit
 
 
 
 
 
 
 
7. Get your files:
 

Revision as of 11:20, 12 March 2013

Retrieving ECMWF historcal grid data (example for ERA_40 or ERA-INTERIM):

Under 7. Re


3. Check that the file flex_ecmwf_91_global_1.0_ecgate contains the following: (for an overview over the parameters and what they mean - see bottom of page)


BEGIN: modification of config file


cat <<EOF >CONTROL_ERA DAY1 YYYYMMDD1 DAY2 YYYYMMDD2 DTIME 3 FORCE_EPS 0 (ENSEMBLE) FORCE_EI 0 (ERA-INTERIM) FORCE_ERA 0 (ERA-40) M_GRID 100 M_LEFT -17800 M_LOWER -9000 M_UPPER 9000 M_RIGHT 18100 M_LEVEL 91 M_RESOL 255 M_GAUSS 1 M_ACCURACY 24 M_OMEGA 0 M_OMEGADIFF 0 M_SMOOTH 179 M_ADDPAR /27/28/173/186/187/188/235/139/39 M_FORMAT GRIB2 GATEWAY ecaccess.ecmwf.int DESTINATION flexpart (or change to another of your MS associations) ECSTORAGE 1 ECTRANS 1 ECFSDIR ectmp:/${USER}/oper_YYYY_MM/ MAILOPS ${USER} MAILFAIL ${USER} EXEDIR . SOURCECODE /home/ms/no/sbc/flex_extract_ecgate_V4 (CHANGE TO YOUR USER!!) EOF


- END: modification of config file