Difference between revisions of "9. Retrieve historical ECMWF fields (ERA40) for FLEXPART"

From mn/geo/geoit
Jump to: navigation, search
(Created page with "'''''Retrieving ECMWF historcal grid data (example for ERA_40):''''' 1) Make sure your ECtrans setup settings on: https://ecaccess.ecmwf.int/ is valid. 2) When ssh'ing onto u...")
 
m
 
(3 intermediate revisions by the same user not shown)
Line 1: Line 1:
−
'''''Retrieving ECMWF historcal grid data (example for ERA_40):'''''
+
Back to ECMWF overview[http://muspelheim.nilu.no/w/index.php/ECMWF]
  
  
−
1) Make sure your ECtrans setup settings on: https://ecaccess.ecmwf.int/ is valid.
+
''Updated by nik: 18 Feb. 2013''
  
  
−
2) When ssh'ing onto username@eceaccess.ecmwf.int  Choose: ecgate
+
Follow the exact same procedures as under
 +
 +
''7. Retrieve ECMWF fields for FLEXPART''
  
 +
Only change either FORCE_EI or FORCE_ERA to 1 to retrieve the appropriate data.
  
−
3) The files you need to extract ERA_40can be found e.g. '''/home/ms/no/sb1d/flex_extract_ecgate_V4''', copy this directory.
 
  
  
−
4) The files that need editing is:
+
'''3. Check that the file flex_ecmwf_91_global_1.0_ecgate contains the following:
  
−
'''seq_extract.V4''' edit path
+
(for an overview over the parameters and what they mean - see bottom of page)'''
−
 
+
-----------------------------------
−
'''seq_control.V4''' -executes seq_extract.V4 for the dates you put in.-Edit dates and path
+
BEGIN: modification of config file
−
 
+
-----------------------------------
−
''./seq_extract.V4 1990 1990 06 06 20 31 1''
+
cat <<EOF >CONTROL_ERA
−
 
+
DAY1 YYYYMMDD1
−
-start_year end_year start_month end_month start_day end_day 1=complete day(s)
+
DAY2 YYYYMMDD2
−
 
+
DTIME 3
−
'''flex_ecmwf_91_global_ecgate_ERA-40'''
+
'''FORCE_EPS 0''' (ENSEMBLE)
−
 
+
'''FORCE_EI 0'''   (ERA-INTERIM)
−
- line 1592 edit path: echo "Finished Job" > /home/ms/no/'''sb1d'''/flex_extract_ecgate_V4/finished.PID
+
'''FORCE_ERA 0'''  (ERA-40)
−
 
+
M_GRID 100 
−
'''submit''' edit path
+
M_LEFT -17800
−
 
+
M_LOWER -9000
−
 
+
M_UPPER 9000
−
5) cp '''flex_ecmwf_91_global_ecgate_ERA-40'''  extract_ecmwf_ftpbase
+
M_RIGHT 18100
−
 
+
M_LEVEL 91
−
 
+
M_RESOL 255
−
6) Start the job by ./submit
+
M_GAUSS 1
−
 
+
M_ACCURACY 24
−
7) Check your job:
+
M_OMEGA 0
−
llq to see your job in the queue
+
M_OMEGADIFF 0
−
eoj <jobid> provides details on the performance of a running job. (also automatically provided at end of job)
+
M_SMOOTH 179
−
 
+
M_ADDPAR /27/28/173/186/187/188/235/139/39
−
 
+
M_FORMAT GRIB2
−
8) The retrieved files are automatically transferred to your ecgate account (via ECTRANS) and then to NILU by ftp. (NB: cannot ftp directly from HPCE, but must go via ecgate). If you can’t find your files in your defined NILU-directory, check the directory you specified in flex_ecmwf_91_finegrid_*  (ECFSDIR) for where it is temporarily stored on the ECWMF system. Then try ftp it over again using the ftp commands specified previously.
+
GATEWAY ecaccess.ecmwf.int
−
 
+
DESTINATION flexpart                                (or change to another of your MS associations)
−
 
+
ECSTORAGE 1
−
 
+
ECTRANS 1
−
 
+
ECFSDIR ectmp:/${USER}/oper_YYYY_MM/
−
 
+
MAILOPS ${USER}
−
 
+
MAILFAIL ${USER}
−
 
+
EXEDIR .
−
 
+
SOURCECODE /home/ms/no/sbc/flex_extract_ecgate_V4     (CHANGE TO YOUR USER!!)
−
 
+
EOF 
−
 
+
-----------------------------------
−
 
+
- END: modification of config file
−
 
+
  -----------------------------------
−
 
 
−
 
 
−
 
 
−
 
 
−
% Choose c1a (not ecgate) upon login to access the supercomputer facility (HPCE)
 
−
 
 
−
%List of files:
 
−
%flex_ecmwf_91_finegrid_*
 
−
%extract_ecmwf_ftpbase
 
−
%seq_extract.V4*
 
−
%seq_control.V4*
 
−
%submit*
 
−
 
 
−
%1. Edit the times in the file: seq_control.V4*
 
−
%./seq_extract.V4 1990 1990 06 06 29 29 1
 
−
 
 
−
2. In file flex_ecmwf_91_finegrid_* modify the following parameters:
 
−
 
 
−
M_GRID 20 (resolution 0.2 deg, for resolution of e.g. 10 deg use 1000)
 
−
 
 
−
M_LEFT -3600 (36 W)
 
−
 
 
−
M_LOWER 4000 (40 N)
 
−
 
 
−
M_UPPER 7600 (76 N)
 
−
 
 
−
M_RIGHT 3600 (36 E)
 
−
 
 
−
M_FORMAT GRIB2 (GRIB1 or GRIB2)
 
−
 
 
−
DESTINATION nina (or another MS association set up on the web interface, e.g flexpart)
 
−
 
 
−
ECFSDIR ectmp:/${USER}/GRIM/ (directory name)
 
−
 
 
−
SOURCECODE /home/ms/no/sb9/flex_extract_ecgate_V4 (your username)
 
−
 
 
−
 
 
−
 
 
−
3. Change all paths to refer to your own user
 
−
grep sb9 *
 
−
to list all files containing the path with user sb9 which need to be changed.
 
−
 
 
−
4. Copy the template file flex_ecmwf_91_finegrid_* to extract_ecmwf_ftpbase
 
−
 
 
−
5. Run the job:
 
−
  ./submit
 
−
 
 
−
 
 
−
 
 
−
7. Get your files:
 

Latest revision as of 12:24, 12 March 2013

Back to ECMWF overview[1]


Updated by nik: 18 Feb. 2013


Follow the exact same procedures as under

7. Retrieve ECMWF fields for FLEXPART

Only change either FORCE_EI or FORCE_ERA to 1 to retrieve the appropriate data.


3. Check that the file flex_ecmwf_91_global_1.0_ecgate contains the following:

(for an overview over the parameters and what they mean - see bottom of page) 

-----------------------------------
BEGIN: modification of config file
-----------------------------------
cat <<EOF >CONTROL_ERA
DAY1 YYYYMMDD1
DAY2 YYYYMMDD2
DTIME 3
FORCE_EPS 0  (ENSEMBLE)
FORCE_EI 0   (ERA-INTERIM)
FORCE_ERA 0  (ERA-40)
M_GRID 100  
M_LEFT -17800
M_LOWER -9000
M_UPPER 9000
M_RIGHT 18100
M_LEVEL 91
M_RESOL 255
M_GAUSS 1
M_ACCURACY 24
M_OMEGA 0
M_OMEGADIFF 0
M_SMOOTH 179
M_ADDPAR /27/28/173/186/187/188/235/139/39
M_FORMAT GRIB2
GATEWAY ecaccess.ecmwf.int
DESTINATION flexpart                                (or change to another of your MS associations)
ECSTORAGE 1
ECTRANS 1
ECFSDIR ectmp:/${USER}/oper_YYYY_MM/
MAILOPS ${USER}
MAILFAIL ${USER}
EXEDIR .
SOURCECODE /home/ms/no/sbc/flex_extract_ecgate_V4     (CHANGE TO YOUR USER!!)
EOF   
-----------------------------------
- END: modification of config file
-----------------------------------
Retrieved from "https://wiki.uio.no/mn/geo/geoit/index.php?title=9._Retrieve_historical_ECMWF_fields_(ERA40)_for_FLEXPART&oldid=614"