Difference between revisions of "10. Some operational FLEXPART ECMWF fields are missing – how to get them!"
m |
|||
(17 intermediate revisions by the same user not shown) | |||
Line 1: | Line 1: | ||
+ | Back to ECMWF overview[http://muspelheim.nilu.no/w/index.php/ECMWF] | ||
+ | |||
+ | |||
+ | ''Updated by nik: 12 March 2013'' | ||
+ | |||
+ | |||
'''Some operational ECMWF fields are missing – what do you do? Where do you get them?''' | '''Some operational ECMWF fields are missing – what do you do? Where do you get them?''' | ||
− | + | ||
+ | == There are three options: == | ||
+ | |||
− | ''' | + | == 1) Files are in the temporary folder at NILU == |
+ | |||
+ | '''The files have been retrieved and sent to NILU but internal IT problems prevented them from being transferred to the right folder so they ended up in the temp folder. ''' | ||
Check if the files are in the temp directory at: | Check if the files are in the temp directory at: | ||
Line 11: | Line 21: | ||
''/xnilu_wrk/nilu_wrk2/tmp_ECMWF/'' | ''/xnilu_wrk/nilu_wrk2/tmp_ECMWF/'' | ||
− | Copy the ones missing over to | + | Copy the ones missing over to (nb: log in as user flexpart) |
+ | |||
+ | ''/flex_wrk/WIND_FIELDS/ECMWF/GLOBAL/OPER_fields/2012/07/'' (change year,month) | ||
+ | |||
+ | You then need to link these files to the directory | ||
+ | ''/flex_wrk/WIND_FIELDS/all_fields_oper_ecmwf/'' | ||
+ | |||
+ | Example of linking (nb: log in as user flexpart) | ||
+ | |||
+ | Go to the "all_fields" dir and say for one field at the time: | ||
+ | ''ln -s EN12070600 /flex_wrk/WIND_FIELDS/all_fields_oper_ecmwf/EN12070600'' | ||
+ | |||
+ | Link for a whole month at the time: | ||
+ | ''ln -s /flex_wrk/WIND_FIELDS/ECMWF/GLOBAL/OPER_fields/2012/07/EN* .'' | ||
+ | |||
+ | |||
+ | NB: You have to be logged in as user flexpart | ||
− | |||
− | ''' | + | == 2) Files were not transferred to NILU == |
+ | |||
+ | '''The files were retrieved at ECWMF but not sent over to NILU.''' | ||
Check if the files are in the temp folder at ECMWF under Sabine’s directory: | Check if the files are in the temp folder at ECMWF under Sabine’s directory: | ||
Line 31: | Line 58: | ||
This command cannot be used with wildcards such as *. | This command cannot be used with wildcards such as *. | ||
− | NB: make sure you use one of the ECtrans association you have set up for | + | NB: make sure you use one of the ECtrans association you have set up for on the ECMWF web service. Here is used nina but you can change it to e.g. flexpart if you have set up that one on your account. |
− | |||
+ | To transfer several files at once use a script containing the following: | ||
− | + | (This one transfers all files on the 15th July 2012 (EN1207150*). | |
− | + | NB: You need that extra 0 after 15 to get ''all'' files on only the 15th, if you don't have the extra 0 you will get all files from the 10th to the 20th) | |
''#!/bin/ksh | ''#!/bin/ksh | ||
− | |||
''for f in `els ectmp:/sbc/oper_2012_07 | grep EN1207150* | awk '{print $9}'`'' | ''for f in `els ectmp:/sbc/oper_2012_07 | grep EN1207150* | awk '{print $9}'`'' | ||
− | |||
''do'' | ''do'' | ||
− | |||
''echo $f'' | ''echo $f'' | ||
− | |||
''ectrans -remote nina@genericSftp -source ectmp:/sbc/oper_2012_07/$f'' | ''ectrans -remote nina@genericSftp -source ectmp:/sbc/oper_2012_07/$f'' | ||
− | + | ''done'' | |
− | ''done'' | ||
Line 56: | Line 78: | ||
After they end up somewhere at NILU make sure you transfer the files to the directory: | After they end up somewhere at NILU make sure you transfer the files to the directory: | ||
+ | ''/flex_wrk/WIND_FIELDS/ECMWF/GLOBAL/OPER_fields/2012/07/'' (change year,month) | ||
+ | and linked to this directory | ||
''/xnilu_wrk/flex_wrk/WIND_FIELDS/all_fields_oper_ecmwf/'' | ''/xnilu_wrk/flex_wrk/WIND_FIELDS/all_fields_oper_ecmwf/'' | ||
− | |||
− | + | == 3) Files were not retrieved == | |
− | + | '''The files were not retrieved at ECMWF so you would need to retrieve them again following the procedures under the previous sections. | |
− | |||
− | |||
− | |||
− | |||
− | |||
− |
Latest revision as of 12:42, 12 March 2013
Back to ECMWF overview[1]
Updated by nik: 12 March 2013
Some operational ECMWF fields are missing – what do you do? Where do you get them?
Contents
There are three options:
1) Files are in the temporary folder at NILU
The files have been retrieved and sent to NILU but internal IT problems prevented them from being transferred to the right folder so they ended up in the temp folder.
Check if the files are in the temp directory at:
/xnilu_wrk/nilu_wrk2/tmp_ECMWF/
Copy the ones missing over to (nb: log in as user flexpart)
/flex_wrk/WIND_FIELDS/ECMWF/GLOBAL/OPER_fields/2012/07/ (change year,month)
You then need to link these files to the directory
/flex_wrk/WIND_FIELDS/all_fields_oper_ecmwf/
Example of linking (nb: log in as user flexpart)
Go to the "all_fields" dir and say for one field at the time:
ln -s EN12070600 /flex_wrk/WIND_FIELDS/all_fields_oper_ecmwf/EN12070600
Link for a whole month at the time:
ln -s /flex_wrk/WIND_FIELDS/ECMWF/GLOBAL/OPER_fields/2012/07/EN* .
NB: You have to be logged in as user flexpart
2) Files were not transferred to NILU
The files were retrieved at ECWMF but not sent over to NILU.
Check if the files are in the temp folder at ECMWF under Sabine’s directory:
els ectmp://sbc/oper_2012_07
Change the year and month to the one you want to check.
If they are there – send them over to NILU by the command ectrans. Example:
ectrans -remote nina@genericSftp -source ectmp://sbc/oper_2012_07/EN12070600
This command cannot be used with wildcards such as *.
NB: make sure you use one of the ECtrans association you have set up for on the ECMWF web service. Here is used nina but you can change it to e.g. flexpart if you have set up that one on your account.
To transfer several files at once use a script containing the following:
(This one transfers all files on the 15th July 2012 (EN1207150*).
NB: You need that extra 0 after 15 to get all files on only the 15th, if you don't have the extra 0 you will get all files from the 10th to the 20th)
#!/bin/ksh for f in `els ectmp:/sbc/oper_2012_07 | grep EN1207150* | awk '{print $9}'` do echo $f ectrans -remote nina@genericSftp -source ectmp:/sbc/oper_2012_07/$f done
Depending on the ECtrans association you have used the files are transferred to your specified directory set up on the ECMWF web service.
After they end up somewhere at NILU make sure you transfer the files to the directory:
/flex_wrk/WIND_FIELDS/ECMWF/GLOBAL/OPER_fields/2012/07/ (change year,month)
and linked to this directory
/xnilu_wrk/flex_wrk/WIND_FIELDS/all_fields_oper_ecmwf/
3) Files were not retrieved
The files were not retrieved at ECMWF so you would need to retrieve them again following the procedures under the previous sections.