Welcome to Geosciences Modeling Wiki

From mn/geo/geoit
Revision as of 16:32, 30 January 2015 by Basal@uio.no (talk | contribs)

Jump to: navigation, search

Welcome to the Geosciences Modeling and Data Science Wiki.

Editing pages
How to
Style guide
Data
Formats
Measurements
Ordering
Re-analysis
Bias correction
Tools
Software
R
Fortran
Micmac
Python
Matlab
Excel
UiO network
Svedrup
Moulin
Abel
Nortur
Norstor
Models
ECMWF
Field of study
Hydrology
Metrology
Glaciology
Communication
Templates
Logo
Climabyte
Administration
Teaching

Purpose:

Provide information on software tools available for data analysis and scientific program for projects within the field of Geosciences in general and to provide users a cenral resource for keeping notes on UIO specific aspects of running various software routines. Ideally, this site will become overtime a 'go to' location where incoming students who will be working with modeling and heavy data analysis on servers can find tips for getting started.

Make a contribution

Feel free to tackle something from the list of NeededUpdates. Essentially, the usefullness of this site is up to you. We are building this up as we go, but don't be shy. Your contributions are valuable. Please, if you are working on something and stumble... it's likely someone else may have the same problem eventually. Make a note here of your solution. 

Tools and Topics

Tools for WorkingOnServers at UiO.

Processing large datasets and running models for geosciences will likely require that you work on the command line of a server and not on your laptop. It's important to learn how to do this efficiently so that you don't feel that it restricts where you can work from. In fact, it's generally the opposite. Once you learn how to use a server well, you will find it much easier to work from anywhere! All you need is an internet connection.

In this section, we give you an overview of UIO computing systems and how to set-up your environment (module package) and cover some tips for connecting via ssh, setting up your own laptop so it is 'as if' you are working locally, and other nice tricks for staying productive in a server-based environment.

Python

A starting point for all-things Python. Provides information on best practices, different packages that are frequently used, and other information to make using Python at NILU easier.

General Fortran Tips

Some general usage tips for coding in FORTRAN.

GNU and intel compilers are both available on our servers. We have a very limited number of licenses for intel compilers so we suggest you to use GNU compilers for all your development.

There is a default GNU compiler but it may be a quite old version. If you wish to use a newer version:

module avail gcc

it returns the list of available versions.

module load gcc/4.9.0

It loads GNU compilers 4.9.0 (both Fortran, C and C++ compilers).

Intel compilers are available by default on our UIO servers but on abel, you would need to load it:

module load intel

Other Fortran materials

  • An interesting free tutorial at http://www.fortrantutorial.com/ You can skip the installation of silverfrost compilers if you already have a Fortran compiler installed on your machine or if you are using sverdrup.uio.no


Access to HPC resources

FLEXPART Model

Information and resources for running and setting up FLEXPART. Mostly geared toward the ATMOS users.


FLEXINVERT

Bayesian inversion code for use with FLEXPART

WRF and WRF-CHEM Models

Information and resources for running and setting up WRF and WRF-CHEM.

OpenIFS ECMWF Model

Information and resources for running and setting up OpenIFS (ECMWF forecast model).

Data formats (netCDF, HDF4, HDF5, GRIB-1, GRIB-2, BUFR, etc.)

Descriptions on how to manipulate and visualize data in these different formats.

Getting data from ECMWF

Decriptions of how to get data in various ways from the ECMWF server.

Matlab (Not open source, but extensively used)

Contributions from MATLAB users


Metview (ECMWF visualization package)