Research Data Archive on Norstore (sigma2)

From mn/geo/geoit
Jump to: navigation, search


The Research Data Archive https://archive.sigma2.no/ allows storing research data and making it accessible to other researchers up to 10 years, including getting a DOI for the dataset.

Some journals require that datasets are archived, referenced with a DOI and made accessible. See for instance this page for AMS journals.

UiO recommends using the Norwegian national archive Norstore Archive: https://archive.sigma2.no/ This service is available to academically funded researchers for free, regardless the size of the data set. You’ll have to get approval from sigma2 before using it. Log onto archive.sigma2.no/, press «deposit» and request access. You will get access through your FEIDE account (meaning: no extra passwords to remember).

See https://www.sigma2.no/content/nird-research-data-archive for more information and this user guide: https://www.sigma2.no/content/archive-user-guide. And, yes, it IS possible to upload datasets directly from project areas, for instance /projects/researchers/researchers01/irenebn (see chap 2.7.2). That is, IF you have a NIRD account, and are able to log into login.nird.sigma2.no (ssh irenebn@login.nird.sigma2.no). Abel does not have the required software (testArchiveDataset and ArchiveDataset).

If not, you may upload up to 5 GB from local machines (this limit is stated in the upload interface, see attached image).

Once you have been able to log in to login.nird.sigma2.no (make sure you have access to nird, norstore_osl and a project account, for instance the latice account NS9066K (for me, NS9373K did not work out)), navigate to its folder:

cd /projects/NS9066K
mkdir to_be_archived_by_irenebn
scp irenebn@abel.uio.no:/projects/researchers/researchers01/irenebn/fCTR14/wrfout_d02* ./to_be_archived_by_irenebn/control_14_d02_2014-05-12_00

Then, run ArchiveDataset (the «testArchiveDataset» mentioned in the email with instructions was no installed in login.nird.sigma2.no).

[irenebn@tos-spw08 to_be_archived_by_irenebn]$ ArchiveDataset BC876D86-DBA7-4F71-AC4A-AF470DCAD038 manifest_file.txt
A sanity check will now be performed.
It can take some time depending of the number of files to archive.
If you skip it you may run into unforseen problems during archiving. Skip check  n/y [n]? n
----------------------------------------------------------------------------------------
Your request will write 363.072 GiB in 13 file(s) 
----------------------------------------------------------------------------------------
Submit this request  n/y [y]? y
----------------------------------------------------------------------------------------
Your request will now be processed and you will receive a mail (atirenebn@geo.uio.no)
when archiving is completed or if errors are found while processing your request.
----------------------------------------------------------------------------------------


Solutions to specific problems I have faced

Before you can do anything in the upload interface, you have to agree to the terms of conditions. When I did this, the link pointed to a blank page. You’ll find the terms here and here.

You will need to nominate a data manager and a rights holder before you can upload the data. You may write your own email address in both these fields. Note that you will get an email with a strange-looking link. Copy only the last part (after ]) into the browser to make it work: [archive.sigma2.no/pages/user/confirmDataset.jsf?id=2937-987-BC876D86-DBA7-4F71-AC4A-AF470DC38]archive.sigma2.no/pages/user/confirmDataset.jsf?id=2937-987-BC876D86-DBA7-4F71-AC4A-AF470DC38

See also

See this geoIT wiki page for more information about data storage at UiO.


Written by IBN, July 2018