Difference between revisions of "Biotin2.hpc.uio.no"

From medicin.ncmm.IT
Jump to: navigation, search
(first version, must add links.)
Line 10: Line 10:
 
* storage from pythagoras, mounted as per needed for each home or group area.
 
* storage from pythagoras, mounted as per needed for each home or group area.
  
== Software Installed, List of ==
+
{| class="wikitable" style="text-align: center;"
 
+
|-
* anacondapython
+
| Application                      || Version on biotin2.hpc.uio.no and biotin3.hpc.uio.no                                          || Status | Comments ||
* atac_dnase_pipelines
+
|-
* ataqv
+
| MATLAB                            || R2016a (9.0.0.341360) 64-bit (glnxa64)                                                        || Done  || - ||
* atsas
+
|-
* aws
+
| R with Bioconductor              || R version 3.5.1 (2018-07-02) -- "Feather Spray"                                                || Done  || latest bioconductor modules are applied according to version tool dependencies. ||
* bamliquidator
+
|-
* bamplot
+
| Perl                              || v5.16.3                                                                                        || Done  || Upgraded version should not cause any problems ||
* bamUtil
+
|-
* bcftools
+
| Perl 6                            || 6c                                                                                            || Done  || Based on Rakudo Star release 17.4 ||
* bds
+
|-
* bedops
+
| Python                            || Python 2.7.5 (default, Apr  9 2015, 11:03:32) and Python 3.5.1 from RedHat Software collections | Done  ||  In a similar way to R, certain Python modules (pip install) might need re-installation. This will be considered again on a "as needed" basis for specific critical applications. To enable the Python 3 version, please type on your shell: <code>scl enable rh-python35 bash</code> ||
* bedtools2
+
|-
* benchfftw
+
| ataqv                            || 1.0.0                                                                                          || Done  || ataqv was built against the HTSLIB in /lsc/htslib and with gcc 8.2.1 (devtoolset-8) ||
* BiasAway
+
|-
* biopython
+
| BiasAway                          || norpy version                                                                                  || Done  || - ||
* bismark
+
|-
* blastdbs
+
| Bismark                          || v0.16.3_dev                                                                                    || Done  || - ||
* blat
+
|-
* bowtie
+
| bowtie                            || version 1.1.2 64-bit                                                                          || Done  || Old bowtie genomic indices were transferred from biotin in /lsc/bowtie1ind ||
* bowtie1ind (bowtie 1 indexes)
+
|-
* bowtie2
+
| bowtie2                          || version 2.3.4.1 64-bit                                                                        || Done  || Old bowtie2 genomic indices were transferred from biotin in /lsc/bowtie2ind ||
* bowtie2ind (bowtie 2 indexes)
+
|-
* BroadPeak
+
| bedops                            || version 2.4.14                                                                                || Done  || - ||
* bsExpress
+
|-
* bsmap
+
| bsExpress                        || v0.5cegx                                                                                      || Done  || The sofware was modified/fixed to run properly on our production environment. 
* bsmoothalign
+
|-
* bwa
+
The modifications fixes are described in UiO RT case #2444978. ||
* bwameth
+
|-
* bwtool
+
| bsmap                            || version 2.74                                                                                  || Done  || - ||
* bxpython
+
|-
* CaVEMan
+
| bwa                              || Version: 0.7.12-r1039                                                                          || Done  || - ||
* ccp4
+
|-
* CEAS
+
| bwa-meth                          || Version 0.2.0                                                                                  || Done  || - ||
* cegxqc
+
|-
* cellranger
+
| blast (NCBI)                      ||  2.2.30+                                                                                      || Done  || Blast DBs were transferred from biotin in /lsc/blastdbs ||
* cgpBigWig
+
|-
* cgpCAVMPP
+
| cta                               || 0.1.2                                                                                          || Done  || Compiled with gcc 8.2.1 (devtoolset-8). It does not compile gcc 4.x . ||
* cgpVcf
+
|-
* chimera
+
| datamash                         || Version 1.1.1                                                                                  || Done  || - ||
* chipseeqer2
+
|-
* circos
+
| DNAshapedTFBS                     || Latest commit418fff6 on 28 Sep 2016                                                            || Done  || - ||
* cisTEM
+
|-
* cmdstan
+
| samtools                          || 1.3.1                                                                                          || Done  || Samtools is used by certain applications as a dependency. Some of these applications might require older versions of the samtools. These cases will be dealt on a "as needed" basis. ||
* condaenvs
+
|-
* cpan
+
| tophat and tophat2                || v2.1.0                                                                                        || Done  || - ||
* cta
+
|-
* ctffind
+
| FastQ Screen                      || v0.5.2                                                                                        || Done  || - ||
* cufflinks
+
|-
* cutadapt
+
| fastQC                            || v0.11.4                                                                                        || Done  || - ||
* datamash
+
|-
* deepTools
+
| gcc 6 compiler                    || v6.3.1                                                                                        || Done  || Default compiler for RHEL 7 is gcc 4.8.x. We include as well gcc version 6. To use type at your shell prompt: <code>scl enable devtoolset-6 bash</code> ||
* DNAshapedTFBS
+
|-
* eautils
+
| gcc 7 compiler                    || v7.3.1                                                                                        || Done  || Default compiler for RHEL 7 is gcc 4.8.x. We include as well gcc version 7. To use type at your shell prompt: <code>scl enable devtoolset-7 bash</code> ||
* edd
+
|-
* eman
+
| Expression analysis ea-utils      || github repo 31/10/2017                                                                        || Done  || - ||
* emboss
+
|-
* Extral
+
| edd                              || v1.1.14                                                                                        || Done  || This is a new installation of the latest Enriched Domain Detector (EDD) software  based on the system wide installed Python 2.7.5 and the following dependency component versions Cython-0.23.4 numpy-1.10.1 pysam-0.8.3 scipy-0.16.1 pandas-0.17.0 patsy-0.4.0 and statsmodels-0.6.1. Biotin used to run this for specific users using manually compiled Python 2.7.9. Recommended to re-run some data to check if the same results are achieved prior using the software, as a precaution. ||
* fasta
+
|-
* FastQC
+
| EMBOSS                            || v6.6.0.0                                                                                      || Done  || - ||
* fastqscreen
+
|-
* fastx
+
| BroadPeak                        || -                                                                                              || Done  || Depended on R and Perl versions. Working. ||
* fastxtoolkit
+
|-
* fftw
+
| cufflinks                        || v2.2.1                                                                                        || Done  || Installed against the RHEL7 dependency libraries boost version 1.53, eigen3-devel version 3.2.5, boost-bjam ||
* fftwold
+
|-
* FLTK
+
| Homer Tools                      || v4.7.2                                                                                        || Done  || Configurable by the end users, installed genomes hg(17-19),mm(8-10),xenTro(2,3),ce(6,10),danRer7, galGal4,rn5 ||
* frealign
+
|-
* fseq
+
| meme                              || v.4.11.4                                                                                      || Done  || No sequence databases were downloaded on biotin, hence no databases on biotin2 ||
* GATK
+
|-
* gcc494
+
| ViennaRNA                        || v2.1.9                                                                                        || Done  || - ||
* genomes
+
|-
* GFFutils
+
| F-Seq                            || v1.8.4                                                                                        || Done  || In biotin2 we have JAVAOPTS="-Xmx16000M" as opposed to JAVAOPTS="-Xmx8000M"  of biotin (twice the heap size) configued in fseq ||
* ghmm
+
|-
* h5fc
+
|  weka                            || v3.7.13                                                                                        || Done  || Type  launch_weka   to start the GUI of the program. Check the functionality against Java 1.8 . Heap size is set to 4 Gig. (4 x biotin size) ||
* hdf5
+
|-
* hdf5_hl
+
| IGV                              || v2.3.88                                                                                        || Done  || Type igv.sh to start the browser. Expect long startup times and responsiveness issues, depending on the size of your genome files. This program is best executed on local workstations rather than a shared server. ||
* hicpro
+
|-
* hiddenDomains
+
| iced                              || v0.5.1                                                                                        || Done  || - ||
* hisat2
+
|-
* homer
+
| novoalign                        || v3.03.01                                                                                      || Done  || - ||
* htseq
+
|-
* htslib
+
| cutadapt                          || v1.12                                                                                          || Done  || One of the many dependencies for iMir ||
* iced
+
|-
* icgc
+
| fasta                            || v36.3.8b Oct, 2015                                                                            || Done  || - ||
* IGV
+
|-
* IGVold
+
| HiC-Pro                          || v2.11.0-beta                                                                                  || Done  || Compiled for python 2.7.5 against bx-python 0.8.2, numpy 1.14.2, scipy 1.0.1 ||
* IGVTools
+
|-
* iMir
+
| Hisat                            || v2.1.0                                                                                        || Done  || Compiled locally with gcc version 7.3.1-5 ||
* iMir_Linux
+
|-
* IMP
+
| iMir                              || -                                                                                              || Done  || Type launch_iMir to start the GUI ||
* intervene
+
|-
* javaclasses
+
| Intervene                        || v0.5.6 git commit 22/02/2017                                                                  || Done  || - ||
* libmpi
+
|-
* lux
+
| Lux                              || latest commit 15/03/2016                                                                      || Done  || Based on STAR version 2.11.0 which is also installed on the server. ||
* macs14
+
|-
* macs2
+
| macs14                            || v1.4.2 20120305                                                                                || Done  || - ||
* macs2old
+
|-
* maint
+
| macs2 - [broken]                  || v2.1.0.20150731                                                                                || Done  || - ||
* maq
+
|-
* matplotlib
+
| MethPipe                          || v3.4.2                                                                                        || Done  || - ||
* mcl
+
|-
* mcr
+
| Methy-Pipe                        || v2.1                                                                                          || Done  || - ||
* mcr77
+
|-
* mcr90
+
| mixcr                            || v2.1.5                                                                                        || Done  || - ||
* mcrinstaller
+
|-
* meme
+
| ngs.plot                          || v2.61                                                                                          || Done  || - ||
* methpipe
+
|-
* methypipe2
+
| oPOSSUM3                          || Latest git commit 01/2016                                                                      || Done  || RDBMS that holds the JASPER and other TFBS databases on hfaistos.uio.no. Biotin2.hpc only has the client programs. See UiO RT 235025. ||
* miniconda3
+
|-
* mirvas
+
| preseq                            || v2.0.1                                                                                        || Done  || Tarball from source reports version 2.0.1, yet the tool reports version 2.0.0. Version error from the authors. ||
* mixcr
+
|-
* moabs
+
| RSAT                              || opting for the latest github version as dictated by the NCMM Computational Biology Group      || Done  || Command line version RSAT tools reference their own versions of NCBI BLAST and vmatch tools ||
* modules (environmental modules)
+
|-
* ncbiblast
+
| StringTie                        || v1.3.4d                                                                                        || Done  || Compiled locally with gcc version 7.3.1-5 ||
* ngsplot
+
|-
* novocraft
+
| velvet                            || v1.2.10                                                                                        || Done  || - ||
* numpy34
+
|-
* octave
+
| vmatch                            || v2.3.0                                                                                        || Done  || Usually required for the RSAT tool, but offered as a standalone utility outside the RSAT program PATH. ||
* oncodrive
+
|-
* oPOSSUM3
+
| ViewBS                            || git repo date 2/11/2018                                                                        || Done  || - ||
* pandas
+
|-
* PCAPcore
+
| NCBI SRA Toolkit (sra-tools)      || v2.5.4.1                                                                                      || Done  || - ||
* perlbrew
+
|-
* phenix
+
| ChIPseeqer                        || v2.0                                                                                          || Done  || Observed many compiler warnings during the build. Users should clarify whether version 2.1 should be installed. The software looks old and unmaintained. ||
* preseq
+
|-
* pybedtools
+
| XDS                              || BUILT=20180319                                                                                || Done  || KMP_STACKSIZE=8m  is exported by default on the shell. If you need to increase that, please raise an RT ticket ||
* pydnase
+
|-
* PyTables
+
| PHENIX                            || v1.10.1-2155                                                                                  || Done  || - ||
* qualimap
+
|-
* quest
+
| CCP4                              || v6.5                                                                                          || Done  || Users need to manually do: source /lsc/ccp4/ccp4-6.5/bin/ccp4.setup-sh prior using the package due to numpy conflicts with other applications. ||
* R
+
|-
* rakudo
+
| bedtools                          || v2.25.0                                                                                        || Done  || - ||
* relion
+
|-
* rhpython35
+
| picard                            || v1.140                                                                                        || Done  || Based on HTSJDK v1.140 ||
* rlibssite
+
|-
* rose2
+
| circos                            || v0.68                                                                                          || Done  || - ||
* rpy
+
|-
* rsat
+
| The Genome Analysis ToolKit (GATK) || v3.4-46-gbc02625                                                                              || Done  || - ||
* RSEM
+
|-
* samtools
+
| HTSeq                            || v0.6.1                                                                                        || Done  || - ||
* saxsgui
+
|-
* scipy
+
| Perl TFBS                        || v0.7.0                                                                                        || Done  || The Perl TFBS module is installed but is not in active development. Instead, we have installed the TFBStools (R/Bioconductor). ||
* sermx
+
|-
* SICER
+
| preseq                            || v2.0.1                                                                                        || Done  || - ||
* snakemake
+
|-
* sources
+
| pyDNase                          || github repo clone 30/05/2017                                                                  || Done  || - ||
* SRA
+
|-
* STAR
+
| RSEM                              || v1.3.0                                                                                        || Done  || - ||
* stringtie
+
|-
* subread
+
| STAR                              || v2.5.3a                                                                                        || Done  || - ||
* SuiteSparse
+
|-
* swig3
+
| CEAS                              || v1.0.2                                                                                        || Done  || - ||
* tabix
+
|-
* TADbit
+
| Qualimap                          || v2.2.1                                                                                        || Done  || linked to the Sun JAVA JRE (/lsc/sources/jre1.7.0_80/bin/java). All R dependencies installed. ||
* tclpkgtools
+
|-
* TFBS
+
| Quest                            || v.2.4                                                                                          || Done  || - ||
* tophat
+
|-
* trim_galore
+
| SICER                            || v1.1                                                                                          || Done  || - ||
* ucsc
+
|-
* unison
+
| XGBoost                          || Latest github commit on 06/04/2017                                                            || Done  || Installed Python 2.7.x module, command line compiled utility and R module. ||
* uomgenomicsutils
+
|-
* VCFtools
+
|}
* velvet
 
* vienna
 
* viewbs
 
* vmatch
 
* weblogo
 
* weka
 
* XDS
 
* xgboost
 
In addition, we have a mix of GNU and Intel compilers for C, C++ and FORTRAN 77 and 90
 
  
 
== Top Directory ( /lsc ) ==
 
== Top Directory ( /lsc ) ==

Revision as of 22:19, 8 January 2019

biotin2 is the departamental general usage server for the 'in silico' groups.

biotin3 is the Mathelier group server for their exclusive use.

Description

  • bioitin2: 128 cores, biotin3: 192 cores
  • 1TB RAM
  • storage from pythagoras, mounted as per needed for each home or group area.
The modifications fixes are described in UiO RT case #2444978. ||
Application Version on biotin2.hpc.uio.no and biotin3.hpc.uio.no Comments
MATLAB R2016a (9.0.0.341360) 64-bit (glnxa64) Done -
R with Bioconductor R version 3.5.1 (2018-07-02) -- "Feather Spray" Done latest bioconductor modules are applied according to version tool dependencies.
Perl v5.16.3 Done Upgraded version should not cause any problems
Perl 6 6c Done Based on Rakudo Star release 17.4
Python Done  In a similar way to R, certain Python modules (pip install) might need re-installation. This will be considered again on a "as needed" basis for specific critical applications. To enable the Python 3 version, please type on your shell: scl enable rh-python35 bash
ataqv 1.0.0 Done ataqv was built against the HTSLIB in /lsc/htslib and with gcc 8.2.1 (devtoolset-8)
BiasAway norpy version Done -
Bismark v0.16.3_dev Done -
bowtie version 1.1.2 64-bit Done Old bowtie genomic indices were transferred from biotin in /lsc/bowtie1ind
bowtie2 version 2.3.4.1 64-bit Done Old bowtie2 genomic indices were transferred from biotin in /lsc/bowtie2ind
bedops version 2.4.14 Done -
bsExpress v0.5cegx Done The sofware was modified/fixed to run properly on our production environment. 
bsmap version 2.74 Done -
bwa Version: 0.7.12-r1039 Done -
bwa-meth Version 0.2.0 Done -
blast (NCBI)  2.2.30+ Done Blast DBs were transferred from biotin in /lsc/blastdbs
cta 0.1.2 Done Compiled with gcc 8.2.1 (devtoolset-8). It does not compile gcc 4.x .
datamash Version 1.1.1 Done -
DNAshapedTFBS Latest commit418fff6 on 28 Sep 2016 Done -
samtools 1.3.1 Done Samtools is used by certain applications as a dependency. Some of these applications might require older versions of the samtools. These cases will be dealt on a "as needed" basis.
tophat and tophat2 v2.1.0 Done -
FastQ Screen v0.5.2 Done -
fastQC v0.11.4 Done -
gcc 6 compiler v6.3.1 Done Default compiler for RHEL 7 is gcc 4.8.x. We include as well gcc version 6. To use type at your shell prompt: scl enable devtoolset-6 bash
gcc 7 compiler v7.3.1 Done Default compiler for RHEL 7 is gcc 4.8.x. We include as well gcc version 7. To use type at your shell prompt: scl enable devtoolset-7 bash
Expression analysis ea-utils github repo 31/10/2017 Done -
edd v1.1.14 Done This is a new installation of the latest Enriched Domain Detector (EDD) software  based on the system wide installed Python 2.7.5 and the following dependency component versions Cython-0.23.4 numpy-1.10.1 pysam-0.8.3 scipy-0.16.1 pandas-0.17.0 patsy-0.4.0 and statsmodels-0.6.1. Biotin used to run this for specific users using manually compiled Python 2.7.9. Recommended to re-run some data to check if the same results are achieved prior using the software, as a precaution.
EMBOSS v6.6.0.0 Done -
BroadPeak - Done Depended on R and Perl versions. Working.
cufflinks v2.2.1 Done Installed against the RHEL7 dependency libraries boost version 1.53, eigen3-devel version 3.2.5, boost-bjam
Homer Tools v4.7.2 Done Configurable by the end users, installed genomes hg(17-19),mm(8-10),xenTro(2,3),ce(6,10),danRer7, galGal4,rn5
meme v.4.11.4 Done No sequence databases were downloaded on biotin, hence no databases on biotin2
ViennaRNA v2.1.9 Done -
F-Seq v1.8.4 Done In biotin2 we have JAVAOPTS="-Xmx16000M" as opposed to JAVAOPTS="-Xmx8000M"  of biotin (twice the heap size) configued in fseq
 weka v3.7.13 Done Type  launch_weka   to start the GUI of the program. Check the functionality against Java 1.8 . Heap size is set to 4 Gig. (4 x biotin size)
IGV v2.3.88 Done Type igv.sh to start the browser. Expect long startup times and responsiveness issues, depending on the size of your genome files. This program is best executed on local workstations rather than a shared server.
iced v0.5.1 Done -
novoalign v3.03.01 Done -
cutadapt v1.12 Done One of the many dependencies for iMir
fasta v36.3.8b Oct, 2015 Done -
HiC-Pro v2.11.0-beta Done Compiled for python 2.7.5 against bx-python 0.8.2, numpy 1.14.2, scipy 1.0.1
Hisat v2.1.0 Done Compiled locally with gcc version 7.3.1-5
iMir - Done Type launch_iMir to start the GUI
Intervene v0.5.6 git commit 22/02/2017 Done -
Lux latest commit 15/03/2016 Done Based on STAR version 2.11.0 which is also installed on the server.
macs14 v1.4.2 20120305 Done -
macs2 - [broken] v2.1.0.20150731 Done -
MethPipe v3.4.2 Done -
Methy-Pipe v2.1 Done -
mixcr v2.1.5 Done -
ngs.plot v2.61 Done -
oPOSSUM3 Latest git commit 01/2016 Done RDBMS that holds the JASPER and other TFBS databases on hfaistos.uio.no. Biotin2.hpc only has the client programs. See UiO RT 235025.
preseq v2.0.1 Done Tarball from source reports version 2.0.1, yet the tool reports version 2.0.0. Version error from the authors.
RSAT opting for the latest github version as dictated by the NCMM Computational Biology Group Done Command line version RSAT tools reference their own versions of NCBI BLAST and vmatch tools
StringTie v1.3.4d Done Compiled locally with gcc version 7.3.1-5
velvet v1.2.10 Done -
vmatch v2.3.0 Done Usually required for the RSAT tool, but offered as a standalone utility outside the RSAT program PATH.
ViewBS git repo date 2/11/2018 Done -
NCBI SRA Toolkit (sra-tools) v2.5.4.1 Done -
ChIPseeqer v2.0 Done Observed many compiler warnings during the build. Users should clarify whether version 2.1 should be installed. The software looks old and unmaintained.
XDS BUILT=20180319 Done KMP_STACKSIZE=8m  is exported by default on the shell. If you need to increase that, please raise an RT ticket
PHENIX v1.10.1-2155 Done -
CCP4 v6.5 Done Users need to manually do: source /lsc/ccp4/ccp4-6.5/bin/ccp4.setup-sh prior using the package due to numpy conflicts with other applications.
bedtools v2.25.0 Done -
picard v1.140 Done Based on HTSJDK v1.140
circos v0.68 Done -
The Genome Analysis ToolKit (GATK) v3.4-46-gbc02625 Done -
HTSeq v0.6.1 Done -
Perl TFBS v0.7.0 Done The Perl TFBS module is installed but is not in active development. Instead, we have installed the TFBStools (R/Bioconductor).
preseq v2.0.1 Done -
pyDNase github repo clone 30/05/2017 Done -
RSEM v1.3.0 Done -
STAR v2.5.3a Done -
CEAS v1.0.2 Done -
Qualimap v2.2.1 Done linked to the Sun JAVA JRE (/lsc/sources/jre1.7.0_80/bin/java). All R dependencies installed.
Quest v.2.4 Done -
SICER v1.1 Done -
XGBoost Latest github commit on 06/04/2017 Done Installed Python 2.7.x module, command line compiled utility and R module.

Top Directory ( /lsc )

Top directory for all installed software is /lsc

How are applications are run on biotin2/3