HPC/Carbon Cluster - Development tools - Revision history

Stern: /* Intel MPI */

2011-06-03T22:22:07Z

Intel MPI

← Older revision		Revision as of 22:22, June 3, 2011
Line 43:		Line 43:
	* [http://www.open-mpi.org/faq FAQ]		* [http://www.open-mpi.org/faq FAQ]

	=== ~~[http://software.intel.com/en-us/articles/intel-mpi-library/~~ Intel MPI] ===		=== Intel MPI ===
	* ~~[http://software.intel.com/en-us/articles/intel-mpi-library-documentation/ Intel MPI Documentation]~~		* See [[HPC/Software/Modules/impi]]
	; See ~~also:~~ [[HPC/Software/Modules/impi]].

	===[http://www-unix.mcs.anl.gov/mpi/mpich1/ MPICH]/[http://www.mcs.anl.gov/research/projects/mpich2/ MPICH2]===		===[http://www-unix.mcs.anl.gov/mpi/mpich1/ MPICH]/[http://www.mcs.anl.gov/research/projects/mpich2/ MPICH2]===

Stern: /* Intel MPI */

2011-06-03T20:42:56Z

Intel MPI

@@ Line 45: / Line 45: @@
 === [http://software.intel.com/en-us/articles/intel-mpi-library/ Intel MPI] ===
 * [http://software.intel.com/en-us/articles/intel-mpi-library-documentation/ Intel MPI Documentation]
-* I recommend to use the new ''Hydra'' MPI process manager. See sec. ''2.4 Scalable Process Management System'' in the [http://software.intel.com/sites/products/documentation/hpc/mpi/linux/reference_manual.pdf Reference Manual]. This avoids the need to set up and tear down the older and considerably less stable MPD manager.
+; See also: [[HPC/Software/Modules/impi]].
 ===[http://www-unix.mcs.anl.gov/mpi/mpich1/ MPICH]/[http://www.mcs.anl.gov/research/projects/mpich2/ MPICH2]===

Stern: /* Intel MPI */

2011-06-03T20:30:02Z

Intel MPI

← Older revision		Revision as of 20:30, June 3, 2011
Line 53:		Line 53:
	</syntaxhighlight>		</syntaxhighlight>
	* The '''openmpi''' and '''impi''' modules can '''coexist at runtime''' if:		* The '''openmpi''' and '''impi''' modules can '''coexist at runtime''' if:
	** impi is loaded first and is called using <code>mpiexec.hydra</code>,		** impi is loaded first and is called using <code>mpiexec.hydra</code>.
	** ~~ompi~~ is loaded second and is called using <code>mpirun</code>,		** openmpi is loaded second and is called using <code>mpirun</code>.
	** you don't attempt to compile software using the convenience wrappers like <code>mpicc, mpif90,</code> etc. For these wrappers, the last module loaded will be active. It may be possible to use full paths like <code>$IMPI_HOME/bin/mpif90</code>, but this has not been tested fully.		** you don't attempt to compile software using the convenience wrappers like <code>mpicc, mpif90,</code> etc. For these wrappers, the last module loaded will be active. It may be possible to use full paths like <code>$IMPI_HOME/bin/mpif90</code>, but this has not been tested fully.
			: Since openmpi is loaded by default, use the following sequence in ~/.bashrc:
			module unload openmpi
			module load impi
			module load openmpi

	===[http://www-unix.mcs.anl.gov/mpi/mpich1/ MPICH]/[http://www.mcs.anl.gov/research/projects/mpich2/ MPICH2]===		===[http://www-unix.mcs.anl.gov/mpi/mpich1/ MPICH]/[http://www.mcs.anl.gov/research/projects/mpich2/ MPICH2]===

Stern: /* Intel MPI */

2011-06-03T20:24:52Z

Intel MPI

← Older revision		Revision as of 20:24, June 3, 2011
Line 52:		Line 52:
	./a.out		./a.out
	</syntaxhighlight>		</syntaxhighlight>
			* The '''openmpi''' and '''impi''' modules can '''coexist at runtime''' if:
			** impi is loaded first and is called using <code>mpiexec.hydra</code>,
			** ompi is loaded second and is called using <code>mpirun</code>,
			** you don't attempt to compile software using the convenience wrappers like <code>mpicc, mpif90,</code> etc. For these wrappers, the last module loaded will be active. It may be possible to use full paths like <code>$IMPI_HOME/bin/mpif90</code>, but this has not been tested fully.

	===[http://www-unix.mcs.anl.gov/mpi/mpich1/ MPICH]/[http://www.mcs.anl.gov/research/projects/mpich2/ MPICH2]===		===[http://www-unix.mcs.anl.gov/mpi/mpich1/ MPICH]/[http://www.mcs.anl.gov/research/projects/mpich2/ MPICH2]===

Stern: /* Intel MPI */

2011-06-01T23:50:35Z

Intel MPI

← Older revision		Revision as of 23:50, June 1, 2011
Line 45:		Line 45:
	=== [http://software.intel.com/en-us/articles/intel-mpi-library/ Intel MPI] ===		=== [http://software.intel.com/en-us/articles/intel-mpi-library/ Intel MPI] ===
	* [http://software.intel.com/en-us/articles/intel-mpi-library-documentation/ Intel MPI Documentation]		* [http://software.intel.com/en-us/articles/intel-mpi-library-documentation/ Intel MPI Documentation]
			* I recommend to use the new ''Hydra'' MPI process manager. See sec. ''2.4 Scalable Process Management System'' in the [http://software.intel.com/sites/products/documentation/hpc/mpi/linux/reference_manual.pdf Reference Manual]. This avoids the need to set up and tear down the older and considerably less stable MPD manager.
			<syntaxhighlight lang="bash">
			mpiexec.hydra \
			-machinefile $PBS_NODEFILE \
			-np $(wc -l < $PBS_NODEFILE) \
			./a.out
			</syntaxhighlight>

	===[http://www-unix.mcs.anl.gov/mpi/mpich1/ MPICH]/[http://www.mcs.anl.gov/research/projects/mpich2/ MPICH2]===		===[http://www-unix.mcs.anl.gov/mpi/mpich1/ MPICH]/[http://www.mcs.anl.gov/research/projects/mpich2/ MPICH2]===

Stern: /* OpenMPI */

2011-05-31T08:36:46Z

OpenMPI

← Older revision		Revision as of 08:36, May 31, 2011
Line 39:		Line 39:

	=== [http://www.open-mpi.org/ OpenMPI] ===		=== [http://www.open-mpi.org/ OpenMPI] ===
	This is the primary and recommended MPI version. It supports Ethernet and ~~Infiniband~~ interconnect.		This is the primary and recommended MPI version. It supports Ethernet and InfiniBand interconnect, with InfiniBand set as default by means of an [http://www.open-mpi.org/faq/?category=openfabrics#ib-btl <code>OMPI_MCA_…</code>] environment variable.
	* [http://www.open-mpi.org/doc/ OpenMPI Documentation]		* [http://www.open-mpi.org/doc/ OpenMPI Documentation]
	* [http://www.open-mpi.org/faq FAQ]		* [http://www.open-mpi.org/faq FAQ]

Stern at 08:29, May 31, 2011

2011-05-31T08:29:30Z

← Older revision		Revision as of 08:29, May 31, 2011
Line 1:		Line 1:
	__TOC__		__TOC__

			This is an overview of the compilers and MPI libraries available on Carbon.
			Each package name leads to its documentation.

			; See also: [[HPC/Software/Modules#Intel development tools \| Module catalog]].

	== Compilers ==		== Compilers ==
Line 12:		Line 17:
	As of 2011, we have the following tools under support within the [http://software.intel.com/en-us/articles/intel-composer-xe/ ''Intel® Composer XE 2011 for Linux''] bundle.		As of 2011, we have the following tools under support within the [http://software.intel.com/en-us/articles/intel-composer-xe/ ''Intel® Composer XE 2011 for Linux''] bundle.

	~~See [[HPC/Software/Modules#Intel development tools \| '''Module catalog''']].~~
	* [http://software.intel.com/en-us/articles/intel-c-compiler-professional-edition-for-linux-documentation/ Intel C/C++]		* [http://software.intel.com/en-us/articles/intel-c-compiler-professional-edition-for-linux-documentation/ Intel C/C++]
	* [http://software.intel.com/en-us/articles/intel-fortran-compiler-professional-edition-for-linux-documentation/ Intel Fortran]		* [http://software.intel.com/en-us/articles/intel-fortran-compiler-professional-edition-for-linux-documentation/ Intel Fortran]
Line 20:		Line 24:
	* [http://software.intel.com/en-us/articles/intel-c-compiler-professional-edition-for-linux-documentation/ Debugger (idb)]		* [http://software.intel.com/en-us/articles/intel-c-compiler-professional-edition-for-linux-documentation/ Debugger (idb)]

	Documentation is ~~available~~ locally under:		Documentation is installed locally mainly under:
	$ICC_HOME/Documentation		$ICC_HOME/Documentation
	<pre>		<pre>

Stern: /* Intel Software Development Products */ more doc links

2011-05-23T02:54:16Z

Intel Software Development Products: more doc links

← Older revision		Revision as of 02:54, May 23, 2011
Line 10:		Line 10:

	=== [http://software.intel.com/en-us/articles/intel-sdp-products/ Intel Software Development Products] ===		=== [http://software.intel.com/en-us/articles/intel-sdp-products/ Intel Software Development Products] ===
	As of 2011, we have the following tools under support within the ''Intel® Composer XE 2011 for Linux'' bundle.		As of 2011, we have the following tools under support within the [http://software.intel.com/en-us/articles/intel-composer-xe/ ''Intel® Composer XE 2011 for Linux''] bundle.
	* [http://software.intel.com/en-us/articles/intel-c-compiler-professional-edition-for-linux-documentation/ Intel C/C++]~~; includes~~
			See [[HPC/Software/Modules#Intel development tools \| '''Module catalog''']].
			* [http://software.intel.com/en-us/articles/intel-c-compiler-professional-edition-for-linux-documentation/ Intel C/C++]
	* [http://software.intel.com/en-us/articles/intel-fortran-compiler-professional-edition-for-linux-documentation/ Intel Fortran]		* [http://software.intel.com/en-us/articles/intel-fortran-compiler-professional-edition-for-linux-documentation/ Intel Fortran]
	* [http://software.intel.com/en-us/articles/intel-math-kernel-library-documentation/ Math Kernel Library] -- see also [[HPC/Software/Modules/mkl]]		* [http://software.intel.com/en-us/articles/intel-math-kernel-library-documentation/ Math Kernel Library] -- see also [[HPC/Software/Modules/mkl]]
	* Integrated Performance Primitives Documentation (IPP)		* [http://software.intel.com/en-us/articles/intel-integrated-performance-primitives-documentation/ Integrated Performance Primitives Documentation (IPP)]
	* Threading Building Blocks Documentation (TBB)		* [http://software.intel.com/en-us/articles/intel-threading-building-blocks-documentation/ Threading Building Blocks Documentation (TBB)]
	* Debugger (idb)		* [http://software.intel.com/en-us/articles/intel-c-compiler-professional-edition-for-linux-documentation/ Debugger (idb)]

	Documentation is available locally under:		Documentation is available locally under:

Stern at 02:16, May 23, 2011

2011-05-23T02:16:31Z

← Older revision		Revision as of 02:16, May 23, 2011
Line 1:		Line 1:
	__TOC__		__TOC__

	== ~~[http://www.intel.com/support/performancetools/ Intel~~ Compilers ~~and Tools]~~ ==		== Compilers ==
	~~We have supported versions of the following commercial tools, currently installed under <code>/opt/intel</code>:~~
	* [http://www.intel.com/support/performancetools/fortran/linux/ Fortran]
	** [http://www.intel.com/cd/software/products/asmo-na/eng/346152.htm Manual for 10.1]
	** <code>/opt/intel/{fc,fce}/''version''</code>
	* [http://www.intel.com/support/performancetools/c/index.htm C++]
	** [http://www.intel.com/cd/software/products/asmo-na/eng/346158.htm Manual for 10.1]
	** <code>/opt/intel/{cc,cce}/''version''</code>
	* [http://www.intel.com/support/performancetools/libraries/mkl/index.htm Intel Math Kernel Library (MKL)], includes Cluster Edition
	** <code>/opt/intel/mkl/''version''</code>
	* [http://www.intel.com/support/performancetools/vtune/index1.htm VTune analyzer]
	* Intel Debugger
	** <code>/opt/intel/{idb,idbe}/''version''</code>
	~~To access the documentation pages, use '''firefox''' on a login node:~~
	* <code>/opt/intel/fce/''version''/doc/Doc_Index.htm</code>
	* <code>/opt/intel/cce/''version''/doc/Doc_Index.htm</code>
	* <code>/opt/intel/mkl/''version''/doc/Doc_index.htm</code>

	==~~Libraries~~==		=== GNU family ===
			* [http://gcc.gnu.org/onlinedocs/ GCC]
			* [http://www.gnu.org/software/gdb/documentation/ GDB]
			* [http://www.gnu.org/software/make/manual/make.html Make]
			* [http://www.gnu.org/manual/manual.html … other manuals]

	=== [http://~~www~~.intel.com/support/~~performancetools~~/~~libraries~~/~~mkl~~/~~index~~.~~htm~~ Intel Math Kernel Library (~~MKL~~)~~] ===~~		=== [http://software.intel.com/en-us/articles/intel-sdp-products/ Intel Software Development Products] ===
			As of 2011, we have the following tools under support within the ''Intel® Composer XE 2011 for Linux'' bundle.
			* [http://software.intel.com/en-us/articles/intel-c-compiler-professional-edition-for-linux-documentation/ Intel C/C++]; includes
			* [http://software.intel.com/en-us/articles/intel-fortran-compiler-professional-edition-for-linux-documentation/ Intel Fortran]
			* [http://software.intel.com/en-us/articles/intel-math-kernel-library-documentation/ Math Kernel Library] -- see also [[HPC/Software/Modules/mkl]]
			* Integrated Performance Primitives Documentation (IPP)
			* Threading Building Blocks Documentation (TBB)
			* Debugger (idb)

	~~Migrated to [[HPC~~/~~Software~~/~~Modules~~/mkl]]		Documentation is available locally under:
			$ICC_HOME/Documentation
			<pre>
			$ ls -F $ICC_HOME/Documentation/en_US
			Release_NotesC.pdf compiler_c/ documentation_f.htm getting_started_f.pdf lgpltext
			Release_NotesF.pdf compiler_f/ flicense idb/ mkl/
			clicense documentation_c.htm getting_started_c.pdf ipp/ tbb/
			</pre>

	~~=== [http~~:~~//www.vtk.org/ VTK] ===~~		No longer maintained on Carbon:
	* [~~https~~://~~visualization~~.~~hpc~~.~~mil~~/~~wiki~~/~~VTK Intro]~~		* [http://www.intel.com/support/performancetools/vtune/index1.htm VTune analyzer]
	* [https://~~visualization.hpc~~.~~mil/wiki/Getting_Started_with_VTK VTK install notes~~]

	~~=== [http://www.mcs.anl.gov/petsc PETSc] ===~~
	* TODO: Portable, Extensible Toolkit for Scientific Computation

	==MPI==		==MPI==

	===[http://www.open-mpi.org/ OpenMPI]===		=== [http://www.open-mpi.org/ OpenMPI] ===
	This is the primary and recommended MPI version. It supports Ethernet and Infiniband interconnect.		This is the primary and recommended MPI version. It supports Ethernet and Infiniband interconnect.
	* ~~See also:~~ [http://www.open-mpi.org/~~faq FAQ~~]		* [http://www.open-mpi.org/doc/ OpenMPI Documentation]
			* [http://www.open-mpi.org/faq FAQ]
	~~===~~[http://www-~~unix.mcs.anl.gov/~~mpi~~/mpich1/ MPICH]/[http://www~~.~~mcs.anl.gov~~/~~research/projects/mpich2/ MPIC2~~]~~===~~

	~~TBD~~

	===[http://~~www~~.intel.com/cd/~~software~~/~~products/asmo~~-~~na/eng~~/~~308295.htm#support~~ Intel MPI]===		=== [http://software.intel.com/en-us/articles/intel-mpi-library/ Intel MPI] ===
			* [http://software.intel.com/en-us/articles/intel-mpi-library-documentation/ Intel MPI Documentation]

	* [http://www.~~intel~~.~~com~~/cd/~~software~~/~~products~~/~~asmo-na~~/~~eng~~/~~368005~~.~~htm Documentation~~]		===[http://www-unix.mcs.anl.gov/mpi/mpich1/ MPICH]/[http://www.mcs.anl.gov/research/projects/mpich2/ MPICH2]===
			* Not installed explicitly, but Intel-MPI is based on MPICH2 and provides an MPICH2 runtime environment for precompiled binaries.

	[[Category:HPC\|Development]]		[[Category:HPC\|Development]]

Stern: /* Note on binary architectures */

2011-05-23T01:03:33Z

Note on binary architectures

@@ Line 18: / Line 18: @@
 * <code>/opt/intel/cce/''version''/doc/Doc_Index.htm</code>
 * <code>/opt/intel/mkl/''version''/doc/Doc_index.htm</code>
 ==Libraries==