The architecture of the Fortran 2003 sparse BLAS is described in:
>S. Filippone, A. Buttari. Object-Oriented Techniques for Sparse Matrix
>Computations in Fortran 2003, ACM Trans. on Math. Software, vol. 38, No.
4, 2012.
The ideas are explored further with the paper:
The PSBLAS library, developed with the aim to facilitate the parallelization of computationally intensive scientific applications, is designed to address parallel implementation of iterative solvers for sparse linear systems through the distributed memory paradigm. It includes routines for multiplying sparse matrices by dense matrices, solving block diagonal systems with triangular diagonal entries, preprocessing sparse matrices, and contains additional routines for dense matrix operations. The current implementation of PSBLAS addresses a distributed memory execution model operating with message passing.
>V. Cardellini, S. Filippone and D. Rouson. Design Patterns for
>sparse-matrix computations on hybrid CPU/GPU platforms, Scientific
>Programming, 22(2014), pp.1-19.
Version 1.0 of the library is described in:
The PSBLAS library version 3 is implemented in the Fortran 2003 programming language, with reuse and/or adaptation of existing Fortran 77 and Fortran 95 software, plus a handful of C routines.
>S. Filippone, M. Colajanni. PSBLAS: A library for parallel linear
>algebra computation on sparse matrices, ACM Trans. on Math. Software,
>26(4), Dec. 2000, pp. 527-550.
## References
UTILITIES
---------
The `test/util` directory contains some utilities to convert to/from
Harwell-Boeing and MatrixMarket file formats.
The architecture, philosophy and implementation details of the library are contained in the following papers:
DOCUMENTATION
- The architecture of the Fortran 2003 sparse BLAS is described in:
-------------
>S. Filippone, A. Buttari. Object-Oriented Techniques for Sparse Matrix
See docs/psblas-3.9.pdf; an HTML version of the same document is
>Computations in Fortran 2003, ACM Trans. on Math. Software, vol. 38, No.
available in docs/html. Please consult the sample programs, especially
4, 2012.
test/pargen/psb_[sd]_pde[23]d.f90
- The ideas are explored further with the paper:
>V. Cardellini, S. Filippone and D. Rouson. Design Patterns for
>sparse-matrix computations on hybrid CPU/GPU platforms, Scientific
>Programming, 22(2014), pp.1-19.
- Version 1.0 of the library is described in:
>S. Filippone, M. Colajanni. PSBLAS: A library for parallel linear
>algebra computation on sparse matrices, ACM Trans. on Math. Software,
>26(4), Dec. 2000, pp. 527-550.
PSBLAS is the backbone of the Parallel Sparse Computation Toolkit ([PSCToolkit](https://psctoolkit.github.io/)) suite of libraries. See the paper:
where the argument to the extraopenacc option depends on the compiler
you are using (the example shown here is relevant for the GNU
compiler).
INSTALLING
----------
To compile and run our software you will need the following
To compile and run our software you will need the following
prerequisites (see also SERIAL below):
prerequisites (see also SERIAL below):
@ -88,21 +67,27 @@ The configure script will generate a Make.inc file suitable for building
the library. The script is capable of recognizing the needed libraries
the library. The script is capable of recognizing the needed libraries
with their default names; if they are in unusual places consider adding
with their default names; if they are in unusual places consider adding
the paths with `--with-libs`, or explicitly specifying the names in
the paths with `--with-libs`, or explicitly specifying the names in
`--with-blas`, etc. Please note that a common way for the configure script
`--with-blas`, etc.
to fail is to specify inconsistent MPI vs. plain compilers, either
directly or indirectly via environment variables; e.g. specifying the
>[!CAUTION]
Intel compiler with `FC=ifort` while at the same time having an
> Please note that a common way for the configure script
`MPIFC=mpif90` which points to GNU Fortran. The best way to avoid this
> to fail is to specify inconsistent MPI vs. plain compilers, either
situation is (in our opinion) to use the environment modules package
> directly or indirectly via environment variables; e.g. specifying the
(see http://modules.sourceforge.net/), and load the relevant
> Intel compiler with `FC=ifort` while at the same time having an
variables with (e.g.)
> `MPIFC=mpif90` which points to GNU Fortran.
```
module load gnu46 openmpi
>[!TIP]
```
> The best way to avoid this
This will delegate to the modules setup to make sure that the version of
> situation is (in our opinion) to use the environment modules package
openmpi in use is the one compiled with the gnu46 compilers. After the
> (see [http://modules.sourceforge.net/](http://modules.sourceforge.net/)), and load the relevant
configure script has completed you can always tweak the Make.inc file
> variables with (e.g.)
yourself.
> ```
> module load gcc/13.2.0 openmpi/4.1.6
> ```
> This will delegate to the modules setup to make sure that the version of
> openmpi in use is the one compiled with the gnu46 compilers. After the
> configure script has completed you can always tweak the Make.inc file
> yourself.
After you have Make.inc fixed, run
After you have Make.inc fixed, run
```
```
@ -114,37 +99,97 @@ install and the libraries will be installed under `/path/lib`, while the
module files will be installed under `/path/modules`. The regular and
module files will be installed under `/path/modules`. The regular and
experimental C interface header files are under `/path/include`.
experimental C interface header files are under `/path/include`.
SERIAL
### CUDA and GPU support
------
This version of PSBLAS incorporates into a single package three
entities that were previouslty separated:
| Library | |
|---------|--------------------|
| PSBLAS | the base library |
| PSBLAS-EXT | a library providing additional storage formats for matrices and vectors |
| SPGPU | a package of kernels for NVIDIA GPUs originally written by Davide Barbieri and Salvatore Filippone; see the license file [cuda/License-spgpu.md](cuda/License-spgpu.md) |
### OpenACC
There is a highly experimental version of an OpenACC interface,