From b5c301eb05e2a3ac7ef8d9970e349e6e0cee5417 Mon Sep 17 00:00:00 2001 From: Salvatore Filippone Date: Wed, 7 Apr 2021 13:10:40 +0200 Subject: [PATCH] New GPU example --- docs/amg4psblas_1.0-guide.pdf | Bin 1829608 -> 1830328 bytes docs/html/userhtmlsu10.html | 38 +- docs/html/userhtmlsu11.html | 62 +-- docs/html/userhtmlsu12.html | 64 +-- docs/html/userhtmlsu13.html | 62 +-- docs/html/userhtmlsu14.html | 22 +- docs/html/userhtmlsu15.html | 46 +-- docs/html/userhtmlsu16.html | 114 +++--- docs/html/userhtmlsu7.html | 46 ++- docs/html/userhtmlsu9.html | 706 +++++++++++++++++----------------- docs/src/gettingstarted.tex | 19 +- 11 files changed, 594 insertions(+), 585 deletions(-) diff --git a/docs/amg4psblas_1.0-guide.pdf b/docs/amg4psblas_1.0-guide.pdf index 16f3f3d6995c772faa917b7552eb89eb5e4fe8e4..bba1106850f96b27612f9917df3c9d114f9f73db 100644 GIT binary patch delta 3565 zcmai0eQaCR74LKFq&THb8{gQ;Ym*oH!3!m?_w#*}s5DIzD0FKVis;5F<|b}p6xXTk zgmn^_YOXSMt5zi1!ynVwKCUU;x-RAbeJ)kW2KwV~QrU0l7Uny5BamsGEQjMF)6wBSr&J9nFXNtA0 z`q8z;ec9SS3Yl-$7sF$PLMgX@w0l*}TcK{4pFmgRg@bhy=sTb4B%VW+_+(hOZifTC zNdolRbdxWc>jd2Yq{c|5oT+&!m5bfJJvm&S#0Y|`5$r1z!T3127j}Lz8DA-da<~^* z!})~Hg=E~3idoDPj)1;K;=wBx*|fq#C2s8+!Ng1y3!}wM9u8efCYv+)(R)Vfx4vg| zViHcp$PJL|B4hBK<)jhrT|-P*`PbyV;hyWrJ_G)_hPaU=+_07$H%_cUorxpqG`w^l ziHCFR$gEM}|E-F&gfAWL%UVrJnDSDTNNVRZ-&ol_?P~Qu8-#}Iv4IXzCbD^-F9BBxA$CU!Qnn(xGOUc0~oyRtiHaKx9 z*#V2+O)6OSx8!bcddOq2*&)}!*&Z@_;%NFnc*-HaF`#f0X$%ija=?I&FSRX!htDKe zz)?XSg6|zmUJoldAq(9=L8hx^2$trPug5)oj}t>}Rv1WP7>$y0jGjTCB1hsLb38Bn zts-~UN*l%Ukw=!mkVn3*3*QOPI9O@JC*L)|YQi-Jz6id(iKO7On~77?nK+t`ht5XQ zXTSp#Bb>U49FM`&rKA$sl8itHMJ%2aD_0y~{y|0A4)@d5JD z4#N)@9w#%gii^`hh2?v`Kn6i0U>-8c3aA@c3jZ0`5{``L;v`Wk5a>!$-wLG55|X-B z;9~hDK7ptGF;ot4r2_nSwQgWBN}04I=g2X%mAGP*uM4!kLRLyV24RX(6`(VWf>BS= z#9B*G4}SItSqa-8CF$^`N65C$IA@OVVd-hY8aQ`6CBlKzq#@Q2AYyt!xbt~(a{VG9 zsG7&w6`?;%E;m#xM99GXRI|G11aYU<*fmUKc7!)LNtt41d^|f|o4-=FT-HDr4dZ>e z@>q?_XZA-R$L!(yT$XOs5^mS$FnJY@xLw$%2Mk`m zjKKL1GnEphgQapduPv#)7m+G*Lgx|h_Ts_u!csM1bZViWCl<^cXTYGt%`e;o=ZU9AV)J92S|5aWb#a{0 z%(YyGpCfv-U2GBDK?a9XA8lb7&?*QlR|V)AU(X0xXoY&NudVPS!K1j1cd|TAb-)rC zj7(8#c^ZXO1bo-2B9O%R62vG{l z=4&97m^WYPyD*K48tEiQ29Z{wQ{P8F_@+Xflr*7O1yPXV(E{TPG_EPkX~48cF0FuT z48@!Vl4C9z;-SKtD2^cNptlXK>Vg>4JY!Jp=^go}^D2dL0`s9$@S)|Z>^&}6C6cE@|r zbJ0x2iqFE}MRVKG;nk6jFxs9?Mw~R-Ui~oQl+pH{9dWMF-f}SFJfppEPsI5~`@v%o z7Z~lYY>c>#hAF=W=PzP#KlwXcxoC!sXYN{Hm~T7?FJ3aOCj1uViM4A7b_^!|10!mb A>Hq)$ delta 2678 zcmah~ZERI%9p|}l@1?h;PqpvIRNb>bGm%^fB>*!IQEkWGUxfe;uB3I&7`gPI8Q_guF5(KP4Z z-}C(6-=2Hu-kUzu8&R%xhAuQXPQ zFZ0talS~pOB$n~T>1>bZGubeR6H7rWe=}ErHaK)Qcc(QS{8@HK zarDV@Yx+hfzrafN!^B0X0;M8fsW>o+pzqJ;X%1BgwWPIo@dG&_0-dO|p^HyvStEi_ z(EM)xM9$hkC`+&R@V4}C-TYUKdaoAiX>Y(cQrG*%8ftsGTu;C3;C=LN9WPTjR-BY> zTfpCD%%q9nUt;uw3w$!If2Q0@Ust?oVyqI{FspGDT~~aJu5E0ttxHr8`8L#W718e{ zC%XC9a(y96!ob89ZA!0dK8fX390!q-^e=m-*h5Wl2dcf)8YEpWB5nsw^UN2w# zKQrkQz5E51Q&C`rriDxRk(^Y4hzzlQ{^J~GBN9=%zn}kw(N}ht>!<1{Fe*mzS8wvy z&Rb4@94R&Bkzb5SOivH+TPvAOPd&@u&kUQy*P-%b8%qGpXd)s2<0oMh`v(7obQ}p_ z4F)pw69uBf*iUp67BnU~i9mE{{lq$Z0>V)DffKO6NqiB8LirlDL?|Gsg$9!F2WSAb zh8y@6p-Es&SRkvDbp1a5cw1J)0h)915Er>n1XA0y?Ny%3WMhfJO1lp8pLR`@aY(Pv zZEB%+PZvAV#!-GPM>ntWHTg)&Al8CDd!6@wd^m7}w>~$mTsu{23?jn#Nb2}?{uG`1 zJD);B*#yec-_b=H+cHWji#~R zFhM_hv2`J336F%s61_GN;~=}7tt(+_~H5OM4)6Z%S4Zxldc3L5oSDuKEM%Y;z3 z0szKzWPKG0fg9~Bt58@AgXo>FHJTJE6j-B*G7N`-a8h_hw8fPPWkFlq7=x3ADsu3( zYrjR&wTAiF3CG$up$j@T00>57e2kEemH0*)2xC2ra$fNnqijK=QU)sy7N#fC+8@?< z&Wu&?p`jMT2x9P~P{TDk9f`zwRqk1Ih5%3*=h~07(@M}9lfX3Ck#$-|`Vk&y0ENAU zF@p)V62w)>y2wlz`qs^<8O9)5H_+OEXE4#o+_%;xjSAQ}QU!yS#G%VRaR6mDP>6*@ z9H??EF~kN6vD*U;^RYph3`90~T>}y~`3B>T zC4)tnPoY(=6a7DixW3|eU<*33#IgmNda4d7NI#1(oEU~R$RfMrs!gbBbhq3cFE zuG?rMV<2Pt5SDcN=YDbwghd!T=SuhjcFFJ}}-^xpBtR@!>Jv3BJ4;S#FvW_4}MUk z!gGK3Yu?N|FkSzeH|+QK4fI9*ef?V61aE?l%(5j)NVOz3%LZiFzjTqm@c)UVvrl`S zxy&b~u8J;`Na%3iJV$*5+MfjL=g7#eWIy0ZVMZdo2 z&GI&Wrz$I)m~z`T -

[nextMethod hierarchy_build

-

-

+

call p,info)

-

This method builds the hierarchy of matrices and restriction/prolongation operators for the multilevel preconditioner init and set. -

Arguments

a

type(psb_).

The sparse matrix structure containing the local part of the matrix to be preconditioned. Note that ].

desc_a

type(psb_desc_type).

The communication descriptor of a. See the PSBLAS User’s Guide @@ -136,9 +136,9 @@ class="cmr-12">].

info

integer, ).

Error code. If no error, 0 is returned. See Section 

-

[next] [up]

-

diff --git a/docs/html/userhtmlsu11.html b/docs/html/userhtmlsu11.html index f8a6b1e8..08501195 100644 --- a/docs/html/userhtmlsu11.html +++ b/docs/html/userhtmlsu11.html @@ -10,7 +10,7 @@ -

[nextMethod smoothers_build

-

-

+

call p,imold])

-

This method builds the smoothers and the coarsest-level solvers for the multilevel preconditioner  5.3). -

Arguments

@@ -262,7 +262,7 @@ class="td11">

a

type(psb_).

The sparse matrix structure containing the local part of the matrix to be preconditioned. Note that ].

desc_a

type(psb_desc_type).

The communication descriptor of a. See the PSBLAS User’s Guide @@ -150,9 +150,9 @@ class="cmr-12">].

info

integer, ).

Error code. If no error, 0 is returned. See Section 7 for details.

amold

class(psb_optional.

The desired dynamic type for internal matrix components; this allows e.g. running on GPUs; it needs not be the same on all @@ -205,9 +205,9 @@ class="cmr-12">].

vmold

class(psb_optional.

The desired dynamic type for internal vector components; this allows e.g. running on GPUs.

imold

class(psb_i_base_vect_typeoptional.

The desired dynamic type for internal integer vector components; this allows e.g. running on GPUs.

-

[next] [up]

-

diff --git a/docs/html/userhtmlsu12.html b/docs/html/userhtmlsu12.html index 6c3a5807..32e905c0 100644 --- a/docs/html/userhtmlsu12.html +++ b/docs/html/userhtmlsu12.html @@ -10,7 +10,7 @@ -

[next5.5 Method build

-

-

+

call p,imold])

-

This method builds the preconditioner p according to the requirements made by the @@ -83,7 +83,7 @@ class="cmtt-12">smoothers_build, whose nomenclature would however be somewhat unnatural when dealing with simple one-level preconditioners. -

Arguments

a

type(psb_).

The sparse matrix structure containing the local part of the matrix to be preconditioned. Note that ].

desc_a

type(psb_desc_type).

The communication descriptor of a. See the PSBLAS User’s Guide @@ -158,9 +158,9 @@ class="cmr-12">].

info

integer, ).

Error code. If no error, 0 is returned. See Section 7 for details.

amold

class(psb_optional.

The desired dynamic type for internal matrix components; this allows e.g. running on GPUs; it needs not be the same on all @@ -213,9 +213,9 @@ class="cmr-12">].

vmold

class(psb_optional.

The desired dynamic type for internal vector components; this allows e.g. running on GPUs.

imold

class(psb_i_base_vect_typeoptional.

The desired dynamic type for internal integer vector components; this allows e.g. running on GPUs.

-

The method can be used to build multilevel preconditioners too. @@ -272,7 +272,7 @@ class="cmr-12">The method can be used to build multilevel preconditioners too.

[next] [up]

-

diff --git a/docs/html/userhtmlsu13.html b/docs/html/userhtmlsu13.html index 815098fd..6f194dd5 100644 --- a/docs/html/userhtmlsu13.html +++ b/docs/html/userhtmlsu13.html @@ -10,7 +10,7 @@ -

[next5.6 Method apply

-

-

+

call p,work])

-

This method computes y = psb_krylov and hence it is completely transparent to the user. -

Arguments

x

type(kind_parameter), dimension(:), intent(in)—.

The local part of the vector x. Note that , single/double class="cmr-12">precision version of AMG4PSBLAS under use.

y

type(kind_parameter), dimension(:), intent(out)—.

The local part of the vector y. Note that , single/double class="cmr-12">precision version of AMG4PSBLAS under use.

desc_a

type(psb_desc_type).

The communication descriptor associated to the matrix to be preconditioned.

info

integer, ).

Error code. If no error, 0 is returned. See Section 7 for details.

trans

character(lenin).

If trans = 1).

work

type(kind_parameter), dimension(:), optional, target—.

Workspace. Its size should be at least 4 

-

[next] [up]

-

diff --git a/docs/html/userhtmlsu14.html b/docs/html/userhtmlsu14.html index 9a39d0ce..9dab129c 100644 --- a/docs/html/userhtmlsu14.html +++ b/docs/html/userhtmlsu14.html @@ -10,7 +10,7 @@ -

[next5.7 Method free

-

-

+

call p,info)

-

This method deallocates the preconditioner data structure p. -

Arguments

info

integer, ).

Error code. If no error, 0 is returned. See Section 

-

[next] [up]

-

diff --git a/docs/html/userhtmlsu15.html b/docs/html/userhtmlsu15.html index 5a45e88f..8c3cfa76 100644 --- a/docs/html/userhtmlsu15.html +++ b/docs/html/userhtmlsu15.html @@ -10,7 +10,7 @@ -

[next5.8 Method descr

-

-

+

call p verbosity])

-

This method prints a description of the preconditioner p to the standard output or to a @@ -68,7 +68,7 @@ class="cmtt-12">build, have been called. -

Arguments

info

integer, ).

Error code. If no error, 0 is returned. See Section 7 for details.

iout

integer, optional.

The id of the file where the preconditioner description will be printed; the default is the standard output.

root

integer, optional.

The id of the process where the preconditioner description will be printed; the default is psb_root_.

verbosity

integer, optional.

The verbosity level of the description. Default value is 0. For values higher than 0, it prints out further information, e.g., for @@ -174,7 +174,7 @@ class="td11">

-

[next] [up]

-

diff --git a/docs/html/userhtmlsu16.html b/docs/html/userhtmlsu16.html index 99eaf060..6b6ab93f 100644 --- a/docs/html/userhtmlsu16.html +++ b/docs/html/userhtmlsu16.html @@ -10,7 +10,7 @@ -

[prev]

class="cmr-12">5.9 Auxiliary Methods -

Various functionalities are implemented as additional methods of the preconditioner object. -

+

5.9.1 Method: dump
-

-

+

call p,global_num])

-

Dump on file. -

Arguments

info

integer, ).

Error code. If no error, 0 is returned. See Section 7 for details.

amold

class(psb_optional.

The desired dynamic type for internal matrix components; this allows e.g. running on GPUs; it needs not be the same on all @@ -134,15 +134,15 @@ class="cmr-12">.

-

+

5.9.2 Method: clone
-

-

+

call p)
-

Create a (deep) copy of the preconditioner object. -

Arguments

pout

type(amg_).

The copy of the preconditioner data structure. Note that x must @@ -199,9 +199,9 @@ class="cmr-12">, single/double precision class="cmr-12">version of AMG4PSBLAS under use.

info

integer, ).

Error code. If no error, 0 is returned. See Section for details.

-

+

5.9.3 Method: sizeof
-

-

+

sz =

global

logical, optional.

Whether the global or local preconditioner memory occupation is desired. Default: .

Return memory footprint in bytes. -

+

5.9.4 Method: allocate_wrk
-

-

+

call p vmold])

-

Allocate internal work vectors. Each application of the preconditioner uses a number of work vectors which are allocated internally as necessary; therefore allocation and @@ -326,7 +326,7 @@ class="cmr-12">argument to the apply method. -

Arguments

info

integer, ).

Error code. If no error, 0 is returned. See Section 7 for details.

vmold

class(psb_optional.

The desired dynamic type for internal vector components; this allows e.g. running on GPUs.

-

+

5.9.5 Method: free_wrk
-

-

+

call p(info)

-

Deallocate internal work vectors. -

Arguments

info

integer, ).

Error code. If no error, 0 is returned. See Section The code discussed here shows how to set up a program exploiting class="cmr-12">capabilities of PSBLAS and AMG4PSBLAS. The code example is available in the source distribution directory amg4psblas/tests/gpuamg4psblas/examples/gpu.

First of all, we need to include the appropriate modules and declare some auxiliary @@ -51,19 +51,16 @@ class="cmr-12">variables:

-

+

-program amg_d_pde3d
+program amg_dexample_gpu
   use psb_base_mod
   use amg_prec_mod
   use psb_krylov_mod
   use psb_util_mod
   use psb_gpu_mod
   use data_input
-  use amg_d_pde3d_base_mod
-  use amg_d_pde3d_exp_mod
-  use amg_d_pde3d_gauss_mod
-  use amg_d_genpde_mod
+  use amg_d_pde_mod
   implicit none
   .......
   ! GPU variables
@@ -72,7 +69,7 @@ program amg_d_pde3d
   type(psb_i_vect_gpu)       :: igmold
  
-

+


Listing 5: setup of a GPU-enabled test program part one.
@@ -80,7 +77,15 @@ class="content">setup of a GPU-enabled test program part one.

In this particular example we are choosing to employ a HLG data structure for +sparse matrices on GPUs; for more information please refer to the PSBLAS-EXT users’ +guide. +

We then have to initialize the GPU environment, and pass the appropriate MOLD variables to the build methods (see also the PSBLAS and PSBLAS-EXT users’ @@ -89,7 +94,7 @@ class="cmr-12">guides). -

@@ -97,7 +102,7 @@ class="cmr-12">guides).
-

+

   call psb_init(ctxt)
   call psb_info(ctxt,iam,np)
@@ -111,7 +116,7 @@ class="cmr-12">guides).
   call prec%smoothers_build(a,desc_a,info, amold=agmold, vmold=vgmold, imold=igmold)
  
-

+


Listing 6: setup of a GPU-enabled test program part two.
@@ -119,7 +124,7 @@ class="content">setup of a GPU-enabled test program part two.

Finally, we convert the input matrix, the descriptor and the vectors to use a GPU-enabled internal storage format. We then preallocate the preconditioner @@ -130,7 +135,7 @@ class="cmr-12">GPU environment -

@@ -138,7 +143,7 @@ class="cmr-12">GPU environment
-

+

   call desc_a%cnv(mold=igmold)
   call a%cscnv(info,mold=agmold)
@@ -162,7 +167,7 @@ class="cmr-12">GPU environment
   stop
  
-

+


Listing 7: setup of a GPU-enabled test program part three.
@@ -170,7 +175,7 @@ class="content">setup of a GPU-enabled test program part three.

It is very important to employ solvers that are suited to the GPU, i.e. solvers that do NOT employ triangular system solve kernels. Solvers that satisfy this constraint @@ -188,9 +193,10 @@ class="cmtt-12">INVT

  • AINV
    • -

    and their L1

    and their ℓ1 variants. diff --git a/docs/html/userhtmlsu9.html b/docs/html/userhtmlsu9.html index a6891350..c276983a 100644 --- a/docs/html/userhtmlsu9.html +++ b/docs/html/userhtmlsu9.html @@ -515,6 +515,12 @@ class="cmr-12">previously set, the coarsest-level solver is changed to the defau solver.

    In a parallel setting with many cores, we suggest to the users to change the default +coarsest solver for using the KRM choice, i.e. a parallel distributed iterative solution of +the coarsest system based on Krylov methods. +

    Remark 4. The argument idx . -

    @@ -547,7 +553,7 @@ class="cmr-12">.
    -

    +

    +class="td11">

    1

    Parameters defining the aggregation algorithm.

    @@ -948,7 +954,7 @@ class="content">Parameters defining the aggregation algorithm.

    +

    what

    		type

    val

    deault

    cots

    ’ML_CYCLE’

    character(len=*)

    ’VCYCLE’ -

    ’WCYCLE’ -

    ’KCYCLE’ -

    ’ADD’

    ’VCYCLE’

    Multilevel cycle: V-cycle, W-cycle, K-cycle, +class="td11">

    Multilevel cycle: V-cycle, W-cycle, K-cycle, and additive composition.

    ’CYCLE_SWEEPS’

    integer

    Any integer -

    number

    Any integer +

    number ≥ 1

    1

    Number of multilevel cycles.

    Number of multilevel cycles.

    -

    @@ -663,7 +669,7 @@ applied.
    -

    +

    @@ -677,7 +683,7 @@ id="TBL-5-4">

    what

    		type

    val

    deault

    cots

    ’MIN_COARSE_SIZE_PER_PROCESS’

    integer

    Any number -

    Any number +

    > 0

    200

    Coarse size threshold per process. The +class="td11">

    200

    Coarse size threshold per process. The aggregation stops if the global number of variables of the computed coarsest matrix is lower than or equal to this threshold @@ -731,17 +737,17 @@ multiplied by the number of processes

    ’MIN_COARSE_SIZE’

    integer

    Any number -

    Any number +

    > 0

    -1

    Coarse size threshold. The aggregation +class="td11">

    -1

    Coarse size threshold. The aggregation stops if the global number of variables of the computed coarsest matrix is lower than or equal @@ -754,17 +760,17 @@ class="cmtt-10x-x-109">’.

    ’MIN_CR_RATIO’

    real

    Any number -

    Any number +

    > 1

    1.5

    Minimum coarsening +class="td11">

    1.5

    Minimum coarsening ratio. The aggregation stops if the ratio between the global matrix dimensions at two consecutive levels is lower than or @@ -772,41 +778,41 @@ equal to this threshold (see Note).

    ’MAX_LEVS’

    integer

    Any integer -

    number

    Any integer +

    number > 1

    20

    Maximum number of levels. The +class="td11">

    20

    Maximum number of levels. The aggregation stops if the number of levels reaches this value (see Note).

    ’PAR_AGGR_ALG’

    character(len=*)

    ’DEC’, ’SYMDEC’, ’COUPLED’

    ’DEC’

    Parallel aggregation algorithm. -

    the

    Parallel aggregation algorithm. +

    the SYMDEC option applies decoupled aggregation to the sparsity pattern of T .

    ’AGGR_TYPE’

    character(len=*)

    ’SOC1’, @@ -837,11 +843,11 @@ class="cmtt-10x-x-109">’, class="cmtt-10x-x-109">’MATCHBOXP’

    ’SOC1’

    Type of aggregation algorithm: currently, +class="td11">

    Type of aggregation algorithm: currently, for the decoupled aggregation we implement two measures of strength of connection, the @@ -857,22 +863,22 @@ href="userhtmlli5.html#XMatchBoxP">9].

    ’AGGR_SIZE’

    integer

    Any integer -

    power of 2, +class="td11">

    Any integer +

    power of 2, with aggr_size ≥ 2

    4

    Maximum size of aggregates when the +class="td11">

    4

    Maximum size of aggregates when the coupled aggregation based on matching is applied. For aggressive coarsening with size of aggregate larger than 8 @@ -884,16 +890,16 @@ class="cmtt-10x-x-109">’MATCHBOXP’

    ’AGGR_PROL’

    character(len=*)

    ’SMOOTHED’, @@ -901,11 +907,11 @@ class="cmtt-10x-x-109">’, class="cmtt-10x-x-109">’UNSMOOTHED’

    ’SMOOTHED’

    Prolongator used by the aggregation +class="td11">

    Prolongator used by the aggregation algorithm: smoothed or unsmoothed (i.e., tentative prolongator).

    Parameters defining the aggregation algorithm (continued).

    @@ -1091,7 +1097,7 @@ class="content">Parameters defining the aggregation algorithm (continued). -

    +

    @@ -1105,7 +1111,7 @@ id="TBL-7-4">

    @@ -1472,7 +1478,7 @@ class="content">Parameters defining the solver at the coarsest level (continued) -

    @@ -1480,7 +1486,7 @@ class="content">Parameters defining the solver at the coarsest level (continued)
    -

    +

    @@ -1494,7 +1500,7 @@ id="TBL-8-4">

    +class="td11">

    The stopping tolerance.

    Additional parameters defining the solver at the coarsest level. -

    @@ -1934,7 +1940,7 @@ class="content">Additional parameters defining the solver at the coarsest level.
    -

    +

    what

    		type

    val

    deault

    cots

    ’AGGR_ORD’

    character(len=*)

    ’NATURAL’ -

    ’DEGREE’

    ’NATURAL’

    Initial ordering of indices for +class="td11">

    Initial ordering of indices for the decoupled aggregation algorithm: either natural ordering or sorted by descending degrees of the nodes in the @@ -1017,44 +1023,44 @@ matrix graph.

    ’AGGR_THRESH’

    real(kind_parameter)

    Any real -

    number 

    Any real +

    number ∈ [0,1]

    0.01

    The threshold

    0.01

    The threshold θ in the strength of connection algorithm. See also the note at the bottom of this table.

    ’AGGR_FILTER’

    character(len=*)

    ’FILTER’ -

    ’NOFILTER’

    ’NOFILTER’

    Matrix used in computing the smoothed +class="td11">

    Matrix used in computing the smoothed prolongator: filtered or unfiltered.

    what

    		type

    val

    deault

    cots

    ’COARSE_MAT’

    character(len=*)

    ’DIST’ -

    ’REPL’

    ’REPL’

    Coarsest matrix layout: distributed among the +class="td11">

    Coarsest matrix layout: distributed among the processes or replicated on each of them.

    ’COARSE_SOLVE’

    character(len=*)

    ’MUMPS’ -

    ’UMF’ -

    ’SLU’ -

    ’SLUDIST’ -

    ’JACOBI’ -

    ’GS’ -

    ’BJAC’ -

    ’KRM’ @@ -1213,20 +1219,20 @@ class="cmtt-10x-x-109">L1-JACOBI’ -

    ’L1-BJAC’ -

    ’L1-FBGS’

    See Note.

    Solver used at the coarsest level: sequential +class="td11">

    See Note.

    Solver used at the coarsest level: sequential LU from MUMPS, UMFPACK, or SuperLU (plus triangular solve); distributed LU from MUMPS or SuperLU_Dist (plus triangular solve); @@ -1256,53 +1262,53 @@ double precision.

    ’COARSE_SUBSOLVE’

    character(len=*)

    ’ILU’ -

    ’ILUT’ -

    ’MILU’ -

    ’MUMPS’ -

    ’SLU’ -

    ’UMF’ -

    ’INVT’ -

    ’INVK’ -

    ’AINV’

    See Note.

    Solver for the diagonal blocks of the coarsest +class="td11">

    See Note.

    Solver for the diagonal blocks of the coarsest matrix, in case the block Jacobi solver is chosen as coarsest-level solver: ILU(p), ILU(ILU otherwise.

    what

    		type

    val

    deault

    cos

    ’COARSE_SWEEPS’

    integer

    Any +class="td11">

    Any integer -

    number

    number > 0

    10

    Number of sweeps when

    10

    Number of sweeps when JACOBI, GS or BJAC is @@ -1407,39 +1413,39 @@ chosen as coarsest-level solver.

    ’COARSE_FILLIN’

    integer

    Any +class="td11">

    Any integer -

    number

    number ≥ 0

    0

    Fill-in level

    0

    Fill-in level p of the ILU factorizations and first fill-in for the approximate inverses.

    ’COARSE_ILUTHRS’

    real(kind_parameter)

    Any real -

    number

    Any real +

    number ≥ 0

    0

    Drop tolerance

    0

    Drop tolerance t in the ILU(p,t) factorization and first drop-tolerance for the approximate inverses.

    what

    		type

    val

    deault

    cots

    ’BJAC_STOP’

    character(len=*)

    ’FALSE’ -

    ’TRUE’

    ’FALSE’

    Select whether to use a stopping criterion for +class="td11">

    Select whether to use a stopping criterion for the Block-Jacobi method used as a coarse solver.

    ’BJAC_TRACE’

    character(len=*)

    ’FALSE’ -

    ’TRUE’

    ’FALSE’

    Select whether to print a trace for the +class="td11">

    Select whether to print a trace for the calculated residual for the Block-Jacobi method used as a coarse solver.

    ’BJAC_ITRACE’

    integer

    Any integer -

    Any integer +

    > 0

    -1

    Number of iterations after which a trace is to +class="td11">

    -1

    Number of iterations after which a trace is to be printed.

    ’BJAC_RESCHECK’

    integer

    Any integer -

    Any integer +

    > 0

    -1

    Number of iterations after which a residual is +class="td11">

    -1

    Number of iterations after which a residual is to be calculated.

    ’BJAC_STOPTOL’

    real(kind_parameter)

    Any real -

    Any real +

    < 1

    0

    Tolerance for the stopping criterion on the +class="td11">

    0

    Tolerance for the stopping criterion on the residual.

    ’KRM_METHOD’

    character(len=*)

    ’CG’ -

    ’FCG’ -

    ’CGS’ -

    ’CGR’ -

    ’BICG’ -

    ’BICGSTAB’ -

    ’BICGSTABL’ -

    ’RGMRES’

    ’FCG’

    A string that defines the iterative method to +class="td11">

    A string that defines the iterative method to be used when employing a Krylov method ’

    ’KRM_KPREC’

    character(len=*)

    Table 

    Table 1

    ’BJAC’

    The one-level +class="td11">

    The one-level preconditioners from the Table 1 can be used for the coarse Krylov solver.

    ’KRM_SUB_SOLVE’

    character(len=*)

    Table 

    Table 5

    ’ILU’

    Solver for the diagonal blocks of the coarsest +class="td11">

    Solver for the diagonal blocks of the coarsest matrix preconditioner, in case the block Jacobi solver is chosen as 5 applies here.

    ’KRM_GLOBAL’

    character(len=*)

    ’TRUE’, @@ -1789,46 +1795,46 @@ class="cmtt-10x-x-109">’, class="cmtt-10x-x-109">’FALSE’

    ’FALSE’

    Choose between a global Krylov solver, all +class="td11">

    Choose between a global Krylov solver, all unknowns on a single node, or a distributed one. The default choice is the distributed solver.

    ’KRM_EPS’

    real(kind_parameter)

    Real

    Real < 1

    10

    10-6

    The stopping tolerance.

    ’KRM_IRST’

    integer

    Integer -

    Integer +

    ≥ 1

    30

    An integer specifying the restart parameter. +class="td11">

    30

    An integer specifying the restart parameter. This is employed for the BiCGSTABL or RGMRES @@ -1836,16 +1842,16 @@ methods, otherwise it is ignored.

    ’KRM_ISTOPC’

    integer

    Integers +class="td11">

    Integers 1,2,3

    2

    If

    2

    If 1 then the method uses the normwise backward error in the infinity norm; if 2, the @@ -1858,32 +1864,32 @@ for the details.

    ’KRM_ITMAX’

    integer

    Integer -

    Integer +

    ≥ 1

    40

    The maximum number of iterations to +class="td11">

    40

    The maximum number of iterations to perform.

    ’KRM_ITRACE’

    integer

    Integer -

    Integer +

    ≥ 0

    -1

    If

    -1

    If > 0 print out an informational message about convergence every

    ’KRM_FILLIN’

    integer

    Integer -

    Integer +

    ≥ 0

    0

    Fill-in level

    0

    Fill-in level p of the ILU factorizations and first fill-in for the approximate inverses.

    @@ -2268,7 +2274,7 @@ preconditioner. -

    @@ -2276,7 +2282,7 @@ preconditioner.
    -

    +

    what

    		type

    val

    deault

    cots

    ’SMOOTHER_TYPE’

    character(len=*)

    ’JACOBI’ -

    ’GS’ -

    ’BGS’ -

    ’BJAC’ -

    ’AS’ -

    ’L1-JACOBI’ -

    ’L1-BJAC’ -

    ’L1-FBGS’

    ’FBGS’

    Type of smoother used in the multilevel preconditioner: point-Jacobi, hybrid @@ -2050,21 +2056,21 @@ class="cmr-10">–hybrid (forward) Gauss-Seidel, class="cmmi-10">ℓ1-point-Jacobi and Additive Schwarz. -

    It is ignored by one-level preconditioners.

    ’SUB_SOLVE’

    character(len=*)

    ’JACOBI’ @@ -2072,47 +2078,47 @@ class="cmtt-10">’ class="cmtt-10">’GS’ -

    ’BGS’ -

    ’ILU’ -

    ’ILUT’ -

    ’MILU’ -

    ’MUMPS’ -

    ’SLU’ -

    ’UMF’ -

    ’INVT’ -

    ’INVK’ -

    ’AINV’

    GS and BGS multilevel class="cmr-10">preconditioners, respectively -

    ILU for block-Jacobi and Additive Schwarz class="cmr-10">one-level preconditioners

    The local solver to be used with the smoother or one-level preconditioner (see @@ -2190,22 +2196,22 @@ class="cmr-10">Note for details on hybrid Gauss-Seidel.

    ’SMOOTHER_SWEEPS’

    integer

    Any integer -

    number ≥ 0

    1

    Number of sweeps of the smoother or one-level preconditioner. In the multilevel @@ -2232,22 +2238,22 @@ class="cmr-10">respectively.

    ’SUB_OVR’

    integer

    Any integer -

    number ≥ 0

    1

    Number of overlap layers, for Additive Schwarz only.

    what

    		type

    val

    deault

    cots

    ’SUB_RESTR’

    character(len=*)

    ’HALO’ -

    ’NONE’

    ’HALO’

    Type of restriction operator, for Additive Schwarz only: ’NONE’ for neglecting it. -

    Note that HALO must be chosen for the @@ -2366,28 +2372,28 @@ class="cmr-10">its RAS variant.

    ’SUB_PROL’

    character(len=*)

    ’SUM’ -

    ’NONE’

    ’NONE’

    Type of prolongation operator, for Additive Schwarz only: ’ for neglecting them. -

    Note that ’SUMfor its RAS variant.

    ’SUB_FILLIN’

    integer

    Any integer -

    number ≥ 0

    0

    Fill-in level p of the incomplete LU @@ -2443,25 +2449,25 @@ class="cmr-10">factorizations.

    ’SUB_ILUTHRS’

    real(kind_parameter)

    Any real number ≥ 0

    0

    Drop tolerance t in the ILU(factorization.

    ’MUMPS_LOC_GLOB’

    character(len=*)

    ’LOCAL_SOLVER’ -

    ’GLOBAL_SOLVER’

    ’GLOBAL_SOLVER’

    Whether MUMPS should be used as a distributed solver, or as a serial solver acting @@ -2504,19 +2510,19 @@ class="cmr-10">process.

    ’MUMPS_IPAR_ENTRY’

    integer

    Any integer number

    0

    Set an entry in the MUMPS integer control array, as chosen via the argument.

    ’MUMPS_RPAR_ENTRY’

    real

    Any real number

    0

    Set an entry in the MUMPS real control array, as chosen via the Parameters defining the smoother or the details of the one-level -

    [next] [up]

    -

    diff --git a/docs/src/gettingstarted.tex b/docs/src/gettingstarted.tex index 5d35fe7c..cf3ecaca 100644 --- a/docs/src/gettingstarted.tex +++ b/docs/src/gettingstarted.tex @@ -422,24 +422,21 @@ call P%build(A,desc_A,info) The code discussed here shows how to set up a program exploiting the combined GPU capabilities of PSBLAS and AMG4PSBLAS. The code example is available in the source distribution -directory \verb|amg4psblas/tests/gpu|. +directory \verb|amg4psblas/examples/gpu|. First of all, we need to include the appropriate modules and declare some auxiliary variables: \begin{listing}[h!] \ifpdf \begin{minted}[breaklines=true,bgcolor=bg,fontsize=\small]{fortran} -program amg_d_pde3d +program amg_dexample_gpu use psb_base_mod use amg_prec_mod use psb_krylov_mod use psb_util_mod use psb_gpu_mod use data_input - use amg_d_pde3d_base_mod - use amg_d_pde3d_exp_mod - use amg_d_pde3d_gauss_mod - use amg_d_genpde_mod + use amg_d_pde_mod implicit none ....... ! GPU variables @@ -452,17 +449,14 @@ program amg_d_pde3d \begin{minipage}{.90\textwidth} {\small \begin{verbatim} -program amg_d_pde3d +program amg_dexample_gpu use psb_base_mod use amg_prec_mod use psb_krylov_mod use psb_util_mod use psb_gpu_mod use data_input - use amg_d_pde3d_base_mod - use amg_d_pde3d_exp_mod - use amg_d_pde3d_gauss_mod - use amg_d_genpde_mod + use amg_d_pde_mod implicit none ....... ! GPU variables @@ -477,6 +471,9 @@ program amg_d_pde3d \fi \caption{setup of a GPU-enabled test program part one.\label{fig:gpu-ex1}} \end{listing} +In this particular example we are choosing to employ a \verb|HLG| data +structure for sparse matrices on GPUs; for more information please +refer to the PSBLAS-EXT users' guide. We then have to initialize the GPU environment, and pass the appropriate MOLD variables to the build methods (see also the PSBLAS