lid velocity = 2.68464e-05, prandtl # = 1., grashof # = 1.
Number of SNES iterations = 2
************************************************************************************************************************
***             WIDEN YOUR WINDOW TO 120 CHARACTERS.  Use 'enscript -r -fCourier9' to print this document            ***
************************************************************************************************************************

---------------------------------------------- PETSc Performance Summary: ----------------------------------------------

ex19 on a arch-fastmath named Q02-I1-J06.vesta.itd with 16 processors, by balay Thu Aug  1 04:38:37 2013
Using Petsc Release Version 3.4.2, unknown 

                         Max       Max/Min        Avg      Total 
Time (sec):           9.568e+00      1.00000   9.568e+00
Objects:              1.110e+02      1.00000   1.110e+02
Flops:                1.744e+09      1.04229   1.693e+09  2.708e+10
Flops/sec:            1.823e+08      1.04229   1.769e+08  2.831e+09
MPI Messages:         5.301e+03      2.00000   3.976e+03  6.362e+04
MPI Message Lengths:  8.007e+06      2.00000   1.518e+03  9.659e+07
MPI Reductions:       2.713e+03      1.00000

Flop counting convention: 1 flop = 1 real number operation of type (multiply/divide/add/subtract)
                            e.g., VecAXPY() for real vectors of length N --> 2N flops
                            and VecAXPY() for complex vectors of length N --> 8N flops

Summary of Stages:   ----- Time ------  ----- Flops -----  --- Messages ---  -- Message Lengths --  -- Reductions --
                        Avg     %Total     Avg     %Total   counts   %Total     Avg         %Total   counts   %Total 
 0:      Main Stage: 9.5681e+00 100.0%  2.7084e+10 100.0%  6.362e+04 100.0%  1.518e+03      100.0%  2.712e+03 100.0% 

------------------------------------------------------------------------------------------------------------------------
See the 'Profiling' chapter of the users' manual for details on interpreting output.
Phase summary info:
   Count: number of times phase was executed
   Time and Flops: Max - maximum over all processors
                   Ratio - ratio of maximum to minimum over all processors
   Mess: number of messages sent
   Avg. len: average message length (bytes)
   Reduct: number of global reductions
   Global: entire computation
   Stage: stages of a computation. Set stages with PetscLogStagePush() and PetscLogStagePop().
      %T - percent time in this phase         %f - percent flops in this phase
      %M - percent messages in this phase     %L - percent message lengths in this phase
      %R - percent reductions in this phase
   Total Mflop/s: 10e-6 * (sum of flops over all processors)/(max time over all processors)
------------------------------------------------------------------------------------------------------------------------
Event                Count      Time (sec)     Flops                             --- Global ---  --- Stage ---   Total
                   Max Ratio  Max     Ratio   Max  Ratio  Mess   Avg len Reduct  %T %f %M %L %R  %T %f %M %L %R Mflop/s
------------------------------------------------------------------------------------------------------------------------

--- Event Stage 0: Main Stage

SNESSolve              1 1.0 9.4903e+00 1.0 1.74e+09 1.0 6.3e+04 1.5e+03 2.7e+03 99100100100 98  99100100100 98  2854
SNESFunctionEval       3 1.0 1.7040e-03 1.0 6.05e+05 1.0 1.4e+02 9.6e+02 2.0e+00  0  0  0  0  0   0  0  0  0  0  5509
SNESJacobianEval       2 1.0 3.6023e-01 1.0 9.26e+06 1.0 2.2e+03 9.6e+02 7.9e+01  4  1  3  2  3   4  1  3  2  3   399
SNESLineSearch         2 1.0 6.9122e-03 1.0 1.36e+06 1.0 1.9e+02 1.3e+03 8.0e+00  0  0  0  0  0   0  0  0  0  0  3054
VecDot                 2 1.0 3.9387e-04 1.7 3.84e+04 1.0 0.0e+00 0.0e+00 2.0e+00  0  0  0  0  0   0  0  0  0  0  1513
VecMDot             1230 1.0 1.2068e+00 1.3 3.64e+08 1.0 0.0e+00 0.0e+00 1.2e+03 12 21  0  0 45  12 21  0  0 45  4676
VecNorm             1277 1.0 1.7360e-01 1.3 2.45e+07 1.0 0.0e+00 0.0e+00 1.3e+03  2  1  0  0 47   2  1  0  0 47  2192
VecScale            1272 1.0 1.4569e-01 1.0 1.22e+07 1.0 0.0e+00 0.0e+00 0.0e+00  1  1  0  0  0   1  1  0  0  0  1301
VecCopy               86 1.0 1.8857e-03 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
VecSet              1318 1.0 1.6121e-02 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
VecAXPY              122 1.0 1.5728e-02 1.0 2.34e+06 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0  2311
VecWAXPY               2 1.0 2.5105e-04 1.0 1.92e+04 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0  1187
VecMAXPY            1272 1.0 1.4923e+00 1.0 3.87e+08 1.0 0.0e+00 0.0e+00 0.0e+00 15 22  0  0  0  15 22  0  0  0  4028
VecScatterBegin     1319 1.0 9.7711e-02 1.4 0.00e+00 0.0 6.3e+04 1.5e+03 0.0e+00  1  0100100  0   1  0100100  0     0
VecScatterEnd       1319 1.0 1.1736e-01 1.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  1  0  0  0  0   1  0  0  0  0     0
VecReduceArith         5 1.0 4.0507e-04 1.0 9.60e+04 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0  3678
VecReduceComm          3 1.0 1.2565e-04 1.9 0.00e+00 0.0 0.0e+00 0.0e+00 3.0e+00  0  0  0  0  0   0  0  0  0  0     0
VecNormalize        1272 1.0 3.2591e-01 1.1 3.66e+07 1.0 0.0e+00 0.0e+00 1.3e+03  3  2  0  0 47   3  2  0  0 47  1745
MatMult             1272 1.0 2.7695e+00 1.0 4.72e+08 1.0 6.1e+04 1.5e+03 0.0e+00 29 27 96 98  0  29 27 96 98  0  2658
MatSolve            1272 1.0 3.3273e+00 1.1 4.68e+08 1.0 0.0e+00 0.0e+00 0.0e+00 33 27  0  0  0  33 27  0  0  0  2184
MatLUFactorNum         2 1.0 8.6786e-02 1.1 3.53e+06 1.1 0.0e+00 0.0e+00 0.0e+00  1  0  0  0  0   1  0  0  0  0   627
MatILUFactorSym        1 1.0 5.5931e-03 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 1.0e+00  0  0  0  0  0   0  0  0  0  0     0
MatAssemblyBegin       3 1.0 4.4751e-0313.4 0.00e+00 0.0 0.0e+00 0.0e+00 6.0e+00  0  0  0  0  0   0  0  0  0  0     0
MatAssemblyEnd         3 1.0 1.1239e-02 1.0 0.00e+00 0.0 9.6e+01 3.9e+02 8.0e+00  0  0  0  0  0   0  0  0  0  0     0
MatGetRowIJ            1 1.0 3.0994e-06 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
MatGetOrdering         1 1.0 1.2429e-03 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 4.0e+00  0  0  0  0  0   0  0  0  0  0     0
MatZeroEntries         2 1.0 1.2178e-03 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
MatFDColorCreate       1 1.0 6.4164e-02 1.0 0.00e+00 0.0 9.6e+01 3.9e+02 7.1e+01  1  0  0  0  3   1  0  0  0  3     0
MatFDColorApply        2 1.0 2.9558e-01 1.0 9.26e+06 1.0 2.1e+03 9.9e+02 7.0e+00  3  1  3  2  0   3  1  3  2  0   486
MatFDColorFunc        42 1.0 3.0313e-02 1.4 8.47e+06 1.0 2.0e+03 9.6e+02 0.0e+00  0  0  3  2  0   0  0  3  2  0  4335
KSPGMRESOrthog      1230 1.0 2.5983e+00 1.1 7.28e+08 1.0 0.0e+00 0.0e+00 1.2e+03 27 42  0  0 45  27 42  0  0 45  4344
KSPSetUp               4 1.0 1.3692e-03 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 1.0e+01  0  0  0  0  0   0  0  0  0  0     0
KSPSolve               2 1.0 9.1219e+00 1.0 1.73e+09 1.0 6.1e+04 1.5e+03 2.6e+03 95 99 96 97 95  95 99 96 97 95  2951
PCSetUp                4 1.0 9.4185e-02 1.1 3.53e+06 1.1 0.0e+00 0.0e+00 7.0e+00  1  0  0  0  0   1  0  0  0  0   578
PCSetUpOnBlocks        2 1.0 9.3801e-02 1.1 3.53e+06 1.1 0.0e+00 0.0e+00 5.0e+00  1  0  0  0  0   1  0  0  0  0   580
PCApply             1272 1.0 3.4620e+00 1.1 4.68e+08 1.0 0.0e+00 0.0e+00 0.0e+00 35 27  0  0  0  35 27  0  0  0  2099
------------------------------------------------------------------------------------------------------------------------

Memory usage is given in bytes:

Object Type          Creations   Destructions     Memory  Descendants' Mem.
Reports information only for process 0.

--- Event Stage 0: Main Stage

                SNES     1              1         1308     0
      SNESLineSearch     1              1          856     0
              DMSNES     1              1          664     0
              Vector    53             53      3625160     0
      Vector Scatter     4              4         4208     0
              Matrix     4              4      5026468     0
  Matrix FD Coloring     1              1      1563804     0
    Distributed Mesh     1              1        54944     0
     Bipartite Graph     2              2         1584     0
           Index Set    34             34       163800     0
   IS L to G Mapping     3              3        41740     0
       Krylov Solver     2              2        19504     0
     DMKSP interface     1              1          648     0
      Preconditioner     2              2         1848     0
              Viewer     1              0            0     0
========================================================================================================================
Average time to get PetscTime(): 6.91414e-07
Average time for MPI_Barrier(): 2.19345e-06
Average time for zero size MPI_Send(): 9.76026e-06
#PETSc Option Table entries:
-da_refine 6
-log_summary
#End of PETSc Option Table entries
Compiled without FORTRAN kernels
Compiled with full precision matrices (default)
sizeof(short) 2 sizeof(int) 4 sizeof(long) 8 sizeof(void*) 8 sizeof(PetscScalar) 8 sizeof(PetscInt) 4
Configure run at: Wed Jul 31 16:13:30 2013
Configure options: PETSC_ARCH=arch-fastmath --prefix=/gpfs/vesta-fs0/projects/FASTMath/install/petsc/3.4.2.1/linux-rhel_6-ppc64-gcc-4.4.6 --with-cmake=/gpfs/vesta-fs0/projects/FASTMath/install/cmake/2.8.11.1/linux-rhel_6-ppc64-gcc-4.4.6/bin/cmake --with-blas-lib=/gpfs/vesta-fs0/projects/FASTMath/install/blas/19Apr11/linux-rhel_6-ppc64-gcc-4.4.6/lib/libblas.a --with-lapack-lib=/gpfs/vesta-fs0/projects/FASTMath/install/lapack/3.4.2/linux-rhel_6-ppc64-gcc-4.4.6/lib/liblapack.a --with-metis-dir=/gpfs/vesta-fs0/projects/FASTMath/install/metis/5.1.0/linux-rhel_6-ppc64-gcc-4.4.6 --with-parmetis-dir=/gpfs/vesta-fs0/projects/FASTMath/install/parmetis/4.0.3/linux-rhel_6-ppc64-gcc-4.4.6 --with-hdf5-dir=/gpfs/vesta-fs0/projects/FASTMath/install/hdf5/1.8.11/linux-rhel_6-ppc64-gcc-4.4.6 --with-superlu_dist-include=/gpfs/vesta-fs0/projects/FASTMath/install/superlu/dist-3.3/linux-rhel_6-ppc64-gcc-4.4.6/include --with-superlu_dist-lib="-L/gpfs/vesta-fs0/projects/FASTMath/install/superlu/dist-3.3/linux-rhel_6-ppc64-gcc-4.4.6/lib -lsuperlu" --with-zoltan-dir=/gpfs/vesta-fs0/projects/FASTMath/install/zoltan/trilinos-11.2.4/linux-rhel_6-ppc64-gcc-4.4.6 --with-moab-include=/gpfs/vesta-fs0/projects/FASTMath/install/moab/4.6.0/linux-rhel_6-ppc64-gcc-4.4.6/include --with-moab-lib="-L/gpfs/vesta-fs0/projects/FASTMath/install/moab/4.6.0/linux-rhel_6-ppc64-gcc-4.4.6/lib -lMOAB -L/gpfs/vesta-fs0/projects/FASTMath/install/cgma/12.2.0/linux-rhel_6-ppc64-gcc-4.4.6/lib -lcgm -L/gpfs/vesta-fs0/projects/FASTMath/install/zoltan/trilinos-11.2.4/linux-rhel_6-ppc64-gcc-4.4.6/lib -lzoltan -L/gpfs/vesta-fs0/projects/FASTMath/install/parmetis/4.0.3/linux-rhel_6-ppc64-gcc-4.4.6/lib -lparmetis -lmetis -L/gpfs/vesta-fs0/projects/FASTMath/install/hdf5/1.8.11/linux-rhel_6-ppc64-gcc-4.4.6/lib -lhdf5" --with-ml-include=/gpfs/vesta-fs0/projects/FASTMath/install/ml/trilinos-11.2.4/linux-rhel_6-ppc64-gcc-4.4.6/include --with-ml-lib="-L/gpfs/vesta-fs0/projects/FASTMath/install/ml/trilinos-11.2.4/linux-rhel_6-ppc64-gcc-4.4.6/lib -lml -L/gpfs/vesta-fs0/projects/FASTMath/install/parmetis/4.0.3/linux-rhel_6-ppc64-gcc-4.4.6/lib -lparmetis -lmetis" --with-hypre-dir=/gpfs/vesta-fs0/projects/FASTMath/install/hypre/2.9.2a/linux-rhel_6-ppc64-gcc-4.4.6 --with-netcdf-dir=/gpfs/vesta-fs0/projects/FASTMath/install/netcdf/4.3.0/linux-rhel_6-ppc64-gcc-4.4.6 --download-chaco --download-exodusii --with-shared-libraries=0 --with-debugging=0 COPTFLAGS="-g -O2" FOPTFLAGS="-g -O2" CXXOPTFLAGS="-g -O2" --with-etags=0
-----------------------------------------
Libraries compiled on Wed Jul 31 16:13:30 2013 on vestalac1 
Machine characteristics: Linux-2.6.32-358.6.2.el6.ppc64-ppc64-with-redhat-6.3-Santiago
Using PETSc directory: /home/balay/petsc
Using PETSc arch: arch-fastmath
-----------------------------------------

Using C compiler: mpicc  -Wall -Wwrite-strings -Wno-strict-aliasing -Wno-unknown-pragmas -g -O2  ${COPTFLAGS} ${CFLAGS}
Using Fortran compiler: mpif90  -Wall -Wno-unused-variable -g -O2   ${FOPTFLAGS} ${FFLAGS} 
-----------------------------------------

Using include paths: -I/home/balay/petsc/arch-fastmath/include -I/home/balay/petsc/include -I/home/balay/petsc/include -I/home/balay/petsc/arch-fastmath/include -I/gpfs/vesta-fs0/projects/FASTMath/install/superlu/dist-3.3/linux-rhel_6-ppc64-gcc-4.4.6/include -I/gpfs/vesta-fs0/projects/FASTMath/install/hypre/2.9.2a/linux-rhel_6-ppc64-gcc-4.4.6/include -I/gpfs/vesta-fs0/projects/FASTMath/install/ml/trilinos-11.2.4/linux-rhel_6-ppc64-gcc-4.4.6/include -I/gpfs/vesta-fs0/projects/FASTMath/install/zoltan/trilinos-11.2.4/linux-rhel_6-ppc64-gcc-4.4.6/include -I/gpfs/vesta-fs0/projects/FASTMath/install/parmetis/4.0.3/linux-rhel_6-ppc64-gcc-4.4.6/include -I/gpfs/vesta-fs0/projects/FASTMath/install/metis/5.1.0/linux-rhel_6-ppc64-gcc-4.4.6/include -I/gpfs/vesta-fs0/projects/FASTMath/install/moab/4.6.0/linux-rhel_6-ppc64-gcc-4.4.6/include -I/gpfs/vesta-fs0/projects/FASTMath/install/netcdf/4.3.0/linux-rhel_6-ppc64-gcc-4.4.6/include -I/gpfs/vesta-fs0/projects/FASTMath/install/hdf5/1.8.11/linux-rhel_6-ppc64-gcc-4.4.6/include -I/bgsys/drivers/V1R2M0/ppc64 -I/bgsys/drivers/V1R2M0/ppc64/comm/sys/include -I/bgsys/drivers/V1R2M0/ppc64/spi/include -I/bgsys/drivers/V1R2M0/ppc64/spi/include/kernel/cnk -I/bgsys/drivers/V1R2M0/ppc64/comm/gcc/include
-----------------------------------------

Using C linker: mpicc
Using Fortran linker: mpif90
Using libraries: -Wl,-rpath,/home/balay/petsc/arch-fastmath/lib -L/home/balay/petsc/arch-fastmath/lib -lpetsc -L/gpfs/vesta-fs0/projects/FASTMath/install/superlu/dist-3.3/linux-rhel_6-ppc64-gcc-4.4.6/lib -lsuperlu -Wl,-rpath,/gpfs/vesta-fs0/projects/FASTMath/install/hypre/2.9.2a/linux-rhel_6-ppc64-gcc-4.4.6/lib -L/gpfs/vesta-fs0/projects/FASTMath/install/hypre/2.9.2a/linux-rhel_6-ppc64-gcc-4.4.6/lib -lHYPRE -L/bgsys/drivers/V1R2M0/ppc64/spi/lib -L/bgsys/drivers/V1R2M0/ppc64/comm/sys/lib -L/bgsys/drivers/V1R2M0/ppc64/comm/gcc/lib -L/bgsys/drivers/toolchain/V1R2M0-efix23/gnu-linux/lib/gcc/powerpc64-bgq-linux/4.4.6 -L/bgsys/drivers/toolchain/V1R2M0-efix23/gnu-linux/lib/gcc -L/bgsys/drivers/toolchain/V1R2M0-efix23/gnu-linux/powerpc64-bgq-linux/lib -Wl,-rpath,/bgsys/drivers/V1R2M0/ppc64/comm/gcc/lib -lcxxmpich -L/gpfs/vesta-fs0/projects/FASTMath/install/ml/trilinos-11.2.4/linux-rhel_6-ppc64-gcc-4.4.6/lib -lml -L/gpfs/vesta-fs0/projects/FASTMath/install/parmetis/4.0.3/linux-rhel_6-ppc64-gcc-4.4.6/lib -lparmetis -lmetis -Wl,-rpath,/gpfs/vesta-fs0/projects/FASTMath/install/lapack/3.4.2/linux-rhel_6-ppc64-gcc-4.4.6/lib -L/gpfs/vesta-fs0/projects/FASTMath/install/lapack/3.4.2/linux-rhel_6-ppc64-gcc-4.4.6/lib -llapack -Wl,-rpath,/gpfs/vesta-fs0/projects/FASTMath/install/blas/19Apr11/linux-rhel_6-ppc64-gcc-4.4.6/lib -L/gpfs/vesta-fs0/projects/FASTMath/install/blas/19Apr11/linux-rhel_6-ppc64-gcc-4.4.6/lib -lblas -Wl,-rpath,/gpfs/vesta-fs0/projects/FASTMath/install/zoltan/trilinos-11.2.4/linux-rhel_6-ppc64-gcc-4.4.6/lib -L/gpfs/vesta-fs0/projects/FASTMath/install/zoltan/trilinos-11.2.4/linux-rhel_6-ppc64-gcc-4.4.6/lib -lzoltan -Wl,-rpath,/home/balay/petsc/arch-fastmath/lib -L/home/balay/petsc/arch-fastmath/lib -lchaco -Wl,-rpath,/gpfs/vesta-fs0/projects/FASTMath/install/parmetis/4.0.3/linux-rhel_6-ppc64-gcc-4.4.6/lib -lparmetis -Wl,-rpath,/gpfs/vesta-fs0/projects/FASTMath/install/metis/5.1.0/linux-rhel_6-ppc64-gcc-4.4.6/lib -L/gpfs/vesta-fs0/projects/FASTMath/install/metis/5.1.0/linux-rhel_6-ppc64-gcc-4.4.6/lib -lmetis -lpthread -lexoIIv2for -lexodus -L/gpfs/vesta-fs0/projects/FASTMath/install/moab/4.6.0/linux-rhel_6-ppc64-gcc-4.4.6/lib -lMOAB -L/gpfs/vesta-fs0/projects/FASTMath/install/cgma/12.2.0/linux-rhel_6-ppc64-gcc-4.4.6/lib -lcgm -lzoltan -lparmetis -lmetis -L/gpfs/vesta-fs0/projects/FASTMath/install/hdf5/1.8.11/linux-rhel_6-ppc64-gcc-4.4.6/lib -lhdf5 -Wl,-rpath,/gpfs/vesta-fs0/projects/FASTMath/install/netcdf/4.3.0/linux-rhel_6-ppc64-gcc-4.4.6/lib -L/gpfs/vesta-fs0/projects/FASTMath/install/netcdf/4.3.0/linux-rhel_6-ppc64-gcc-4.4.6/lib -lnetcdf -Wl,-rpath,/gpfs/vesta-fs0/projects/FASTMath/install/hdf5/1.8.11/linux-rhel_6-ppc64-gcc-4.4.6/lib -lhdf5_hl -lhdf5 -lm -lmpichf90 -lgfortran -lm -lm -lcxxmpich -ldl -lmpich -lopa -lmpl -lpami -lSPI -lSPI_cnk -lrt -lpthread -lstdc++ -lgcc_eh -lnss_files -lnss_dns -lresolv -ldl 
-----------------------------------------