IDS Forum

Re: Config Help

Posted By: John Miller iii
Date: Tuesday, 17 July 2012, at 5:44 p.m.

In Response To: Config Help (JOHN LAWRIE)

Here is a few suggestions:

I would set

VP_MEMORY_CACHE_KB 4096

Will reduce the latch contention when allocating/free memory

RESIDENT -1

Will enables sun's optimization of Intimate

Shared Memory, more efficient with large blocks of memory

DS_NONPDQ_QUERY_MEM 1024

Help reduce the number of time sort/hash join goes to

disk for overflow

DS_TOTAL_MEMORY 1048576

Just set it to something, even if you do not use it.

NETTYPE tlitcp,3,600,CPU

It appears you have many users, but do not configure the

network layer. It will use some defaults which are very

small and then dynamically grow/shrink. Set it and you

will get more throughput.

TEMPTAB_NOLOG 1

This can reduce allot of IO, as all temp table become
non-logged.

If you need transactional integrity on temp tables do NOT use

this, but most people do not.

BUFFERPOOL
size=2K,buffers=600000,lrus=128,lru_min_dirty=1.000000,lru_max_dirty=2.000000

CHANGE TO

BUFFERPOOL
size=2K,buffers=600000,lrus=128,lru_min_dirty=20.000000,lru_max_dirty=30.000000

You are not taking advantage of auto checkpoints by having the lru so
small. I would sugest at least 20/30 (even higher).

As Art pointed optimizing the I/O running on VM will help
performance, A few of the changes above

will help, the biggest will be the BUFFERPOOL
lru_min_dirty/lru_max_dirty changes.

John F. Miller III
STSM, Embedability Architect
miller3@us.ibm.com
503-578-5645
IBM Informix Dynamic Server (IDS)

ids-bounces@iiug.org wrote on 07/17/2012 01:57:04 PM:

> From: "JOHN LAWRIE" <bravolawrie@yahoo.com>
> To: ids@iiug.org,
> Date: 07/17/2012 01:59 PM
> Subject: Config Help [27628]
> Sent by: ids-bounces@iiug.org
>
> We've recently taken over a IDS server that host the DB for an inhouse
> developed application. I'm convinced that what processes are taking for
every
> and previously have been considered acceptable performance are due to
poor
> configs. I'm not a DBA just a systems administrator. There are
> somethings that
> I've noticed that are definitely in my opinion glaring and was hoping to
see
> if someone could just throw a set of wiser eyes on it before I go
> marching off
> in the wrong direction with troubleshooting. Basically I'm never not
getting
> 100% cpu usage with either 4 or 5 vcpu (informix) and my ready queues are

> never empty. ranging from 5-20 items on a 1 second refresh. I've managed
to
> improve my onstat -g glo inefficiencies by reducing vcpus but (you'll see
the
> onconfig show the creation of 5)
>
> The host is a Vmware ESXi 5.0 4x 6-Core AMD 8431 2.4 GHz cpu. The virtual

> machine running IDS is allocated 6 vCPU and has 6 gb RAM. It's running 64
bit
> Solaris 10 10/09 and Informix 11.5.FC6 most connections are as the same
user
> from about 9-16 different Windows workstations.
>
> CONFIG:
> ROOTNAME rootdbs
> ROOTPATH /export/home/informix/dbs/rootdbs
> ROOTOFFSET 0
> ROOTSIZE 248000
> MIRROR 0
> MIRRORPATH
> MIRROROFFSET 0
>
> PHYSFILE 300000
> PLOG_OVERFLOW_PATH $INFORMIXDIR/tmp
> PHYSBUFF 128
>
> LOGFILES 40
> LOGSIZE 10000
> DYNAMIC_LOGS 2
> LOGBUFF 64
>
> LTXHWM 50
> LTXEHWM 60
>
> MSGPATH $INFORMIXDIR/tmp/db_abc.log
> CONSOLE $INFORMIXDIR/tmp/db_abc.con
>
> TBLTBLFIRST 0
> TBLTBLNEXT 0
> TBLSPACE_STATS 0
>
> DBSPACETEMP temp1:temp2:temp3:temp4
> SBSPACETEMP
>
> SBSPACENAME
> SYSSBSPACENAME
> ONDBSPACEDOWN 2
>
> SERVERNUM 0
> DBSERVERNAME db_abc
> DBSERVERALIASES db_abc_tcp
>
> NETTYPE ipcshm,1,50,CPU
> LISTEN_TIMEOUT 60
> MAX_INCOMPLETE_CONNECTIONS 1024
> FASTPOLL 1
>
> MULTIPROCESSOR 1
> VPCLASS cpu,num=5,noage
> #VPCLASS cpu,num=7,noage
> VP_MEMORY_CACHE_KB 0
> SINGLE_CPU_VP 0
>
> #VPCLASS aio,num=1
> CLEANERS 127
> AUTO_AIOVPS 1
> DIRECT_IO 0
>
> LOCKS 2000000
> DEF_TABLE_LOCKMODE row
>
> RESIDENT 0
> SHMBASE 0x10A000000L
> SHMVIRTSIZE 1600000
> SHMADD 262144
> EXTSHMADD 8192
> SHMTOTAL 0
> SHMVIRT_ALLOCSEG 0,3
> SHMNOACCESS
>
> #CKPTINTVL 900
> CKPTINTVL 300
> AUTO_CKPTS 0
> RTO_SERVER_RESTART 0
> BLOCKTIMEOUT 3600
>
> CONVERSION_GUARD 1
> RESTORE_POINT_DIR $INFORMIXDIR/tmp
>
> TXTIMEOUT 300
> DEADLOCK_TIMEOUT 60
> HETERO_COMMIT 0
>
> TAPEDEV /dev/tapedev
> TAPEBLK 32
> TAPESIZE 0
>
> LTAPEDEV /dev/tapedev
> #LTAPEDEV /dev/null
> LTAPEBLK 32
> LTAPESIZE 0
>
> BAR_ACT_LOG $INFORMIXDIR/tmp/bar_act.log
> BAR_DEBUG_LOG $INFORMIXDIR/tmp/bar_dbug.log
> BAR_DEBUG 0
> BAR_MAX_BACKUP 0
> BAR_RETRY 1
> BAR_NB_XPORT_COUNT 20
> BAR_XFER_BUF_SIZE 31
> RESTARTABLE_RESTORE ON
> BAR_PROGRESS_FREQ 0
> BAR_BSALIB_PATH
> BACKUP_FILTER
> RESTORE_FILTER
> BAR_PERFORMANCE 0
>
> ISM_DATA_POOL ISMDiskData
> ISM_LOG_POOL ISMDiskLogs
>
> DD_HASHSIZE 31
> DD_HASHMAX 10
>
> DS_HASHSIZE 31
> DS_POOLSIZE 127
>
> PC_HASHSIZE 31
> PC_POOLSIZE 127
>
> STMT_CACHE 2
> STMT_CACHE_HITS 0
> STMT_CACHE_SIZE 2048
> STMT_CACHE_NOLIMIT 0
> STMT_CACHE_NUMPOOL 3
>
> USEOSTIME 0
> STACKSIZE 64
> ALLOW_NEWLINE 0
> USELASTCOMMITTED NONE
>
> FILLFACTOR 90
> MAX_FILL_DATA_PAGES 0
> BTSCANNER num=1,threshold=5000,rangesize=-1,alice=6,compression=default
> ONLIDX_MAXMEM 5120
>
> MAX_PDQPRIORITY 100
> DS_MAX_QUERIES
> DS_TOTAL_MEMORY
> DS_MAX_SCANS 1048576
> DS_NONPDQ_QUERY_MEM 128
> DATASKIP
>
> OPTCOMPIND 2
> DIRECTIVES 1
> EXT_DIRECTIVES 0
> OPT_GOAL -1
> IFX_FOLDVIEW 0
> AUTO_REPREPARE 1
>
> RA_PAGES 64
> RA_THRESHOLD 16
> BATCHEDREAD_TABLE 0
>
> EXPLAIN_STAT 1
> #SQLTRACE level=low,ntraces=1000,size=2,mode=global
>
> #DBCREATE_PERMISSION informix
> #DB_LIBRARY_PATH
> IFX_EXTEND_ROLE 1
> SECURITY_LOCALCONNECTION
> UNSECURE_ONSTAT
> ADMIN_USER_MODE_WITH_DBSA
> ADMIN_MODE_USERS
> SSL_KEYSTORE_LABEL
>
> PLCY_POOLSIZE 127
> PLCY_HASHSIZE 31
> USRC_POOLSIZE 127
> USRC_HASHSIZE 31
>
> STAGEBLOB
> OPCACHEMAX 0
>
> ENCRYPT_HDR
> ENCRYPT_SMX
> ENCRYPT_CDR 0
> ENCRYPT_CIPHERS
> ENCRYPT_MAC
> ENCRYPT_MACFILE
> ENCRYPT_SWITCH
>
> CDR_EVALTHREADS 1,2
> CDR_DSLOCKWAIT 5
> CDR_QUEUEMEM 4096
> CDR_NIFCOMPRESS 0
> CDR_SERIAL 0
> CDR_DBSPACE
> CDR_QHDR_DBSPACE
> CDR_QDATA_SBSPACE
> CDR_MAX_DYNAMIC_LOGS 0
> CDR_SUPPRESS_ATSRISWARN
>
> DRAUTO 0
> DRINTERVAL 30
> DRTIMEOUT 30
> HA_ALIAS
> DRLOSTFOUND $INFORMIXDIR/etc/dr.lostfound
> DRIDXAUTO 0
> LOG_INDEX_BUILDS
> SDS_ENABLE
> SDS_TIMEOUT 20
> SDS_TEMPDBS
> SDS_PAGING
> UPDATABLE_SECONDARY 0
> FAILOVER_CALLBACK
> TEMPTAB_NOLOG 0
> DELAY_APPLY 0
> STOP_APPLY 0
> LOG_STAGING_DIR
>
> ON_RECVRY_THREADS 1
> OFF_RECVRY_THREADS 10
>
> DUMPDIR $INFORMIXDIR/tmp
> DUMPSHMEM 1
> DUMPGCORE 0
> DUMPCORE 0
> DUMPCNT 1
>
> ALARMPROGRAM $INFORMIXDIR/etc/alarmprogram.sh
> ALRM_ALL_EVENTS 0
> STORAGE_FULL_ALARM 600,3
> SYSALARMPROGRAM $INFORMIXDIR/etc/evidence.sh
>
> RAS_PLOG_SPEED 14620
> RAS_LLOG_SPEED 856
>
> EILSEQ_COMPAT_MODE 0
>
> QSTATS 0
> WSTATS 0
>
> #VPCLASS jvp,num=1
> JVPJAVAHOME $INFORMIXDIR/extend/krakatoa/jre/
> JVPHOME $INFORMIXDIR/extend/krakatoa
> JVPPROPFILE $INFORMIXDIR/extend/krakatoa/.jvpprops
> JVPLOGFILE $INFORMIXDIR/jvp.log
> #JDKVERSION 1.5
> JVPJAVALIB /lib/amd64
> JVPJAVAVM server
> #JVPARGS -verbose:jni
> #JVPCLASSPATH
> $INFORMIXDIR/extend/krakatoa/krakatoa_g.jar:$INFORMIXDIR/extend/
> krakatoa/jdbc_g.jar
> JVPCLASSPATH
> $INFORMIXDIR/extend/krakatoa/krakatoa.jar:$INFORMIXDIR/extend/
> krakatoa/jdbc.jar
>
> BUFFERPOOL
>
default,buffers=10000,lrus=8,lru_min_dirty=50.000000,lru_max_dirty=60.500000

> BUFFERPOOL
>
size=2K,buffers=600000,lrus=128,lru_min_dirty=1.000000,lru_max_dirty=2.000000

> AUTO_LRU_TUNING 1
>
>
>
-------------------------------------------------------------------------------

> THIS IS ~2.5 HOURS AFTER RESET STATS
>
>
-------------------------------------------------------------------------------

> onstat -g glo
>
> MT global info:
> sessions threads vps lngspins
> 1235 1383 12 67
>
> sched calls thread switches yield 0 yield n yield forever
> total: 195789061 147288992 111978958 1215348 41953722
> per sec: 24647 22644 11132 136 7183
>
> Virtual processor summary:
> class vps usercpu syscpu total
> cpu 4 31910.76 2983.98 34894.74
> aio 2 0.17 0.32 0.49
> tli 1 491.21 380.67 871.88
> lio 1 0.09 0.16 0.25
> pio 1 0.09 0.16 0.25
> adm 1 1.19 0.45 1.64
> msc 1 7.38 3.12 10.50
> fifo 1 0.09 0.16 0.25
> total 12 32410.98 3369.02 35780.00
>
> Individual virtual processors:
> vp pid class usercpu syscpu total Thread Eff
> 1 973 cpu 7902.40 799.57 8701.97 8964.92 97%
> 2 974 adm 1.19 0.45 1.64 0.00 0%
> 3 975 cpu 7997.71 730.14 8727.85 8963.22 97%
> 4 976 cpu 8013.60 717.50 8731.10 8963.23 97%
> 5 977 cpu 7997.05 736.77 8733.82 8963.25 97%
> 7 979 lio 0.09 0.16 0.25 0.00 0%
> 8 980 pio 0.09 0.16 0.25 0.00 0%
> 9 981 aio 0.09 0.16 0.25 0.00 0%
> 10 982 msc 7.38 3.12 10.50 19.35 54%
> 11 983 fifo 0.09 0.16 0.25 0.00 0%
> 12 984 aio 0.08 0.16 0.24 0.00 0%
> 13 985 tli 491.21 380.67 871.88 NA NA
>
> tot 32410.98 3369.02 35780.00
>
> onstat -p
>
> IBM Informix Dynamic Server Version 11.50.FC6 -- On-Line -- Up 14 days
> 20:37:14 -- 3477504 Kbytes
>
> Profile
> dskreads pagreads bufreads %cached dskwrits pagwrits bufwrits %cached
> 254436304 272478044 9343755483 97.28 711774 1763798 8323939 91.74
>
> isamtot open start read write rewrite delete commit rollbk
> 4405537541 72311073 109128678 3970104855 2337699 33971 62907 136143 1708
>
> gp_read gp_write gp_rewrt gp_del gp_alloc gp_free gp_curs
> 0 0 0 0 0 0 0
>
> ovlock ovuserthread ovbuff usercpu syscpu numckpts flushes
> 0 0 0 32709.24 3399.55 60 46
>
> bufwaits lokwaits lockreqs deadlks dltouts ckpwaits compress seqscans
> 7602300 0 5790771082 0 0 189 124199 188600
>
> ixda-RA idx-RA da-RA RA-pgsused lchwaits
> 9543205 4055316 229509228 242725831 410002
>
> onstat -g iov
>
> IBM Informix Dynamic Server Version 11.50.FC6 -- On-Line -- Up 14 days
> 20:37:52 -- 3477504 Kbytes
>
> AIO I/O vps:
> class/vp/id s io/s totalops dskread dskwrite dskcopy wakeups io/wup
errors
> tempops
> fifo 11 0 i 0.0 0 0 0 0 0 0.0 0 0
> kio -1 0 i 1010.0 9173986 9052271 121715 0 5907231 1.6 0 0
> kio -1 1 i 1027.7 9334846 9163289 171557 0 5793440 1.6 0 0
> kio -1 2 i 991.0 9001385 8808992 192393 0 5649694 1.6 0 0
> kio -1 4 i 1020.7 9270692 9137953 132739 0 5850144 1.6 0 0
> msc 10 0 i 12.8 116650 0 0 0 115964 1.0 0 10772302
> aio 9 0 i 0.0 0 0 0 0 0 0.0 0 0
> aio 12 1 i 0.0 0 0 0 0 0 0.0 0 0
> pio 8 0 i 0.0 0 0 0 0 0 0.0 0 0
> lio 7 0 i 0.0 0 0 0 0 0 0.0 0 0
>
> onstat -u
>
> 1358 active, 1664 total, 1576 maximum concurrent
>
> onstat -g seg
>
> IBM Informix Dynamic Server Version 11.50.FC6 -- On-Line -- Up 14 days
> 20:41:05 -- 3477504 Kbytes
>
> Segment Summary:
> id key addr size ovhd class blkused blkfree
> 0 52564801 10a000000 1652555776 19799296 R 403398 58
> 1 52564802 16c800000 1638924288 19207936 V 372072 28056
> 2 52564803 1ce300000 1048576 13552 M 138 118
> 3 52564804 1ce400000 268435456 3147376 V 5639 59897
> Total: - - 3560964096 - - 781247 88129
>
>
>
*******************************************************************************

> Forum Note: Use "Reply" to post a response in the discussion forum.
>

Messages In This Thread

• Config Help
  JOHN LAWRIE -- Tuesday, 17 July 2012, at 4:57 p.m.
  • Re: Config Help
    Art Kagel -- Tuesday, 17 July 2012, at 5:03 p.m.
  • Re: Config Help
    John Miller iii -- Tuesday, 17 July 2012, at 5:44 p.m.
    • Re: Config Help
      JOHN LAWRIE -- Thursday, 19 July 2012, at 9:33 a.m.
      • Re: Config Help
        Art Kagel -- Thursday, 19 July 2012, at 11:24 a.m.
  • Re: Config Help
    JOHN LAWRIE -- Tuesday, 17 July 2012, at 10:10 p.m.
    • Re: Config Help
      Art Kagel -- Wednesday, 18 July 2012, at 6:37 a.m.

IDS Forum is maintained by Administrator with WebBBS 5.12.