Join IIUG
 for   
 

Informix News
18 Nov 13 - ZDNet - Top 20 mobile skills in demand... Read
09 Sep 13 - telecompaper - Shaspa and Tatung have shown a new smart home platform at Ifa in Berlin. Powered by the IBM Informix software... Read
06 Sep 13 - IBM data magazine - Mission Accomplished - Miami, Florida will be the backdrop for the 2014 IIUG Informix Conference... Read
01 Feb 13 - IBM Data Magazine - Are your database backups safe? Lester Knutsen (IBM Champion) writes about database back up safety using "archecker"... Read
14 Nov 12 - IBM - IBM's Big Data For Smart Grid Goes Live In Texas... Read
3 Oct 12 - The Financial - IBM and TransWorks Collaborate to Help Louisiana-Pacific Corporation Achieve Supply Chain Efficiency... Read
28 Aug 12 - techCLOUD9 - Splunk kicks up a SaaS Storm... Read
10 Aug 12 - businessCLOUD9 - Is this the other half of Cloud monitoring?... Read
3 Aug 12 - IBM data management - Supercharging the data warehouse while keeping costs down IBM Informix Warehouse Accelerator (IWA) delivers superior performance for in-memory analytics processing... Read
2 Aug 12 - channelbiz - Oninit Group launches Pay Per Pulse cloud-based service... Read
28 May 12 - Bloor - David Norfolk on the recent Informix benchmark "pretty impressive results"... Read
23 May 12 - DBTA - Informix Genero: A Way to Modernize Informix 4GL Applications... Read
9 Apr 12 - Mastering Data Management - Upping the Informix Ante: Advanced Data Tools... Read
22 Mar 12 - developerWorks - Optimizing Informix database access... Read
14 Mar 12 - BernieSpang.com - International Informix User Group set to meet in San Diego... Read
1 Mar 12 - IBM Data Management - IIUG Heads West for 2012 - Get ready for sun and sand in San Diego... Read
1 Mar 12 - IBM Data Management - Running Informix on Solid-State Drives.Speed Up Database Access... Read
26 Feb 12 - BernieSpan.com - Better results, lower cost for a broad set of new IBM clients and partners... Read
24 Feb 12 - developerWorks - Informix Warehouse Accelerator: Continuous Acceleration during Data Refresh... Read
6 Feb 12 - PRLOG - Informix port delivers unlimited database scalability for popular SaaS application ... Read
2 Feb 12 - developerWorks - Loading data with the IBM Informix TimeSeries Plug-in for Data Studio... Read
1 Feb 12 - developerWorks - 100 Tech Tips, #47: Log-in to Fix Central... Read
13 Jan 12 - MC Press online - Informix Dynamic Server Entices New Users with Free Production Edition ... Read
11 Jan 12 - Computerworld - Ecologic Analytics and Landis+Gyr -- Suitors Decide to Tie the Knot... Read
9 Jan 12 - planetIDS.com - DNS impact on Informix / Impacto do DNS no Informix... Read
8 Sep 11 - TMCnet.com - IBM Offers Database Solution to Enable Smart Meter Data Capture... Read
1 Aug 11 - IBM Data Management Magazine - IIUG user view: Happy 10th anniversary to IBM and Informix... Read
8 Jul 11 - Database Trends and Applications - Managing Time Series Data with Informix... Read
31 May 11 - Smart Grid - The meter data management pitfall utilities are overlooking... Read
27 May 11 - IBM Data Management Magazine - IIUG user view: Big data, big time ( Series data, warehouse acceleration, and 4GLs )... Read
16 May 11 - Business Wire - HiT Software Announces DBMoto for Enterprise Integration, Adds Informix. Log-based Change Data Capture... Read
21 Mar 11 - Yahoo! Finance - IBM and Cable&Wireless Worldwide Announce UK Smart Energy Cloud... Read
14 Mar 11 - MarketWatch - Fuzzy Logix and IBM Unveil In-Database Analytics for IBM Informix... Read
11 Mar 11 - InvestorPlace - It's Time to Give IBM Props: How many tech stocks are up 53% since the dot-com boom?... Read
9 Mar 11 - DBTA - Database Administration and the Goal of Diminishing Downtime... Read
2 Feb 11 - DBTAs - Informix 11.7 Flexible Grid Provides a Different Way of Looking at Database Servers... Read
27 Jan 11 - exactsolutions - Exact to Add Informix Support to Database Replay, SQL Monitoring Solutions... Read
25 Jan 11 - PR Newswire - Bank of China in the UK Works With IBM to Become a Smarter, Greener Bank... Read
12 Oct 10 - Database Trends and Applications - Informix 11.7: The Beginning of the Next Decade of IBM Informix... Read
20 Sep 10 - planetIDS.com - ITG analyst paper: Cost/Benefit case for IBM Informix as compared to Microsoft SQL Server... Read
20 Jul 10 - IBM Announcements - IBM Informix Choice Edition V11.50 helps deploy low-cost scalable and reliable solutions for Apple Macintosh and Microsoft Windows... Read
20 Jul 10 - IBM Announcements - Software withdrawal: Elite Support for Informix Ultimate-C Edition... Read
24 May 10 - eWeek Europe - IBM Supplies Database Tech For EU Smart Grid... Read
23 May 10 - SiliconIndia - IBM's smart metering system allows wise use of energy... Read
21 May 10 - CNET - IBM to help people monitor energy use... Read
20 May 10 - ebiz - IBM Teams With Hildebrand To Bring Smart Metering To Homes Across Britain... Read
19 May 10 - The New Blog Times - Misurare il consumo energetico: DEHEMS è pronto... Read
19 May 10 - ZDNet - IBM software in your home? Pact enables five-city smart meter pilot in Europe... Read
17 March 10 - ZDNet (blog) David Morgenstern - TCO: New research finds Macs in the enterprise easier, cheaper to manage than... Read
17 March 2010 - Virtualization Review - ...key components of Big Blue's platform to the commercial cloud such as its WebSphere suite of application ser vers and its DB2 and Informix databases... Read
10 February 2010 - The Wall Street Journal - International Business Machines is expanding an initiative to win over students and professors on its products. How do they lure the college crowd?... Read


End of Support Dates

IIUG on Facebook IIUG on Twitter

[ View Thread ] [ Post Response ] [ Return to Index ] [ Read Prev Msg ] [ Read Next Msg ]

IDS Forum

Re: Performance Issues

Posted By: John Miller iii
Date: Thursday, 4 August 2011, at 4:15 a.m.

In Response To: Re: Performance Issues (VIKAS HIVARKAR)

Just a few thoughts, the answer to your question is here:

1. You are on HPUX which has some unique property. First is its abilit=
y to
downgrade a
process if it deems a process is consuming to much cpu cycles. Since
Informix has one process
for many many users the Informix cpu vps are subject to this. While no=
age
does help I often find
it does not do enough. I would suggest moving the cpu vps into the re=
al
time priority. You can
accomplish this by using the rtprio command

rtsched -s SCHED_RTPRIO -p 127 -P {PID of CPU VPS}

I have see this help many customers on HP. It can be done while the
informix system is
running. It helps with system not utilizing their entire cpu and also =
with
contention.

2. First HPUX historically has not done well with large number of shar=
ed
memory segments. While
they have made great improvements,I still would recommend minimizing th=
e
number of shared
memory segments. One simple way to accomplish this is to re-configure=

your NETTYPE.
Currently your NETTYPE ipcshm,10,30,CPU. Each shared memory poll threa=
d
required 1
shared memory segment. This mean with this configuration paramater alo=
ng
you require 10
shared memory segments. I would suggest NETTYPE ipcshm,2,200,CPU

Now I do not see an onstat -g glo in all the different emails, but the=

onstat -p provide does
have the user and system cpu times. These do not look good.
usercpu 99930.89 system cpu 49477.95 This is almost a 2 to 1 ratio
generally not want
you want to see. There could be a few reason, latching and network is=
the
most probably
and these two are related.

3) Optimizinig network settings. Please make sure you have the onconf=
ig
paramater FASTPOLL
enabled (or ON). Second NETTYPE soctcp,12,150,NET. I would change thi=
s to
the following
NETTYPE soctcp 4,450,CPU. The FASTPOLL drastically improves the
efficiency of the poll thread
while you do want some parallelism, HP historically has not done well w=
hen
many process calling
poll()/select() system call in parallel. In addition, I always like
running my poll threads on cpu vp.

Now you asked the question as to why my first 10 cpu vp have NO busy wa=
its.
This is do to the
optimization or running your poll threads on the cpu vps. Instead of
spinning wasting cpu cycles
looking for threads to schedule, the cpu vps do a quick check to see if=

there is pending network
messages.

4) I would make sure that you have the VP_MEMORY_CACHE_KB set to a cou=
ple
of MB.

Lastly, if you could supply a few items it would help look at your syst=
em
more.

1. ontat -g glo (help check the system and user time)

2. onstat -g spi | sort -nr | head -40

John F. Miller III
STSM, Embedability Architect
miller3@us.ibm.com
503-578-5645
IBM Informix Dynamic Server (IDS)

ids-bounces@iiug.org wrote on 08/03/2011 10:17:17 PM:

> From: "VIKAS HIVARKAR" <vikas.hivarkar@gmail.com>
> To: ids@iiug.org
> Date: 08/03/2011 10:18 PM
> Subject: Re: Performance Issues [24533]
> Sent by: ids-bounces@iiug.org
>
> Hello All,
>
> "onstat -g sch" (We now have the vpuvps =3D cpu cores ) but
>
> VP Scheduler Statistics:
> vp pid class semops busy waits spins/wait
> 1 20655 cpu 0 0 0
> 2 20795 adm 0 0 0
> 3 20796 cpu 0 0 0
> 4 20797 cpu 0 0 0
> 5 20798 cpu 0 0 0
> 6 20799 cpu 0 0 0
> 7 20800 cpu 0 0 0
> 8 20801 cpu 0 0 0
> 9 20802 cpu 0 0 0
> 10 20803 cpu 0 0 0
> 11 20804 cpu 0 0 0
> 12 20809 cpu 33767045 34198356 997
> 13 20810 cpu 32838062 33260684 997
> 14 20812 lio 0 0 0
> 15 20813 pio 0 0 0
> 16 20814 aio 794912 0 0
> 17 20815 msc 1219209 0 0
> 18 20816 fifo 0 0 0
> 19 20817 aio 19127 0 0
> 20 20818 soc 1704 14257 698
> 21 20819 soc 1213 6589 568
> 22 20820 soc 1450 6469 679
> 23 20821 soc 1166 6740 674
> 24 20822 soc 1290 6546 631
> 25 20823 soc 883 3925 671
> 26 20824 soc 1701 8528 660
> 27 20825 soc 2223 11920 607
> 28 20826 soc 1484 6617 642
> 29 20827 soc 1572 8573 649
> 30 20828 soc 10311 14680 845
> 31 20829 soc 10929 24908 821
>
> I do not understand why most of the initial cpuvps not spining or doi=
ng
any
> work?
>
> We will be adding more buffers this weekend and currently looking at =
the
hot
> spots on the disc.
>
> Regards,
>
>
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D

> Hello All,
>
> Yes was have an HDR and SDS (primary + 1node)
>
> Database running with UNBUFFERED log mode
>
> increased the no of cores to 12, now suits 12 cpuvps and considering =
to
> increase the buffers too
>
> "onstat -l" output:
>
> Physical Logging
> Buffer bufused bufsize numpages numwrits pages/io
> P-2 72 512 15225310 104294 145.98
>
> phybegin physize phypos phyused %used
>
> 62:53 19995000 3137280 582604 2.91
>
> Logical Logging
> Buffer bufused bufsize numrecs numpages numwrits recs/pages pages/io
> L-1 0 512 69423775 2990157 719686 23.2 4.2
>
> Subsystem numrecs Log Space used
>
> OLDRSAM 69391925 5290671676
>
> HA 31850 1410892
>
> Buffer Waiting
> Buffer ioproc flags
> L-1 0 0x1 0
> L-3 0 0x1 0
>
> I will be checking for seqential scans on big tables with the below q=
uery

> through the day:
>
> "onstat -g dic"
> I am trying to check the tables with high refcnt, if that is what I
should be
> checking?
>
> Dictionary Cache: Number of lists: 503, Maximum list size: 10
> Total number of dictionary entries: 158
>
> Any more checks or suggesstions?
>
> Regards,
> Vikas
>
>
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D

> Are your main databases using BUFFERED LOG? That might explain the
> contention for the logical log buffers. The BTR indicates that you co=
uld
> use a significant increase in the number of buffers. Also over 9% of =
your

> queries seem to include a sequential scan [(seqscans / (isam starts))=
*
> 100]. See if those are being performed against large tables.
>
> Art
>
>
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D

> 1) Are you using HDR?
>
> 2) Are you doing unbuffered logging? What is the output of onstat -l?=

> Just because you have a large log buffer does not mean that you are g=
oi=3D
> ng
> to use the full buffer. That would be the case with unbuffered loggin=
g=3D
> ..
>
> 3) I'm not sure that I would be setting the number of cpuvps greater =
t=3D
> han
> the number of cores. That can cause lock inversion.
>
> 4) To find the sequential scans...
>
> select dbsname, tabname , pf_seqscans , npdata, npused
> from sysptntab, systabnames, sysptnhdr
> where pf_seqscans > 0
> and sysptnhdr.npdata > 16
> and sysptnhdr.npused > 16
> and sysptnhdr.partnum =3D3D systabnames.partnum =3D
>
> and systabnames.partnum =3D3D sysptntab.partnum =3D
>
> order by pf_seqscans DESC
>
> Also - what is the output of onstat -g dic.
>
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D

> Do you use HR?
> Can you paste the top 20 lines of "onstat -l"?
>
>
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D

> =3D
>
> From: "VIKAS HIVARKAR" <vikas.hivarkar@gmail.com> =3D
>
> =3D
>
> To: ids@iiug.org =3D
>
> =3D
>
> Date: 07/30/2011 10:38 AM =3D
>
> =3D
>
> Subject: Performance Issues [24479] =3D
>
> =3D
>
> Sent by: ids-bounces@iiug.org =3D
>
> =3D
>
> Hello All,
>
> IDS 11.50.FC8W2 on HP-UX 11.23, 8 cores
>
> Facing performance issue and hence drilling through the following
>
> NETTYPE ipcshm,10,30,CPU
> NETTYPE soctcp,12,150,NET
> VPCLASS cpu,num=3D3D10,noage
>
> "onstat -g sch" shows all the cpuvps spinning equally & 4-5 busy wait=
s =3D
> for
> all
> cpuvps except the first one having 194 busy waits
>
> BUFFERPOOL
> size=3D3D2K,buffers=3D3D6000000,lrus=3D3D512,lru_min_dirty=3D3D50.000=
000,lru_ma=3D
> x_dirty=3D3D60.000000
>
> BUFFERPOOL
> size=3D3D4K,buffers=3D3D2500000,lrus=3D3D512,lru_min_dirty=3D3D50.000=
000,lru_ma=3D
> x_dirty=3D3D60.000000
>
> BUFFERPOOL
> size=3D3D16K,buffers=3D3D600000,lrus=3D3D512,lru_min_dirty=3D3D50.000=
000,lru_ma=3D
> x_dirty=3D3D60.000000
>
> "onstat -u" I see lot many sessions waiting for Log buffer G-BPX--
> and some sessions doing rollbacks frequently :(
>
> We do have good amount of log buffer set LOGBUFF 1024 and huge amount=
o=3D
> f
> logical logs
>
> Some calculations:
> BR: 0.3456
> RAU: 99.94
> BTR: 61.00/hrs, 146/hrs, 610/hrs (calculated for 3 bufferpools differ=
en=3D
> tly)
>
> BTR: 40/hrs (combined for all 3 buffers)
>
> Also pasting the output from "onstat -p"
> Profile
> dskreads pagreads bufreads %cached dskwrits pagwrits bufwrits %cached=

> 178371295 5841005690 6876949471 97.41 29669851 123813498 290614611 89=
.7=3D
> 9
>
> isamtot open start read write rewrite delete commit rollbk
> 7040485791 950978742 312005761 921931088 75467491 7475945 9111695 437=
16=3D
> 88
> 4869
>
> gp_read gp_write gp_rewrt gp_del gp_alloc gp_free gp_curs
> 0 0 0 0 0 0 0
>
> ovlock ovuserthread ovbuff usercpu syscpu numckpts flushes
> 0 0 0 99930.89 49477.95 179 460935
>
> bufwaits lokwaits lockreqs deadlks dltouts ckpwaits compress seqscans=

> 21899422 44236 1696677622 0 0 12779 4298263 30103468
>
> ixda-RA idx-RA da-RA RA-pgsused lchwaits
> 39575656 5892 179906 39742052 9803879
>
> Any suggessions to check why the sessions are waiting so much for buf=
fe=3D
> rs
> and
> logbufers?
>
> Application check:
> The below formula shows atleast 20% of the sql's doing sequential sca=
n,=3D
>
> calculated as
> SSR =3D3D (seqscans / isam starts) * 100.00
> How do I capture or find these SQL's doing sequential scan and or mis=
si=3D
> ng
> indexs
> How do I find out aged out Indexes if any
>
>
>
***********************************************************************=
********

> Forum Note: Use "Reply" to post a response in the discussion forum.=

>=

Messages In This Thread

[ View Thread ] [ Post Response ] [ Return to Index ] [ Read Prev Msg ] [ Read Next Msg ]

IDS Forum is maintained by Administrator with WebBBS 5.12.