Join IIUG
 for   
 

Informix News
18 Nov 13 - ZDNet - Top 20 mobile skills in demand... Read
09 Sep 13 - telecompaper - Shaspa and Tatung have shown a new smart home platform at Ifa in Berlin. Powered by the IBM Informix software... Read
06 Sep 13 - IBM data magazine - Mission Accomplished - Miami, Florida will be the backdrop for the 2014 IIUG Informix Conference... Read
01 Feb 13 - IBM Data Magazine - Are your database backups safe? Lester Knutsen (IBM Champion) writes about database back up safety using "archecker"... Read
14 Nov 12 - IBM - IBM's Big Data For Smart Grid Goes Live In Texas... Read
3 Oct 12 - The Financial - IBM and TransWorks Collaborate to Help Louisiana-Pacific Corporation Achieve Supply Chain Efficiency... Read
28 Aug 12 - techCLOUD9 - Splunk kicks up a SaaS Storm... Read
10 Aug 12 - businessCLOUD9 - Is this the other half of Cloud monitoring?... Read
3 Aug 12 - IBM data management - Supercharging the data warehouse while keeping costs down IBM Informix Warehouse Accelerator (IWA) delivers superior performance for in-memory analytics processing... Read
2 Aug 12 - channelbiz - Oninit Group launches Pay Per Pulse cloud-based service... Read
28 May 12 - Bloor - David Norfolk on the recent Informix benchmark "pretty impressive results"... Read
23 May 12 - DBTA - Informix Genero: A Way to Modernize Informix 4GL Applications... Read
9 Apr 12 - Mastering Data Management - Upping the Informix Ante: Advanced Data Tools... Read
22 Mar 12 - developerWorks - Optimizing Informix database access... Read
14 Mar 12 - BernieSpang.com - International Informix User Group set to meet in San Diego... Read
1 Mar 12 - IBM Data Management - IIUG Heads West for 2012 - Get ready for sun and sand in San Diego... Read
1 Mar 12 - IBM Data Management - Running Informix on Solid-State Drives.Speed Up Database Access... Read
26 Feb 12 - BernieSpan.com - Better results, lower cost for a broad set of new IBM clients and partners... Read
24 Feb 12 - developerWorks - Informix Warehouse Accelerator: Continuous Acceleration during Data Refresh... Read
6 Feb 12 - PRLOG - Informix port delivers unlimited database scalability for popular SaaS application ... Read
2 Feb 12 - developerWorks - Loading data with the IBM Informix TimeSeries Plug-in for Data Studio... Read
1 Feb 12 - developerWorks - 100 Tech Tips, #47: Log-in to Fix Central... Read
13 Jan 12 - MC Press online - Informix Dynamic Server Entices New Users with Free Production Edition ... Read
11 Jan 12 - Computerworld - Ecologic Analytics and Landis+Gyr -- Suitors Decide to Tie the Knot... Read
9 Jan 12 - planetIDS.com - DNS impact on Informix / Impacto do DNS no Informix... Read
8 Sep 11 - TMCnet.com - IBM Offers Database Solution to Enable Smart Meter Data Capture... Read
1 Aug 11 - IBM Data Management Magazine - IIUG user view: Happy 10th anniversary to IBM and Informix... Read
8 Jul 11 - Database Trends and Applications - Managing Time Series Data with Informix... Read
31 May 11 - Smart Grid - The meter data management pitfall utilities are overlooking... Read
27 May 11 - IBM Data Management Magazine - IIUG user view: Big data, big time ( Series data, warehouse acceleration, and 4GLs )... Read
16 May 11 - Business Wire - HiT Software Announces DBMoto for Enterprise Integration, Adds Informix. Log-based Change Data Capture... Read
21 Mar 11 - Yahoo! Finance - IBM and Cable&Wireless Worldwide Announce UK Smart Energy Cloud... Read
14 Mar 11 - MarketWatch - Fuzzy Logix and IBM Unveil In-Database Analytics for IBM Informix... Read
11 Mar 11 - InvestorPlace - It's Time to Give IBM Props: How many tech stocks are up 53% since the dot-com boom?... Read
9 Mar 11 - DBTA - Database Administration and the Goal of Diminishing Downtime... Read
2 Feb 11 - DBTAs - Informix 11.7 Flexible Grid Provides a Different Way of Looking at Database Servers... Read
27 Jan 11 - exactsolutions - Exact to Add Informix Support to Database Replay, SQL Monitoring Solutions... Read
25 Jan 11 - PR Newswire - Bank of China in the UK Works With IBM to Become a Smarter, Greener Bank... Read
12 Oct 10 - Database Trends and Applications - Informix 11.7: The Beginning of the Next Decade of IBM Informix... Read
20 Sep 10 - planetIDS.com - ITG analyst paper: Cost/Benefit case for IBM Informix as compared to Microsoft SQL Server... Read
20 Jul 10 - IBM Announcements - IBM Informix Choice Edition V11.50 helps deploy low-cost scalable and reliable solutions for Apple Macintosh and Microsoft Windows... Read
20 Jul 10 - IBM Announcements - Software withdrawal: Elite Support for Informix Ultimate-C Edition... Read
24 May 10 - eWeek Europe - IBM Supplies Database Tech For EU Smart Grid... Read
23 May 10 - SiliconIndia - IBM's smart metering system allows wise use of energy... Read
21 May 10 - CNET - IBM to help people monitor energy use... Read
20 May 10 - ebiz - IBM Teams With Hildebrand To Bring Smart Metering To Homes Across Britain... Read
19 May 10 - The New Blog Times - Misurare il consumo energetico: DEHEMS è pronto... Read
19 May 10 - ZDNet - IBM software in your home? Pact enables five-city smart meter pilot in Europe... Read
17 March 10 - ZDNet (blog) David Morgenstern - TCO: New research finds Macs in the enterprise easier, cheaper to manage than... Read
17 March 2010 - Virtualization Review - ...key components of Big Blue's platform to the commercial cloud such as its WebSphere suite of application ser vers and its DB2 and Informix databases... Read
10 February 2010 - The Wall Street Journal - International Business Machines is expanding an initiative to win over students and professors on its products. How do they lure the college crowd?... Read

End of Support Dates
IDS 11.10 - 30 Sep 2012
Subscribe to notifications

IIUG on Facebook IIUG on Twitter

[ View Thread ] [ Post Response ] [ Return to Index ] [ Read Prev Msg ] [ Read Next Msg ]

IDS Forum

Re: RE: IDS 7.31 Solaris8 - Long Checkpoints

Posted By: Art Kagel
Date: Monday, 16 March 2009, at 3:19 p.m.

In Response To: RE: RE: IDS 7.31 Solaris8 - Long Checkpoints (Norma Jean Sebastian)

I'm brave, but not foolish. In general, I agree, change one thing at a time
and watch what happens. But there are several groups of parameters that are
related and those should generally be modified in lock step for best
results. The groups of parameters below are each dependent for resources on
the ones listed below them and interrelated the other parameter in the
group.

- CKPTINTVL with PHYSFILE

- LRU_MIN_DIRTY with LRU_MAX_DIRTY

- LRUS with CLEANERS

- NUMAIOVPS (or VPCLASS aio in newer engine versions)

Often these four sets of parameters are related. Modifying the earlier
groups without supplying the resources from the later groups can be
detrimental to performance. Longer checkpoint intervals require a larger
physical log. If you do not have one CLEANER for each LRU queue then at LRU
flush time some LRU queues may become 100% dirty causing foreground writes.
Even if they do not reach 100%, if some queues exceed LRU_MAX_DIRTY
frequently then checkpoints will become longer. As Kate pointed out, the
number of AIO VPs is a critical resource in general and depending on the
kind of chunk files used is a major performance limiter when incorrectly
tuned. If two or more LRU queues need to be flushed at the same time at LRU
flush time or dirty pages from multiple chunks have to be flushed at
checkpoint time, but, as in the OP's system, there is only a single AIO VP,
some IO requests will have to wait in queue.

Therefore, I put them all together and tend to tune the less independent
parameters (NUMAIOVPS and LRUS/CLEANERS) when I adjust the more dependent
ones (LRU_MIN/MAX_DIRTY and LRUS/CLEANERS).

Art

On Mon, Mar 16, 2009 at 1:58 PM, Norma Jean Sebastian <
nsebastian@flinnsci.com> wrote:

> I did.
> It is an option, and I most certainly didn't mean to change several
> parameters at the same time. I assumed it was common knowledge to tweak
> one thing at a time...
> Sorry.
> NJ
>
> -----Original Message-----
> From: ids-bounces@iiug.org [mailto:ids-bounces@iiug.org] On Behalf Of
> Art Kagel
> Sent: Monday, March 16, 2009 11:54 AM
> To: ids@iiug.org
> Subject: Re: RE: IDS 7.31 Solaris8 - Long Checkpoints [15164]
>
> Sorry, someone did. My apologies.
>
> Art
>
> On Mon, Mar 16, 2009 at 12:47 PM, kate <kate@iiug.org> wrote:
>
> > I never said to increase buffers, so we are agreeing. I said that IF
> YOU
> > DID you would need to retune everything.
> >
> > Thanks!
> > Kate Tomchik [ kate@iiug.org ] www.iiug.org
> > International Informix Users Group Board of Directors
> >
> > A computer lets you make more mistakes faster than any invention in
> human
> > history - with the possible exceptions of handguns and tequila.
> > Mitch Ratliffe
> >
> > ---------- Original Message -----------
> > From: "Art Kagel" <art.kagel@gmail.com>
> > To: ids@iiug.org
> > Sent: Mon, 16 Mar 2009 12:35:18 -0400 (EDT)
> > Subject: Re: RE: IDS 7.31 Solaris8 - Long Checkpoints [15159]
> >
> > > I have to disagree with both of your suggestins Kate. Increasing
> > > buffers will only increase the number of dirty buffers at checkpoint
>
> > > time making the checkpoints even longer. Since the OP is using 7.31
> > > he only has full integer control of the LRU_MIN/MAX_DIRTY
> parameters,
> > > so 2/1 is as low as he can go and changing the MIN from 2 to 1 will
> > > not help a whole lot if they are increasing BUFFERS to boot. Now you
>
> > > may be right that the instance is too small and they could use more
> > > buffers to make EVERYTHING run better and faster, but that's not
> > > going to help the checkpoint duration at all.
> > >
> > > Your the ideas in your other post I'll address there.
> > >
> > > Art
> > >
> > > On Mon, Mar 16, 2009 at 12:24 PM, kate <kate@iiug.org> wrote:
> > >
> > > > No NJ, that would be changing too many things at once. Even Art
> has too
> > > > many. For starters just change what I said, bounce you engine, and
> see
> > what
> > > > your results are.
> > > >
> > > > Changing buffers often causes a retune of the whole environment. I
>
> > agree
> > he
> > > > could be using many more, but lets focus on the current problem
> first.
> > > >
> > > > Thanks!
> > > > Kate Tomchik [ kate@iiug.org ] www.iiug.org
> > > > International Informix Users Group Board of Directors
> > > >
> > > > A computer lets you make more mistakes faster than any invention
> in
> > human
> > > > history - with the possible exceptions of handguns and tequila.
> > > > Mitch Ratliffe
> > > >
> > > > ---------- Original Message -----------
> > > > From: "Norma Jean Sebastian" <nsebastian@flinnsci.com>
> > > > To: ids@iiug.org
> > > > Sent: Mon, 16 Mar 2009 11:56:55 -0400 (EDT)
> > > > Subject: RE: RE: IDS 7.31 Solaris8 - Long Checkpoints [15154]
> > > >
> > > > > Kurt,
> > > > > It's cool you're not taking more virtual memory segs to get the
> work
> > > > > done (only 1 "V" in your onstat -g seg output).
> > > > > Your engine is only sized to about 413MB, while you said you
> have
> > > > > 4GB RAM on the server.
> > > > >
> > > > > In addition to Art Kagel's suggestion he just saw posted....
> > > > > Try increasing your buffers... what else is running on the
> > > > > server?... increasing buffers is the main thing that will
> increase
> > > > > the size of your Informix engine... you're on a 7.31 (32bit)
> engine
> > > > > ... you could max the Informix engine up to about 3.75GB I
> think...
> > > > > you don't have to go for the full max, but at least double it to
>
> > > > > about 1 GB instead of the 413MB you have now.
> > > > >
> > > > > Thanks,
> > > > > Norma Jean Sebastian
> > > > >
> > > > > -----Original Message-----
> > > > > From: ids-bounces@iiug.org [mailto:ids-bounces@iiug.org] On
> Behalf
> > > > > Of KURT VAN GOMPEL Sent: Monday, March 16, 2009 10:36 AM To:
> > > > > ids@iiug.org Subject: Re: RE: IDS 7.31 Solaris8 - Long
> Checkpoints
> > > > > [15149]
> > > > >
> > > > > Hello,
> > > > >
> > > > > Here's the output op onstat -g seg:
> > > > >
> > > > > Informix Dynamic Server Version 7.31.UD1 -- On-Line -- Up
> 10:22:10 --
> > > > > 412752 Kbytes
> > > > >
> > > > > Segment Summary:
> > > > > id key addr size ovhd class blkused blkfree
> > > > > 94000 1394493441 a000000 268435456 24820 R* 31026 1742
> > > > > 94001 1394493442 1a000000 153600000 2948 V 9760 8990
> > > > > 94002 1394493443 2327c000 622592 616 M 75 1
> > > > > Total: - - 422658048 - - 40861 10733
> > > > >
> > > > > (* segment locked in memory)
> > > > >
> > > > > Hello,
> > > > > We are running IDS7.31 UD1 on a Solaris8 server with 2 Sparc64
> > > > > processors and 4GB RAM.
> > > > > It is used for interactive and batch processing.
> > > > > When lots of manipulations on the DB are done, it takes
> sometimes
> > > > > more than 60 seconds to do his checkpoints. Some parameters of
> our
> > > > > config file: MULTIPROCESSOR 1 NUMCPUVPS 2 SINGLE_CPU_VP 0 NOAGE
> 1
> > > > > AFF_SPROC 0 AFF_NPROCS 0 LOCKS 700000 BUFFERS 100000 NUMAIOVPS 1
>
> > > > > PHYSBUFF 64 LOGBUFF 64 LOGSMAX 600 CLEANERS 8 CKPTINTVL 120 LRUS
> 8
> > > > > LRU_MAX_DIRTY 5 LRU_MIN_DIRTY 2 Any idea how to speed up the
> > > > > checkpoints?
> > > > >
> > > > >
> > > >
> > > >
> > >
> >
> >
> ************************************************************************
> *****
> >
> > > > ** Forum Note: Use "Reply" to post a response in the discussion
> forum.
> > > > ------- End of Original Message -------
> > > >
> > > >
> > > >
> > > >
> > >
> >
> >
> ************************************************************************
> *****
> > **
> > > > Forum Note: Use "Reply" to post a response in the discussion
> forum.
> > > >
> > > >
> > >
> > > --
> > > Art S. Kagel
> > > Oninit (www.oninit.com)
> > > IIUG Board of Directors (art@iiug.org)
> > >
> > > Disclaimer: Please keep in mind that my own opinions are my own
> > > opinions and do not reflect on my employer, Oninit, the IIUG, nor
> > > any other organization with which I am associated either explicitly
> > > or implicitly. Neither do those opinions reflect those of other
> > > individuals affiliated with any entity with which I am affiliated
> > > nor those of the entities themselves.
> > >
> > > --001636427251eb776a04653f08bd
> > >
> > >
> >
> >
> ************************************************************************
> *****
> > ** Forum Note: Use "Reply" to post a response in the discussion forum.
>
> > ------- End of Original Message -------
> >
> >
> >
> >
> ************************************************************************
> *******
> > Forum Note: Use "Reply" to post a response in the discussion forum.
> >
> >
>
> --
> Art S. Kagel
> Oninit (www.oninit.com)
> IIUG Board of Directors (art@iiug.org)
>
> Disclaimer: Please keep in mind that my own opinions are my own opinions
> and
> do not reflect on my employer, Oninit, the IIUG, nor any other
> organization
> with which I am associated either explicitly or implicitly. Neither do
> those opinions reflect those of other individuals affiliated with any
> entity
> with which I am affiliated nor those of the entities themselves.
>
> --0016368324ea8b947104653f4bcb
>
> ************************************************************************
> *******
> Forum Note: Use "Reply" to post a response in the discussion forum.
>
>
>
> *******************************************************************************
> Forum Note: Use "Reply" to post a response in the discussion forum.
>
>

--
Art S. Kagel
Oninit (www.oninit.com)
IIUG Board of Directors (art@iiug.org)

Disclaimer: Please keep in mind that my own opinions are my own opinions and
do not reflect on my employer, Oninit, the IIUG, nor any other organization
with which I am associated either explicitly or implicitly. Neither do
those opinions reflect those of other individuals affiliated with any entity
with which I am affiliated nor those of the entities themselves.

--0016368325a89f20b9046541544e

Messages In This Thread

[ View Thread ] [ Post Response ] [ Return to Index ] [ Read Prev Msg ] [ Read Next Msg ]

IDS Forum is maintained by Administrator with WebBBS 5.12.