Join IIUG
 for   
 

Informix News
18 Nov 13 - ZDNet - Top 20 mobile skills in demand... Read
09 Sep 13 - telecompaper - Shaspa and Tatung have shown a new smart home platform at Ifa in Berlin. Powered by the IBM Informix software... Read
06 Sep 13 - IBM data magazine - Mission Accomplished - Miami, Florida will be the backdrop for the 2014 IIUG Informix Conference... Read
01 Feb 13 - IBM Data Magazine - Are your database backups safe? Lester Knutsen (IBM Champion) writes about database back up safety using "archecker"... Read
14 Nov 12 - IBM - IBM's Big Data For Smart Grid Goes Live In Texas... Read
3 Oct 12 - The Financial - IBM and TransWorks Collaborate to Help Louisiana-Pacific Corporation Achieve Supply Chain Efficiency... Read
28 Aug 12 - techCLOUD9 - Splunk kicks up a SaaS Storm... Read
10 Aug 12 - businessCLOUD9 - Is this the other half of Cloud monitoring?... Read
3 Aug 12 - IBM data management - Supercharging the data warehouse while keeping costs down IBM Informix Warehouse Accelerator (IWA) delivers superior performance for in-memory analytics processing... Read
2 Aug 12 - channelbiz - Oninit Group launches Pay Per Pulse cloud-based service... Read
28 May 12 - Bloor - David Norfolk on the recent Informix benchmark "pretty impressive results"... Read
23 May 12 - DBTA - Informix Genero: A Way to Modernize Informix 4GL Applications... Read
9 Apr 12 - Mastering Data Management - Upping the Informix Ante: Advanced Data Tools... Read
22 Mar 12 - developerWorks - Optimizing Informix database access... Read
14 Mar 12 - BernieSpang.com - International Informix User Group set to meet in San Diego... Read
1 Mar 12 - IBM Data Management - IIUG Heads West for 2012 - Get ready for sun and sand in San Diego... Read
1 Mar 12 - IBM Data Management - Running Informix on Solid-State Drives.Speed Up Database Access... Read
26 Feb 12 - BernieSpan.com - Better results, lower cost for a broad set of new IBM clients and partners... Read
24 Feb 12 - developerWorks - Informix Warehouse Accelerator: Continuous Acceleration during Data Refresh... Read
6 Feb 12 - PRLOG - Informix port delivers unlimited database scalability for popular SaaS application ... Read
2 Feb 12 - developerWorks - Loading data with the IBM Informix TimeSeries Plug-in for Data Studio... Read
1 Feb 12 - developerWorks - 100 Tech Tips, #47: Log-in to Fix Central... Read
13 Jan 12 - MC Press online - Informix Dynamic Server Entices New Users with Free Production Edition ... Read
11 Jan 12 - Computerworld - Ecologic Analytics and Landis+Gyr -- Suitors Decide to Tie the Knot... Read
9 Jan 12 - planetIDS.com - DNS impact on Informix / Impacto do DNS no Informix... Read
8 Sep 11 - TMCnet.com - IBM Offers Database Solution to Enable Smart Meter Data Capture... Read
1 Aug 11 - IBM Data Management Magazine - IIUG user view: Happy 10th anniversary to IBM and Informix... Read
8 Jul 11 - Database Trends and Applications - Managing Time Series Data with Informix... Read
31 May 11 - Smart Grid - The meter data management pitfall utilities are overlooking... Read
27 May 11 - IBM Data Management Magazine - IIUG user view: Big data, big time ( Series data, warehouse acceleration, and 4GLs )... Read
16 May 11 - Business Wire - HiT Software Announces DBMoto for Enterprise Integration, Adds Informix. Log-based Change Data Capture... Read
21 Mar 11 - Yahoo! Finance - IBM and Cable&Wireless Worldwide Announce UK Smart Energy Cloud... Read
14 Mar 11 - MarketWatch - Fuzzy Logix and IBM Unveil In-Database Analytics for IBM Informix... Read
11 Mar 11 - InvestorPlace - It's Time to Give IBM Props: How many tech stocks are up 53% since the dot-com boom?... Read
9 Mar 11 - DBTA - Database Administration and the Goal of Diminishing Downtime... Read
2 Feb 11 - DBTAs - Informix 11.7 Flexible Grid Provides a Different Way of Looking at Database Servers... Read
27 Jan 11 - exactsolutions - Exact to Add Informix Support to Database Replay, SQL Monitoring Solutions... Read
25 Jan 11 - PR Newswire - Bank of China in the UK Works With IBM to Become a Smarter, Greener Bank... Read
12 Oct 10 - Database Trends and Applications - Informix 11.7: The Beginning of the Next Decade of IBM Informix... Read
20 Sep 10 - planetIDS.com - ITG analyst paper: Cost/Benefit case for IBM Informix as compared to Microsoft SQL Server... Read
20 Jul 10 - IBM Announcements - IBM Informix Choice Edition V11.50 helps deploy low-cost scalable and reliable solutions for Apple Macintosh and Microsoft Windows... Read
20 Jul 10 - IBM Announcements - Software withdrawal: Elite Support for Informix Ultimate-C Edition... Read
24 May 10 - eWeek Europe - IBM Supplies Database Tech For EU Smart Grid... Read
23 May 10 - SiliconIndia - IBM's smart metering system allows wise use of energy... Read
21 May 10 - CNET - IBM to help people monitor energy use... Read
20 May 10 - ebiz - IBM Teams With Hildebrand To Bring Smart Metering To Homes Across Britain... Read
19 May 10 - The New Blog Times - Misurare il consumo energetico: DEHEMS è pronto... Read
19 May 10 - ZDNet - IBM software in your home? Pact enables five-city smart meter pilot in Europe... Read
17 March 10 - ZDNet (blog) David Morgenstern - TCO: New research finds Macs in the enterprise easier, cheaper to manage than... Read
17 March 2010 - Virtualization Review - ...key components of Big Blue's platform to the commercial cloud such as its WebSphere suite of application ser vers and its DB2 and Informix databases... Read
10 February 2010 - The Wall Street Journal - International Business Machines is expanding an initiative to win over students and professors on its products. How do they lure the college crowd?... Read

End of Support Dates
IDS 11.10 - 30 Sep 2012
Subscribe to notifications

IIUG on Facebook IIUG on Twitter

[ View Thread ] [ Post Response ] [ Return to Index ] [ Read Prev Msg ] [ Read Next Msg ]

IDS Forum

Re: Performance Impact after storage migration

Posted By: VIKAS HIVARKAR
Date: Friday, 11 October 2013, at 7:38 a.m.

In Response To: Re: Performance Impact after storage migration (Art Kagel)

Hello Art,

Sorry for the delay in my reponse, I was waiting for the information from HP

Art - did the onstat -g ckp show long block times?

Yes, infact lately we have increased the BUFFER size for 16K buffer as we saw high BTR and I believe that since that change I am seeing checkpoints taking long time with fairly longer blocking time.

Configured with group of 168 FC 10k RPM drives and dedicated four front end ports for Informix cluster.

What RAID level?
79 VGs in total out of which 61 are on RAID 1 and 18 are RAID 5

How big is the stripe blocking?
For Raid 5 stripe size is 128Kb
For Raid 1 stripe size is 256Kb

How many spindles are in each structure?
All luns are wide striped across 168 spindles.

onstat -F

IBM Informix Dynamic Server Version 11.50.FC8W2 -- On-Line (Prim) -- Up 9 days 10:14:13 -- 83208912 Kbytes

Fg Writes LRU Writes Chunk Writes
0 51712213 95335894

address flusher state data # LRU Chunk Wakeups Idle Tim
c000001408415888 0 I 0 0 3819542 4621106 813303.587
c0000014084160e0 1 I 0 0 3557889 4359644 813343.843
c000001408416938 2 I 0 0 3274470 4075463 812531.368
c000001408417190 3 I 0 0 3166100 3966471 811934.702
c0000014084179e8 4 I 0 0 3002538 3804280 813324.752
c000001408418240 5 I 0 0 2834845 3636310 813031.860
c000001408418a98 6 I 0 0 2686597 3486253 811202.465
c0000014084192f0 7 I 0 0 2557634 3358741 812642.450
c000001408419b48 8 I 0 0 2467357 3268927 813121.692
c00000140841a3a0 9 I 0 0 2423648 3225405 813342.546
c00000140841abf8 10 I 0 0 2375710 3175721 811535.485
c00000140841b450 11 I 0 0 2301315 3101566 811795.799
c00000140841bca8 12 I 0 0 2267774 3068964 812759.581
c00000140841c500 13 I 0 0 2195100 2996698 813156.343
c00000140841cd58 14 I 0 0 2075059 2876297 812764.397
c00000140841d5b0 15 I 0 0 1774294 2576683 813943.028
c00000140841de08 16 I 0 0 1757574 2560138 814113.722
c00000140841e660 17 I 0 0 1740367 2542914 814100.952
c00000140841eeb8 18 I 0 0 1715677 2518217 814078.609
c00000140841f710 19 I 0 0 1678186 2480560 813929.036
c00000140841ff68 20 I 0 0 1628619 2430915 813850.870
c0000014084207c0 21 I 0 0 1578856 2380834 813509.546
c000001408421018 22 I 0 0 1557423 2359718 813847.838
c000001408421870 23 I 0 0 1524951 2326763 813363.393
c0000014084220c8 24 I 0 0 1489123 2291543 813976.098
c000001408422920 25 I 0 0 1439096 2241394 813848.700
c000001408423178 26 I 0 0 1408349 2210684 813881.037
c0000014084239d0 27 I 0 0 1346739 2149156 813965.500
c000001408424228 28 I 0 0 1284856 2087248 813931.687
c000001408424a80 29 I 0 0 1212814 2015075 813809.127
c0000014084252d8 30 I 0 0 1148024 1950013 813522.639
c000001408425b30 31 I 0 0 1116655 1918692 813586.337
c000001408426388 32 I 0 0 1074229 1876200 813506.475
c000001408426be0 33 I 0 0 1026402 1828330 813454.487
c000001408427438 34 I 0 0 975538 1777522 813516.306
c000001408427c90 35 I 0 0 935815 1737636 813347.500
c0000014084284e8 36 I 0 0 867591 1669514 813447.230
c000001408428d40 37 I 0 0 818066 1619650 813138.467
c000001408429598 38 I 0 0 789886 1591734 813375.733
c000001408429df0 39 I 0 0 757005 1558901 813434.546
c00000140842a648 40 I 0 0 712937 1514772 813384.725
c00000140842aea0 41 I 0 0 654107 1455916 813360.628
c00000140842b6f8 42 I 0 0 639123 1440821 813233.113
c00000140842bf50 43 I 0 0 585283 1386602 812831.072
c00000140842c7a8 44 I 0 0 538219 1339512 812784.338
c00000140842d000 45 I 0 0 513150 1314294 812633.153
c00000140842d858 46 I 0 0 449294 1250415 812619.052
c00000140842e0b0 47 I 0 0 413833 1215221 812911.429
c00000140842e908 48 I 0 0 396667 1198171 813026.016
c00000140842f160 49 I 0 0 366924 1168836 813432.231
c00000140842f9b8 50 I 0 0 352521 1154531 813523.150
c000001408430210 51 I 0 0 334947 1136473 813038.820
c000001408430a68 52 I 0 0 317619 1119994 813893.778
c0000014084312c0 53 I 0 0 309327 1111570 813759.278
c000001408431b18 54 I 0 0 299992 1101864 813378.746
c000001408432370 55 I 0 0 281463 1083137 813189.738
c000001408432bc8 56 I 0 0 267427 1069605 813678.658
c000001408433420 57 I 0 0 257462 1059482 813543.164
c000001408433c78 58 I 0 0 233999 1036539 814069.121
c0000014084344d0 59 I 0 0 216667 1019007 813869.390
c000001408434d28 60 I 0 0 208636 1011150 814033.976
c000001408435580 61 I 0 0 199558 1002101 814067.447
c000001408435dd8 62 I 0 0 191899 994587 814209.011
c000001408436630 63 I 0 0 187226 989824 814125.894
c000001408436e88 64 I 0 0 181928 984465 814061.368
c0000014084376e0 65 I 0 0 177257 979813 814086.271
c000001408437f38 66 I 0 0 171837 974313 814006.752
c000001408438790 67 I 0 0 148002 950578 814103.220
c000001408438fe8 68 I 0 0 142534 945130 814124.732
c000001408439840 69 I 0 0 137263 939803 814061.076
c00000140843a098 70 I 0 0 126512 928923 813930.265
c00000140843a8f0 71 I 0 0 124673 926876 813726.060
c00000140843b148 72 I 0 0 104677 906280 813120.425
c00000140843b9a0 73 I 0 0 100333 902258 813452.502
c00000140843c1f8 74 I 0 0 98501 901189 814216.083
c00000140843ca50 75 I 0 0 86576 889207 814164.492
c00000140843d2a8 76 I 0 0 85357 887859 814038.557
c00000140843db00 77 I 0 0 83300 885932 814165.726
c00000140843e358 78 I 0 0 75558 877991 813950.859
c00000140843ebb0 79 I 0 0 63186 865910 814255.623
c00000140843f408 80 I 0 0 63039 865806 814295.974
c00000140843fc60 81 I 0 0 62133 864630 814020.365
c0000014084404b8 82 I 0 0 61008 863136 813651.043
c000001408440d10 83 I 0 0 52552 855215 814184.712
c000001408441568 84 I 0 0 52336 854973 814159.424
c000001408441dc0 85 I 0 0 40774 843556 814316.028
c000001408442618 86 I 0 0 34525 837235 814229.431
c000001408442e70 87 I 0 0 34327 837111 814311.499
c0000014084436c8 88 I 0 0 28096 830800 814226.639
c000001408443f20 89 I 0 0 27830 830520 814221.625
c000001408444778 90 I 0 0 27724 830457 814258.723
c000001408444fd0 91 I 0 0 27645 830370 814254.519
c000001408445828 92 I 0 0 27415 830089 814208.406
c000001408446080 93 I 0 0 27360 829859 814018.141
c0000014084468d8 94 I 0 0 13939 816265 813852.939
c000001408447130 95 I 0 0 13897 816490 814115.386
c000001408447988 96 I 0 0 3793 806212 813938.983
c0000014084481e0 97 I 0 0 3745 806441 814216.083
c000001408448a38 98 I 0 0 3700 806557 814382.270
c000001408449290 99 I 0 0 3640 806389 814276.829
c000001408449ae8 100 I 0 0 3411 806188 814305.173
c00000140844a340 101 I 0 0 1109 803833 814243.488
c00000140844ab98 102 I 0 0 1082 803407 813848.433
c00000140844b3f0 103 I 0 0 1058 803911 814376.240
c00000140844bc48 104 I 0 0 1038 803782 814269.765
c00000140844c4a0 105 I 0 0 1020 803781 814283.682
c00000140844ccf8 106 I 0 0 992 803779 814317.611
c00000140844d550 107 I 0 0 967 803688 814243.383
c00000140844dda8 108 I 0 0 951 803747 814323.007
c00000140844e600 109 I 0 0 924 803729 814327.078
c00000140844ee58 110 I 0 0 883 803648 814287.418
c00000140844f6b0 111 I 0 0 855 803512 814181.788
c00000140844ff08 112 I 0 7641 827 809705 812751.497
c000001408450760 113 I 0 4125 805 806920 813510.738
c000001408450fb8 114 I 0 10575 773 811401 811519.681
c000001408451810 115 I 0 7 748 803544 814311.271
c000001408452068 116 I 0 10319 718 811707 812178.285
c0000014084528c0 117 I 0 9742 696 811593 812652.787
c000001408453118 118 I 0 3249 661 806361 813981.246
c000001408453970 119 I 0 9357 637 811009 812524.289
c0000014084541c8 120 I 0 10162 613 811888 812616.816
c000001408454a20 121 I 0 23916 591 823368 810370.983
c000001408455278 122 I 0 13050 573 814214 812066.717
c000001408455ad0 123 I 0 13687 535 814766 812042.904
c000001408456328 124 I 0 16133 506 816702 811555.855
c000001408456b80 125 I 0 12462 491 813683 812234.570
c0000014084573d8 126 I 0 24459 460 823719 810281.647
c00000142367b030 127 I 0 21941 433 821454 810570.403

states: Exit Idle Chunk Lru

----------------------------------------------------------------------------
Vikas:

Onstat -F will tell you whether LRU writes or Chunk writes are dominating.
With your lru_min/max_dirty settings at 1&3 I'd also guess that LRU writes
are dominating. Normally on v11.50+ with non-blocking checkpoints, most
sessions are not affected by long checkpoints, but it does happen. Before
you turned on the auto checkpointing, did the onstat -g ckp show long block
times?

You say that you "upgraded" your storage. That usually means a bigger
badder SAN. If you now have all of your chunks, including logical and
physical logs, rootdb, temp spaces, and your data, all on a single
monstrous structure on the SAN you may be experiencing IO bottlenecks
during the checkpoints and, also during periods of more intense LRU
flushing, that is affecting the engine's ability to move data into the
cache when it is needed. Similarly, how was(were) the SAN structure(s) for
the instance configured? What RAID level? How big is the stripe blocking?
How many spindles are in each structure? Is it possible that the same
sets of spindles are being shared with other applications that have
different access patterns than the database (Windows filesystems and
especially mail servers are especially bad to share with for example). How
are your read and write IO service times as the engine sees them (onstat -g
iof)?

Art

Art S. Kagel, Principal Consultant

Advanced DataTools (www.advancedatatools.com)
Blog: http://informix-myview.blogspot.com/

Disclaimer: Please keep in mind that my own opinions are my own opinions
and do not reflect on my employer, Advanced DataTools, the IIUG, nor any
other organization with which I am associated either explicitly,
implicitly, or by inference. Neither do those opinions reflect those of
other individuals affiliated with any entity with which I am affiliated nor
those of the entities themselves.

On Wed, Oct 9, 2013 at 3:47 AM, VIKAS HIVARKAR <vikas.hivarkar@gmail.com>wrote:

> Hello All,
>
> IDS 11.50.FC8W2 on HP-UX B.11.31 U ia64
>
> Recently we have upgraded our storage and the hp boxes and since then we
> see
> intermittent performance issues.
>
> onstat -g ckp
> AUTO_CKPTS=On RTO_SERVER_RESTART=180 seconds Estimated recovery time 1304
> seconds
>
> We observed that the checkpoint was taking long time and blocking the
> transactions hence we set the RTO_SERVER_RESTART to 180
> post this the AUTO_CKPTS was ON and now I see there is very very less
> number
> of checkpoint except for the checkpoints triggered
> by backup so I believe most of the writing is done by LRU flushing
>
> Is it normal not to have regular interval checkpoints ? could the excessing
> LRU flusing is causing the intermittent performance problems?
>
> onstat -c |grep ^BUFFER
> BUFFERPOOL
>
> size=2K,buffers=9000000,lrus=512,lru_min_dirty=1.000000,lru_max_dirty=3.000000
> BUFFERPOOL
>
> size=4K,buffers=3000000,lrus=512,lru_min_dirty=1.000000,lru_max_dirty=3.000000
> BUFFERPOOL
>
> size=8K,buffers=1200000,lrus=512,lru_min_dirty=1.000000,lru_max_dirty=3.000000
> BUFFERPOOL
>
> size=16K,buffers=3500000,lrus=512,lru_min_dirty=1.000000,lru_max_dirty=3.000000
>
> onstat -g seg
> Segment Summary:
> id key addr size ovhd class blkused blkfree
> 32789 52564803 c000000015380000 348160 5296 M 84 1
> 65551 52564801 c000000100000000 77832777728 912540720 R* 19002141 2
> 393236 52564802 c000001400000000 7372800000 86401888 V* 1127853 672147
> Total: - - 85205925888 - - 20130078 672150
>
> onstat -p
> Profile
> dskreads pagreads bufreads %cached dskwrits pagwrits bufwrits %cached
> 3533376905 40019324337 129263240373 97.27 119250498 619708349 2931928150
> 95.94
>
> isamtot open start read write rewrite delete commit rollbk
> 168657611197 15194194925 5119943273 78536749289 1844472464 29194093
> 56456814
> 32472838 8777
>
> gp_read gp_write gp_rewrt gp_del gp_alloc gp_free gp_curs
> 0 0 0 0 0 0 0
>
> ovlock ovuserthread ovbuff usercpu syscpu numckpts flushes
> 0 0 0 987815.69 148729.15 1685 3891180
>
> bufwaits lokwaits lockreqs deadlks dltouts ckpwaits compress seqscans
> 420005993 316802 28144601035 0 0 61682 104707403 2348872108
>
> ixda-RA idx-RA da-RA RA-pgsused lchwaits
> 1053637354 85987054 623849831 1727787827 84014387

Messages In This Thread

[ View Thread ] [ Post Response ] [ Return to Index ] [ Read Prev Msg ] [ Read Next Msg ]

IDS Forum is maintained by Administrator with WebBBS 5.12.