 |
IDS Forum
Re: Update statistics issue
Posted By: medkba
Date: Friday, 27 June 2014, at 12:42 p.m.
In Response To: Re: Update statistics issue (medkba)
how to do the PDQPRIORITY before run the statics
On Sat, Jun 28, 2014 at 12:36 AM, medkba <medkba@gmail.com> wrote:
> tk_id 18
> tk_name Auto Update Statistics Evaluation
> tk_enable f
> tk_next_execution 2014-06-28 00:30:28
>
> tk_id 19
> tk_name Auto Update Statistics Refresh
> tk_enable f
> tk_next_execution 2014-06-28 00:29:31
>
> I have disable both jobs and will continue to run manually statistics but
> please let me know how to do the
>
> On Sat, Jun 28, 2014 at 12:20 AM, Art Kagel <art.kagel@gmail.com> wrote:
>
> > Yes, either disable them or change them to run further apart and rely on
> > what they do and disable your own scripts. Right now it looks like the
> > refresh is running 11 minutes after the evaluator starts running and that
> > can't be right unless your database has very few tables. If you decide to
> > keep AUS running and abandon your own scripts then you should look in the
> > ph_run table to see how long the evaluator actually runs for (columns
> > duration) and change the scheduling for the AUS refresh task:
> >
> > select * from ph_run where run_task_id = 18;
> >
> > Art
> >
> > Art S. Kagel, Principal Consultant
> > ASK Database Management
> >
> > Blog: http://informix-myview.blogspot.com/
> >
> > Disclaimer: Please keep in mind that my own opinions are my own opinions
> > and do not reflect on the IIUG, nor any other organization with which I
> am
> > associated either explicitly, implicitly, or by inference. Neither do
> > those opinions reflect those of other individuals affiliated with any
> > entity with which I am affiliated nor those of the entities themselves.
> >
> > On Fri, Jun 27, 2014 at 11:51 AM, medkba <medkba@gmail.com> wrote:
> >
> > > Thank you very much Art
> > >
> > > The below output executing the query
> > >
> > > tk_id 18
> > > tk_name Auto Update Statistics Evaluation
> > > tk_enable t
> > > tk_next_execution 2014-06-28 01:00:00
> > >
> > > tk_id 19
> > > tk_name Auto Update Statistics Refresh
> > > tk_enable t
> > > tk_next_execution 2014-06-28 01:11:00
> > >
> > > It means that statistics running automatically. Am i right? I need to
> > > disable both
> > >
> > > On Fri, Jun 27, 2014 at 11:39 PM, Art Kagel <art.kagel@gmail.com>
> wrote:
> > >
> > > > There are two AUS tasks, the AUS evaluator that determines what
> tables
> > > need
> > > > their stats updated and the AUS refresh task that executes the
> commands
> > > > calculated by the evaluator. You can find the task manager records
> > > > governing their execution in the sysadmin database in the table
> > ph_task.
> > > > Run:
> > > >
> > > > select tk_id, tk_name, tk_enable, tk_next_execution
> > > > from sysadmin:ph_task
> > > > where tk_execute matches 'aus*';
> > > >
> > > > If tk_enable is set to 't' then the AUS tasks are running. Obviously
> if
> > > > the evaluator is executing but the refresh is not, then stats are not
> > > being
> > > > updated by AUS and if the refresh is running without the evaluator
> > > running
> > > > before it then the list of work its doing is probably out-of-date and
> > may
> > > > even be empty. The tk_next_execution column will tell you when each
> is
> > > > scheduled to run next. Note that in 11.50 the evaluator was rather
> > > > inefficient and could take longer to run than the default difference
> in
> > > the
> > > > scheduled run times of the two tasks (1 hour) so that when the
> refresh
> > > > launched the evaluator may not have finished running resulting in the
> > > > refresh only processing some of the tables that needed to updated.
> This
> > > > was fixed in 11.70 and again in 12.10 by recoding the evaluator to
> run
> > > > faster and by changing the default scheduling of the tasks so they
> run
> > > > further apart.
> > > >
> > > > Art
> > > >
> > > > Art S. Kagel, Principal Consultant
> > > > ASK Database Management
> > > >
> > > > Blog: http://informix-myview.blogspot.com/
> > > >
> > > > Disclaimer: Please keep in mind that my own opinions are my own
> > opinions
> > > > and do not reflect on the IIUG, nor any other organization with
> which I
> > > am
> > > > associated either explicitly, implicitly, or by inference. Neither do
> > > > those opinions reflect those of other individuals affiliated with any
> > > > entity with which I am affiliated nor those of the entities
> themselves.
> > > >
> > > > On Fri, Jun 27, 2014 at 10:05 AM, medkba <medkba@gmail.com> wrote:
> > > >
> > > > > Yes, i have running update statistics one of the database i.e. most
> > > used
> > > > > the application
> > > > > Run UPDATE STATISTICS LOW
> > > > > Ok, i will read this article
> > > > > Dosstat runs weekly once
> > > > > This is new hp blade server with 32gb memory. It means that
> hardware
> > > very
> > > > > powerful but statistics job running slow then the question aries
> why
> > > slow
> > > > > and hard to convenience management to change different way of
> > running.
> > > > > How do i check aus running
> > > > > Thank you
> > > > > On 27 Jun 2014 21:18, "Art Kagel" <art.kagel@gmail.com> wrote:
> > > > >
> > > > > > "from a shell script" wasn't what I was looking for. Are you
> > running
> > > > plan
> > > > > > UPDATE STATISTICS? UPDATE STATISTICS LOW? UPDATE STATISTICS
> MEDIUM?
> > > > > > UPDATE STATISTICS HIGH? Combinations of multiple commands? Are
> you
> > > > > > running these in dbaccess? If so are you running against just
> this
> > > one
> > > > > > table in each command or against the entire database? Are you
> using
> > > my
> > > > > > dostats utility to generate an optimal set of commands?
> > > > > >
> > > > > > OK, first thing to do then is to read John's paper. Link here:
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
> http://www.ibm.com/developerworks/data/zones/informix/library/techarticle/miller/0203miller.html#section3
> > > > > >
> > > > > > Quick-and-dirty:
> > > > > >
> > > > > > export PDQPRIORITY=100 # Or as high as you dare without
> disrupting
> > > > > > production resource requirements.
> > > > > > export PSORT_NPROCS=16 # I know the max documented is 10, trust
> me.
> > > > > > Make sure that you have lots of memory allocated to
> DS_TOTAL_MEMORY
> > > to
> > > > > > allow for all sorting to be accomplished in memory. If you want
> to
> > > know
> > > > > how
> > > > > > much memory you will need and you haven't zero'd out your server
> > > stats
> > > > > > since the last time you tried running the update statistics (ie
> > > onstat
> > > > > -z)
> > > > > > then the sysmaster:sysprofile table has a row containing the size
> > of
> > > > the
> > > > > > largest sort that's been executed in KB:
> > > > > >
> > > > > > select value from sysmaster:sysprofile where name =
> 'maxsortspace';
> > > > > >
> > > > > > I think that I remember that you are using 11.50 so you can't
> take
> > > > > > advantage or LOW sampling.
> > > > > >
> > > > > > BTW, in another reply you said you are only runing vanilla UPDATE
> > > > > > STATISTICS with no modifiers. This command does not update the
> data
> > > > > > distributions for the table, it only updates a few columns in
> > > > systables,
> > > > > > syscolumns, sysfragments, and sysindices/sysindexes like nrows
> and
> > > > npused
> > > > > > in systables, colmin and colmax in syscolumns, nlevels, nleaves,
> > > uniq,
> > > > > > clust, and nrows in sysindices. You need to run a combination of
> > LOW,
> > > > > > MEDIUM, and HIGH on individual sets of columns to get really
> useful
> > > > data
> > > > > > distributions in minimum time. If you use my dostats utility, as
> do
> > > > > > hundreds of Informix sites, it will take care of that for you.
> > > > > >
> > > > > > BTW, have you disabled Auto Update Statistics (AUS)? Because if
> not
> > > > then
> > > > > > AUS is running every night updating stats for you (almost as well
> > as
> > > > > > dostats would) so you should not have to be running update
> > statistics
> > > > > > manually (or from cron) anyway.
> > > > > >
> > > > > > Art
> > > > > >
> > > > > > Art S. Kagel, Principal Consultant
> > > > > > ASK Database Management
> > > > > >
> > > > > > Blog: http://informix-myview.blogspot.com/
> > > > > >
> > > > > > Disclaimer: Please keep in mind that my own opinions are my own
> > > > opinions
> > > > > > and do not reflect on the IIUG, nor any other organization with
> > > which I
> > > > > am
> > > > > > associated either explicitly, implicitly, or by inference.
> Neither
> > do
> > > > > > those opinions reflect those of other individuals affiliated with
> > any
> > > > > > entity with which I am affiliated nor those of the entities
> > > themselves.
> > > > > >
> > > > > > On Fri, Jun 27, 2014 at 8:48 AM, medkba <medkba@gmail.com>
> wrote:
> > > > > >
> > > > > > > Running from cron jobs daily from shell script
> > > > > > > Not using PDQPRIORITY
> > > > > > > 23 CPUs
> > > > > > > 8 cpu vps is used increased from 6 to 8 no improvement
> > > > > > >
> > > > > > > Please let me if require more information
> > > > > > >
> > > > > > > Thank you very much
> > > > > > > On 27 Jun 2014 19:43, "Art Kagel" <art.kagel@gmail.com> wrote:
> > > > > > >
> > > > > > > > How are you running update statistics for that table? What
> > > > > environment
> > > > > > > > variables have you set? Are you using PDQPRIORITY? What
> engine
> > > > > version
> > > > > > > > and edition are you using? How many cores are on the machine
> > and
> > > > how
> > > > > > many
> > > > > > > > CPU VPs are configured?
> > > > > > > >
> > > > > > > > Have you read John Miller's paper in optimizing update
> > statistics
> > > > > runs?
> > > > > > > >
> > > > > > > > Art
> > > > > > > >
> > > > > > > > Art S. Kagel, Principal Consultant
> > > > > > > > ASK Database Management
> > > > > > > >
> > > > > > > > Blog: http://informix-myview.blogspot.com/
> > > > > > > >
> > > > > > > > Disclaimer: Please keep in mind that my own opinions are my
> own
> > > > > > opinions
> > > > > > > > and do not reflect on the IIUG, nor any other organization
> with
> > > > > which I
> > > > > > > am
> > > > > > > > associated either explicitly, implicitly, or by inference.
> > > Neither
> > > > do
> > > > > > > > those opinions reflect those of other individuals affiliated
> > with
> > > > any
> > > > > > > > entity with which I am affiliated nor those of the entities
> > > > > themselves.
> > > > > > > >
> > > > > > > > On Fri, Jun 27, 2014 at 3:30 AM, medkba <medkba@gmail.com>
> > > wrote:
> > > > > > > >
> > > > > > > > > Hi All,
> > > > > > > > >
> > > > > > > > > I am having one table and contains data 23326189 and taking
> > > about
> > > > > 15
> > > > > > > mins
> > > > > > > > > to complete update statistics
> > > > > > > > >
> > > > > > > > > Is there any opportunities to minimize this time?
> > > > > > > > >
> > > > > > > > > thank you very much
> > > > > > > > >
> > > > > > > > > --001a11c35338ab010704fccc4622
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
> *******************************************************************************
> > > > > > > > > Forum Note: Use "Reply" to post a response in the
> discussion
> > > > forum.
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > > > --001a11c3eaaa3f037b04fccfcec4
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
> *******************************************************************************
> > > > > > > > Forum Note: Use "Reply" to post a response in the discussion
> > > forum.
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > > > --089e0158b87c65336e04fcd0b829
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
> *******************************************************************************
> > > > > > > Forum Note: Use "Reply" to post a response in the discussion
> > forum.
> > > > > > >
> > > > > > >
> > > > > >
> > > > > > --089e01182b54c5879104fcd123c5
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
> *******************************************************************************
> > > > > > Forum Note: Use "Reply" to post a response in the discussion
> forum.
> > > > > >
> > > > > >
> > > > >
> > > > > --001a1133d1e23364d104fcd1ce86
> > > > >
> > > > >
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
> *******************************************************************************
> > > > > Forum Note: Use "Reply" to post a response in the discussion forum.
> > > > >
> > > > >
> > > >
> > > > --001a11c3c44290f36d04fcd31c93
> > > >
> > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
> *******************************************************************************
> > > > Forum Note: Use "Reply" to post a response in the discussion forum.
> > > >
> > > >
> > >
> > > --001a1132edec24236a04fcd34826
> > >
> > >
> > >
> > >
> >
> >
>
> *******************************************************************************
> > > Forum Note: Use "Reply" to post a response in the discussion forum.
> > >
> > >
> >
> > --001a11c34198a6cf4d04fcd3af97
> >
> >
> >
> >
>
> *******************************************************************************
> > Forum Note: Use "Reply" to post a response in the discussion forum.
> >
> >
>
> --001a1134ca1e39dd4c04fcd3e7f2
>
>
>
> *******************************************************************************
> Forum Note: Use "Reply" to post a response in the discussion forum.
>
>
--089e01493c4042762f04fcd3fb2a
Messages In This Thread
IDS Forum is maintained by Administrator with WebBBS 5.12.
|
|
