 |
IDS Forum
Re: Update statistics issue
Posted By: Art Kagel
Date: Friday, 27 June 2014, at 1:01 p.m.
In Response To: Re: Update statistics issue (medkba)
You can either set it in the environment with:
export PDQPRIORITY=100
or if you are executing the UPDATE STATISTICS in dbaccess, then you can
include this SQL line at the top of the SQL script:
SET PDQPRIORITY 100;
When you run dostats you would add the flag:
-Q 100
Art
Art S. Kagel, Principal Consultant
ASK Database Management
Blog: http://informix-myview.blogspot.com/
Disclaimer: Please keep in mind that my own opinions are my own opinions
and do not reflect on the IIUG, nor any other organization with which I am
associated either explicitly, implicitly, or by inference. Neither do
those opinions reflect those of other individuals affiliated with any
entity with which I am affiliated nor those of the entities themselves.
On Fri, Jun 27, 2014 at 12:42 PM, medkba <medkba@gmail.com> wrote:
> how to do the PDQPRIORITY before run the statics
>
> On Sat, Jun 28, 2014 at 12:36 AM, medkba <medkba@gmail.com> wrote:
>
> > tk_id 18
> > tk_name Auto Update Statistics Evaluation
> > tk_enable f
> > tk_next_execution 2014-06-28 00:30:28
> >
> > tk_id 19
> > tk_name Auto Update Statistics Refresh
> > tk_enable f
> > tk_next_execution 2014-06-28 00:29:31
> >
> > I have disable both jobs and will continue to run manually statistics but
> > please let me know how to do the
> >
> > On Sat, Jun 28, 2014 at 12:20 AM, Art Kagel <art.kagel@gmail.com> wrote:
> >
> > > Yes, either disable them or change them to run further apart and rely
> on
> > > what they do and disable your own scripts. Right now it looks like the
> > > refresh is running 11 minutes after the evaluator starts running and
> that
> > > can't be right unless your database has very few tables. If you decide
> to
> > > keep AUS running and abandon your own scripts then you should look in
> the
> > > ph_run table to see how long the evaluator actually runs for (columns
> > > duration) and change the scheduling for the AUS refresh task:
> > >
> > > select * from ph_run where run_task_id = 18;
> > >
> > > Art
> > >
> > > Art S. Kagel, Principal Consultant
> > > ASK Database Management
> > >
> > > Blog: http://informix-myview.blogspot.com/
> > >
> > > Disclaimer: Please keep in mind that my own opinions are my own
> opinions
> > > and do not reflect on the IIUG, nor any other organization with which I
> > am
> > > associated either explicitly, implicitly, or by inference. Neither do
> > > those opinions reflect those of other individuals affiliated with any
> > > entity with which I am affiliated nor those of the entities themselves.
> > >
> > > On Fri, Jun 27, 2014 at 11:51 AM, medkba <medkba@gmail.com> wrote:
> > >
> > > > Thank you very much Art
> > > >
> > > > The below output executing the query
> > > >
> > > > tk_id 18
> > > > tk_name Auto Update Statistics Evaluation
> > > > tk_enable t
> > > > tk_next_execution 2014-06-28 01:00:00
> > > >
> > > > tk_id 19
> > > > tk_name Auto Update Statistics Refresh
> > > > tk_enable t
> > > > tk_next_execution 2014-06-28 01:11:00
> > > >
> > > > It means that statistics running automatically. Am i right? I need to
> > > > disable both
> > > >
> > > > On Fri, Jun 27, 2014 at 11:39 PM, Art Kagel <art.kagel@gmail.com>
> > wrote:
> > > >
> > > > > There are two AUS tasks, the AUS evaluator that determines what
> > tables
> > > > need
> > > > > their stats updated and the AUS refresh task that executes the
> > commands
> > > > > calculated by the evaluator. You can find the task manager records
> > > > > governing their execution in the sysadmin database in the table
> > > ph_task.
> > > > > Run:
> > > > >
> > > > > select tk_id, tk_name, tk_enable, tk_next_execution
> > > > > from sysadmin:ph_task
> > > > > where tk_execute matches 'aus*';
> > > > >
> > > > > If tk_enable is set to 't' then the AUS tasks are running.
> Obviously
> > if
> > > > > the evaluator is executing but the refresh is not, then stats are
> not
> > > > being
> > > > > updated by AUS and if the refresh is running without the evaluator
> > > > running
> > > > > before it then the list of work its doing is probably out-of-date
> and
> > > may
> > > > > even be empty. The tk_next_execution column will tell you when each
> > is
> > > > > scheduled to run next. Note that in 11.50 the evaluator was rather
> > > > > inefficient and could take longer to run than the default
> difference
> > in
> > > > the
> > > > > scheduled run times of the two tasks (1 hour) so that when the
> > refresh
> > > > > launched the evaluator may not have finished running resulting in
> the
> > > > > refresh only processing some of the tables that needed to updated.
> > This
> > > > > was fixed in 11.70 and again in 12.10 by recoding the evaluator to
> > run
> > > > > faster and by changing the default scheduling of the tasks so they
> > run
> > > > > further apart.
> > > > >
> > > > > Art
> > > > >
> > > > > Art S. Kagel, Principal Consultant
> > > > > ASK Database Management
> > > > >
> > > > > Blog: http://informix-myview.blogspot.com/
> > > > >
> > > > > Disclaimer: Please keep in mind that my own opinions are my own
> > > opinions
> > > > > and do not reflect on the IIUG, nor any other organization with
> > which I
> > > > am
> > > > > associated either explicitly, implicitly, or by inference. Neither
> do
> > > > > those opinions reflect those of other individuals affiliated with
> any
> > > > > entity with which I am affiliated nor those of the entities
> > themselves.
> > > > >
> > > > > On Fri, Jun 27, 2014 at 10:05 AM, medkba <medkba@gmail.com> wrote:
> > > > >
> > > > > > Yes, i have running update statistics one of the database i.e.
> most
> > > > used
> > > > > > the application
> > > > > > Run UPDATE STATISTICS LOW
> > > > > > Ok, i will read this article
> > > > > > Dosstat runs weekly once
> > > > > > This is new hp blade server with 32gb memory. It means that
> > hardware
> > > > very
> > > > > > powerful but statistics job running slow then the question aries
> > why
> > > > slow
> > > > > > and hard to convenience management to change different way of
> > > running.
> > > > > > How do i check aus running
> > > > > > Thank you
> > > > > > On 27 Jun 2014 21:18, "Art Kagel" <art.kagel@gmail.com> wrote:
> > > > > >
> > > > > > > "from a shell script" wasn't what I was looking for. Are you
> > > running
> > > > > plan
> > > > > > > UPDATE STATISTICS? UPDATE STATISTICS LOW? UPDATE STATISTICS
> > MEDIUM?
> > > > > > > UPDATE STATISTICS HIGH? Combinations of multiple commands? Are
> > you
> > > > > > > running these in dbaccess? If so are you running against just
> > this
> > > > one
> > > > > > > table in each command or against the entire database? Are you
> > using
> > > > my
> > > > > > > dostats utility to generate an optimal set of commands?
> > > > > > >
> > > > > > > OK, first thing to do then is to read John's paper. Link here:
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
> http://www.ibm.com/developerworks/data/zones/informix/library/techarticle/miller/0203miller.html#section3
> > > > > > >
> > > > > > > Quick-and-dirty:
> > > > > > >
> > > > > > > export PDQPRIORITY=100 # Or as high as you dare without
> > disrupting
> > > > > > > production resource requirements.
> > > > > > > export PSORT_NPROCS=16 # I know the max documented is 10, trust
> > me.
> > > > > > > Make sure that you have lots of memory allocated to
> > DS_TOTAL_MEMORY
> > > > to
> > > > > > > allow for all sorting to be accomplished in memory. If you want
> > to
> > > > know
> > > > > > how
> > > > > > > much memory you will need and you haven't zero'd out your
> server
> > > > stats
> > > > > > > since the last time you tried running the update statistics (ie
> > > > onstat
> > > > > > -z)
> > > > > > > then the sysmaster:sysprofile table has a row containing the
> size
> > > of
> > > > > the
> > > > > > > largest sort that's been executed in KB:
> > > > > > >
> > > > > > > select value from sysmaster:sysprofile where name =
> > 'maxsortspace';
> > > > > > >
> > > > > > > I think that I remember that you are using 11.50 so you can't
> > take
> > > > > > > advantage or LOW sampling.
> > > > > > >
> > > > > > > BTW, in another reply you said you are only runing vanilla
> UPDATE
> > > > > > > STATISTICS with no modifiers. This command does not update the
> > data
> > > > > > > distributions for the table, it only updates a few columns in
> > > > > systables,
> > > > > > > syscolumns, sysfragments, and sysindices/sysindexes like nrows
> > and
> > > > > npused
> > > > > > > in systables, colmin and colmax in syscolumns, nlevels,
> nleaves,
> > > > uniq,
> > > > > > > clust, and nrows in sysindices. You need to run a combination
> of
> > > LOW,
> > > > > > > MEDIUM, and HIGH on individual sets of columns to get really
> > useful
> > > > > data
> > > > > > > distributions in minimum time. If you use my dostats utility,
> as
> > do
> > > > > > > hundreds of Informix sites, it will take care of that for you.
> > > > > > >
> > > > > > > BTW, have you disabled Auto Update Statistics (AUS)? Because if
> > not
> > > > > then
> > > > > > > AUS is running every night updating stats for you (almost as
> well
> > > as
> > > > > > > dostats would) so you should not have to be running update
> > > statistics
> > > > > > > manually (or from cron) anyway.
> > > > > > >
> > > > > > > Art
> > > > > > >
> > > > > > > Art S. Kagel, Principal Consultant
> > > > > > > ASK Database Management
> > > > > > >
> > > > > > > Blog: http://informix-myview.blogspot.com/
> > > > > > >
> > > > > > > Disclaimer: Please keep in mind that my own opinions are my own
> > > > > opinions
> > > > > > > and do not reflect on the IIUG, nor any other organization with
> > > > which I
> > > > > > am
> > > > > > > associated either explicitly, implicitly, or by inference.
> > Neither
> > > do
> > > > > > > those opinions reflect those of other individuals affiliated
> with
> > > any
> > > > > > > entity with which I am affiliated nor those of the entities
> > > > themselves.
> > > > > > >
> > > > > > > On Fri, Jun 27, 2014 at 8:48 AM, medkba <medkba@gmail.com>
> > wrote:
> > > > > > >
> > > > > > > > Running from cron jobs daily from shell script
> > > > > > > > Not using PDQPRIORITY
> > > > > > > > 23 CPUs
> > > > > > > > 8 cpu vps is used increased from 6 to 8 no improvement
> > > > > > > >
> > > > > > > > Please let me if require more information
> > > > > > > >
> > > > > > > > Thank you very much
> > > > > > > > On 27 Jun 2014 19:43, "Art Kagel" <art.kagel@gmail.com>
> wrote:
> > > > > > > >
> > > > > > > > > How are you running update statistics for that table? What
> > > > > > environment
> > > > > > > > > variables have you set? Are you using PDQPRIORITY? What
> > engine
> > > > > > version
> > > > > > > > > and edition are you using? How many cores are on the
> machine
> > > and
> > > > > how
> > > > > > > many
> > > > > > > > > CPU VPs are configured?
> > > > > > > > >
> > > > > > > > > Have you read John Miller's paper in optimizing update
> > > statistics
> > > > > > runs?
> > > > > > > > >
> > > > > > > > > Art
> > > > > > > > >
> > > > > > > > > Art S. Kagel, Principal Consultant
> > > > > > > > > ASK Database Management
> > > > > > > > >
> > > > > > > > > Blog: http://informix-myview.blogspot.com/
> > > > > > > > >
> > > > > > > > > Disclaimer: Please keep in mind that my own opinions are my
> > own
> > > > > > > opinions
> > > > > > > > > and do not reflect on the IIUG, nor any other organization
> > with
> > > > > > which I
> > > > > > > > am
> > > > > > > > > associated either explicitly, implicitly, or by inference.
> > > > Neither
> > > > > do
> > > > > > > > > those opinions reflect those of other individuals
> affiliated
> > > with
> > > > > any
> > > > > > > > > entity with which I am affiliated nor those of the entities
> > > > > > themselves.
> > > > > > > > >
> > > > > > > > > On Fri, Jun 27, 2014 at 3:30 AM, medkba <medkba@gmail.com>
> > > > wrote:
> > > > > > > > >
> > > > > > > > > > Hi All,
> > > > > > > > > >
> > > > > > > > > > I am having one table and contains data 23326189 and
> taking
> > > > about
> > > > > > 15
> > > > > > > > mins
> > > > > > > > > > to complete update statistics
> > > > > > > > > >
> > > > > > > > > > Is there any opportunities to minimize this time?
> > > > > > > > > >
> > > > > > > > > > thank you very much
> > > > > > > > > >
> > > > > > > > > > --001a11c35338ab010704fccc4622
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
> *******************************************************************************
> > > > > > > > > > Forum Note: Use "Reply" to post a response in the
> > discussion
> > > > > forum.
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > > --001a11c3eaaa3f037b04fccfcec4
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
> *******************************************************************************
> > > > > > > > > Forum Note: Use "Reply" to post a response in the
> discussion
> > > > forum.
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > > > --089e0158b87c65336e04fcd0b829
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
> *******************************************************************************
> > > > > > > > Forum Note: Use "Reply" to post a response in the discussion
> > > forum.
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > > > --089e01182b54c5879104fcd123c5
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
> *******************************************************************************
> > > > > > > Forum Note: Use "Reply" to post a response in the discussion
> > forum.
> > > > > > >
> > > > > > >
> > > > > >
> > > > > > --001a1133d1e23364d104fcd1ce86
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
> *******************************************************************************
> > > > > > Forum Note: Use "Reply" to post a response in the discussion
> forum.
> > > > > >
> > > > > >
> > > > >
> > > > > --001a11c3c44290f36d04fcd31c93
> > > > >
> > > > >
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
> *******************************************************************************
> > > > > Forum Note: Use "Reply" to post a response in the discussion forum.
> > > > >
> > > > >
> > > >
> > > > --001a1132edec24236a04fcd34826
> > > >
> > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
> *******************************************************************************
> > > > Forum Note: Use "Reply" to post a response in the discussion forum.
> > > >
> > > >
> > >
> > > --001a11c34198a6cf4d04fcd3af97
> > >
> > >
> > >
> > >
> >
> >
>
> *******************************************************************************
> > > Forum Note: Use "Reply" to post a response in the discussion forum.
> > >
> > >
> >
> > --001a1134ca1e39dd4c04fcd3e7f2
> >
> >
> >
> >
>
> *******************************************************************************
> > Forum Note: Use "Reply" to post a response in the discussion forum.
> >
> >
>
> --089e01493c4042762f04fcd3fb2a
>
>
>
> *******************************************************************************
> Forum Note: Use "Reply" to post a response in the discussion forum.
>
>
--001a11c2ae2aa7927a04fcd44022
Messages In This Thread
IDS Forum is maintained by Administrator with WebBBS 5.12.
|
|
