IDS Forum

FW: Data Loads taking lots of extra time

Posted By: Knox, Ernest
Date: Friday, 1 April 2011, at 7:55 a.m.

IDS 9.40.TC1

OS: Win 2000 SP4

Intel(r) XEON(tm) MP CPU 1.90GHz AT/AT COMPATIBLE 3,669,424 KB RAM

=20

Questions:

=20

1. I did see other processes running at the same time, which could
be utilizing internal disk controller. Should I look at something else?
2. Should I let the customer use a different load method?
3. Would a newer version perform faster (11.7)?

=20

Problem:

=20

From my Customer:

=20

"Sent: Thu 3/31/2011 9:37 AM

=20

After March 15, our loads to the asc_coach_detail table has increased
from loading in 20-45 minutes to 3-5 hours. The amount of data rows has
not increased dramatically, to support the delay.

Can you check to see if there has been some change that has facilitated
this delay in loading? I am copying the wintel team as well in case they
are aware of any changes to the servers listed below."

=20

My initial response to the Customer and his reply:

=20

Sent: Thursday, March 31, 2011 5:13 PM

I really don't see much of an informix issue.

=20

1. When (time) are you performing these loads? Normally between 5:30 and
6:30 Central. Sometimes after 7am.

2. Are the loads being performed during OLTP times? We are data loading
into a reporting database. This database has no OLTP

3. How many rows are you loading between commits? Mary might know. She
did analysis in the Fall when we had a similar issue.=20=20

4. You have 9 indexes to also insert into, which can take time. Yes, but
until 3/15, load time was <1 hour. After 3/15, consistently >3 hours=20

5. You may want to upgrade to new version of informix 11.5+ Bring it
on. We have it in dev, but no time to test it. Joel????

6. Things seem to be running fast right now. Our load completed at
9:46.=20

7. Are you using load, DBload, HPL, or what to load the data? DBLOAD
because of the volume of data.=20

8. How many rows are you loading at each time? 200-300k rows. We loaded
550k (month end data) rows on 2/27 in less than an hour.=20

9. How many of these loads are running each day? only 3 or 4 loads use
dbload. We have several (maybe 50 per day) loads using an odbc
connection. When I sent the email this morning, the

asc_coach_detail dbload was the only hit on the database.

=20

Thanks,

*******************************************************************

Ernie Knox

IT Database Administrator Specialist

Sears Holdings - BU: I & T Group

3333 Beverly Rd., B4-266A

Hoffman Estates, IL. 60179

Office: (847) 286-5735

Email: Ernest.Knox@searshc.com

Blackberry: 2244650553@messaging.sprintpcs.com
<mailto:2244650553@messaging.sprintpcs.com>=20

Page via Skytel: 2244650553@sprint.skytel.com
<mailto:2244650553@sprint.skytel.com>=20

Informix or MySQL Primary: 9110210@skytel.com
<mailto:9110210@skytel.com>=20

Informix or MySQL Secondary: 7276872@skytel.com
<mailto:7276872@skytel.com>=20

=20

" Yes we can make a Change! "

" It's always a great day to watch Sports - GO LIONS, TIGERS, and BEARS!
"

" Lets not forget - GO Pistons and Red Wings! "

GSU

*******************************************************************

This message, including any attachments, is the property of Sears Holdings =
Corporation and/or one of its subsidiaries. It is confidential and may cont=
ain proprietary or legally privileged information. If you are not the inten=
ded recipient, please delete it without reading the contents. Thank you.

Messages In This Thread

• FW: Data Loads taking lots of extra time
  Knox, Ernest -- Friday, 1 April 2011, at 7:55 a.m.
  • Re: Data Loads taking lots of extra time
    Jack Parker -- Friday, 1 April 2011, at 8:06 a.m.
  • Re: FW: Data Loads taking lots of extra time
    GERARDO PADIERNA -- Tuesday, 5 April 2011, at 3:10 a.m.
    • Re: Data Loads taking lots of extra time
      Jack Parker -- Tuesday, 5 April 2011, at 6:17 a.m.
      • Re: Data Loads taking lots of extra time
        Knox, Ernest -- Tuesday, 5 April 2011, at 7:12 a.m.
        • Re: Data Loads taking lots of extra time
          Jack Parker -- Tuesday, 5 April 2011, at 7:23 a.m.
          • Re: Data Loads taking lots of extra time
            Knox, Ernest -- Tuesday, 5 April 2011, at 7:34 a.m.
            • Re: Data Loads taking lots of extra time
              Jack Parker -- Tuesday, 5 April 2011, at 8:01 a.m.
              • RE: Data Loads taking lots of extra time
                Knox, Ernest -- Tuesday, 5 April 2011, at 9:22 a.m.
                • Re: Data Loads taking lots of extra time *NM*
                  Jack Parker -- Tuesday, 5 April 2011, at 10:22 a.m.
              • RE: Data Loads taking lots of extra time
                Knox, Ernest -- Tuesday, 5 April 2011, at 10:32 a.m.
                • Re: Data Loads taking lots of extra time
                  Art Kagel -- Tuesday, 5 April 2011, at 10:42 a.m.
                  • RE: Data Loads taking lots of extra time
                    Knox, Ernest -- Tuesday, 5 April 2011, at 10:45 a.m.
                    • Re: Data Loads taking lots of extra time
                      Art Kagel -- Tuesday, 5 April 2011, at 10:48 a.m.
                • Re: Data Loads taking lots of extra time
                  Jack Parker -- Tuesday, 5 April 2011, at 10:57 a.m.
    • Re: FW: Data Loads taking lots of extra time
      Knox, Ernest -- Tuesday, 5 April 2011, at 7:10 a.m.
  • FW: FW: Data Loads taking lots of extra time
    Knox, Ernest -- Friday, 15 April 2011, at 1:18 p.m.

IDS Forum is maintained by Administrator with WebBBS 5.12.