Bulk Load Stratagies



Bulk Load Stratagies

Ok ok... I'm having a brain fart here. (normal I know...)

One of the DBA's I work with is trying to reload about 1.2 mil rows
into a new table under VMS Ingres 2.0 and is encountering "force
abort" errors. (i.e. the reload is being logged, and filling up the
logfile) His Logfile is 1.2 gig in size.

My understanding was under Ingres 2.0 you could kick things into
"Bullk-Load/Fast-Load" (non-logged) by doing the following;

Creating a new empty table. Set no journaling. Modify the table to
BTREE (in this case) with extend, allocation and page size vars added.
Then copy the data with "row estimate", and "bingo-bango-bamo" bulk
load underway.

Always seems to work for me. However when this other DBA called
techsupport they said create table as HEAP and then modify. This
doesn't ring true to me. I've reloaded tables in the 5-6 mil rows
range using my method, and have never hit up against "force-abort".
(my logfile is only 1gig in size)

Anyone else run into this problem?

Thanks,
Tyler


EXAMPLE RELOAD SCRIPT:

/* SQL script created by COPYDB, version II 2.0/0308 (axm.vms/00). */

\sql
set autocommit on
\p\g
set nojournaling
\p\g
\sql
set session with privileges=all
\p\g

/* TABLES */
\nocontinue
create table foobar(
blah blah blah
)
with duplicates,
page_size = 4096,
location = (ii_database2,
ii_database3),
security_audit=(table,norow)
;
modify foobar to btree on
foo1,
foo2,
foo3,
foo4,
foo5
with nonleaffill = 80,
leaffill = 70,
fillfactor = 80,
extend = 32,
allocation = 16,
page_size = 4096
\p\g
copy foobar(
blah blah blah
nl= d1)
from 'INGRES_ACCOUNTS:[INGRES.TRASH]foo.ing'
with row_estimate = 6372718
\p\g

/* INDEXES */

/* PERMISSIONS */

.



Relevant Pages

  • Re: Unbeatable players
    ... Flop is Q rag rag. ... This time Mr. Unbeatable raises, I re-raise, blah blah blah all ... > I reload one more time. ...
    (rec.gambling.poker)
  • Re: [Info-Ingres] Bulk Load Stratagies
    ... Do the modify and copy in the same transaction. ... One of the DBA's I work with is trying to reload about 1.2 mil rows ... Set no journaling. ... blah blah blah ...
    (comp.databases.ingres)
  • Re: Unbeatable players
    ... i always tell myself that the cards have no memory, ... Flop is Q rag rag. ... > But a 6 comes on the river and I have to reload as Mr. Unbeatable types "ty ... This time Mr. Unbeatable raises, I re-raise, blah blah blah all in ...
    (rec.gambling.poker)