Re: How to set up Filemaker to avoid decreasing of speed

I would rather like to split the file, but at first I need to do following:
1. I need to collect all amounts per each subscriber
2. Sort all subscribers by total amount
3. Then put mark for each 10% of database (I'm doing segmentation by
revenue)

This is impossible to make on different databases, while I don't know what
revenue is criteria for each of 10% of subscribers. So, first two tasks is
simple (but slow). Third task I made on following way:
- In sorted database I've created a field 'Mark' and then run 'Update of
serial number'
- At another database I've created 10 records where are 1.6 mil numbers
splitted to each 10% with their upper and lower level (each group of 10% has
160.000 of numbers with appropriate mark: 10%, 20%,....)
- Relationship between master database with 'one-to-many' relationship,
where each record at master database responds as:
- Field 'Mark' (master file) > Field (Upper Level)
- Field 'Mark' (master file) < Field (Lower Level)
- In addition, everything is just updating at master file a separated field
'Decile' (which 'Mark' field responds to 'Upper' and 'Lower level' mark of
another database).

Main purpose for remaining all records at one database is further usage of
the same database at Cognos (Business Intelligence software), where is
'piece of cake' making calculations based on good segmentation.
Issue is not logicaly way (everything is automated), then decreasing of
speed of execution. At beginning, all scripts (based on REPLACE) doing cca.
1.000 records per second, and after short time - 10 per second, and then 3-5
per second.

Maybe is possible to make another logicaly procedure that wouldn't decrease
the speed, or there are some 'tricks' how to set-up memory and file cache
options at FileMaker.

Sorry on long posting, and please help me.



"Remi-Noel Menegaux" <rnmenegaux@xxxxxxx> wrote in message
news:42f5bcfd$0$29950$626a14ce@xxxxxxxxxxxxxxx
> I have encountered such a problem, and I just split the file by script
> into several sets of records where the processing speed is still high.
> When you think of it, it should not be too hard to set up.
> Just my 2 - euros :) - cents.
> Remi-Noel
>
>
> "Beetle" <beetle@xxxxxxxxxxx> a écrit dans le message de news:
> dd0l12$f7p$1@xxxxxxxxxxxxxxxxx
> > Please if somebody can help me!
> >
> > I have database of 1.6 mil subscribers (cca. 1.2 Gb, 60 fields,
> > FileMaker
> > Developer 7) - where I want to put average amounts (of 7 different
> > revenue
> > types) from 6 different databases (each database has monthly
> > revenues).
> >
> > I have two options:
> > 1. Make REPLACE script to calculate one-by-one column, or
> > 2. Make LOOP script to calculate one-by-one row.
> >
> > Each of this two ways start to work fine (REPLACE: 1000 records per
> > second,
> > LOOP: 30 records per second), but after some time the speed decreases
> > to few
> > records per second.
> >
> > I don't know what to do! I have Workstation with two 2.4 GHz
> > processors, 3
> > Gb RAM, SATA HDD's with enaugh place for temp files... Do I need to
> > set up
> > Edit - Preferences - Memory to higher or lower memory, and how to set
> > up
> > Save Cache Content (idle time or on intervals)?
> >
> > Please help!
> >
> >
>
>


.

Relevant Pages