Re: VERY chalanging question



If the table contains 1.5 millions rows, and the query runs for 16 days,
then there must be something wrong with the query or with the table
setup (inclusing indexes).

From your narrative I do not really understand what you are trying to
achieve. Please post DDL (including indexes), some sample data and the
results you are trying to achieve.

Gert-Jan


Tom Moreau wrote:

Moving it to Oracle won't buy you anything. Perhaps indexing on each of the
columns to be filtered will help you.

--
Tom

----------------------------------------------------
Thomas A. Moreau, BSc, PhD, MCSE, MCDBA
SQL Server MVP
Toronto, ON Canada
.
"groupy" <liav.ezer@xxxxxxxxx> wrote in message
news:1149010763.810314.63670@xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx
input: 1.5 million records table consisting users with 4 nvchar
fields:A,B,C,D
the problem: there are many records with dublicates A's or duplicates
B's or duplicates A+B's or duplicates B+C+D's & so on. Mathematicly
there are 16-1 posibilities for each duplication.

aim: find the duplicates & filter them, leave only the unique users
which don't have ANY duplication.

We can do it by a simple select query that logicly checks the
duplication in a OR operator.
But it takes about 16 days in a very fast PC.
The DB is in sql-server, converting it to Oracle might acomplish it to
8 days.

How can i do it in a few hours?
Remeber that filtering first the users with parameter A & than by
parameter B & so on will result an error in the final result because it
will loose the information regarding the filtered users - maybe in
parameter C they are equal to other users in the table...

THANK YOU
.



Relevant Pages

  • Re: VERY chalanging question
    ... Moving it to Oracle won't buy you anything. ... SQL Server MVP ... there are 16-1 posibilities for each duplication. ... find the duplicates & filter them, ...
    (comp.databases.ms-sqlserver)
  • Multiple filter arguments in dbms_ldap
    ... I'm querying Microdsoft Active Directory using dbms_ldap in oracle 10g. ... Making the connection and query the AD works fine and I'm getting ... I also use the filter, but I can't find out how to use ...
    (comp.databases.oracle.server)
  • Re: AfterUpdate event and Form Filtering
    ... but the combo box I'm using to filter the ... data is based on a select query, which is based on an Oracle ... pass-through query. ... An easy test to see if the code is firing is to temporarily add a line to ...
    (microsoft.public.access.formscoding)
  • Including/parsing out text from within document in query..
    ... document in the data yielded by an Oracle Text CONTAINS query. ... word docs and pdf files), in which case I could execute this query: ... imagine I could write an expression to filter these out, ... Oracle Database 10g Express Edition Release ...
    (comp.databases.oracle.misc)
  • Re: Informix vs Oracle vs DB2. SQL Query optimization.
    ... filter on table A to get the object ids. ... stored in a global temp table. ... like Oracle. ... I had to stop the query after 2.6 hours. ...
    (comp.databases.informix)