Large Recordsets - An unbuffered approach?

[Ruslan Zasukhin]

On 12/8/05 12:30 AM, "Lynch, Jonathan" <bnz2 at cdc.gov> wrote:

> This is prolly an ignorant suggestion, but...
> 
> Rather than returning the entire record set, can you just return a list
> of the record IDs from your query? 60-million record IDs should not
> overwhelm your memory.
> 
> Then you can go down the list, and for each record (or a predetermined
> number of records), you load the content, perform your analysis on each
> record, then discard that Information.

    60M * 4 bytes = 240 MB

Not so small.
And if this will happens via network -- exactly not fast.

-- 
Best regards,

Ruslan Zasukhin
VP Engineering and New Technology
Paradigma Software, Inc

Valentina - Joining Worlds of Information
http://www.paradigmasoft.com

[I feel the need: the need for speed]