the large file challenge

[andu]

--On Friday, November 08, 2002 18:24:56 -0800 Richard Gaskin 
<ambassador at fourthworld.com> wrote:

> Sadhunathan Nadesan wrote:
>
>> # !/usr/local/bin/mc
>> on startup
>> put "/gig/tmp/log/xaa" into the_file
>> put 1 into start_read
>> put 0 into the_counter
>> put 1 into the_offset
>> open file the_file for read
>> read from file the_file until eof
>> put the num of lines of it into end_read
>> close file the_file
>> repeat while (start_read < end_read)
>> open file the_file for read
>> read from file the_file at the_offset for 99 lines
>> put it into the_text
>> put the number of chars of it + the_offset into the_offset
>> repeat for each line this_line in the_text
>> if (not eof) then
>> if (this_line contains "mystic_mouse") then
>> put the_counter + 1 into the_counter
>> end if
>> end if
>> end repeat
>> close file the_file
>> add 100 to start_read
>> end repeat
>> put the_counter
>> end startup
>>
>>
>> Now, I feel sure we could improve this, fix my errors, etc  .... anyone?
>
> I'm confused:  if the point is to avoid reading the entire file into
> memory, isn't what what line 8 does?  And if it's already in memory, why
> is it read again inside the loop?
>
> I think I missed something from the original post....

No, you got it right.

>
> --
>  Richard Gaskin
>  Fourth World Media Corporation
>  Developer of WebMerge 2.0: Publish any database on any site
>  ___________________________________________________________
>  Ambassador at FourthWorld.com       http://www.FourthWorld.com
>  Tel: 323-225-3717                       AIM: FourthWorldInc
>
> _______________________________________________
> metacard mailing list
> metacard at lists.runrev.com
> http://lists.runrev.com/mailman/listinfo/metacard
>



Regards, Andu Novac