Working with csv files that are 5000 lines or more

[Jim Schaubeck]

John,
Thank you for the response
If I can figure out how to do this I will try it next.  I've tried Mysql (via Navicat) and the sort command work quite quickly.  So the db approach looks promising and I know the rev docs say "anything over 2000 records is best handled with a db".  I do not know (yet) how to use the internal db of runrev.  I'll explore this

Jim...

 
On Wednesday, April 09, 2008, at 05:51PM, "John Tregea" <john at debraneys.com> wrote:
>Dear Jim,
>
>Rather than reading the file, could you import it into the "internal" database within Rev and then undertake your data manipulation? The database engine will be more optimised for large table sorts etc.
>
>Regards
>
>John
>-----Original Message-----
>From: Jim Schaubeck [mailto:schaubeck at mac.com]
>Sent: Thursday, April 10, 2008 10:35 AM
>To: use-revolution at lists.runrev.com
>Subject: Working with csv files that are 5000 lines or more
>
>My next project is reading in a csv file as large as 7000 lines with 60 items per line. The "read file..." and "put it into tempvar" command work very quickly. When I search the data in tempvar, the repeat command works quickly for the first 1000 lines or so then things slow down dramatically. I tested it with a scrollbar being updated for every line and 1000 seems to be the break point. Using "Find..." in excel works very quickly but the same file in my stack is slow. I'll be loading my app onto 20 or so other users so a database may not be an option unless I can load it into the stack (never tried to include an actual database in my apps).Any ideas on how to search through csv files that are 2000 to 7000 lines?Thanks in advanceJim..._______________________________________________use-revolution mailing listuse-revolution at lists.runrev.comPlease visit this url to subscribe, unsubscribe and manage your subscription preferences:http://lists.runrev.com/mailman/listinfo/use-revo!
 lution
>_______________________________________________
>use-revolution mailing list
>use-revolution at lists.runrev.com
>Please visit this url to subscribe, unsubscribe and manage your subscription preferences:
>http://lists.runrev.com/mailman/listinfo/use-revolution
>
>