Working with csv files that are 5000 lines or more

[John Tregea]

Dear Jim,

Rather than reading the file, could you import it into the "internal" database within Rev and then undertake your data manipulation? The database engine will be more optimised for large table sorts etc.

Regards

John
-----Original Message-----
From: Jim Schaubeck [mailto:schaubeck at mac.com]
Sent: Thursday, April 10, 2008 10:35 AM
To: use-revolution at lists.runrev.com
Subject: Working with csv files that are 5000 lines or more

My next project is reading in a csv file as large as 7000 lines with 60 items per line. The "read file..." and "put it into tempvar" command work very quickly. When I search the data in tempvar, the repeat command works quickly for the first 1000 lines or so then things slow down dramatically. I tested it with a scrollbar being updated for every line and 1000 seems to be the break point. Using "Find..." in excel works very quickly but the same file in my stack is slow. I'll be loading my app onto 20 or so other users so a database may not be an option unless I can load it into the stack (never tried to include an actual database in my apps).Any ideas on how to search through csv files that are 2000 to 7000 lines?Thanks in advanceJim..._______________________________________________use-revolution mailing listuse-revolution at lists.runrev.comPlease visit this url to subscribe, unsubscribe and manage your subscription preferences:http://lists.runrev.com/mailman/listinfo/use-revolution