Best data import approach

[Magicgate Software - Skip Kimpel]

Excellent... Thank you Pete...

Alex, would you be so kind to share?

SKIP


On Sat, Mar 30, 2013 at 4:37 PM, Peter Haworth <pete at lcsql.com> wrote:

> Skip,
> Alex Tweedly has a great handler for importing csv files that deals with
> many of the gnarly issues.  Hopefully he'll see this and supply it for you.
> Pete
> lcSQL Software <http://www.lcsql.com>
>
>
> On Sat, Mar 30, 2013 at 12:38 PM, Magicgate Software - Skip Kimpel <
> skip at magicgate.com> wrote:
>
> > I think it will be easier to go back and try to fix the source and how
> the
> > data is being entered in to begin with.  I realized there was a issue
> with
> > one of the fields that allowed the user to enter multiple lines of data
> > under the "notes" field.  If the user hit the RETURN key to type in these
> > notes, it is throwing everything off.
> >
> > SKIP
> >
> >
> > On Sat, Mar 30, 2013 at 3:16 PM, Magicgate Software - Skip Kimpel <
> > skip at magicgate.com> wrote:
> >
> > > Thanks.. I had tried that but I was getting some funky data formatting
> > > coming in.  Come to find out that the data in the log file has an
> > > occasional misplaced CR and LF embedded.
> > >
> > > Having said THAT, is there a way to strip out those characters?  I know
> > > exactly how many columns I have in my field and each is separated with
> a
> > > tab.  So I guess at this point what I am trying to say is there a way
> to
> > > clean up the data and still be able to determine a new record (row)?
> > >
> > > SKIP
> > >
> > >
> > > On Sat, Mar 30, 2013 at 3:10 PM, stephen barncard <
> > > stephenREVOLUTION2 at barncard.com> wrote:
> > >
> > >> and if the first line contains the names of the individual fields on
> the
> > >> first row, you can
> > >>
> > >> put the dgText[true]
> > >>
> > >>
> > >> On Sat, Mar 30, 2013 at 12:03 PM, Mike Bonner <bonnmike at gmail.com>
> > wrote:
> > >>
> > >> > set the dgtext of group "yourgroup" to URL
> > ("binfile:/path/to/the/file")
> > >> > should work.  dgtext works directly with tab and cr delimited text,
> so
> > >> > should be easy peasy.
> > >> >
> > >> >
> > >> > On Sat, Mar 30, 2013 at 12:04 PM, Keith Clarke <
> > >> > keith.clarke at clarkeandclarke.co.uk> wrote:
> > >> >
> > >> > > Why not just put the file into a variable, set the item delimiters
> > to
> > >> tab
> > >> > > and away you go?
> > >> > >
> > >> > > Just query the items of the first line to understand your
> (changing)
> > >> > > column labels?
> > >> > > Best,
> > >> > > Keith..
> > >> > >
> > >> > > On 30 Mar 2013, at 17:54, Magicgate Software - Skip Kimpel <
> > >> > > skip at magicgate.com> wrote:
> > >> > >
> > >> > > > Hello LC's,
> > >> > > >
> > >> > > > I have a tab delimited text file(log file) that I need to
> > manipulate
> > >> > > every
> > >> > > > once in a while and extract data from it.  Is there a good way
> to
> > >> read
> > >> > > this
> > >> > > > directly into a datagrid and manipulate it from there or I am
> > better
> > >> > off
> > >> > > > reading the file, loading it into a sqlite db and THEN
> manipulate
> > it
> > >> > from
> > >> > > > there.
> > >> > > >
> > >> > > > The text file I am reading is constantly changing so I can not
> > just
> > >> do
> > >> > a
> > >> > > > one time conversion, I will always have to read from this file.
> > >> > > >
> > >> > > > This is for a desktop app, by the way....
> > >> > > >
> > >> > > > Thanks in advance for your input!
> > >> > > >
> > >> > > > SKIP
> > >> > > > _______________________________________________
> > >> > > > use-livecode mailing list
> > >> > > > use-livecode at lists.runrev.com
> > >> > > > Please visit this url to subscribe, unsubscribe and manage your
> > >> > > subscription preferences:
> > >> > > > http://lists.runrev.com/mailman/listinfo/use-livecode
> > >> > >
> > >> > >
> > >> > > _______________________________________________
> > >> > > use-livecode mailing list
> > >> > > use-livecode at lists.runrev.com
> > >> > > Please visit this url to subscribe, unsubscribe and manage your
> > >> > > subscription preferences:
> > >> > > http://lists.runrev.com/mailman/listinfo/use-livecode
> > >> > >
> > >> > _______________________________________________
> > >> > use-livecode mailing list
> > >> > use-livecode at lists.runrev.com
> > >> > Please visit this url to subscribe, unsubscribe and manage your
> > >> > subscription preferences:
> > >> > http://lists.runrev.com/mailman/listinfo/use-livecode
> > >> >
> > >>
> > >>
> > >>
> > >> --
> > >>
> > >>
> > >>
> > >> Stephen Barncard
> > >> San Francisco Ca. USA
> > >>
> > >> more about sqb  <http://www.google.com/profiles/sbarncar>
> > >> _______________________________________________
> > >> use-livecode mailing list
> > >> use-livecode at lists.runrev.com
> > >> Please visit this url to subscribe, unsubscribe and manage your
> > >> subscription preferences:
> > >> http://lists.runrev.com/mailman/listinfo/use-livecode
> > >>
> > >
> > >
> > _______________________________________________
> > use-livecode mailing list
> > use-livecode at lists.runrev.com
> > Please visit this url to subscribe, unsubscribe and manage your
> > subscription preferences:
> > http://lists.runrev.com/mailman/listinfo/use-livecode
> >
> _______________________________________________
> use-livecode mailing list
> use-livecode at lists.runrev.com
> Please visit this url to subscribe, unsubscribe and manage your
> subscription preferences:
> http://lists.runrev.com/mailman/listinfo/use-livecode
>