Memory garbage overrun on windows server

[Sean Cole (Pi)]

What the. It autoincorrected to that! Bizarre technology. :/

On Thu, 27 May 2021 at 21:34, matthias rebbe via use-livecode <
use-livecode at lists.runrev.com> wrote:

> tsNetCustomSync? You mean tsNetClose, right? ;)
>
> > Am 27.05.2021 um 22:17 schrieb Sean Cole (Pi) via use-livecode <
> use-livecode at lists.runrev.com>:
> >
> > Good shout, Matthias. It could well be.
> >
> > Although, I’ve just been running the app for a different clients emails
> and
> > those aren’t having as huge an effect. It is going up, but not by nearly
> as
> > much as the first ones I was doing. The main difference between them is
> the
> > amount of data in their csv files and then the pdf layouts. So, I’m
> > wondering if it’s to do with the types of images used in this particular
> > clients report templates. I’ll check it out once I’ve got through this
> > batch.
> >
> > But I will try the tsNetCustomSync thing and get back to you.
> >
> > Thanks
> > S
> >
> > On Thu, 27 May 2021 at 19:01, matthias rebbe via use-livecode <
> > use-livecode at lists.runrev.com> wrote:
> >
> >> Hi Sean,
> >>
> >> i am not sure if this helps, but are you using tsNet for sending the
> >> emails?
> >> If so, could you try to execute the command tsNetClose after each
> >> iteration?
> >> This should close all existing connections and disable tsNet.
> >> To use tsNet again you need to run tsNetInit once to initialize tsNet
> >> again.
> >>
> >> If this solves the problem, tsNet is the culprit. If it doesn't, we know
> >> tsNet isn't it. ;)
> >>
> >> Matthias
> >>
> >>
> >>
> >>> Am 27.05.2021 um 19:37 schrieb Sean Cole (Pi) via use-livecode <
> >> use-livecode at lists.runrev.com>:
> >>>
> >>> Hi
> >>> I have an LC app running on a server that collects csv files from an
> >> email
> >>> server, analyses the data from each, stores that data to an sql db then
> >>> creates a pdf which it then uploads to an ftp server.
> >>>
> >>> Each iteration of this is followed by my attempt to purge the data in
> all
> >>> local and global arrays and variables. The stack which is used to
> create
> >>> the pdf is also closed, destroyed and deleted.
> >>>
> >>> But with each email that gets processed the memory usage goes up by
> about
> >>> 120Mb. That's ok, but it only goes up. It only plateaus once it reaches
> >>> 100%, which for a 2Gb server instance happens after just 10 emails.
> After
> >>> that the resource manager begins to record hard faults/sec spikes and
> >> task
> >>> manager shows the memory usage go up to 14Gb of 14Gb committed memory
> >> where
> >>> it finally gives up and kills the app.
> >>>
> >>> Looking through old posts and bugs it does seem related to bug
> >>> https://quality.livecode.com/show_bug.cgi?id=17434 but this refers to
> >> MacOS
> >>> and heap fragmentation. Is this a problem with windows also? I wouldn't
> >>> know.
> >>>
> >>> Is there some other way of purging this memory intermittently so that
> it
> >>> can continue without having to keep closing down LC or the standalone
> and
> >>> restarting it? It kind of defeats the object of having a server app
> when
> >> I
> >>> have to baby sit it processing. Even once it has completed it never
> frees
> >>> up the memory used until it is killed and restarted. I'm going to
> >> increase
> >>> the memory allocation for the server instance to 4GB (at great cost)
> >> which
> >>> will alleviate some of the pressure but is only delaying the
> inevitable.
> >>>
> >>> It does seem we need some kind of bare knuckle approach to memory
> purging
> >>> in LC somewhere, in my humble opinion. But, in the meantime, if I can
> get
> >>> some advice and background it may help to manage it for now.
> >>>
> >>> Regards
> >>> S
> >>> --
> >>> Pi Digital
> >>> _______________________________________________
> >>> use-livecode mailing list
> >>> use-livecode at lists.runrev.com
> >>> Please visit this url to subscribe, unsubscribe and manage your
> >> subscription preferences:
> >>> http://lists.runrev.com/mailman/listinfo/use-livecode
> >>
> >>
> >> _______________________________________________
> >> use-livecode mailing list
> >> use-livecode at lists.runrev.com
> >> Please visit this url to subscribe, unsubscribe and manage your
> >> subscription preferences:
> >> http://lists.runrev.com/mailman/listinfo/use-livecode
> >>
> > --
> > Pi Digital
> > _______________________________________________
> > use-livecode mailing list
> > use-livecode at lists.runrev.com
> > Please visit this url to subscribe, unsubscribe and manage your
> subscription preferences:
> > http://lists.runrev.com/mailman/listinfo/use-livecode
>
>
> _______________________________________________
> use-livecode mailing list
> use-livecode at lists.runrev.com
> Please visit this url to subscribe, unsubscribe and manage your
> subscription preferences:
> http://lists.runrev.com/mailman/listinfo/use-livecode
>
-- 
Pi Digital