Memory garbage overrun on windows server

[Sean Cole (Pi)]

Good shout, Matthias. It could well be.

Although, I’ve just been running the app for a different clients emails and
those aren’t having as huge an effect. It is going up, but not by nearly as
much as the first ones I was doing. The main difference between them is the
amount of data in their csv files and then the pdf layouts. So, I’m
wondering if it’s to do with the types of images used in this particular
clients report templates. I’ll check it out once I’ve got through this
batch.

But I will try the tsNetCustomSync thing and get back to you.

Thanks
S

On Thu, 27 May 2021 at 19:01, matthias rebbe via use-livecode <
use-livecode at lists.runrev.com> wrote:

> Hi Sean,
>
> i am not sure if this helps, but are you using tsNet for sending the
> emails?
> If so, could you try to execute the command tsNetClose after each
> iteration?
> This should close all existing connections and disable tsNet.
> To use tsNet again you need to run tsNetInit once to initialize tsNet
> again.
>
> If this solves the problem, tsNet is the culprit. If it doesn't, we know
> tsNet isn't it. ;)
>
> Matthias
>
>
>
> > Am 27.05.2021 um 19:37 schrieb Sean Cole (Pi) via use-livecode <
> use-livecode at lists.runrev.com>:
> >
> > Hi
> > I have an LC app running on a server that collects csv files from an
> email
> > server, analyses the data from each, stores that data to an sql db then
> > creates a pdf which it then uploads to an ftp server.
> >
> > Each iteration of this is followed by my attempt to purge the data in all
> > local and global arrays and variables. The stack which is used to create
> > the pdf is also closed, destroyed and deleted.
> >
> > But with each email that gets processed the memory usage goes up by about
> > 120Mb. That's ok, but it only goes up. It only plateaus once it reaches
> > 100%, which for a 2Gb server instance happens after just 10 emails. After
> > that the resource manager begins to record hard faults/sec spikes and
> task
> > manager shows the memory usage go up to 14Gb of 14Gb committed memory
> where
> > it finally gives up and kills the app.
> >
> > Looking through old posts and bugs it does seem related to bug
> > https://quality.livecode.com/show_bug.cgi?id=17434 but this refers to
> MacOS
> > and heap fragmentation. Is this a problem with windows also? I wouldn't
> > know.
> >
> > Is there some other way of purging this memory intermittently so that it
> > can continue without having to keep closing down LC or the standalone and
> > restarting it? It kind of defeats the object of having a server app when
> I
> > have to baby sit it processing. Even once it has completed it never frees
> > up the memory used until it is killed and restarted. I'm going to
> increase
> > the memory allocation for the server instance to 4GB (at great cost)
> which
> > will alleviate some of the pressure but is only delaying the inevitable.
> >
> > It does seem we need some kind of bare knuckle approach to memory purging
> > in LC somewhere, in my humble opinion. But, in the meantime, if I can get
> > some advice and background it may help to manage it for now.
> >
> > Regards
> > S
> > --
> > Pi Digital
> > _______________________________________________
> > use-livecode mailing list
> > use-livecode at lists.runrev.com
> > Please visit this url to subscribe, unsubscribe and manage your
> subscription preferences:
> > http://lists.runrev.com/mailman/listinfo/use-livecode
>
>
> _______________________________________________
> use-livecode mailing list
> use-livecode at lists.runrev.com
> Please visit this url to subscribe, unsubscribe and manage your
> subscription preferences:
> http://lists.runrev.com/mailman/listinfo/use-livecode
>
-- 
Pi Digital