Decrypting (and encrypting) Large files

[Mike Kerner]

I don't think you're necessarily going to be limited by physical memory, as
the computer will have  a certain addressing space in VM, as well, right?

On Mon, May 9, 2022 at 2:42 PM Craig Newman via use-livecode <
use-livecode at lists.runrev.com> wrote:

> Ah, I see.
>
> I did not appreciate that the dataset could be in the many gigabytes.
>
> Craig
>
> > On May 9, 2022, at 12:42 PM, Tom Glod via use-livecode <
> use-livecode at lists.runrev.com> wrote:
> >
> > there is no way to decrypt something that does not fit in memory. with 64
> > bit builds the limit is whatever the motherboard  supports.   on 32 bit
> > builds the limit is whatever the os will allow 1 process to have,
> > but then u need memory to store the decrypted data too.
> > you can use a command line program to outsource that work and memory
> > management.
> >
> > On Mon, May 9, 2022 at 9:44 AM Craig Newman via use-livecode <
> > use-livecode at lists.runrev.com> wrote:
> >
> >> I believe that there is no upper limit to the size of a variable in LC.
> So
> >> I am with Mike here. What makes you nervous about dealing with a large
> >> dataset within LC itself?
> >>
> >> Craig
> >>
> >>> On May 9, 2022, at 8:49 AM, Mike Kerner via use-livecode <
> >> use-livecode at lists.runrev.com> wrote:
> >>>
> >>> have you tried ti? i have not run into a situation where a variable was
> >> too
> >>> big.
> >>>
> >>> On Sun, May 8, 2022 at 6:46 PM Mark Clark via use-livecode <
> >>> use-livecode at lists.runrev.com> wrote:
> >>>
> >>>> Wondering if anyone has used LiveCode for encrypting-decrypting large
> >>>> files? The docs typically have nice examples for files that can fit
> >> into a
> >>>> variable, but what are folks doing for big files that are larger than
> >> what
> >>>> you’d want in a variable? I’m thinking about using LC for decrypting
> zip
> >>>> compressed log files that can be multiple gigabytes in size. I’d like
> to
> >>>> use just LC vs. resorting to shell if possible.
> >>>>
> >>>> Likely need a hash value to compare the decrypted output against the
> >>>> original as well. I’m thinking some variation along the lines of open
> >> file
> >>>> x for read, reading some manageable chunk into memory, decrypting a
> >>>> portion, writing that to disk and repeat. But that seems too simple.
> >> Think
> >>>> we need AES 256. Any shared experience much appreciated.
> >>>>
> >>>> Thanks all,
> >>>>
> >>>> Mark
> >>>> _______________________________________________
> >>>> use-livecode mailing list
> >>>> use-livecode at lists.runrev.com
> >>>> Please visit this url to subscribe, unsubscribe and manage your
> >>>> subscription preferences:
> >>>> http://lists.runrev.com/mailman/listinfo/use-livecode
> >>>>
> >>>
> >>>
> >>> --
> >>> On the first day, God created the heavens and the Earth
> >>> On the second day, God created the oceans.
> >>> On the third day, God put the animals on hold for a few hours,
> >>>  and did a little diving.
> >>> And God said, "This is good."
> >>> _______________________________________________
> >>> use-livecode mailing list
> >>> use-livecode at lists.runrev.com
> >>> Please visit this url to subscribe, unsubscribe and manage your
> >> subscription preferences:
> >>> http://lists.runrev.com/mailman/listinfo/use-livecode
> >>
> >>
> >> _______________________________________________
> >> use-livecode mailing list
> >> use-livecode at lists.runrev.com
> >> Please visit this url to subscribe, unsubscribe and manage your
> >> subscription preferences:
> >> http://lists.runrev.com/mailman/listinfo/use-livecode
> >>
> > _______________________________________________
> > use-livecode mailing list
> > use-livecode at lists.runrev.com
> > Please visit this url to subscribe, unsubscribe and manage your
> subscription preferences:
> > http://lists.runrev.com/mailman/listinfo/use-livecode
>
>
> _______________________________________________
> use-livecode mailing list
> use-livecode at lists.runrev.com
> Please visit this url to subscribe, unsubscribe and manage your
> subscription preferences:
> http://lists.runrev.com/mailman/listinfo/use-livecode
>


-- 
On the first day, God created the heavens and the Earth
On the second day, God created the oceans.
On the third day, God put the animals on hold for a few hours,
   and did a little diving.
And God said, "This is good."