I recently hit a “Not enough App Memory” message when running a lookup in PanX on the same Mini. The message uses the term “memory” and I only have 8GB RAM. But the warning mentions amounts in the 48GB range. So I’m guessing, processes are shifting work over to the SSD, and there wasn’t enough room on the SSD.
The raw effort was doing lookups for 82,000 records that were looking for matches in another file of 82,000 records. A unique matching field had to be created, by concatenating fields together, for both files. A sample “key” would be: CASHCASH04/01/85SAN JOSE HONDA/SONYSONY KV-4000 4"""" TVSONY KV-4000 4"""" TV.
How much RAM and Drive space would be required to do the 82,000 against 82,000 in one pass? I figure this depends on record size and such so I’m wondering about the “behind-the-scenes” processing. The files themselves were about 22MB and 30MB. When both were open, Total Date Usage was 52MB or 0.61%. Does running out of “memory” have something to do with the “Unlimited UnDo” feature?
I was able to move forward by breaking the files into chunks like selecting 3000 records in FileA and doing lookupselected on 10000 records in FileB.
If those numbers got much higher - say selecting 5000 records in FileA, I’d get an Apple - “Application ran out of Memory” error with a Force Quit dialog. Sometimes even that was locked up and I had to restart the computer.
For comparison, last month I ran a SimplyFortran program where I had to run an iteration of 3,600,000 numbers against another 3,600,000 numbers. The timing for one iteration of 3,600,000 was only a few hundredths of a second. Before I started, I multiplied that times 3,600,000 and it came to about 20 hours. I crossed my fingers, held my breath, turned in three circles, and pushed “Go”. The next day the process was done.
So in general, with PanX, when you are doing a whole of things against a whole lot of things, what do you have to be aware of so you don’t get, the “Ran out of App memory” / Force Quit message? Note that only PanX and the Finder were running at the time.