06-03-2014, 07:42 PM
This is an oldish thread, but I came to it today looking for alternatives to what I'm about to provide here. It seems that at least a few others are in the same boat as I was, and outside of reloading the mbox files into a mail program, nobody's offering anything.
There is an alternative text editor though - UltraEdit - which I used to use in the Windows world, and it totally rocks with large files (multi-GB). It is now also available for the Mac.
Instead of loading the entire file into memory like BBEdit does, UltraEdit allows you to load only sections at a time into memory, sort of scrolling through the file. When you reach the end of the data loaded into memory, it dumps what's at the other end and loads more data. (Of course I'm not giving a technical explanation of what's going on under the covers, I don't know. I'm just describing the observable behavior).
You can control how much memory is dedicated to the files, which kind of sets the width of your "window" into the data file.
An email correspondence with the company (IDM Computer Solutions Inc) several years ago told me that the Mac version works the same way, but I had never used the Mac version until now. I've just downloaded it - actually leveraging my initial investment in the Windows version of the product with upgrade pricing after all these years, and having the ability to install and activate both Windows and Mac versions at the same time - and it works. For example, I've just opened an 800MB file, some 10 million lines of data from an mbox file, performed a substring search and found all 104 occurrences in 20-25 seconds.
This program does ~not~ provide the ability to preview images in stream, so far as I know, it just shows the base64 encoded data. There may be some way to preview, I'm not sure.
Seems like it will solve my problem, anyway… what about yours?!
There is an alternative text editor though - UltraEdit - which I used to use in the Windows world, and it totally rocks with large files (multi-GB). It is now also available for the Mac.
Instead of loading the entire file into memory like BBEdit does, UltraEdit allows you to load only sections at a time into memory, sort of scrolling through the file. When you reach the end of the data loaded into memory, it dumps what's at the other end and loads more data. (Of course I'm not giving a technical explanation of what's going on under the covers, I don't know. I'm just describing the observable behavior).
You can control how much memory is dedicated to the files, which kind of sets the width of your "window" into the data file.
An email correspondence with the company (IDM Computer Solutions Inc) several years ago told me that the Mac version works the same way, but I had never used the Mac version until now. I've just downloaded it - actually leveraging my initial investment in the Windows version of the product with upgrade pricing after all these years, and having the ability to install and activate both Windows and Mac versions at the same time - and it works. For example, I've just opened an 800MB file, some 10 million lines of data from an mbox file, performed a substring search and found all 104 occurrences in 20-25 seconds.
This program does ~not~ provide the ability to preview images in stream, so far as I know, it just shows the base64 encoded data. There may be some way to preview, I'm not sure.
Seems like it will solve my problem, anyway… what about yours?!