Reading a file larger than 2GB into memory in Java

Question

Since ByteArrayInputStream is limited to 2GB, is there any alternate solution that allows me to store the whole contents of a 2.3GB (and possibly larger) file i

Answer 1

You can use memory writing the data compressed to a

ByteArrayOutputStream baos = new ByteArrayOutputStream
... new GZIPOutputStream(baos));

byte[] bytes = baos.toByteArray(); // < 100 MB?

ByteArrayInputStream ....

And then later wrap the input stream in a GZIPInputStream.

Still a minor slow down, but should be ideal for XML.