We have an application that is running on 5 (server) nodes (16 cores, 128 GB Memory each) that loads almost 70 GB data on each machine. This application is distributed and serve
If it is a fragmentation problem then you cannot solve it without some sort of profiling. Search for a memory profiler that supports fragmentation detection to know exactly the cause of this fragmentation.