There's a lot been written about PHPExcel and memory use, and I'm not going to repeat it all here.
Try reading some of the threads on the PHPExcel discussion board discussing the issue, such as this one; or previous answers here on SO such as this one or this one