Why we have not changed just the storing routine in hadoop (making it in memory) instead of inventing a different tool, Apache spark, altogether?

Question

We all know that Spark uses RAM to store processed data, both Spark and Hadoop use RAM for computation, which makes Spark to access data at blazing fast speed. But if that i