Is Hadoop right for running my simulations?

前端 未结 5 1808
花落未央
花落未央 2021-02-02 14:20

have written a stochastic simulation in Java, which loads data from a few CSV files on disk (totaling about 100MB) and writes results to another output file (not much data, just

5条回答
  •  抹茶落季
    2021-02-02 14:59

    While you might be able to get by using MapReduce with Hadoop, it seems like what you're doing might be better suited for a grid/job scheduler such as Condor or Sun Grid Engine. Hadoop is more suited for doing something where you take a single (very large) input, split it into chunks for your worker machines to process, and then reduce it to produce an output.

提交回复
热议问题