What's the successor of mrunit?

后端 未结 2 750
一生所求
一生所求 2021-01-31 11:07

Today I found out that the ASF retired mrunit (see https://blogs.apache.org/foundation/entry/the_apache_news_round_up85 and https://issues.apache.org/jira/browse/HADOOP-3733 and

相关标签:
2条回答
  • 2021-01-31 12:09

    I believe the reason for this retirement is the realization that Mockito already can handle what you need to unit test your mapper/reducers. All you need is to mock your Context, Counter and HBase KeyValue and you can then pass in a row (in the form of the Result object) to a mapper and check if the key/value emitted is correct.

    FYI - I actually got my MR unit tests working perfectly using this approach without any assistance from MRUnit and PowerMock.

    0 讨论(0)
  • 2021-01-31 12:10

    Not exactly a successor, but I tried and tested a work-around with a bit of research. It is actually based on the Minicluster module of hadoop.

    To find out how to use it, details can be found in this link here. And a github demo project exists here.

    0 讨论(0)
提交回复
热议问题