How can I access the Mapper/Reducer counters on the Output stage?

前端 未结 1 704
你的背包
你的背包 2021-01-07 00:53

I have some counters I created at my Mapper class:

(example written using the appengine-mapreduce Java library v.0.5)

@Override
public void map(Entit         


        
相关标签:
1条回答
  • 2021-01-07 01:11

    There is not a way to do this inside of output today. But feel free to request it here: https://code.google.com/p/appengine-mapreduce/issues/list

    What you can do however is to chain a job to run after your map-reduce that will receive it's output and counters. There is an example of this here: https://code.google.com/p/appengine-mapreduce/source/browse/trunk/java/example/src/com/google/appengine/demos/mapreduce/entitycount/ChainedMapReduceJob.java

    In the above example it is running 3 MapReduce jobs in a row. Note that these don't have to be MapReduce jobs, you can create your own class that extends Job and has a run method which creates your Summary object.

    0 讨论(0)
提交回复
热议问题