Working of RecordReader in Hadoop

前端 未结 2 2029
春和景丽
春和景丽 2021-02-08 19:20

Can anyone explain how the RecordReader actually works? How are the methods nextkeyvalue(), getCurrentkey() and getprogress() work after t

2条回答
  •  [愿得一人]
    2021-02-08 19:56

    org.apache.hadoop.mapred.MapTask - runNewMapper()

    Imp steps:

    1. creates new mapper

    2. get input split for the mapper

    3. get recordreader for the split

    4. initialize record reader

    5. using record reader iterate through getNextKeyVal() and pass key,val to mappers map method

    6. clean up

提交回复
热议问题