Fllink Web UI not displaying records received in a Custom Source implementation

眉间皱痕 提交于 2020-01-02 05:23:14

问题


I have build a custom source to process a log stream in Flink. The program is running fine and giving me the desired results after processing the records.

But, when I check the Web UI, I do not see the counts. Below is the screenshot: Records/Bytes Count


回答1:


Flink chained all the operators of your pipeline into one operator: Source -> FlatMap -> ProcessLog -> Sink. Thus, this single operator contains the source and the sink. Additionally, Flink can neither measure the amount of bytes read by a source nor the number of bytes written by a sink. It can only measure the bytes sent between operators. Since the source and sink are executed in the same operator, the web UI does not show you any bytes sent/received.



来源:https://stackoverflow.com/questions/34682082/fllink-web-ui-not-displaying-records-received-in-a-custom-source-implementation

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!