Why __webpack_hmr route is 404 when using webpack-dev-server?

Question

I have the following webpack configuration and start my dev server with webpack-dev-server --hot. However hmr does not seem to work. In browser console I see