HttpResponseMessage represent a moden way to use Http. It is being used by REST solutions such as Web API to manipulate status code and the Location header.
HttpWebResponse is goold old class that contains all the Http information but considers Obsolete.