Does removing docker image affect the caching

Question

At the end of a Jenkins pipeline there is a
docker image rm #{IMAGE_ID_HERE}"
I noticed that on each build the cache is not utilized, and all t