Developing an office 365, outlook add-in. Changed the add-in icon (Basically just replaced the old icons with new one. Icons have the same name.). Icon comes up fine on OWA
I resolved it by simply renaming the icon files and updating the manifest files accordingly.
You need to delete the local cache. Delete the contents of %LOCALAPPDATA%\Microsoft\Office\16.0\Wef\