powershell replace with exception

Question

I would like to change a file name. All dots in the name must be replaced by underscores. The exception is the last dot in the sentence, which is the one for the file extension.