On Windows XP, in a folder of files, I need to rename some files, replacing one character in the filename with another and overwriting any files that already have that name.
You can try the Move-Item command instead, with the -Force parameter.
Move-Item
-Force
Get-ChildItem . -include *.xml | Move-Item -Destination { $_.name.Replace("A","b")} -Force