regexp_replace only captures first instance

Question

I\'m trying to remove the two periods from a name like B.J. Smith using regexp_replace(name,\'[.]\',\'\') but it\'s only removing the first period. I a