Generally, no difference. They are interchangeable.
The only important note is not to use one inside itself.
For example in php:
echo '"hello world"';
Outputs - "hello world"
Or
echo "'hello world'";
Outputs 'hello world'
BUT
echo ""hello world"";
Will throw an error if the " is unescaped, as it's closing that parameter before the contents.