I almost have a solution (well, you might see it as a solution) and it works with your HTML :
p::before {
content:'*';
position:absolute;
color: red;
text-shadow: 0 0 1px red;
}
Demonstration
I launched a virtual machine to test on IE, it looks good :