I come from a DBA world and performance has always been an obsession. I am turning to development and I always think about performance, constantly, all the time.
For me, when i am working with image manipulation, multiple large sql queries or loops that pass the 100k mark, i think about optimization. Otherwise i don't, unless i see its slow when its working.