Well, it's not like if You're using D you have to build everything completely from scratch. For example, You can use:
- GLFW for input/output
- Horde3D as rendering engine
- OpenAL for sound
- Bullet for physics
- Lua for scripting
- lzo for fast decompression
- maybe Orange for serialization
I'm not sure about overlays though. It's a pretty solid base which hopefully will work for me :)
Good luck man!