For a WPF application which will need 10 - 20 small icons and images for illustrative purposes, is storing these in the assembly as embedded resources the right way to go?>
Yes, it's the right way. You can use images in the Resource file using a path: