I installed my windows service via (name of the service: Testing Service)
InstallUtil.exe present in .NET Framework (:\\Windows\\Microsoft.NET\\Fram
Installutil.exe (Installer Tool)
The Installer tool is a command-line utility that allows you to install and uninstall server resources by executing the installer components in specified assemblies.
Its job in life is to do exactly that,
To fill in your knowledge you should read through this
Chapter 2. Install/Uninstall
You will notice this is an entirely different concept, and actually has all the information you need (albeit in a very verbose manner)
There are various ways to achieve what you are after, one of them is using out of the box installation software, MSI, click once, or many others. or you could roll your own by using the above resources