To see the literal map in your desktop app's window, you can embed a browser control that is Java-based and is compatible with the Google Maps application.
See this question to find out how to embed a browser in your Java app:
Embedding web browser window in Java