I suggest you take a look at Slick2D. It's an easy-to-use comprehensive 2D game library: a great platform for experimenting with Java.
Since you don't have any experience with Java yet, I would advise you stay clear of low-level libraries such as LWJGL or complex libraries such as JMonkeyEngine.
