Edit: I was actually able to get this to work and form, in my oppinion, a good example. The accepted answer is my example and feel free to leave comments if you
You're very new to Java - I think you're overcomplicating this and trying to swallow too much at once.
Forget about your grand design. Forget about UI. Forget about Android.
Start with a toy problem and build up.
Can you make a single Listener class that responds to an Event and a producer class to send that Event out? Can you see the action being taken? If you can't do that, you won't get far. When you have one working, move onto the next and see if you can get your design working with these simpler objects. Only when the whole thing is working should you worry about tying in the Android and UI elements.
Start with simple POJO models and you'll get further faster.