You probably have more than one element with the same ID.
You don't have to use ID at all in case you want to remove them by index you can use the .eq()
method:
$("#btnRemove").click(function() {
$("#myList li").eq(1).remove();
});
This will remove the second list item each click.
Live test case.