It took me a little bit, but I figured out that I can\'t click on my inputs because of the touch.punch script I\'m using to enable jquery UI drag functionality on touch devices.
One solution is to use a handle. Add an icon inside and use this to drag. Then the inputs work fine.
Move $("#sortableList").sortable({ handle: ".move" });