So I have my app working good when you press and drag along. I also have UIButtons set to Touch Down in Interface Builder.
As well when you drag you need to drag fro
Tried something different. Using this worked much better:
if(CGRectContainsPoint(myObject.frame, location) && lastButton != myObject) {
Used it in touchesBegan & touchesMoved.