In the attached image, I want the column of buttons to match the height of the image, but I also want there to be a minimum height for the column of buttons.
I don't know all your exact requirements, but it seems you can solve this with another layer pretty much like in your diagram. Set the minHeight on an outer layout and then just fill_parent/match_parent on the inside. Maybe something like: