Python: Sort 2d arrays by similarity

Question

If I have the following four arrays, I would like them sorted in either the order 1324 or 4231. Array3 is most like Array1, but it is just shifted over