Is there a way to use numpy.outer on only a subset of dimensions?

Question

I have an array of arrays, like this:

import numpy as np
a = np.array([[1, 2, 3], [4, 5, 6]])

I would like to calculate the pairwise differen