Tensorflow, gather from image by spatial indices

Question

I have a batch of image, [B, H, W, 3], and spatial N indices, [B, N, 2], where N < min(H, W). 2 is for H and W.
Does anyone know how to get N