Is it possible to do this using Grid Bag layout/ constraints without adding extra space to right or left of first 2 rows?
Should look like this roughly: