So I have 6 panels, all of them used a grid layout. And I put them together using gridbaglayout, here is the design I wanted
Add this:
c.gridwidth = 2;
Before adding the FIRST and SECOND panels, then set gridwidth back to 1 before adding the others. Alternatively you could separate them further as suggested above. You could use two FlowLayouts for each row, and add those two to another panel with a BorderLayout with NORTH/SOUTH.