UIScrollView jumpy view using UIHostingController

Question

I would like to put a SwiftUI view into UIScrollView using UIHostingController. However my button "toggle" seems to be jumping around the