BrowseSupportFragment in Leanback android Tv makes Server calls when I move from one menu to another and back

Question

I have implemented the BrowseSupportFragment from the Leanback library. It has a left navigation bar with rowItems and headerIcons. Each time I move from one row in the navi