Android RecyclerView with StaggeredGridLayoutManager scrolls a bit on coming back to fragment

Question

I am using RecyclerView with StaggeredGridLayoutManager in fragment. after clicking on a item another fragment has been open. problem is if coming