Material transition FAB to activity - Activity is still present for a second when transitioning back

Question

I am trying to get a material transition to work from a FAB in Activity A to Activity B and back. Its currently working but with a slight issue. When I click on a FAB it expands