I recently got over this odd behavior in Flutter, someone else here on stack-overflow pointed it out but never posted an full fix or workaround, seems flutter font managemen
