Add 2D or 3D Face Filters like MSQRD/SnapChat Using Google Vision API for iOS

Question

Here\'s some research I have done so far: - I have used Google Vision API to detect various face landmarks. Here\'s the reference: https://developers.google.com/vision/intro

Answer 1

Canvas class is used in android for drawing such 3D / 2D models or core graphics for IOS can be used. What you can do is detect the face components, take their location points and draw images on top of them. Consider going through this

Answer 2

You need to either predict x,y,z coordinates(check out this demo), either use x,y predictions but then find parameters of universal 3d-model & camera that will give the closest projection of current x,y.