Auto Keypoint Extractor for Retopology

The idea of this tool is to extract the facial keypoints of a texture, mark the vertices and export the information for retopology tools likeĀ R3DS Wrap.

Result
Alex with annotated keypoints

The tool creates multiple renderings of the face and then extracts 68 landmarks form the face. The different landmarks from the multiple view angles are then stitched together and used to create a 3d landmark detection. For this, rays are project from the camera onto the 3d model, and the intersection point will be used as 3d landmark.

The plugin has been written for blender as a Python script. For more information about the installation and usage, check out the repository: https://gitlab.zhdk.ch/iaspace/auto-keypoint-retopology