Hyungwon's Notebook

Notice This instruction is mainly written for the NAMZ & EMCS members. Therefore, the other users who would like to duplicate this tutorial might experience unexpected errors. System Settings Mac OSX(Sierra) Matlab Speech2face Introduction Speech2face is a plotting tool that visualizes dynamic lips movement in real time. This is trained with deep neural network which receives speech signals as inputs to predict lip parameters (as outputs). (Speech2face will be updated to visualize whole face movement.) By uttering a few sentences, the speaker is able to receive instantaneous feedback of his or her lip movement from the machine. Pronouncing /a/,/o/,/i/ Install Feature Extractors Go visit this github and download speech2face to your local computer. We will use ‘FaceTracker’ and ‘OpenFace’ toolkit in order to retrieve 3 types of data: images, raw.pcm(audio file), and parameters.txt (pts data). Two toolkits are already donwloaded and manipulated for the...