LipTalk is a plugin for Cinema 4D to create realistic lip sync animations for your 3D characters. Liptalk works with custom characters and DAZ Studio characters.
Liptalk has an
Audio Mode
that lets you generate lip movements from voice files (wav). To use this mode, you need the free AudioConverter from 3Deoskill. You can download the
AudioConverter
and use it to convert
voice files from up to 2500 languages into Liptalk-compatible transcripts, which you can then import into the plugin.
Liptalk also has a
Text Mode
that allows you to turn your text input into phonemes, which then drives the lip animations. Text mode currently supports now five languages: English, German, Russian, French and Italian.
Text Mode is suitable if you want to voice-over the animation later or just need some lip movements.
Text mode is very powerful and works most accurately. It gives you the most control over the lip sync. You can adjust the length and strength of each phoneme using a special parameter syntax directly in your prompts and also insert pauses as needed. With some tricks in combination with Motion Clips you have total control over the animation in a non-linear way which allows you to design it artistically according to your needs
The Manual Recorder can overwrite the automatic mode to either animate specific areas manually or to simply remove unwanted passages from the transcripts.
Finally, you can use Liptalk’s built-in Bake functionality to convert the lip sync into keyframes and then into Motion Clips which you can save and reuse with any character that is compatible with Liptalk. Motion clips are very powerful because they open up new doors and further possibilities in combination with LipTalk, they can be used non-linearly, they can be edited, they can be changed in length, they can be divided and they can reused on any character which is prepared for LipTalk.
In addition, LipTalk includes another tag, the so-called
Jaw Solver
tag. The Jaw Solver can be assigned to an object, preferably a Jaw Joint, to animate it using LipTalk. This variant is particularly suitable if characters have a Jaw Joint and you want to mix blend shapes with a Jaw Joint so that the Jaw Joint takes over the opening of the jaw and the Pose Morph Tag or the blendshapes the movement of the lips. But you also can just animate the jaw without any lip animations. This is also possible and the fastest setup and simplest animation technique.
Since the plugin often raises questions for beginners in Cinema 4D, I really recommend that you study the tutorial videos and the manual carefully. We have also included example scenes that you can download to understand the LipTalk setup. Basically, using LipTalk is child's play and once you understand the workflow and know all the tricks you can do with it, it's even fun.
If you still have any questions, don't hesitate to contact us.
----------------------------------------------------------------------------------------------------
Audio Converter Download
IMPORTANT:
To ensure the full functionality of Liptalk, it is recommended to download and first test the free AudioConverter. Only when the AudioConverter works you can use Audio Mode in LipTalk with the transcripts.
Although you can use the plugin purely in text mode, which is actually very powerful, I recommend only purchasing LipTalk for the full functionality once you have got the AudioConverter work on your system.
The free
3Deoskill
AudioConverter
analyzes audio speech files and creates certain audio transcript files. Not only the individual phonemes are taken into account, but also the timing, intonation and speed of the language. The converter supports up to 2500 languages. The Advanced mode can also handle audio files with long vowels, which are often difficult to synchronize.
<<<<<<<<< You can find the AudioConverter to your left
(Please test the Audio Converter before purchasing LipTalk)