Run AI Digital Human Software Easy-Wav2Lip Locally on Mac: Faster and Stronger!

Recently, there has been another breakthrough in the AI digital human field—Easy-Wav2Lip. As an improved version of Wav2Lip, Easy-Wav2Lip features a more streamlined design, faster execution speed, and more realistic video output. Frankly speaking, the advent of this software has made us more optimistic about the future of digital human technology.

What is Wav2Lip?

Wav2Lip technology enables the generation of lip movements that match the input audio for characters in a video, achieving lip-sync with the speech. This technology can be applied not only to static images but also to dynamic videos, producing video outputs synchronized with the target audio.

Why Choose Easy-Wav2Lip?

Compared to its predecessor, Easy-Wav2Lip is designed to be simpler, faster, and generates more realistic video effects.

Features of Easy-Wav2Lip

Speed

Easy-Wav2Lip excels in processing speed. For example, processing a 9-second, 720p, 60fps test video in the Colab T4 environment, Easy-Wav2Lip reduces the processing time from nearly 7 minutes to less than 1 minute.

Feature	Original Wav2Lip	Easy-Wav2Lip
Execution Time	6 min 53 sec	56 sec

Visual Effects

Easy-Wav2Lip corrects the visual defects in lip-sync present in the original Wav2Lip, making the generated video more natural and realistic.

It offers three different quality options:

• Quick: Basic Wav2Lip effect
• Improved: Adds feathered mouth masks on top of Wav2Lip while retaining the original resolution of other facial parts
• Enhanced: Combines Wav2Lip, masking, and GFPGAN technology for a comprehensive facial enhancement

Installation Guide

To simplify the installation process, the tools have been packaged into a standalone startup package. Users can run it with a simple click without the need for complicated Python environment configurations. Here are the detailed steps to obtain and install the application:

Download the Application

Go to the download page: https://www.patreon.com/posts/run-ai-digital-108160744.

Note: Only supports devices equipped with Mac M1/2/3 series chips.

Installation Steps

1. Download the DMG image file from the above link, drag the app file to the Applications folder.

2. After copying, do not open from the Launchpad for the first time; right-click and open from the Applications folder as shown below.

3. The software will automatically open the operation interface. Select the corresponding photo and audio files in the respective folders to generate the video.

Conclusion

The emergence of Easy-Wav2Lip undoubtedly brings us more possibilities. Whether in terms of processing speed or visual effects, it far surpasses Wav2Lip. We hope everyone can make full use of this technology to create more amazing works.