babysor /MockingBird

🚀Clone a voice in 5 seconds to generate arbitrary speech in real-time

★ 36,865⑂ 5,148👁 298⑃ 102● 889▤ 1
PythonNOASSERTIONCreated 2021-08-07
下载:A previous version checkpointA-0.0.1 ↓0.0.12021-11-07
-1
日增长
-6
周增长
-23
月增长
36,865
stars
5,148
forks
298
watchers
102
prs
889
issues
1
releases

README

🚧 While I no longer actively update this repo, you can find me continuously pushing this tech forward to good side and open-source. I'm also building an optimized and cloud hosted version: https://noiz.ai/ and we're hiring.

!mockingbird




 English | 中文| 中文Linux

 Features
🌍 Chinese supported mandarin and tested with multiple datasets: aidatatang_200zh, magicdata, aishell3, data_aishell, and etc.

🤩 PyTorch worked for pytorch, tested in version of 1.9.0(latest in August 2021), with GPU Tesla T4 and GTX 2060

🌍 Windows + Linux run in both Windows OS and linux OS (even in M1 MACOS)

🤩 Easy & Awesome effect with only newly-trained synthesizer, by reusing the pretrained encoder/vocoder

🌍 Webserver Ready to serve your result with remote calling

 DEMO VIDEO

 Quick Start

 1. Install Requirements
 1.1 General Setup
 Follow the original repo to test if you got all environment ready.
Python 3.7 or higher  is needed to run the toolbox.

 Install PyTorch.
 If you get an ERROR: Could not find a version that satisfies the requirement torch==1.9.0+cu102 (from versions: 0.1.2, 0.1.2.post1, 0.1.2.post2 ) This error is probably due to a low version of python, try using 3.9 and it will install successfully
 Install ffmpeg.
 Run pip install -r requirements.txt to install the remaining necessary packages.
 The recommended environment here is Repo Tag 0.0.1 Pytorch1.9.0 with Torchvision0.10.0 and cudatoolkit10.2 requirements.txt webrtcvad-wheels because requirements. txt was exported a few months ago, so it doesn't work with newer versions
 Install webrtcvad pip install webrtcvad-wheels(If you need)

or
- install dependencies with conda or mamba

  conda env create -n env_name -f env.yml

  mamba env create -n env_name -f env.yml

  will create a virtual environment where necessary dependencies are installed. Switch to the new environment by conda activate env_name and enjoy it.
   env.yml only includes the necessary dependencies to run the project,temporarily without monotonic-align. You can check the official website to install the GPU version of pytorch.

 1.2 Setup with a M1 Mac
 The following steps are a workaround to directly use the original demo_toolbox.pywithout the changing of codes.

    Since the major issue comes with the PyQt5 packages used in demo_toolbox.py not compatible with M1 chips, were one to attempt on training models with the M1 chip, either that person can forgo demo_toolbox.py, or one can try the web.py in the project.

 1.2.1 Install PyQt5, with ref here.
   Create and open a Rosetta Terminal, with ref here.
   Use system Python to create a virtual environment for the project
    
    /usr/bin/python3 -m venv /PathToMockingBird/venv
    source /PathToMockingBird/venv/bin/activate
    
   Upgrade pip and install PyQt5
    
    pip install --upgrade pip
    pip install pyqt5
    
 1.2.2 Install pyworld and ctc-segmentation

 Both packages seem to be unique to this project and are not seen in the original Real-Time Voice Cloning project. 

Top issues

Discussions

Latest release

A previous version checkpoint v0.0.1 2021-11-07

Snapshot: 2026-11-16T09:23:14Z · Data license Apache-2.0 · JSON