Ultimate Vocal Remover GUI v4.0.0

About

This application is a GUI version of the vocal remover AI's created and posted by GitHub user tsurumeso. You can find tsurumeso's original command line version here. Please note that we do not maintain or directly support any of tsurumesos AI application code. Direct support and development for the Ultimate Vocal Remover GUI is only maintained within this repository.

• Special Thanks
  • tsurumeso - The engineer who authored the AI code. Thank you for the hard work and dedication put into the AI application this GUI is built around!
  • DilanBoskan - The main GUI code contributor, thank you for helping bring this GUI to life, your hard work and continued support is greatly appreciated!

Installation

The application was made with Tkinter for cross-platform compatibility, so this should work with Windows, Mac, and Linux systems. This application has only been tested on Windows 10 & Linux Ubuntu.

Install Required Applications & Packages

1. Download & install Python 3.7 here (Windows link)
   • Ensure the "Add Python 3.7 to PATH" box is checked
2. Once Python has installed, download Ultimate Vocal Remover GUI Version 4.1.0 here (link pending)
3. Place the UVR-V4GUI folder contained within the .zip file where ever you wish.
   • Your documents folder is recommended for ease of access.
4. From the UVR-V4GUI directory, open the Windows Command Prompt and run the following installs -

pip install --no-cache-dir -r requirements.txt
pip install torch==1.6.0+cu101 torchvision==0.7.0+cu101 -f https://download.pytorch.org/whl/torch_stable.html

Running the Vocal Remover GUI & Models

• Open the file labeled 'VocalRemover.py'.
  • It's recommended that you create a shortcut for the file labeled 'VocalRemover.py' to your desktop for easy access.
    • If you are unable to open the 'VocalRemover.py' file, please go to the troubleshooting section below.

Option Guide

Choose AI Engine:

• This option allows you to toggle between tsurumeso's v2 & v4 AI engines.
  • Please note, The TTA option and the ability to set the N_FFT value is only available for the v4 engine.

Model Selections:

The v2 & v4 AI engines use different sets of models. The available models for each engine will automatically populate within the model selection dropdowns based on which engine was selected.

• Choose Main Model - Here is where you choose the main model to convert your tracks with.
  • Each of the models provided were trained on different parameters, though they can convert tracks of all genres.
  • The variety of models allows the user the chance to determine which one works best for the type of music they're converting.
    • The 'Model Test Option' will allow the user to more easily determine which model is best for the track(s) being converted.
• Choose Stacked Model - These models are meant to clean up vocal artifacts from instrumental outputs.
  • The stacked models provided are only meant to process instrumental outputs created by a main model.
  • Selecting the 'Stack Passes' option will enable you to select a stacked model to run with the main model.
    • If you wish to only run a stacked model on a track, make sure the 'Stack Conversion Only' option is checked.
  • The varying main model/stacked model combination options allows the user more flexibility in finding what blend works best for the track(s) they are proessing.
    • To reiterate, the 'Model Test Option' makes testing different model blends easier on the user, that's what it is there for.

Parameter Values

All models released here will have the values they were trained with appended to the end of their filenames like so, 'MGM-HIGHEND_sr44100_hl512_w512_nf2048.pth'. The '_sr44100_hl512_w512_nf2048' portion automatically sets the SR, HOP LENGNTH, WINDOW SIZE, & N_FFT values within the application, so please do not change the model files names. If there are no values appended to the end of the models' filename, the value fields will be editable and auto-populate with default values.

• Default Values:
  • SR - 44100
  • HOP LENGTH - 1024
  • WINDOW SIZE - 512
  • N_FFT - 2048

Checkboxes

• GPU Conversion - Selecting this option ensures the GPU is used for conversions.
  • NOTE: It will not work if you don't have a Cuda compatible GPU (Nividia GPU's are most compatible with Cuda).
• Post-process - This option can potentially identify leftover instrumental artifacts within the vocal outputs. This option may improve the separation on some songs.
  • NOTE: Having this option selected can potentially have an adverse effect on the conversion process, depending on the track. Because of this, it's only recommended as a last resort.
• TTA - This option performs Test-Time-Augmentation to improve the separation quality.
  • Having this selected will increase the time it takes to complete a conversion.
  • This option is not compatible with the v2 AI engine.
• Output Image - Selecting this option will include the images of the spectrograms for the instrumental & vocal audio outputs.
• Stack Passes - This option allows the user to set the number of times a track is to run through a stacked model.
  • The best range is 3-5 passes, any more than 5 can cause quality degradation of the track.
• Stack Conversion Only - Selecting this option allows the user to bypass the main model and run a track through a stacked model only.
• Save All Stacked Outputs - Having this option selected will auto-generate a new directory to the 'Save to' path with the track name. The new directory will contain all of the outputs generated by the whole conversion process. The amount of audio outputs will depend on the input number of stack passes.
  • Each output filename will be appended with the number of passes it has had.
    • For example, if you choose 5 stack passes this option will provide you with 5 pairs of audio outputs generated after each pass.
  • This option can be very useful in determining the optimal number of passes needed to clean a track.
• Model Test Mode - This option is meant to make it easier for users to test the results of different models, and model combinations, without having to manually create new folders and/or change the filenames.
  • When this option is selected the application will auto-generate a new folder with the name of the selected model(s) in the 'Save to' path you have chosen.
    • The instrumental & vocal outputs filenames will have the selected model(s) name(s) appended to them and save to the auto-generated directory.

Other Buttons:

• Add New Model - This button will automatically take you to the models folder.
  • If you are adding a new model, make sure to add it accordingly based on the AI engine it was trained on!
    • For example, if you wish to add a model trained on the v4 engine, add it to the correct folder located in the 'v4' directory.
  • The application will automatically detect any models added the correct directories without needing a restart.
• Restart Button - If the application hangs for any reason, you can hit the circular arrow button immediately to the right of the 'Start Conversion' button.

Models Included

PLEASE NOTE: Do not change the name of the models provided! The required parameters are specified and appended to the end of the filenames.

Here's a list of the models included within the package -

• v2 AI Engine

  • Main Models
    • (list pending)
  • Stacked Models
    • (list pending)

• v4 AI Engine

  • Main Models
    • (list pending)
  • Stacked Models
    • (list pending)

A special thank you to aufr33 for helping me expand the dataset used to train these models and for the helpful training tips.

Other GUI Notes

• The application will automatically remember your 'save to' path upon closing and reopening until you change it.
  • It will also remember the last directory you accessed to select files to be processed.
• Multiple conversions are supported.
• The ability to drag & drop audio files to convert has also been added.
• Conversion times will greatly depend on your hardware.
  • This application will not be friendly to older or budget hardware. Please proceed with caution! Pay attention to your PC and make sure it doesn't overheat. We are not responsible for any hardware damage.

Troubleshooting

• If the 'VocalRemover.py' file won't open under any circumstances and all other resources have been exhausted, please do the following -

1. Open the cmd prompt from the UVR-V4GUI directory
2. Run the following command -

python VocalRemover.py

3. Copy and paste the error output in the cmd prompt to the issues center on the GitHub repository.

License

The Ultimate Vocal Remover GUI code is MIT-licensed.

Contributing

For anyone interested in the ongoing development of Ultimate Vocal Remover GUI please send us a pull request and we will review it. This project is 100% open-source and free for anyone to use and/or modify as they wish.

References

• [1] Takahashi et al., "Multi-scale Multi-band DenseNets for Audio Source Separation", https://arxiv.org/pdf/1706.09588.pdf