HypoX64/DeepMosaics: Automatically Remove The Mosaics ... - GitHub

Skip to content Dismiss alert {{ message }} HypoX64 / DeepMosaics Public

• Notifications You must be signed in to change notification settings
• Fork 471
• Star 2.5k

• Code
• Issues 108
• Pull requests 5
• Actions
• Projects
• Security
• Insights

Additional navigation options

 masterBranchesTagsGo to fileCodeOpen more actions menu

Folders and files

Name		Name	Last commit message	Last commit date
Latest commit   History 84 Commits84 Commits
cores		cores
cpp		cpp
docs		docs
imgs		imgs
make_datasets		make_datasets
models		models
pretrained_models		pretrained_models
tools		tools
train		train
util		util
.gitignore		.gitignore
LICENSE		LICENSE
README.md		README.md
README_CN.md		README_CN.md
deepmosaic.py		deepmosaic.py
requirements.txt		requirements.txt
View all files

Repository files navigation

• README
• GPL-3.0 license

     DeepMosaics

English | 中文 You can use it to automatically remove the mosaics in images and videos, or add mosaics to them.This project is based on "semantic segmentation" and "Image-to-Image Translation".Try it at this website!

Examples

origin	auto add mosaic	auto clean mosaic

• Compared with DeepCreamPy

mosaic image	DeepCreamPy	ours

• Style Transfer

origin	to Van Gogh	to winter

An interesting example:Ricardo Milos to cat

Run DeepMosaics

You can either run DeepMosaics via a pre-built binary package, or from source.

Try it on web

You can simply try to remove the mosaic on the face at this website.

Pre-built binary package

For Windows, we bulid a GUI version for easy testing. Download this version, and a pre-trained model via [Google Drive] [百度云,提取码1x0a]

• [Help document]
• Video tutorial => [youtube] [bilibili]

Attentions:

• Requires Windows_x86_64, Windows10 is better.
• Different pre-trained models are suitable for different effects.[Introduction to pre-trained models]
• Run time depends on computers performance (GPU version has better performance but requires CUDA to be installed).
• If output video cannot be played, you can try with potplayer.
• GUI version updates slower than source.

Run From Source

Prerequisites

• Linux, Mac OS, Windows
• Python 3.6+
• ffmpeg 3.4.6
• Pytorch 1.0+
• CPU or NVIDIA GPU + CUDA CuDNN

Dependencies

This code depends on opencv-python, torchvision available via pip install.

Clone this repo

git clone https://github.com/HypoX64/DeepMosaics.git cd DeepMosaics

Get Pre-Trained Models

You can download pre_trained models and put them into './pretrained_models'. [Google Drive] [百度云,提取码1x0a] [Introduction to pre-trained models]

In order to add/remove mosaic, there must be a model file mosaic_position.pth at ./pretrained_models/mosaic/mosaic_position.pth

Install dependencies

(Optional) Create a virtual environment

virtualenv mosaic source mosaic/bin/activate

Then install the dependencies

pip install -r requirements.txt

If you can not build scikit-image, running export CFLAGS='-Wno-implicit-function-declaration then try to rebuild.

Simple Example

• Add Mosaic (output media will be saved in './result')

python deepmosaic.py --media_path ./imgs/ruoruo.jpg --model_path ./pretrained_models/mosaic/add_face.pth --gpu_id 0

• Clean Mosaic (output media will save in './result')

python deepmosaic.py --media_path ./result/ruoruo_add.jpg --model_path ./pretrained_models/mosaic/clean_face_HD.pth --gpu_id 0

If you see the error Please check mosaic_position_model_path!, check if there is a model file named mosaic_position.pth at ./pretrained_models/mosaic/mosaic_position.pth

More Parameters

If you want to test other images or videos, please refer to this file. [options_introduction.md]

Training With Your Own Dataset

If you want to train with your own dataset, please refer to training_with_your_own_dataset.md

Acknowledgements

This code borrows heavily from [pytorch-CycleGAN-and-pix2pix] [Pytorch-UNet] [pix2pixHD] [BiSeNet] [DFDNet] [GFRNet_pytorch_new].

About

Automatically remove the mosaics in images and videos, or add mosaics to them.

Topics

computer-vision deep-learning pytorch mosaic video-inpainting

Resources

Readme

License

GPL-3.0 license

Uh oh!

There was an error while loading. Please reload this page.

Activity

Stars

2.5k stars

Watchers

47 watching

Forks

471 forks Report repository

Releases 3

v0.5.1 Latest May 23, 2021 + 2 releases

Packages

Uh oh!

There was an error while loading. Please reload this page.

Uh oh!

There was an error while loading. Please reload this page.

Contributors 3

• HypoX64 Hypo
• zhangtiance Zhang Tiance
• seniorm0ment Smitty Werbenmanjensen

Languages

• Python 97.5%
• C++ 1.5%
• CMake 1.0%

You can’t perform that action at this time.