hzwer /ECCV2022-RIFE
ECCV2022 - Real-Time Intermediate Flow Estimation for Video Frame Interpolation
★ 5,697⑂ 572👁 77⑃ 40● 359▤ 1
+4
日增长
5,697
stars
572
forks
77
watchers
40
prs
359
issues
1
releases
README
Real-Time Intermediate Flow Estimation for Video Frame Interpolation YouTube | BiliBili | Colab | Tutorial | DeepWiki Introduction This project is the implement of Real-Time Intermediate Flow Estimation for Video Frame Interpolation. Currently, our model can run 30+FPS for 2X 720p interpolation on a 2080Ti GPU. It supports arbitrary-timestep interpolation between a pair of images. 2024.08 - We find that 4.22.lite is quite suitable for post-processing of some diffusion model generated videos. 2023.11 - We recently release new v4.7-4.10 optimized for anime scenes! We draw from SAFA’s research. 2022.7.4 - Our paper is accepted by ECCV2022. Thanks to all relevant authors, contributors and users! From 2020 to 2022, we submitted RIFE for five submissions(rejected by CVPR21 ICCV21 AAAI22 CVPR22). Thanks to all anonymous reviewers, your suggestions have helped to significantly improve the paper! ECCV Poster | ECCV 5-min presentation | 论文中文介绍 | rebuttal (2WA1WR-3WA) Pinned Software: RIFE-App | FlowFrames | SVFI (中文) 16X interpolation results from two input images: !Demo !Demo Software Flowframes | SVFI(中文) | Waifu2x-Extension-GUI | Autodesk Flame | SVP | mpv_PlayKit | enhancr RIFE-App(Paid) | Steam-VFI(Paid) We are not responsible for and participating in the development of above software. According to the open source license, we respect the commercial behavior of other developers. VapourSynth-RIFE | RIFE-ncnn-vulkan | VapourSynth-RIFE-ncnn-Vulkan | vs-mlrt If you are a developer, welcome to follow Practical-RIFE, which aims to make RIFE more practical for users by adding various features and design new models with faster speed. You may check this pull request for supporting macOS. CLI Usage Installation git clone [email protected]:megvii-research/ECCV2022-RIFE.git cd ECCV2022-RIFE pip3 install -r requirements.txt Download the pretrained HD models from here. (百度网盘链接:https://pan.baidu.com/share/init?surl=u6Q7-i4Hu4Vx9_5BJibPPA 密码:hfk3,把压缩包解开后放在 train_log/\) Unzip and move the pretrained parameters to train_log/\ This model is not reported by our paper, for our paper model please refer to evaluation. Run Video Frame Interpolation You can use our demo video or your own video. python3 inference_video.py --exp=1 --video=video.mp4 (generate video_2X_xxfps.mp4) python3 inference_video.py --exp=2 --video=video.mp4 (for 4X interpolation) python3 inference_video.py --exp=1 --video=video.mp4 --scale=0.5 (If your video has very high resolution such as 4K, we recommend set --scale=0.5 (default 1.0). If you generate disordered pattern on your videos, try set --scale=2.0. This parameter control the process resolution for optical flow model.) python3 inference_video.py --exp=2 --img=input/ (to read video from pngs, like input/0.png ... input/612.png, ensure that the png names are numbers) python3 inference_video.py --exp=2 --video=video.mp4 --fps=60 (add slomo effect, the audio will be removed) python3 inference_video.py -
Top issues
Latest release
Archive the code for v5 and earlier arXiv preprints arxiv_v5_code Pre-release 2021-08-13https://arxiv.org/abs/2011.06294v5