leandromoreira /digital_video_introduction
A hands-on introduction to video technology: image, video, codec (av1, vp9, h265) and more (ffmpeg encoding). Translations: 🇺🇸 🇨🇳 🇯🇵 🇮🇹 🇰🇷 🇷🇺 🇧🇷 🇪🇸
★ 16,387⑂ 1,379👁 424⑃ 87● 56▤ 2
-2
日增长
+9
周增长
+30
月增长
16,387
stars
1,379
forks
424
watchers
87
prs
56
issues
2
releases
README
🇺🇸
🇨🇳
🇯🇵
🇮🇹
🇰🇷
🇷🇺
🇧🇷
🇪🇸
Intro
A gentle introduction to video technology, although it's aimed at software developers / engineers, we want to make it easy for anyone to learn. This idea was born during a mini workshop for newcomers to video technology.
The goal is to introduce some digital video concepts with a simple vocabulary, lots of visual elements and practical examples when possible, and make this knowledge available everywhere. Please, feel free to send corrections, suggestions and improve it.
There will be hands-on sections which require you to have docker installed and this repository cloned.
bash
git clone https://github.com/leandromoreira/digital_video_introduction.git
cd digital_video_introduction
./setup.sh
WARNING: when you see a ./s/ffmpeg or ./s/mediainfo command, it means we're running a containerized version of that program, which already includes all the needed requirements.
All the hands-on should be performed from the folder you cloned this repository. For the jupyter examples you must start the server ./s/start_jupyter.sh and copy the URL and use it in your browser.
Changelog
added DRM system
released version 1.0.0
added simplified Chinese translation
added FFmpeg oscilloscope filter example
added Brazilian Portuguese translation
added Spanish translation
Index
- Intro
- Index
- Basic terminology
Other ways to encode a color image
Hands-on: play around with image and color
DVD is DAR 4:3
Hands-on: Check video properties
- Redundancy removal
Colors, Luminance and our eyes
+ Color model
+ Converting between YCbCr and RGB
+ Chroma subsampling
+ Hands-on: Check YCbCr histogram
Frame types
+ I Frame (intra, keyframe)
+ P Frame (predicted)
- Hands-on: A video with a single I-frame
+ B Frame (bi-predictive)
- Hands-on: Compare videos with B-frame
+ Summary
Temporal redundancy (inter prediction)
- Hands-on: See the motion vectors
Spatial redundancy (intra prediction)
- Hands-on: Check intra predictions
- How does a video codec work?
What? Why? How?
History
+ The birth of AV1
A generic codec
1st step - picture partitioning
+ Hands-on: Check partitions
2nd step - predictions
3rd step - transform
+ Hands-on: throwing away different coefficients
4th step - quantization
+ Hands-on: quantization
5th step - entropy coding
+ VLC coding
+ Arithmetic coding
+ Hands-on: CABAC vs CAVLC
6th step - bitstream format
+ H.264 bitstream
+ Hands-on: Inspect the H.264 bitstream
Review
How does H.265 achieve a better compression ratio than H.264?
- Online streaming
General architecture
Progressive download and adaptive streaming
Content protection
- How to use jupyter
- Conferences
- References
Basic terminology
An image can be thought of as a 2D matrix. If we think about colors, we can extrapolate this idea seeing this image as a 3D matrix where the additional dimensions aTop issues
#93File size - YCbCr 422 vs YCbCr 42011 comments · 2020-04-28#57Docker Req'd?7 comments · 2017-10-10#137Question regarding "2nd Step - predictions"4 comments · 2023-08-17#83On the front page, I do not understand explanation of 4:2:2 etc4 comments · 2019-06-25#71Doubts on function of cones and rods3 comments · 2018-08-08#35What does this sentence mean?Thanks2 comments · 2017-06-11#29Add info about BT.709 recommendation2 comments · 2017-06-06#22Minor2 comments · 2017-06-03