Image Rectification

Image rectification is related to the multi-camera or stereo camera setting. When you have images from two camera, you need image rectification. Let's see what is this and how it's done.

Image rectification is a transformation process used to project images onto a common image plane.

Why do we need rectification and What does it do

Finding point matches in stereo vision is restricted by epipolar geometry: Each pixel's match in another image can only be found on a line called the epipolar line. If two images are coplanar, i.e. they were taken such that the right camera is only offset horizontally compared to the left camera (not being moved towards the object or rotated), then each pixel's epipolar line is horizontal and at the same vertical position as that pixel. However, in general settings (the camera did move towards the object or rotate) the epipolar lines are slanted. Image rectification warps both images such that they appear as if they have been taken with only a horizontal displacement and as a consequence all epipolar lines are horizontal, which slightly simplifies the stereo matching process.

Image Rectification Diagram

Algorithm

Last updated