How to measure the latency of a WebCam with OpenCV

In this quick tutorial, you will learn how to measure the latency of your webcam to make the assessment whether it is capable to handle image capturing task with a higher real-time demand compared to doing a still image capturing.

Picture a beverage producing line filling bottles rapidly along a conveyor. A camera is deployed to validate the quality of each bottle like the volume of liquid and shape, every defected product must be sorted out. The real-time requirement for the image capturing is critical since any elongated latency could result in a different bottle being diverted in the wrong path.

Vision-based inspection

Where the latency comes from?

It might seem simple to read a frame from your webcam by calling camera.read() in Python cv2 library, however, lots of stuff happens behind the scene which could introduce the unpredictable latency not desirable the in real-time application.

Camera pipeline

As seen from the above diagram, the captured image traveled a “long” way to reach your computer then it can be decoded and displayed on the screen.

Measure the latency

To measure the latency between when the actual image is captured and displayed on your screen, we are going to whip up a simple Python script to read the image from the camera as fast as we can and flip the display color as soon as the previous color change is detected at the end of the pipeline.

Measure latency

The previous sequence demonstrates that the latency might be longer than several frames.

Here is the logic diagram for this experiment.

Flowchart

The complete script shown below.

By pointing your camera at the popup window and watch the color flips between black and white several times per second which reflects the latency.

You can point your camera lens as close to the screen as possible, it doesn’t need to have a clear focus, only the average intensity is necessary to make the color flip.

I have tested it on my Logitech C930e USB webcam and here is the result.

Demo

Two image resolutions are tested, and you can see the lower resolution produces slightly lower latency.

Latency distribution 640 x 480Latency distribution 1280 x 720

The value is measured in milliseconds, with the average around 200ms. Given a conveyor traveling at a constant speed of 1m/s, the bottle has already moved 20cm away.

What is the solution?

If your application demands more predictive and lower latency image capturing, one simple and effective solution is to upgrade your camera to an industrial camera with external trigger signal where a photo eye sensor or digital controlled IO can be hooked up.

External trigger

In this case, an image can be captured at a more predictive timestamp either triggered by something blocking the photo eye sensor or a real-time signal from the computer.

Share on Twitter Share on Facebook

Originally published at www.dlology.com.

How to measure the latency of a WebCam with OpenCV was originally published in Hacker Noon on Medium, where people are continuing the conversation by highlighting and responding to this story.