How a Security Camera Earns UL Approval

Feb 27

Written by: Lou Chavez
2/27/2014 2:50 PM  RssIcon

In mid-January, IC Realtime, a manufacturer of visual surveillance solutions for the residential, commercial, military and government sectors, issued a press release stating the company’s support for UL’s 2802 Performance Testing Standard for Camera Image Quality. In the works for more than two years—and released last September—the new standard defines a method to assess video image quality through a series of performance-based tests that are conducted on production digital cameras.

To help create the UL 2802 standard, IC Realtime worked closely with UL, including submitting its B-2000 2-MegaPixel IP Bullet camera to use as part of the testing development process. According to UL, the camera achieved high scores on many of the performance tests, with a certification and the results expected to be published shortly.

Residential Systems was curious about this process, and because it is new, we thought that UL could provide an explanation about the steps that a visual surveillance product would have to go through to become UL certified. Thanks to UL and IC Realtime’s PR agent Paul Muto, we were able to receive the following description of the process from Lou Chavez, UL, principal engineer, security. Here’s what Mr. Chavez told us, starting with a little science:

There are basic similarities between the operating system of a digital video camera and the human eye. Both are sensitive to light and both process light rays to interpret and view images. Image quality is generally a factor of interpreting light, lens, and processing abilities. We form images through the optic systems of our eyes and our brains process interpreted light. A digital video camera operates similarly in that electronic circuits and semiconductors mimic the brain’s functions. Challenging factors, such as light intensity, distance from an object, quick movement, glare, etc. affect our ability to discern quality images. These same factors also affect the output of a digital video camera.

In an effort to provide objective test methods to assess the image quality of a camera, UL has published a new standard UL 2802, Standard for Performance Testing of Camera Image Quality. This new standard can be used as a tool to assist in determining appropriate video cameras for specific use cases based on the camera’s performance under challenging test conditions.

Program Overview

The new UL 2802 certification program objectively assesses the image quality of individual digital video camera models. The standard includes methods for assessing image quality using a series of nine performance-based tests that are conducted on production camera samples. The nine tests result in performance scores for the following camera parameters: image resolution, distortion, relative illumination, dynamic range, maximum frame rate, grey level, sensitivity, bad pixel, and veiling glare. Each test results in achieving a score in a range of 0-100 with zero being the minimum and 100 the maximum. Additionally the individual score are conveyed in standard photographic units such as line pair per picture height (LP/PH) for resolution, lux for dynamic range, frames per second (FPS) for maximum frame rate, percent of bad pixels for bad pixel tests, etc.

The testing process begins with the manufacturer of the video camera determining what device will be subjected to the test program. Typically a manufacturer will consider the multiple configurations of devices and different combination of component and software that are available in a product line. The video cameras that are selected and tested are specific to that configuration and combination components tested. Different combinations of images sensors, image processors and related software, operating system, lens, camera housing/body and the like generally affect the overall image quality of the camera.

During the test program, the manufacture and UL collaborate to ensure that the video camera settings are optimized and the test results reflect the camera’s best abilities. The process typically involves fine-tuning resolution properties, optimizing exposure time and gain during each test, enabling or disabling default features, etc., to optimize camera performance and achieve the most favorable test results. The process of optimizing settings is no different from what is typically done during deployment of a video system.

Below are a few unique features of the UL test program that offers a new approach from traditional test methods. All test and test apparatus are comprehensively detailed in the published standard.

Electronic Test Targets

Traditional methods for testing video camera image quality involve the use of standardized, published test charts for resolution and grey level tests. UL’s program implements a different approach that incorporates calibrated light sources of known luminous levels, frequency, spatial orientation, and grey levels. Each of these factors contributes to a video camera’s ability to capture record and store an image relative to the actual object. The electronic test targets that UL uses for its test procedures eliminates some of the known potential inconsistencies associated with the use of printed test charts under very specific lighting conditions and lighting angles, which can be difficult to control. The electronic test targets are calibrated and measured during each test program, with all of the data and settings recorded for each test.

The UL2802 test lab 

Circular Edge Analysis

Image resolution is a critical test in that it is a measure of how closely the digital image captured by the camera matches the actual subject. Digital images are made up of pixels, which are stored in the relative dimension of the actual image. An accurate resolution measurement requires an evaluation of a camera’s lens and sensors, as well as its imaging software, and is often presented as line pairs per picture height or LP/PH. The metric is a measure of how many distinguishable alternating colors can be represented in an image.

Modulation transfer function (MTF) is a technique used to quantify image resolution in more complex images. MTF corresponds to the spatial frequency of image line pairs per picture height (LP/PH), that is, the ability to represent the “real” object by taking the light intensity and plotting it along imaginary lines traversing the representation of the object.

Other mechanisms for measuring distortion are detailed in ISO 12233 (photography—Electronic still-picture cameras—Resolution measurements), and in the standard mobile imaging architecture (SMIA) forum specification. UL 2802 uses the same spatial frequency response (SFR) method for resolution. The primary difference is that UL 2802 uses a circular edge analysis method (see “The Circular-edge Spatial Frequency Response Test,” by Richard Baer, Agilent Laboratories, 2002) versus a more traditional slanted-edge method to detect the transition edge of a known image. Additional benefits of the circular edge methods include an accurate method of averaging SFR from all circular directions versus multiple (horizontal and vertical) measurements using slanted-edge techniques. An added benefit is that consistency of measurements is improved using circular-edge techniques, as the slanted-edge SFR assumes that the transition edge of the printed resolution chart is a straight line and factors such as lens distortion can deviate the edge from a straight line, resulting in measurement inaccuracies. The benefits of using the electronic test targets and circular edge techniques for measuring SFR are cumulative in producing accurate test data.

Circular edge vs. slanted edge. Signal around edge transition and the derivative of the edge transition signal

Performance Score

Each test results in an interpolated performance score that is calculated from traditional photographic units. UL reports the scores in two usable units of measure. For simple comparisons the UL units scores of 0-100 makes comparing one camera’s test score to another’s relatively simple without being a camera expert. For those that are more technically involved, the photographic unit scores may be more meaningful in comparing test results. Either way, the performance scores reflect the image quality achieved for each test parameter.

Performance scores will help a video system integrator make an accurate decision of what camera would be best for their particular use case based on known conditions. For example, if I need a camera that will perform well under low lighting condition and with fast moving objects, I may want to target camera parameters that specifically relate to those conditions such as sensitivity, dynamic range and frame rate.

No single number or criteria can provide a reasonably accurate and objective evaluation of a given camera therefore it is normal that an integrator will need to consider multiple parameters based on the camera’s use case application. UL 2802 is a standard that provides objective test results based on the cameras tested image quality.

Location: Blogs Parent Separator RES Blogs

Your name:
Gravatar Preview
Your email:
(Optional) Email used only to show Gravatar.
Your website:
Security Code
Enter the code shown above in the box below
Add Comment   Cancel 


<July 2015>
July 2015 (15)
June 2015 (16)
May 2015 (10)
April 2015 (15)
March 2015 (14)
February 2015 (11)
January 2015 (16)
December 2014 (12)
November 2014 (10)
October 2014 (19)
September 2014 (21)
August 2014 (13)
July 2014 (15)
June 2014 (12)
May 2014 (12)
April 2014 (14)
March 2014 (15)
February 2014 (14)
January 2014 (24)
December 2013 (11)
November 2013 (12)
October 2013 (15)
September 2013 (19)
August 2013 (18)
July 2013 (19)
June 2013 (12)
May 2013 (18)
April 2013 (17)
March 2013 (13)
February 2013 (16)
January 2013 (26)
December 2012 (9)
November 2012 (11)
October 2012 (16)
September 2012 (11)
August 2012 (15)
July 2012 (13)
June 2012 (8)
May 2012 (9)
April 2012 (10)
March 2012 (7)
February 2012 (11)
January 2012 (14)
December 2011 (5)
November 2011 (12)
October 2011 (8)
September 2011 (4)
August 2011 (7)
July 2011 (11)
June 2011 (12)
May 2011 (8)
April 2011 (6)
March 2011 (9)
February 2011 (10)
January 2011 (9)
December 2010 (4)
November 2010 (7)
October 2010 (4)
September 2010 (9)
August 2010 (7)
July 2010 (8)
June 2010 (12)
May 2010 (6)
April 2010 (8)
March 2010 (10)
February 2010 (11)
January 2010 (1)
December 2009 (6)
November 2009 (6)
October 2009 (11)
September 2009 (6)
August 2009 (4)
July 2009 (4)
June 2009 (5)
May 2009 (7)
April 2009 (9)
March 2009 (7)
February 2009 (9)
January 2009 (8)
December 2008 (9)
November 2008 (6)
October 2008 (7)
September 2008 (7)
August 2008 (3)
July 2008 (5)
May 2008 (1)
April 2008 (4)
March 2008 (3)
February 2008 (5)
January 2008 (2)
November 2007 (1)
October 2007 (4)
September 2007 (2)
August 2007 (3)
July 2007 (4)
June 2007 (6)
May 2007 (6)
April 2007 (4)
March 2007 (4)


Skip Navigation Links.
Skip Navigation Links.

Core Brands Helps Dealers Combat Internet Sales
Read More»
By John Sciacca

Function is Taking a Whole New Form in the Connected Home
Read More»
By Rich Bira

5 Ways the Cheapest is More Expensive than Buying Power
Read More»
By Heather L. Sidorowicz

Maintaining the Chain of Custody on Your Jobs
Read More»
By Todd Anthony Puma

Surviving Manufacturer Breakups
Read More»
By John Sciacca

Slide Show
Slide Show

Audio Video Systems, Plainview, NY
Slide Show

Station Earth, Fergus, Ontario, Canada
Slide Show

Audio Command Systems, Westbury, NY
Slide Show

Evolution Video and Sound, Calgary, Alberta, Canada
Finest Rakhi Gift Item for Brothers - Make Your Nice Brothers Feel Special on This Raksha Bandhan Fe
Read More»
buy runescape account no confirmation pay by paypal on rsorder
Read More»
Nice time to gain 8% discount gold swtor on swtor2credits for Patch 3.3a
Read More»
Which gender in FIFA 16,Men or Women?
Read More»
How to prevent cheapest rs3 gold with best service
Read More»
Re: Expose New Technology Demonstration FIFA 16 coins
Read More»
5 Tips On Starting Your World Of Warcraft Adventures
Read More»
possibly be one of many golden top by cheap fut 16 coins
Read More»
Packing Commodities for a Painless House Moving
Read More»
Packing Commodities for a Painless House Moving
Read More»