Using Video Camera IMX219
In this guide, we will provide a step-by-step walkthrough on utilizing the OV5647 video camera on SP7350 platforms.
Table of Contents
1. IMX219 Specification
The Raspberry Pi Camera Module 2 is used here. The pin definition of the SP7350 EV board’s MIPI-CSI RX connectors is compatible with this camera. The camera mounts directly to our SP7350 EV board.
Back-illuminated CMOS image sensor Exmor RTM
2-wire serial communication circuit on chip
CSI2 serial data output (selection of 4lane/2lane)
Timing generator, H and V driver circuits on chip
CDS/PGA on chip
10-bit A/D converter on chip
Automatic optical black (OB) clamp circuit on chip
PLL on chip (rectangular wave)
High sensitivity, low dark current, no smear
Excellent anti-blooming characteristics
Variable-speed shutter function (1 H units)
R, G, B primary color pigment mosaic filters on chip
Max. 30 frame/s in all-pixel scan mode
Pixel rate: 280 [Mpixel/s] (All-pixels mode)
180 frame/s @720p with 2x2 analog (special) binning, 60 frame/s @1080p with V-crop
Data rate: Max. 755 Mbps/lane(@4lane), 912Mbps/Lane(@2lane)
2. Setup a SP7350 Platform
The Raspberry Pi Camera Module 2 is used here. The v2 Camera Module has a Sony IMX219 8-megapixel sensor. The pin definition of the SP7350 EV board’s MIPI-CSI RX connectors is compatible with this module. The module mounts directly to our SP7350 EV board.
2.1. Enable IMX219 Driver in Linux Kernel Configuration
Please follow the steps below.
Step 1: Enter kernel configuration
# cd ./linux/kernel
# make menuconfig
Step 2: Selects sub-menus: Device Drivers > Multimedia support > Media ancillary drivers > Camera sensor devices
Step 3: Select “Sony IMX219 sensor support” and press <Y>. And then save and exit.
2.2. Modify Device-tree Source
Device-tree source files of SP7350 are located in linux/kernel/arch/arm64/boot/dts/sunplus/. Here lists all files for SP7350 boards:
Boards | Device-tree source files |
C3V-W EVB | sp7350-ev.dts |
Modify device tree source file to define IMX219 source for driver. We had added some compiler switches for IMX219 camera in the beginning of sp7350-ev.dts. These compiler switches are turned off by default. They are shown below. You can turn it on based on your usage. For example, if an IMX219 camera is connected to MIPI-CSI RX4 port, the compiler switch IMX219_IN4 should be turned on.
//#define IMX219_IN0
//#define IMX219_IN1
//#define IMX219_IN2
//#define IMX219_IN3
//#define IMX219_IN4
//#define IMX219_IN5
2.3. Compile and Burn
Downloading and Compiling Code | 7. Build code
2.4. Connect Sensor Module
A Raspberry Pi Camera Module 2 is connected to MIPI/CSI-RX4 port on C3V-W board. It’s shown below.
2.5. Check
After the burning is completed, start the board. The probing logs for MIPI-CSI RX and VIN drivers can be found. It’s as follows. The video device video0 has been successfully registered.
[ 1.333642] sp-csi2 f8005480.csirx: 2 lanes found
[ 1.338482] sp-vin f8005980.video: assigned reserved memory node mipicsirx@4f600000
[ 1.345864] imx219 0-0010: Consider updating driver imx219 to match on endpoints
[ 1.353444] sp-vin f8005980.video: Device VIN8 registered as video0
[ 1.359496] sp-vin f8005980.video: SP VIN driver probed
After the system startup is completed, the video device video0 can be found.
3. Test
The v4l2-ctl application is used here. v4l2-ctl is a command line tool for controlling video devices on Linux systems.
3.1. Display Video Device Information
Running ‘v4l2-ctl –all-device‘ command displays all information about the video device video0. The results are as follows.
3.2. List Supported Video Format and Resolution
Running ‘v4l2-ctl –list-format-ext’ command lists the supported video format and resolution of the video device vidoe0. The results are as follows.
3.3. Configure Camera
Running ‘v4l2-ctl –get-ctrl’ gets the value of the controls. Running ‘v4l2-ctl –set-ctrl’ sets the value of the controls. The results are as follows.
3.4. Capture Image
Running following command capture a RAW8 picture. The pixel format RGGB means 8-bit Bayer RGRG/GBGB.
The following is the description of these parameters.
-d <device>: Set video device
--set-fmt-video=width=<width>,height=<height>,pixelformat=<format>: Set image format
--stream-mmap <count>: The number of buffers to allocate. The default is 3.
--stream-to <file>: The captured image is saved to this file.
--stream-count <count>: How many images to capture.
4. Display Image
The PixelViewer application is used here. PixelViewer is an open source project based cross-platform image viewer. You can download it from it’s website.
https://carinastudio.azurewebsites.net/PixelViewer/
Use PixelViewer to open the image file ‘imx219.raw’. Please follow the steps below to configure PixelViewer.
Step 1: Set ‘Format’ to Byer Pattern (8-bit)
Step 2: Set ’Bayer pattern’ to RGGB (2x2)
Step 3: Set ‘Dimension (px)’ to 1920 x 1080