1 OV5640 Specification
5 megapixel (2592x1944) camera
Pixel Size: 1.4 x 1.4 μm
Optical size: 1/4"
Max video resolution: 2592x1944@15fps
Max frame rate: QVGA@120fps
Maximum exposure times (seconds): 0.97
Selectable video resolutions: 2592x1944@15fps 1080p@30fps, 720p@60fps, 480p@90fps
automatic image control functions: automatic exposure control (AEC), automatic white balance (AWB), automatic band filter (ABF), automatic 50/60 Hz luminance detection, and automatic black level calibration (ABLC)
support for output formats: RAW RGB, RGB565/555/444, CCIR656, YUV422/420, YCbCr422, and compression
2 Setup
2.1 Enable OV5640 in Linux Kernel Configuration
1 Enter the kernel configuration by running the following command in the top directory of project.
...
3 Select “OmniVision OV5640 sensor support” and press <Y>. Then save and exit.
2.2 Modify Device-tree Source
Device-tree source files of SP7350 are located in linux/kernel/arch/arm64/boot/dts/sunplus/.
...
Modify device tree source file to define OV5640 source for driver
2.2.1 Using SP7350 MIPI/CSI-RX4
Open OV5640_IN4 macro to add OV5640 node and link mipicsirx4.
2.2.2 Using SP7350 Other MIPI/CSI-RX
Define OV5640 node in i2c node:
...
| Code Block |
|---|
mipicsirx: csirx@f8005480 {
port@0 {
reg = <0>;
/* MIPI CSI-2 bus endpoint */
csi1_ep1: endpoint {
remote-endpoint = <&ov5640_out>;
bus-type = <4>;
clock-lanes = <0>;
data-lanes = <1 2>;
};
}; |
2.3 Compile and Burn
2.4 Connect Sensor Module
Using C3V-W board MIPI/CSI-RX4, as follows：
...
2.5 Check
After the burning is completed, start the board. The system should print the following information through the serial port.
...
| Code Block |
|---|
root@dbv3:~# ls /dev/video0 /dev/video0 |
3 Test
3.1 v4l2-ctl Command
This command is used to control V4L2 devices from the command line. It allows you to query device capabilities, set device parameters, and capture video and still image.
...
| Code Block |
|---|
root@dbv3:~# v4l2-ctl --all --device /dev/video0
Driver Info:
Driver name : sp_vin
Card type : SP_VIN
Bus info : platform:f8005980.video
Driver version : 5.10.201
Capabilities : 0xa5200001
Video Capture
Read/Write
Streaming
Extended Pix Format
Device Capabilities
Device Caps : 0x25200001
Video Capture
Read/Write
Streaming
Extended Pix Format
Media Driver Info:
Driver name : sp_vin
Model : sunplus,sp7350-vin
Serial :
Bus info : platform:f8005980.video
Media version : 5.10.201
Hardware revision: 0x00000000 (0)
Driver version : 5.10.201
Entity Info:
ID : 15
Name : VIN8 output
Type : V4L2 I/O
Pad : 0: Sink
Priority: 2
Video input : 0 (VIN8 output: ok)
Format Video Capture:
Width/Height : 1280/720
Pixel Format : 'UYVY' (UYVY 4:2:2)
Field : None
Bytes per Line : 2560
Size Image : 1843200
Colorspace : sRGB
Transfer Function : sRGB
YCbCr/HSV Encoding: ITU-R 601
Quantization : Full Range
Flags :
User Controls
contrast 0x00980901 (int) : min=0 max=255 step=1 default=0 value=0 flags=slider
saturation 0x00980902 (int) : min=0 max=255 step=1 default=64 value=64 flags=slider
hue 0x00980903 (int) : min=0 max=359 step=1 default=0 value=0 flags=slider
white_balance_automatic 0x0098090c (bool) : default=1 value=1 flags=update
red_balance 0x0098090e (int) : min=0 max=4095 step=1 default=0 value=0 flags=inactive, slider
blue_balance 0x0098090f (int) : min=0 max=4095 step=1 default=0 value=0 flags=inactive, slider
exposure 0x00980911 (int) : min=0 max=1276 step=1 default=560 value=0 flags=inactive, volatile
gain_automatic 0x00980912 (bool) : default=1 value=1 flags=update
horizontal_flip 0x00980914 (bool) : default=0 value=0
vertical_flip 0x00980915 (bool) : default=0 value=0
power_line_frequency 0x00980918 (menu) : min=0 max=3 default=1 value=1
alpha_component 0x00980929 (int) : min=0 max=255 step=1 default=255 value=255
Camera Controls
auto_exposure 0x009a0901 (menu) : min=0 max=1 default=0 value=0 flags=update
focus_automatic_continuous 0x009a090c (bool) : default=0 value=1
Image Source Controls
vertical_blanking 0x009e0901 (int) : min=24 max=2655 step=1 default=560 value=560
horizontal_blanking 0x009e0902 (int) : min=320 max=320 step=1 default=320 value=320 flags=read-only
analogue_gain 0x009e0903 (int) : min=0 max=1023 step=1 default=0 value=0 flags=inactive, volatile
Image Processing Controls
link_frequency 0x009f0901 (intmenu): min=0 max=22 default=13 value=18 flags=read-only
pixel_rate 0x009f0902 (int64) : min=48000000 max=168000000 step=1 default=48000000 value=62000000 flags=read-only
test_pattern 0x009f0903 (menu) : min=0 max=4 default=0 value=0 |
3.2 Capture Image
3.2.1 Config Video Device
Use v4l2-ctl -d /dev/video0 --set-ctrl params=value setting device controls.
...
| Code Block |
|---|
v4l2-ctl -d /dev/video0 --set-ctrl focus_automatic_continuous=1 |
3.2.2 Capture
Use v4l2-ctl --list-formats-ext --device /dev/video0 querying device video format.
...
After executing the capture command, the stream data is written to /home/root/OV5640_UYVY_720P.yuv.
3.3 Display Image Raw Data
3.3.1 Download and Install Raw Image Viewer
Download raw image viewer from PixelViewer | Carina Studio. And PixelViewer is an open source project based cross-platform image which viewer supports reading raw Luminance/YUV/RGB/ARGB/Bayer pixels data from file and rendering it.
3.3.2 Use PixelViewer to Open Image
...
Config render params by 3.2.2 v4l2-ctl capture command
4 Performance testing of OV5640 on SP7350
rootfs：Yocto
tools：v4l2-ctl
...
test frame count: 300 Frame
4.1 Do not write camera data to rootfs
Test command:
| Code Block |
|---|
nohup v4l2-ctl -d /dev/video0 --set-fmt-video=width=1280,height=720,pixelformat=UYVY --set-parm=60 --stream-mmap=10 --stream-count=300 > my_script.log 2>&1 & top -d 0.5 | grep "v4l2-ctl" |
...
Frame size/Frame rate/Format | bitrate | CPU loading | memory | FPS | drop frame |
1920*1080@30FPS UYVY | 124.416MB/s | 1.9% | 0.0 | 30 | NO |
1920*1080@15FPS UYVY | 62.208MB/s | 1.9% | 0.0 | 15 | NO |
1280*720@60FPS UYVY | 110.592MB/s | 2.0% | 0.0 | 60 | NO |
1280*720@30FPS UYVY | 55.296MB/s | 1.9% | 0.0 | 30 | NO |
1280*720@15FPS UYVY | 27.648MB/s | 2.0% | 0.0 | 15 | NO |
640*480@60FPS UYVY | 36.864MB/s | 1.9% | 0.0 | 60 | NO |
640*480@30FPS UYVY | 18.432MB/s | 1.9% | 0.0 | 30 | NO |
640*480@15FPS UYVY | 9.216MB/s | 1.9% | 0.0 | 15 | NO |
4.2 Write camera data to rootfs
Test command:
| Code Block |
|---|
echo 1 > /sys/module/videobuf2_dma_contig/parameters/remap nohup v4l2-ctl -d /dev/video0 --set-fmt-video=width=1920,height=1080,pixelformat=UYVY --set-parm=30 --stream-mmap=10 --stream-count=300 --stream-to=/tmp/OV5640_UYVY_1080P_30FPS.yuv > my_script.log 2>&1 & top -d 0.5 | grep "v4l2-ctl" |
...