D3 Intelligent Camera Platform
Total Page:16
File Type:pdf, Size:1020Kb
Easy! D3 Intelligent Camera Platform Intelligent Cameras | Framegrabbers | Made in Germany WWW.STEMMER-IMAGING.COM Ease of Use The D3 Intelligent Camera New Intelligent Camera Platform The D3 is the latest, most advanced intelligent camera generation by VRmagic. The D3 platform was designed with usability, flexibility, and performance in mind. Excellent Usability The D3 platform runs a wide range of embedded software and libraries, such as Common Vision Blox Embedded, EyeVision, or HALCON Embedded. This way you can easily take advantage of the latest, state- of-the-art machine vision algorithms. Additionally, the new Mono compatible .NET interface makes applica- tion development with the VRmagic SDK much easier. Software development for the D3 intelligent camera platform – that’s ease of use. Built-In Flexibility The D3‘s embedded system provides users with a high level of flexibility by supporting a multitude of interfaces, such as Ethernet, USB, and GPIOs. Choose either a standard OEM interface board for compact systems integration or an interface evaluation board for convenient test and development. A version for industrial environments is also available. Depending on the business case, a custom interface board may also be a viable option. High Performance The D3 intelligent camera platform features a 1 GHz ARM® Cortex™-A8 Core with floating point unit (FPU) running Linux. A 700 MHz C674x™ DSP with FPU is at your disposal for computationally intensive algo- The D3 Industrial Camera has a rigid aluminum rithms. 2 GB DDR3-800 RAM with 6103 MB/s band- body and industry-standard interfaces such as width and a Gigabit Ethernet interface ensure rapid 24 V power supply and Power over Ethernet. processing and efficient transmission of image data. WWW.STEMMER-IMAGING.COM Comparison of the D2 and D3 Intelligent Camera Platform Intelligent Camera Platform D2 D3 Operating System Debian Linux Ubuntu Linux ARM Core and Frequency 300 MHz ARM9® 1 GHz ARM® Cortex™-A8 DSP Core and Frequency 600 MHz C64x™ 700 MHz C674x™ ARM and DSP Instruction Type Fixed point Floating point (FPU) and fixed point Cortex-A8 NEON™ Architecture – z RAM 256 MB DDR2/333 2 GB DDR3/800 Memory Bus Width, Bandwidth 32 bit, 1332 MB/s 2 x 32 bit, 6103 MB/s Flash Memory 512 MB 32 GB Ethernet Fast Ethernet (100 Mbit/s) Gigabit Ethernet (1 Gbit/s) Typical Ethernet Bandwidth 10 MB/s 40 MB/s SD Card – z USB Host / Device z / – z / z GPIOs up to 13 up to 44 RS232 / RS485 z / – z / z SATA – z CAN Bus – z JTAG z z Real-time Clock (RTC) – z Maximum Video Resolution 720p 1080p S-Video z z RGB888 z z HDMI { z Audio in/out { z Wake on LAN – z Power over Ethernet – z I2C – z Watchdog – z 24 V operation – z WWW.STEMMER-IMAGING.COM D3 Dual-Core Programming Intelligent Camera with Ubuntu Linux Operating System Image Processing on the Dual-Core Chip (ARMv7, Thumb2) and its FPU (NEON). Additional compo- The substantial processing power of the ARM processor nents, such as web servers of NFS servers, can be easily is used to run the Linux OS as well as image processing installed using the Linux package repository. USB devices, tasks. The DSP is completely available for image process- such as Wi-Fi dongles, hard disks, or keyboards can also ing. Both processors have a floating-point unit (FPU). be used with the camera. Hardware codecs as well as various commercial codecs and open source algorithms are available for the DSP, for Convenient Application Programming example the TI IMGLIB for basic image processing tasks. With a standard Ubuntu Linux operating system and full A free codec by VRmagic converts image data into various access to the ARM/DSP core, the D3 provides a conve- target formats, for example RGB565 or YUV. nient platform for programming applications with C/C++ or other programming languages. ARM software can be Extendable Linux Operating System developed in standard integrated development environ- The D3 platform runs a customized Linux kernel. The ments under Ubuntu Linux. After cross-compiling, the root file system is taken from Ubuntu 12.04 LTS, which software can be executed on the camera natively supports the instruction set of the Cortex-A8 Image Sensors Dual-Core Chip DDR3 RAM Master Slave 400 MHz (DDR3-800) 2 GB ARM DSPDS C674x 2 x 32 Bit Cortex-A88 System Interconnection 64 Bit 1 GHz 700 MHz Linux Interrupt Request Codecs Ethernet USB 2.0 Video Audio GPIO ... 1 Gbit/S The D3 intelligent camera architecture WWW.STEMMER-IMAGING.COM Applications developed on a x86 PC need to be cross- compiled for the D3 platform. Code for the ARM core can ARM Core DSP Core be cross-compiled using the ARM EABI toolchain. Code Control Linux Codecs for the DSP needs to be cross-compiled using the TI DSP compiler. Both compilers and the required tools are avail- able free of charge. Data Data Data Data Mono™-Compatible .NET Framework Linux Shared DSP Thanks to the Mono compatible .NET interface available Memory Memory Memory on all VRmagic intelligent camera platforms, applications CMEM development has now become easier. Mono is an open source implementation of Microsoft’s .NET Framework RAM designed to facilitate cross-platform applications. Architecture of the dual-core chip: all memory sections Updates via Ethernet can be resized according to your requirements. Updates of your camera applications and the camera firmware are possible via Ethernet. This saves time and money, especially if you cannot access the cameras di- rectly in the field. Easy Debugging Simple Data Transfer from and to the D3 • Applications can be developed, tested, and debugged • Create a network share (NFS or Samba/Windows) on on a PC and then transferred to the camera (ARM). your PC and mount it on the camera – or vice versa. • Remote debugging via Ethernet is possible, for ex- •Transfer data via USB flash drive or SD card. ample with Eclipse and gdbserver (ARM). •Use the secure copy (scp) command under Linux. • TI TraceUtil enables printf-debugging of DSP code. •A JTAG port connects real-time emulators (XDS510 or XDS560) and enables DSP debugging with CCS. WWW.STEMMER-IMAGING.COM Machine Vision SDK and Libraries Software Development for the D3 – It Doesn’t Get Much Easier Start Developing in 15 Minutes VRmagic SDK The VRmagic Easy Installer automatically sets up a com- The included VRmagic SDK contains an application pro- plete development environment with all required applica- gramming interface (API), which offers full control over the tions and toolchain elements. After only a few minutes, camera and works with all VRmagic cameras and frame you can compile demos and start developing applications grabbers. This makes it possible to exchange devices with- for the D3 intelligent camera platform. out additional programming costs. The SDK also contains a VRmagic codec for the ARM and DSP, which converts CamLab Application image data into different target formats, for example RGB32, YUV, or GRAY. The CamLab application is part of the VRmagic SDK. It offers user full control over all sensor parameters via a graphical user interface. Tool tips indicate the respective Programming Libraries API property for each parameter. The D3’s floating point unit (FPU) allows a wide range of state-of-the-art machine vision libraries and toolkits to run Free Demos with Source Codes on either the ARM or DSP cores. This lets you take advan- tage of numerous image processing algorithms. For exx- The following demos and sources are included in the SDK: ample, develop a HALCON script on your PC and execute Bayer/Grey to RGB565 converter on ARM or DSP, demo it directly on the D3 with HALCON Embedded – develop- for integration of customer specific DSP codecs (JPEG, ment for intelligent cameras has never been easier. Sobel, and more), viewer for S-Video output (DirectFB and SDL), control of general purpose I/Os. x86 Host ARM Target Source Binary Code ARM GCC ARM Development process for the ARM: code Header (.h) Runtime is developed on an x86 PC using specific Dev Libs ARM development libraries. After cross-compiling Libs ARM Versions must match the code, the binary can run on the D3’s ARM using the corresponding runtime libraries. WWW.STEMMER-IMAGING.COM Libraries and Toolkits for ARM and DSP Programming Libraries for ARM Programming Libraries for DSP The following libraries and applications create code or script Programming for the DSP requires advanced program- that executes on the ARM processor of the D3. These ming skills, however, making use of it boosts the speed of tools cover a broad spectrum of project requirements, your applications considerably. The following libraries take from simple to complex, and offer solutions for the full advantage of the DSP on the D3. range of applications in the field of machine vision. • TI Codecs: Audio and video codecs optimized for the • Common Vision Blox Embedded: A fast and DSP, for example H.264, MPEG-2, or JPEG. powerful programming library for vision applications. • TI IMGLIB: A collection of more than 70 building block • EyeVision: Software with a graphical user interface for kernels optimized for the DSP that can be used for intuitive development of image processing applications. image and video processing applications. • GStreamer: Multimedia framework for playback, • TI VLIB: Video analytics and vision library for video streaming and processing of video and audio. surveillance, automotive vision, consumer electronics, • HALCON Embedded: A leading machine vision library and many more. with more than 1800 operators. • VM_LIB: VRmagic machine vision library for object • OpenCV: An open source computer vision and recognition, blob segmentation, barcode readers, and machine learning software library. many more.