View source for Department of Physical Sciences, Meru University of Science and Technology (MUST)

= About Meru&nbsp;University of Science and Technology&nbsp; =

[http://www.must.ac.ke Meru University of Science and Technology (MUST)] is a young public university in Meru County of the Republic of Kenya having been chartered in March 2013 established under The Universities Act of 2012. Prior to the University status, MUST was a constituent college of Jomo Kenyatta University of Agriculture and Technology (JKUAT).

= Meru University of Science and Technology&nbsp;Raspberry Pi Project =

[http://www.must.ac.ke/ Meru University of Science and Technology] has won a KENET Raspberry mini grant. This project is geared towards using a credit size gadget called Raspberry Pi (RPI) to teach computational units in the University. Raspberry Pi is a small device that was developed for teaching Computer Science in schools. Besides being portable, RPI is affordable and can be easily interfaced with the outside and used to perform automation projects.

As a pilot project, we will use RPI to teach three computational units on offer in the university during the April - August 2015 semester. We will also be conducting RPI related projects with an aim of publishing the results in referred journals. Students will be encouraged to develop their own projects using the pi and eventually showcase them within the University and other forums organized by RPI stake holders. Read more.

= Executive Summary =

The overall objective is&nbsp;to establish a Raspberry Pi teaching Laboratory in [http://www.must.ac.ke/ Meru University of Science and Technology (MUST)]. To achieve this a minimum of three computational units&nbsp;will be used to pilot the use of Raspberry Pi in teaching. Instructional manuals for teaching these units using Raspberry Pi will be developed and provided to the students. Student learning outcomes will be assessed throughout the semester. Publications regarding novel findings observed in the pilot stage will be presented in a refereed conference. Prior to the grant the university had&nbsp;already acquired a number of Raspberry Pi units and its accessories, developed exhibits of how Raspberry Pi can be used for teaching computer related courses in schools and showcased the projects in Commission for University Education exhibitions and ASK shows. Work is also in progress to develop a security surveillance system and an electronic device for early detection of crop diseases and other plant stress using Raspberry Pi. Upon successful completion of the pilot stage the university will upscale the use of Raspberry Pi in teaching more courses and launch a campaign for popularizing the adoption of Raspberry Pi in teaching computer related course in tertiary institutions of learning, secondary and primary schools within the environs of the university.

= Team Members =

*Mr. Daniel Maitethia Memeu - [http://www.must.ac.ke/site/ Department of Physical Sciences] - Lead Researcher
*Mr. Ronoh Wycliffe – [http://www.must.ac.ke/site/ Department of Information Technology & Computer Science] - Team member
*Mr. Abkul Orto - [http://www.must.ac.ke/site/ Department of Information Technology & Computer Science] - Team member
*Mr. Kinuthia Mugi – [http://www.must.ac.ke/site/ Department of Engineering] - Team member

= Methodology of Implementation and Assessment =

[[File:Setting up.jpg|thumb|center|600px|Setting up.jpg]]

The [http://www.must.ac.ke/site/ University ]currently has four teaching computer laboratories fully connected to the internet. One of these computer labs will be used to establish a Raspberry pi based teaching laboratory. Facilities such as computer monitors, USB keyboards and mice, internet connectivity and computer desks will be shared by the existing PCs and the Raspberry Pi modules to be acquired. A suitable mode of embedding the Raspberry Pi modules in the system unit will be adopted.

= Meru University RPI team first&nbsp;training =

On 2<sup>nd</sup> march 2015 RPI project team underwent their first training on getting started with RPI. The course focused on the key components of the Pi, downloading and load the Raspbian (Raspberry Pi official OS) to the SD card, powering up the Pi, configuring the pi OS, launching basic Pi applications for word processing, spread sheet, presentation and internet browsing. Members were also introduced to Python programming using the Python IDE which comes with Raspbian.

= Launch of RPI to Computing&nbsp;students =

[[File:Class.jpg|thumb|center|600px|Class.jpg]]

On 15<sup>th</sup> March&nbsp; 2015, the Meru University RPI team introduced RPI to computer science students. The students were explained the capabilities of the gadgets with demonstrations. In this meeting students resolved to organize themselves into groups to learn and develop more RPI applications.&nbsp;

= RPI related projects in progress =

<span style="font-size:larger;">RPI imaging module for crop stress monitoring</span>

<span style="font-size:larger;">[[File:Imaging.jpg|thumb|center|600px|Imaging.jpg]]</span>

We are developing a system for detecting crop stress in green houses using Raspberry imaging module. The module comprises of the RPI connected to RPI camera. An executable Linux script for periodically taking photos is written and incorporated to the Linux task scheduler (cron) so that upon reboot the pi starts taking photos after a specified period. The system is powered by solar. So far the imaging module is complete and has been tested in the green house and has been found to be working fine. We are now working on suitable algorithms for processing the images captured for stress. We intend to use python and open CV imaging processing library to accomplish the task.

= Raspberry pi Tutor project =

[http://www.must.ac.ke/site/ Meru University] Raspberry pi team is working on making Raspberry pi an ideal gadget for learning. The team is specifically developing educational applications for running on the Pi geared at making learning interesting right from early childhood. So far applications incorporating elementary English, mathematics, and technology lessons have been developed. Images, videos, and sound are used as learning aids in these subjects.&nbsp;<br/>The project has been showcased in various forums including the Commission of University exhibition held in Machakos in from 19th to 21st March, 2015, the NACOSTI exhibition week held in the University of Nairobi from 11th to 16th May 2015, and the Meru National ASK show held in Meru ASK show ground from 3rd to 6th June, 2015. members of the public were interested by the capabilities of the little device and agreed the Pi can make a great learning companion to the pupils and students as well as teachers.<br/>The team main agenda as pertaining this project is to advocate for the adoption of the Raspberry pi (RPI) as an alternative to desktop/laptops/tablets computers in learning of IT related courses.

The presentation was categorized as an exhibition, and apart from showcasing our amazing gadget, the team was also able to interact and learn where to improve and the many possible challenges that the project is likely to encounter in the near future.

'''PROJECT DESCRIPTION&nbsp;'''''(By developers: students from [http://www.must.ac.ke/site/ Meru University])''<br/>Target Audience: Class 1-4 students, Teachers<br/>Application: Teaching Aid, Student management<br/>Detailed Description:

[[File:Welcome.jpg|thumb|center|600px|Welcome.jpg]]<br/>“CHEESE” is an innovative program that is aimed at teaching young students different subjects in an immersive and well interactive manner.<br/>The Graphical user interface is developed in such a way to allow different students to log in so as to start the lesson<br/>The student is required to type in their name and the teachers name after which a log is kept.<br/>The teacher can then use the log to trace and make a follow up of which students were present for the class and also be able to access the student performance.<br/>The program also allows working in groups by allowing login of different group members. This data is very useful to the teacher for progress assessment and grading.<br/>From the login phase the student can choose from a range of different subject. Our personal favorite is Technology as a subsidiary of Science. In this subject the program present different logos and graphics and the students is supposed to recognize them and key in the correct answer. Points are awarded for correct answers.<br/>But thats not all.

<br/>Teachers also have the ability to upload their own images that they feel may be appropriate and defining the correct answers thereby further extending the capability of the program.<br/>This is because during the development of this program we not only have the students in mind but also the teachers who are supposed to be supervising the students.<br/>There is a total of six subjects that students can select from:

{| border="1" cellspacing="1" cellpadding="1" style="width: 500px;"
|-
! scope="col" | SUBJECT
! scope="col" | DESCRIPTION
|-
| Mathematics
| 
The subject has simple arithmetic questions that the student is tasked with finding the answers to, awarding points for each correct answer answered

|-
| 
English

| 
Aimed at the young children, this subject requires that the student identifies pictures and spells the correctly

|-
| 
Kiswahili

| 
Graphics is core to the subject with students being tasked with translating and spelling different pictures.

|-
| 
Christian Education

| 
Morals are an important lesson both to us and the society, which is why as part of our development in the project we designed simple stories some borrowed from famous tales to teach children different morals and life skills

|-
| 
Social Studies

| 
&lt;Under development&gt;

|-
| 
Music

| 
&lt;Under development&gt;

|-
| 
Art and Craft

| 
&lt;Under development&gt;

|-
| 
Technology

| 
In this subject the program present different logos and graphics and the students is supposed to recognize them and key in the correct answer. &nbsp;

|-
| <br/>
| 
'''NB: '''''For all of the above subjects, point are awarded for each correct answer''

|}

Developed by Mr. Michael Kamau and Steve Kisinga, both students from [http://www.must.ac.ke/site/ Meru University], we believe that the application has huge potential as a teaching aid as well as a good student management program that is user friendly.

[[File:About.jpg|thumb|center|600px|About.jpg]]

We also presented the same project at the Meru ASK show where we scooped various awards, among them being the best innovation stand. Major efforts are being carried at ensuring that the project succeeds, and a lot of dedication is being displayed by the team members

<span style="font-size:large;">'''RASPBERRY AS A TEACHING AID'''</span>

'''CIT 3102 – FUNDAMENTALS OF COMPUTER PROGRAMMING'''

'''[[File:IMG 20150702 092618.jpg|thumb|center|IMG 20150702 092618.jpg]]'''

The raspberry pi has been used in [http://www.must.ac.ke/site/ Meru University] as a teaching aid to teach among other units, Fundamentals of computer programming.

Students were introduced to the raspberry pi, what it is, it's capabilities and its advantages. As part of the lesson students were required to use the raspberry pi to access the internet and use various search engines to find out the technical specifications of the device.

Students were intoduced to programming basic programming and taught basic proramming skills. Geany was used as the IDE of choice to teach C programming. Ranging from displaying simple text on the terminal to the more complex programming skills of assigning variables and accepting input, the raspberry pi has offered a great deal in helping teach the unit.

[[File:Geany.png|thumb|center|600px|Geany.png]]

 ==

== '''Introduction Raspberry Pi and GPIO&nbsp;programming''' ==

Professor Simon Cox and his team at the University of&nbsp;Southampton connected 64 Raspberry Pi boards to build&nbsp;<br/>an experimental supercomputer, held together with Lego&nbsp;bricks.

The project was able to cut the cost of a supercomputer&nbsp;from millions of dollars to thousands or even hundreds.

Introduction<br/>System on a Chip

What does System on a Chip (SoC)mean?

A system on a chip (SoC) combines the required&nbsp;electronic circuits of various computer components onto&nbsp;<br/>a single, integrated chip (IC).&nbsp;

A SoC is a complete electronic substrate system that may&nbsp;contain analog, digital, mixed-signal or radio frequency&nbsp;<br/>functions.&nbsp;

Its components usually include a graphical processing &nbsp;unit (GPU), a central processing unit (CPU) that may be&nbsp;<br/>multi-core, and system memory (RAM).

Because a SoC includes both the hardware and software, &nbsp;it uses less power, has better performance, requires less&nbsp;<br/>space and is more reliable than multi-chip systems. Most&nbsp;system-on-chips today come inside mobile devices like&nbsp;<br/>smartphones and tablets.

A distinction between a microprocessor and a microcontroller should also be explained.

A microprocessor is an integrated circuit (IC) which has&nbsp;only the central processing unit (CPU) on it. Such as the&nbsp;<br/>Intel i7 CPU.

Microcontrollers have a CPU, memory, and other&nbsp;peripherals embedded on them.

A microcontroller can be programmed to perform certain&nbsp;functions.<br/>A very popular microcontroller is the Arduino Uno.<br/>The difference between a SoC and a microcontroller often times is defined by the amount of random access&nbsp;<br/>memory (RAM).<br/>A SoC is capable of running its own operating system.<br/><br/>System on a Chip

The SoC we will use today is the Raspberry Pi B+.

The heart of this credit card sized computer is the Broadcom BCM2835 chipset that contains an ARM CPU&nbsp;<br/>and a Videocore4 graphics processing unit.

The B+ has a 700 MhzCPU and 512 MB of RAM.<br/>Pi Assembly and Raspbian Install

We will now discuss how to assemble the components that make up the Raspberry Pi.<br/>You will need the following (should be on the bench):<br/>•Raspberry Pi B+ board<br/>•HDMI to DVI cable<br/>•Monitor or TV<br/>•Micro SD card<br/>•USB keyboard and mouse<br/>•Micro USB power supply

<br/>Pi Assembly and Raspbian Install

We will now bake (assemble) the Pi!

Once you have it put together, power it on.

You should see the New Out Of Box Software (NOOBS) &nbsp;operating system installer.&nbsp;

Select the Raspbian [RECOMMENDED] option, change the &nbsp;language to English (US), change the keyboard to US, and&nbsp;<br/>click install.

While the OS is installing we will discuss some electronics &nbsp;information.

<br/>Voltage, Current, and Resistance

When a potential difference exists between two charged bodies that are connected by a conductor, electrons flow&nbsp;<br/>in the conductor. This flow is from the negatively charged&nbsp;body to the positively charged body.

The voltage does not flow, only the charge. Voltage&nbsp;supplies the “push” or “pressure”.

<br/>Plumbing Analogy

It is difficult to keep straight the concepts of&nbsp;voltage, current, charge, resistance, etc., but for&nbsp;<br/>electrical circuits there is a helpful analogy with&nbsp;plumbing systems. Wires are, of course, like pipes;&nbsp;<br/>current is like the rate of water flow (gallons per&nbsp;minute); and resistance is like friction in the&nbsp;<br/>pipes. Now, here is the most helpful part of the&nbsp;analogy: voltage is like water pressure, and&nbsp;<br/>batteries and generators are like pumps. Like all&nbsp;analogies, however, it doesn't quite work.&nbsp;

Voltage, Current, and Resistance

<br/>Voltage can also be looked at as water pressure.We are mainly concerned with the potential&nbsp;<br/>difference between two points.

Ground is the reference point and is considered to&nbsp;have zero potential.<br/>Electric current –directed flow of free electrons.&nbsp;

Moves from a region of negative potential to a&nbsp;region of positive potential.&nbsp;

Therefore it can be stated that electric current&nbsp;flows from negative to positive.

Voltage, Current, and Resistance

<br/>Breadboarding Basics

What is a Breadboard?<br/>What circuit are we going to breadboard today?<br/>Are these wires connected?<br/>Which is Correct???<br/>Longer&nbsp;<br/>Lead of&nbsp;<br/>LED goes&nbsp;<br/>on top<br/>Connect Circuit to Pi

Now that you have a working resistor and LED circuit, we &nbsp;can now connect it to the Raspberry Pi.

Located on the Pi is a 40 pin general purpose input output&nbsp;(GPIO) connector.

The 40 pins can be connected to various inputs or&nbsp;outputs.&nbsp;In our experiment we will connect our LED circuit to two&nbsp;of the outputs.

To connect the GPIO header to the breadboard we will&nbsp;<br/>use a 40 pin cable.

The red stripe on the cable indicates pin number 1, which&nbsp;<br/>is in the upper left corner of the GPIO header.

We will connect the ribbon cable as follows:

Pin 6 will be used for ground (common to both LEDs)

Pin 11 will be used for our output to the Blue LED

Pin 12 will be used for our output to the Red LED

Connect a black or brown wire to pin 6, and a red or orange wire to pin 11 and pin 12 on the ribbon cable.

Plug the black wire to the negative side of the circuit and the red wire to the positive side.

Your project should look like this:

<br/>Program the Pi

Now that the Pi is setup and the electronics are connected, we will now begin programming the GPIO&nbsp;output using a programming language known as Python.Python is an interpreted, object-oriented, high-level programing language.Python’s simple, easy to learn syntax emphasizes readability, which makes it easy to maintain and update.Python is included in the Raspbian distribution.We will run a simple python program to verify that our Pi&nbsp;is ready to go.Logon to the Pi with the username of piand the password&nbsp;of raspberryProgram the Pi

You should now see the shell prompt like:<br/>Type sudopythonand you should see the following:

Type quit() to exit from the python interpreter.

This shows us that Python is installed and ready for action.

'''Program the Pi'''

We will now write our first Python program.

Type <code>sudonanohelloworld.py&nbsp;</code>and press Enter.

Nanois a text editor that can be used to type our code.

Type <kbd>print “Hello World!”</kbd>;

Once you have the code written, press CTRLand xat the &nbsp;same time and press y to save the file.

Now type <kbd>sudopython helloworld.py&nbsp;</kbd>You should see:

We will now write some code to control the LED circuit.

Type <code>sudonanoled.py&nbsp;</code>and press Enter.

<kbd>import RPi.GPIOas GPIO</kbd>

<kbd>import time</kbd>

<kbd>GPIO.setmode(GPIO.BOARD)</kbd>

<kbd>GPIO.setup(11,GPIO.OUT)</kbd>

<kbd>GPIO.output(11,GPIO.HIGH)</kbd>

<kbd>time.sleep(1)</kbd>

<kbd>GPIO.output(11,GPIO.LOW)</kbd>

<kbd>GPIO.cleanup()</kbd>

Note, these are&nbsp;capital O’s, not&nbsp;0’s (zeroes).

Add code to&nbsp;light up pin 12.

Program the Pi<br/>Once you have the code written, press CTRLand xat the&nbsp;<br/>same time and press y to save the file.

Now type sudo python led.pyYou should see your LEDs&nbsp;<br/>light up for 1 second and turn off.

Modify your code to make the LEDs blink 3 times.<br/>Program the Pi

<code>import RPi.GPIOas GPIO</code>

<code>import time</code>

<code>GPIO.setmode(GPIO.BOARD)</code>

<code>GPIO.setup(11,GPIO.OUT)</code>

<code>for iin range (0,3):</code>

<code>GPIO.output(11, GPIO.HIGH)</code>

<code>time.sleep(1)</code>

<code>GPIO.output(11, GPIO.LOW)</code>

<code>time.sleep(1)</code>

<code>GPIO.cleanup()</code>

{Be sure to&nbsp;use a tab&nbsp;instead of&nbsp;space here

Add code&nbsp;<br/>for pin 12!

<br/>Putting it all Together

You now have the skills to build a complete light show&nbsp;<br/>system!

Enjoy!

== '''Introduction to Python''' ==

<br/>A readable, dynamic, pleasant,&nbsp;flexible, fast and powerful language

Nowell Strite&nbsp;<br/>Manager of Tech Solutions @ PBSnowell@strite.org<br/>Overview<br/>•Background<br/>•Syntax<br/>•Types / Operators / Control Flow<br/>•Functions<br/>•Classes<br/>•Tools



What is Python<br/>•Multi-purpose (Web, GUI, Scripting,&nbsp;etc.)<br/>•Object Oriented<br/>•Interpreted<br/>•Strongly typed and Dynamically&nbsp;typed<br/>•Focus on readability and&nbsp;productivity

Features<br/>•Batteries Included<br/>•Everything is an Object<br/>•Interactive Shell<br/>•Strong Introspection<br/>•Cross Platform<br/>•CPython, Jython, IronPython, PyPy



Who Uses Python<br/>•Google<br/>•PBS<br/>•NASA<br/>•Library of Congress<br/>•the ONION<br/>•...the list goes on...



Releases

•Created in 1989 by Guido Van Rossum<br/>•Python 1.0 released in 1994<br/>•Python 2.0 released in 2000<br/>•Python 3.0 released in 2008<br/>•Python 2.7 is the recommended&nbsp;<br/>version<br/>•3.0 adoption will take a few years



Syntax

<br/>Hello World

hello_world.py

<br/>Indentation<br/>•Most languages don’t care about &nbsp;indentation<br/>•Most humans do<br/>•We tend to group similar things together



IndentationThe else here actually belongs to the 2nd if &nbsp;statement&nbsp;

IndentationThe else here actually belongs to the 2nd if statement<br/>IndentationI knew a coder like this<br/>IndentationYou should always be explicit<br/>Indentation

Python embraces indentation<br/>Comments

<br/>Types<br/>Strings<br/>Numbers<br/>Null<br/>Lists<br/>Lists<br/>Dictionaries<br/>Dictionary Methods<br/>Booleans<br/>Operators<br/>Arithmetic<br/>String Manipulation<br/>Logical Comparison<br/>Identity Comparison

<br/>Arithmetic&nbsp;<br/>Comparison<br/>Control Flow

<br/>Conditionals

<br/>For Loop

<br/>Expanded For Loop&nbsp;While Loop<br/>List Comprehensions<br/>•Useful for replacing simple for-loops.



Functions<br/>Basic Function<br/>Function Arguments<br/>Arbitrary Arguments<br/>Fibonacci<br/>Fibonacci Generator<br/>Classes<br/>Class Declaration

<br/>Class Attributes<br/>•Attributes assigned at class&nbsp;<br/>declaration should always be&nbsp;<br/>immutable



Class Methods

<br/>Class Instantiation & Attribute Access

<br/>Class Inheritance<br/>Python’s Way<br/>•No interfaces<br/>•No real private&nbsp;attributes/functions<br/>•Private attributes start (but do&nbsp;not end) with double underscores.<br/>•Special class methods start and end&nbsp;with double underscores.<br/>•__init__, __doc__, __cmp__,&nbsp;<br/>__str__





Imports<br/>•Allows code isolation and re-use<br/>•Adds references to&nbsp;variables/classes/functions/etc.&nbsp;into current namespace



Imports<br/>More Imports<br/>Error Handling<br/>Documentation<br/>Docstrings<br/>Tools<br/>Web Frameworks

•Django<br/>•Flask<br/>•Pylons<br/>•TurboGears<br/>•Zope<br/>•Grok



IDEs<br/>•Emacs<br/>•Vim<br/>•Komodo<br/>•PyCharm<br/>•Eclipse (PyDev)



Package Management

<br/>Resources<br/>•[http://python.org/ http://python.org/]<br/>•[http://diveintopython.org/ http://diveintopython.org/]<br/>•[http://djangoproject.com/ http://djangoproject.com/]



Example<br/>Going Further<br/>•Decorators<br/>•Context Managers<br/>•Lambda functions<br/>•Generators



== COMPUTER VISION USING &nbsp;SIMPLECV AND THE&nbsp;RASPBERRY PI&nbsp; ==

Reference:&nbsp;<br/>Practical Computer Vision with SimpleCV -Demaagd (2012)&nbsp;

Enabling Computers To See&nbsp;

SimpleCV is an open source framework for building &nbsp;computer vision applications.&nbsp;&nbsp;<br/>With it, you get access to several high-powered &nbsp;computer vision libraries such as OpenCV – without&nbsp;having to first learn about bit depths, file formats, &nbsp;color spaces, buffer management, eigenvalues, or &nbsp;matrix versus bitmap storage.&nbsp;<br/><br/>This is computer vision made easy.&nbsp;

SimpleCV is an open source framework&nbsp;<br/>It is a collection of libraries and software that you can&nbsp;use to develop vision applications.&nbsp;<br/>It lets you work with the images or video streams that&nbsp;come from webcams, Kinects, FireWire and IP cameras, or mobile phones.&nbsp;<br/><br/>It’s helps you build software to make your various&nbsp;technologies not only see the world, but understand it&nbsp;<br/>too.&nbsp;&nbsp;<br/>SimpleCV is written in Python, and it's free to use. It runs&nbsp;on Mac, Windows, and Ubuntu Linux, and it's licensed&nbsp;<br/>under the BSD license.&nbsp;<br/>Features&nbsp;

Convenient "Superpack" installation for rapid&nbsp;deployment&nbsp;Feature detection and discrimination of Corners, Edges,<br/>Blobs, and Barcodes&nbsp;&nbsp;Filter and sort image features by their location, color,&nbsp;quality, and/or size&nbsp;An integrated iPython interactive shell makes&nbsp;developing code easy&nbsp;<br/><br/>Image manipulation and format conversion&nbsp;<br/><br/>Capture and process video streams from Kinect,&nbsp;Webcams, Firewire, IP Cams, or even mobile phones&nbsp;Learn how to build your own computer vision (CV) &nbsp;applications quickly and easily with SimpleCV.&nbsp;You can access the book online through the Safari&nbsp;collection of the ITESM CEM Digital Library.&nbsp;



SimpleCV Framework 6&nbsp;<br/>Installing SimpleCV for Ubuntu is done through a .deb package. From the SimpleCV download page, click the latest stable release link. This will &nbsp;download the package and handle the installation of all the required dependencies.&nbsp;<br/>From the command line, type the following two commands:&nbsp;<br/><code>$ sudo apt-get install ipython python-opencv pythonscipy&nbsp;python-numpy python-pygame python-setuptoolspython-pip</code>

<code>$ sudo pip install&nbsp;[https://github.com/ingenuitas/SimpleCV/zipball/master&nbsp https://github.com/ingenuitas/SimpleCV/zipball/master&nbsp];</code><br/>The first command installs the required Python packages, and the second&nbsp;<br/>command uses the newly installed pip tool to install the latest version ofSimpleCV from the GitHub repository.&nbsp;<br/>Once everything is installed, you type 'simplecv' on the command line to&nbsp;launch the SimpleCV interactive shell.&nbsp;<br/>Note, however, that even recent distributions of Ubuntu&nbsp;may have an outdated version of OpenCV, one of the&nbsp;major dependencies for SimpleCV. If the installation&nbsp;<br/>throws errors with OpenCV, in a Terminal window enter:&nbsp;<br/><code>$ sudo add-apt-repository ppa:gijzelaar/opencv2.3$ sudo apt-get update&nbsp;</code><br/>Once SimpleCV is installed, start the SimpleCV&nbsp;interactive Python shell by opening a command prompt&nbsp;and entering python -m SimpleCV.__init__. A majority&nbsp;<br/>of the examples can be completed from the SimpleCV&nbsp;shell.&nbsp;

Hello World&nbsp;<br/>f<code>rom SimpleCV import Camera, Display, Image# Initialize the camera&nbsp;<br/>cam = Camera()<br/># Initialize the displaydisplay = Display()<br/># Snap a picture using the cameraimg = cam.getImage()<br/># Show the picture on the screenimg.save(display)&nbsp;</code>

<br/>Retrieve an Image-object&nbsp;from the camera with the&nbsp;highest quality possible.&nbsp;

<code>from SimpleCV import Camera, Display, Imageimport time&nbsp;</code>

#Initialize the camera&nbsp;

<code>cam = Camera()</code>

#Initialize the display

<code>display = Display()</code>

#Snap a picture using the camera

<code>img = cam.getImage()</code>

#Show some text&nbsp;

<code>img.drawText("Hello World!")</code>

#Show the picture on the screen

<code>img.save(display)</code>

#Wait five seconds so the window doesn't close right away

<code>time.sleep(5)&nbsp;</code><br/>The shell is built using IPython, an interactive shell&nbsp;for Python development.&nbsp;<br/><br/>Most of the example code in this book is written so&nbsp;that it could be executed as a standalone script.&nbsp;<br/>However, this code can be still be run in the&nbsp;SimpleCV shell.&nbsp;<br/>The interactive tutorial is started with the tutorial&nbsp;command:&nbsp;<br/><code>>>> tutorial</code><br/>Introduction to the camera&nbsp;<br/>The simplest setup is a computer with a built-in&nbsp;webcam or an external video camera. These usually&nbsp;fall into a category called a USB Video Class (UVC)&nbsp;<br/>device.&nbsp;UVC has emerged as a “device class” which provides a&nbsp;standard way to control video streaming over USB.&nbsp;Most webcams today are now supported by UVC, and&nbsp;do not require additional drivers for basic operation.&nbsp;Not all UVC devices support all functions, so when in&nbsp;doubt, tinker with the camera in a program like&nbsp;guvcview to see what works and what does not.&nbsp;RPi Verified Peripherals: USB Webcams&nbsp;

'''Camera Initialization&nbsp;'''<br/>The following line of code initializes the camera:&nbsp;<br/><code>from SimpleCV import Camera&nbsp;</code>

#Initialize the camera&nbsp;

<code><kbd>cam = Camera()&nbsp;</kbd></code>

..This approach will work when dealing with just one&nbsp;<br/>camera, using the default camera resolution, without&nbsp;<br/>needing any special calibration.&nbsp;<br/>Shortcut when the goal is simply to initialize the camera and&nbsp;<br/>make sure that it is working:<br/><code>from SimpleCV import Camera&nbsp;</code>

#Initialize the camera&nbsp;

<code>cam = Camera()</code>

#Capture and image and display it

<code>cam.getImage().show()</code>

<br/>The <code>show()</code> function simply pops up the image from the&nbsp;<br/>camera on the screen. It is often necessary to store the&nbsp;<br/>image in a variable for additional manipulation instead ofsimply calling show() after getImage(), but this is a&nbsp;<br/>good block of code for a quick test to make sure that the&nbsp;<br/>camera is properly initialized and capturing video.&nbsp;

Example output of the basic camera&nbsp;example&nbsp;<br/>To access more than one camera, pass the camera_id as an&nbsp;<br/>argument to the <code>Camera()</code> constructor.&nbsp;<br/>•&nbsp;<br/>On Linux, all peripheral devices have a file created for them in the&nbsp;<br/>/dev directory. For cameras, the file names start with video and end&nbsp;<br/>with the camera ID, such as /dev/video0 and /dev/video1.&nbsp;<br/><code>from SimpleCV import Camera&nbsp;</code>

#First attached camera&nbsp;

<code>cam0 = Camera(0)</code>

#Second attached camera&nbsp;

<code>cam1 = Camera(1)</code>

#Show a picture from the first camera

<code>cam0.getImage().show()</code>

#Show a picture from the second camera

<code>cam1.getImage().show()&nbsp;</code><br/>The SimpleCV framework can control many other camera properties. An&nbsp;easy example is forcing the resolution.&nbsp;Almost every webcam supports the standard resolutions of 320×240, and&nbsp;640×480 (often called “VGA” resolution). Many newer webcams can&nbsp;handle higher resolutions such as 800×600, 1024×768, 1200×1024, or&nbsp;<br/>1600×1200.&nbsp;Here is an example of how to move text to the upper left quadrant of an&nbsp;image, starting at the coordinates (160, 120) on a 640×480 image:&nbsp;

<code>from SimpleCV import Camera&nbsp;<br/>cam = Camera(0, { "width": 640, "height": 480 }<br/>img = cam.getImage(<br/>)<br/>img.drawText("Hello World", 160, 120)<br/>img.show(<br/>)&nbsp;</code><br/>Notice that the camera’s constructor passed a new argument in the form of{"key":value}&nbsp;

Drawing on Images in SimpleCV 20&nbsp;

Layers&nbsp;<br/>Layers can be unlimited and&nbsp;what's ever above or on top ofthe other layer will cover the&nbsp;<br/>layer below it. Let's look at the&nbsp;simplecv logo with some text&nbsp;written on it.&nbsp;<br/>•&nbsp;<br/>Which in reality is an image&nbsp;with 3 layers, each layer has&nbsp;the text displayed. If we rotate&nbsp;the image and expand the&nbsp;<br/>layers you can get a better&nbsp;idea of what is really&nbsp;happening with image layers.<br/><code>>>> scv = Image('simplecv')&nbsp;<br/>>>> logo = Image('logo')&nbsp;<br/>>>> #write image 2 on top of image&nbsp;<br/>>>> scv.dl().blit(logo)&nbsp;</code><br/>NOTE: Run help DrawingLayer for more information.&nbsp;<br/>Here is an example of how to move text to the&nbsp;upper left quadrant of an image, starting at the&nbsp;coordinates (160, 120) on a 640×480 image:&nbsp;<br/><code>from SimpleCV import Camera&nbsp;<br/>cam = Camera(0, { "width": 640, "height": 480 }<br/>img = cam.getImage()<br/>img.drawText("Hello World", 160, 120)<br/>img.show(<br/>)&nbsp;</code>

Camera class attributes&nbsp;<br/>The <code>Camera()</code> function has a properties argument for basic cameracalibration.&nbsp;Multiple properties are passed in as a comma delimited list, with the&nbsp;entire list enclosed in brackets.&nbsp;&nbsp;<br/>Note that the camera ID number is NOT passed inside the brackets,&nbsp;since it is a separate argument. The configuration options are:&nbsp;

*width and height&nbsp;
*brightness&nbsp;
*contrast&nbsp;
*saturation&nbsp;
*hue&nbsp;
*gain&nbsp;
*exposure&nbsp;

The available options are part of the computer’s UVC system.&nbsp;

A live camera feed&nbsp;<br/>To get live video feed from the camera, use the <code>live()</code> function.&nbsp;<br/><code>from SimpleCV import Camera&nbsp;<br/>cam = Camera(<br/>)<br/>cam.live(<br/>)&nbsp;</code><br/>In addition to displaying live video feed, the live() function has two &nbsp;other very useful properties. The live feed makes it easy to find both &nbsp;the coordinates and the color of a pixel on the screen.&nbsp;To get the coordinates or color for a pixel, use the live() function as&nbsp;outlined in the example above.&nbsp;After the window showing the video feed appears, click the left mouse&nbsp;button on the image for the pixel of interest.&nbsp;The coordinates and color for the pixel at that location will then be&nbsp;displayed on the screen and also output to the shell. The coordinates will&nbsp;be in the (x, y) format, and the color will be displayed as an RGB triplet&nbsp;(R,G,B).&nbsp;

'''Demonstration of the live feed'''&nbsp;<br/>To control the closing of a window based on the user&nbsp;interaction with the window:&nbsp;

<code>from SimpleCV import Display, Imageimport time&nbsp;<br/>display = Display()<br/>Image("logo").save(display)<br/>print "I launched a window"&nbsp;<br/># This while loop will keep looping untilthe window is closed&nbsp;<br/>while not display.isDone():<br/>time.sleep(0.1)<br/>print "You closed the window"</code>&nbsp;

<br/>The user will not be able to&nbsp;close the window by clicking&nbsp;the close button in the corner&nbsp;of the window.&nbsp;Checks the event queue&nbsp;and returns True if a quit&nbsp;event has been issued.&nbsp;It outputs to thecommand prompt, and&nbsp;not the image.&nbsp;Information about the mouse&nbsp;<br/>While the window is open, the following information about&nbsp;<br/>the mouse is available:&nbsp;

mouseX and mouseY (Display class)&nbsp;<br/>The coordinates of the mouse&nbsp;<br/>mouseLeft, mouseRight, and mouseMiddle&nbsp;<br/>Events triggered when the left, right, or middle buttons on&nbsp;the mouse are clicked&nbsp;&nbsp;<br/>mouseWheelUp and mouseWheelDown&nbsp;Events triggered then the scroll wheel on the mouse is moved&nbsp;

'''How to draw on a screen&nbsp;'''<br/><code>from SimpleCV import Display, Image, Color<br/>winsize = (640,480)<br/>display = Display(winsize)<br/>img = Image(winsize)&nbsp;</code><br/>If the button is clicked, draw the circle.&nbsp;

<code>img.save(display)&nbsp;</code><br/>The image has a drawing layer, which is&nbsp;<br/>accessed with the <code>dl()</code> function. The&nbsp;<br/>drawing layer then provides access to&nbsp;

<code>while not display.isDone()</code>: the <code>circle()</code> function.&nbsp;<br/><code>if display.mouseLeft:&nbsp;<br/>img.dl().circle((display.mouseX,display.mouseY),4,</code>

<code>Color.WHITE, filled=True)<br/>img.save(display)<br/>img.save("painting.png"<br/>)&nbsp;</code>

Example using the drawing application&nbsp;<br/>The little circles from the drawing act like a paint&nbsp;brush, coloring in a small region of the screen&nbsp;wherever the mouse is clicked.&nbsp;

Examples=<br/><code>from SimpleCV import Camera, Imageimport time&nbsp;</code><br/><code>cam = Camera()</code>

#Set the number of frames to capture

<code>numFrames = 10&nbsp;</code>

#Loop until we reach the limit set in numFrames

<code>for x in range(0, numFrames):<br/>img = cam.getImage()<br/>filepath = "image-" + str(x) + ".jpg"<br/>img.save(filepath)<br/>print "Saved image to: " + filepath</code>

<code>time.sleep(60)&nbsp;</code>

<br/>'''Color'''

Introduction&nbsp;

Although colorsounds like a&nbsp;relatively&nbsp;straightforward&nbsp;concept, differentrepresentations ofcolor are useful in&nbsp;different contexts.&nbsp;<br/>The following&nbsp;examples workwith an image ofThe Starry Night&nbsp;by Vincent van&nbsp;Gogh (1889)<br/><br/>In the SimpleCV framework, the colors of an&nbsp;individual pixel are extracted with the getPixel()&nbsp;function.&nbsp;from SimpleCV import Imageimg = Image('starry_night.png')<br/>print img.getPixel(0, 0)&nbsp;Prints the RGB triplet&nbsp;for the pixel at (0,0),&nbsp;which will equal&nbsp;(71.0, 65.0, 54.0).&nbsp;<br/>Example RGB&nbsp;<br/>Original Image R-Component&nbsp;

G-Component B-Component&nbsp;

HSV&nbsp;<br/>One criticism of RGB is that it does not specifically model&nbsp;luminance.&nbsp;Yet the luminance/brightness is one of the most common&nbsp;properties to manipulate.In theory, the luminance is the relationship of the of R, G, and B&nbsp;values.&nbsp;In practice, however, it is sometimes more convenient to separate&nbsp;the color values from the luminance values.&nbsp;The solution is HSV, which stands for hue, saturation, and&nbsp;value.&nbsp;The color is defined according to the hue and saturation, while value is the measure of the luminance/brightness.&nbsp;&nbsp;<br/>The HSV color space is essentially just a transformation of the&nbsp;RGB color space because all colors in the RGB space have a&nbsp;corresponding unique color in the HSV space, and vice versa.&nbsp;

Example HSV&nbsp;<br/>Original Image Hue&nbsp;

Saturation Value (Intensity)&nbsp;

RGB ñ&nbsp;<br/>HSV&nbsp;<br/>The HSV color&nbsp;space is often used&nbsp;by people because&nbsp;it corresponds&nbsp;better to how&nbsp;people experience&nbsp;color than the RGB&nbsp;color space does.&nbsp;

It is easy to convert images between the RGB and&nbsp;HSV color spaces, as is demonstrated below.&nbsp;from SimpleCV import Imageimg = Image('starry_night.png')<br/><code>hsv = img.toHSV()<br/>print hsv.getPixel(25,25)<br/>rgb = hsv.toRGB()<br/>print rgb.getPixel(25,25)&nbsp;</code><br/>It converts the image from&nbsp;the original RGB to HSV.&nbsp;<br/>it prints the HSV&nbsp;<br/>values for the pixel&nbsp;<br/>It converts the image back&nbsp;<br/>to RGB&nbsp;<br/>it prints the HSV&nbsp;<br/>values for the pixel&nbsp;<br/>The HSV color space is particularly useful when&nbsp;dealing with an object that has a lot of specular&nbsp;highlights or reflections.In the HSV color space, specular reflections will have a&nbsp;<br/>high luminance value (V) and a lower saturation (S)&nbsp;component.&nbsp;The hue (H) component may get noisy depending on&nbsp;how bright the reflection is, but an object of solid color&nbsp;<br/>will have largely the same hue even under variable&nbsp;lighting.&nbsp;A grayscale image represents the luminance of the&nbsp;image, but lacks any color components.&nbsp;<br/>An 8-bit grayscale image has many shades of grey,&nbsp;usually on a scale from 0 to 255.&nbsp;<br/><br/>The challenge is to create a single value from 0 to 255&nbsp;out of the three values of red, green, and blue found in&nbsp;an RGB image.&nbsp;There is no single scheme for doing this, but it is done by&nbsp;taking a weighted average of the three.

<code>from SimpleCV import Imageimg = Image('starry_night.png')<br/>gray = img.grayscale()<br/>print gray.getPixel(0,0)</code>&nbsp;

<code>getPixel</code> returns the same number three times.&nbsp;This keeps a consistent format with RGB and HSV, which&nbsp;both return three values.&nbsp;To get the grayscale value for a particular pixel&nbsp;<br/>without having to convert the image to grayscale,&nbsp;

use <code>getGrayPixel().</code>&nbsp;<br/>The Starry Night, converted to grayscale&nbsp;Segmentation is the process of dividing an image into&nbsp;areas of related content.Color segmentation is based on subtracting away the&nbsp;<br/>pixels that are far away from the target color, while&nbsp;preserving the pixels that are similar to the color.&nbsp;&nbsp;<br/>The Image class has a function called<code>colorDistance()&nbsp;</code>that computes the distance between every pixel in an&nbsp;image and a given color.&nbsp;<br/>This function takes as an argument the RGB value of the&nbsp;target color, and it returns another image representing the&nbsp;distance from the specified color.&nbsp;Segmentation Example&nbsp;

<br/>46&nbsp;<br/>from SimpleCV import Image, ColoryellowTool = Image("yellowtool.png")&nbsp;

yellowDistBin = yellowDist.binarize(50).invert()<br/>onlyYellow = yellowTool -yellowDistBinonlyYellow.show()&nbsp;

yellowDist = yellowTool.colorDistance((223, 191, 29))1&nbsp;

'''Basic Feature Detection'''

Introduction&nbsp;<br/>The human brain does a lot of pattern recognition to makesense of raw visual inputs.&nbsp;After the eye focuses on an object, the brain identifies the&nbsp;characteristics of the object —such as its shape, color, or&nbsp;texture— and then compares these to the characteristics offamiliar objects to match and recognize the object.&nbsp;<br/>In computer vision, that process of deciding what to focus on&nbsp;is called feature detection.&nbsp;A feature can be formally defined as “one or more&nbsp;measurements of some quantifiable property of an object,&nbsp;computed so that it quantifies some significant characteristics ofthe object” (Kenneth R. Castleman, Digital Image Processing,&nbsp;Prentice Hall, 1996).&nbsp;<br/>Easier way to think of it:&nbsp;a feature is an “interesting” part of an image.&nbsp;<br/>A good vision system should not waste time—or&nbsp;processing power—analyzing the unimportant or&nbsp;uninteresting parts of an image, so feature&nbsp;detection helps determine which pixels to focus on.&nbsp;In this session we will focus on the most basic types&nbsp;of features: blobs, lines, circles, and corners.&nbsp;If the detection is robust, a feature is something that&nbsp;could be reliably detected across multiple images.&nbsp;

Detection criteria&nbsp;<br/>How we describe the feature can also determine&nbsp;the situations in which we can detect the feature.&nbsp;Our detection criteria for the feature determines&nbsp;whether we can:&nbsp;Find the features in different locations of the picture&nbsp;(position invariant)&nbsp;Find the feature if it’s large or small, near or far (scale&nbsp;invariant)Find the feature if it’s rotated at different orientations&nbsp;<br/>(rotation invariant)&nbsp;

Blobs&nbsp;

<br/>51&nbsp;<br/>•&nbsp;<br/>Blobs are objects or connected components,&nbsp;<br/>regions of similar pixels in an image.&nbsp;<br/>•&nbsp;<br/>Examples:&nbsp;<br/>a group of brownish pixels together, which might&nbsp;<br/>represent food in a pet food detector.&nbsp;<br/>•&nbsp;<br/>a group of shiny metal looking pixels, which on a&nbsp;<br/>door detector would represent the door knob&nbsp;<br/>•&nbsp;<br/>a group of matte white pixels, which on a&nbsp;<br/>medicine bottle detector could represent the cap.&nbsp;<br/>•&nbsp;<br/>Blobs are valuable in machine vision because&nbsp;<br/>many things can be described as an area of&nbsp;<br/>a certain color or shade in contrast to a&nbsp;<br/>background.&nbsp;

52&nbsp;<br/>52&nbsp;<br/>s&nbsp;

<br/>•&nbsp;<br/>findBlobs() can be used to find objects that are&nbsp;<br/>lightly colored in an image. If no parameters are&nbsp;<br/>specified, the function tries to automatically detect&nbsp;<br/>what is bright and what is dark.&nbsp;<br/>Left: Original image of pennies; Right: Blobs detected&nbsp;



Blob measurements&nbsp;

<br/>53&nbsp;<br/>After a blob is identified we can:&nbsp;

•&nbsp;<br/>measure a lot of different things:&nbsp;<br/>•&nbsp;<br/>area&nbsp;<br/>•&nbsp;<br/>width and height&nbsp;<br/>•&nbsp;<br/>find the centroid&nbsp;<br/>•&nbsp;<br/>count the number of blobs&nbsp;<br/>•&nbsp;<br/>look at the color of blobs&nbsp;<br/>•&nbsp;<br/>look at its angle to see its rotation&nbsp;<br/>•&nbsp;<br/>find how close it is to a circle, square, or rectangle —or&nbsp;<br/>compare its shape to another blob&nbsp;

Blob detection and measurement&nbsp;

<br/>from SimpleCV import Imagepennies = Image("pennies.png")<br/>binPen = pennies.binarize()<br/>blobs = binPen.findBlobs()<br/>blobs.show(width=5)&nbsp;<br/>54&nbsp;<br/>1&nbsp;<br/>2&nbsp;<br/>3&nbsp;<br/>1.&nbsp;<br/>Blobs are most easily detected on a binarized image.&nbsp;<br/>2.&nbsp;<br/>Since no arguments are being passed to the findBlobs() function, it&nbsp;<br/>returns a FeatureSet&nbsp;<br/>•&nbsp;<br/>list of features about the blobs found&nbsp;<br/>•&nbsp;<br/>has a set of defined methods that are useful when handling features&nbsp;<br/>3.&nbsp;<br/>show() function is being called on blobs and not the Image object&nbsp;<br/>•&nbsp;<br/>It draws each feature in the FeatureSet on top of the original image and&nbsp;<br/>then displays the results.&nbsp;

Blob detection and measurement (3)&nbsp;

<br/>55&nbsp;<br/>•&nbsp;<br/>After the blob is found, several other functions&nbsp;<br/>provide basic information about the feature, such as&nbsp;<br/>its size, location, and orientation.&nbsp;<br/>from SimpleCV import Image<br/>pennies = Image("pennies.png"<br/>)<br/>binPen = pennies.binarize(<br/>)<br/>blobs = binPen.findBlobs(<br/>)<br/>print "Areas: ", blobs.area(<br/>)<br/>print "Angles: ", blobs.angle(<br/>)<br/>print "Centers: ", blobs.coordinates(<br/>)&nbsp;



Blob detection and measurement (2)&nbsp;

<br/>56&nbsp;<br/>•&nbsp;<br/>area function: returns an array of the area of each&nbsp;<br/>feature in pixels.&nbsp;<br/>•&nbsp;<br/>By default, the blobs are sorted by size, so the areas should&nbsp;<br/>be ascending in size.&nbsp;<br/>•&nbsp;<br/>angle function: returns an array of the angles, as&nbsp;<br/>measured in degrees, for each feature.&nbsp;<br/>•&nbsp;<br/>The angle is the measure of rotation of the feature away&nbsp;<br/>from the x-axis, which is the 0 point. (+: counter-clockwise&nbsp;<br/>rotation; -: , clockwise rotation)&nbsp;<br/>•&nbsp;<br/>coordinates function: returns a two-dimensional array of&nbsp;<br/>the (x, y) coordinates for the center of each feature.&nbsp;

57&nbsp;<br/>57&nbsp;<br/>s&nbsp;

<br/>•&nbsp;<br/>If the objects of interest are darkly colored on a&nbsp;<br/>light background, use the invert() function.&nbsp;<br/>from SimpleCV import Imageimg = Image("chessmen.png")<br/>invImg = img.invert()<br/>blobs = invImg.findBlobs()<br/>blobs.show(width=2)<br/>img.addDrawingLayer(invImg.dl())<br/>img.show()&nbsp;<br/>1&nbsp;<br/>2&nbsp;<br/>3&nbsp;<br/>4&nbsp;

58&nbsp;<br/>58&nbsp;<br/>)&nbsp;

<br/>1.&nbsp;<br/>invert() function: turns the black chess pieces white and&nbsp;<br/>turns the white background to black&nbsp;<br/>2.&nbsp;<br/>findBlobs() function: can then find the lightly colored&nbsp;<br/>blobs as it normally does.&nbsp;<br/>3.&nbsp;<br/>Show the blobs. Note, however, that this function will&nbsp;<br/>show the blobs on the inverted image, not the original&nbsp;<br/>image.&nbsp;<br/>4.&nbsp;<br/>To make the blobs appear on the original image, take&nbsp;<br/>the drawing layer from the inverted image (which is&nbsp;<br/>where the blob lines were drawn), and add that layer&nbsp;<br/>to the original image.&nbsp;

59&nbsp;<br/>59&nbsp;

<br/>•&nbsp;<br/>In many cases, the actual color is more important&nbsp;<br/>than the brightness or darkness of the objects.&nbsp;<br/>•&nbsp;<br/>Example: find the blobs that represent the blue&nbsp;<br/>candies&nbsp;

Finding Blobs of a Specific Color (2)&nbsp;

<br/>60&nbsp;<br/>from SimpleCV import Color, Imageimg = Image("mandms.png")<br/>blue_distance =&nbsp;<br/>img.colorDistance(Color.BLUE).invert()<br/>blobs = blue_distance.findBlobs()<br/>blobs.draw(color=Color.PUCE, width=3)<br/>blue_distance.show()<br/>img.addDrawingLayer(blue_distance.dl())<br/>img.show()&nbsp;<br/>1&nbsp;<br/>2&nbsp;<br/>3&nbsp;<br/>4&nbsp;<br/>Left: the original image; Center: blobs based on the&nbsp;<br/>blue distance; Right: The blobs on the original image&nbsp;



Finding Blobs of a Specific Color (3)&nbsp;

<br/>61&nbsp;<br/>1.&nbsp;<br/>colorDistance() function: returns an image that shows how&nbsp;<br/>far away the colors in the original image are from the&nbsp;<br/>passed in Color.BLUE argument.&nbsp;<br/>•&nbsp;<br/>To make this even more accurate, we could find the RGB triplet&nbsp;<br/>for the actual blue color on the candy.&nbsp;<br/>•&nbsp;<br/>Because any colors close to blue are black and colors far awayfrom blue are white, we again use the invert() function to switchthe target blue colors to white instead.&nbsp;<br/>2.&nbsp;<br/>We use the new image to find the blobs representing the&nbsp;<br/>blue candies.&nbsp;<br/>•&nbsp;<br/>We can also fine-tune what the findBlobs() function discovers bypassing in a threshold argument. The threshold can either be an&nbsp;<br/>integer or an RGB triplet. When a threshold value is passed in,&nbsp;<br/>the function changes any pixels that are darker than the&nbsp;<br/>threshold value to white and any pixels above the value to&nbsp;<br/>black.&nbsp;

Finding Blobs of a Specific Color (4)&nbsp;

<br/>62&nbsp;<br/>3.&nbsp;<br/>In the previous examples, we have used the&nbsp;<br/>FeatureSet show() method instead of these two lines&nbsp;<br/>(blobs.show()). That would also work here. We’ve&nbsp;<br/>broken this out into the two lines here just to show that&nbsp;<br/>they are the equivalent of using the other method.&nbsp;<br/>•&nbsp;<br/>To outline the blue candies in a color not otherwise found in&nbsp;<br/>candy, they are drawn in puce, which is a reddish color.&nbsp;<br/>4.&nbsp;<br/>Similar to the previous example, the drawing ends up&nbsp;<br/>on the blue_distance image. Copy the drawing layer&nbsp;<br/>back to the original image.&nbsp;

63&nbsp;<br/>63&nbsp;

•&nbsp;<br/>Sometimes the lighting conditions can make color&nbsp;<br/>detection more difficult.&nbsp;<br/>•&nbsp;<br/>To resolve this problem use hueDistance() instead of&nbsp;<br/>colorDistance().&nbsp;<br/>•&nbsp;<br/>The hue is more robust to changes in light&nbsp;<br/>from SimpleCV import Color, Imageimg = Image("mandms-dark.png")<br/>blue_distance = img.hueDistance(Color.BLUE).invert()<br/>blobs = blue_distance.findBlobs()<br/>blobs.draw(color=Color.PUCE, width=3)<br/>img.addDrawingLayer(blue_distance.dl())<br/>img.show()&nbsp;<br/>1&nbsp;

Blob detection in less-than-ideal light&nbsp;<br/>conditions (2)<br/>64&nbsp;

Blob detection in less-than-ideal light&nbsp;<br/>conditions (2)<br/>64&nbsp;<br/>Blobs detected with

Blobs detected with&nbsp;<br/>hueDistance() colorDistance()&nbsp;

<br/>Lines and Circles65&nbsp;

Lines&nbsp;

<br/>66&nbsp;<br/>•&nbsp;<br/>A line feature is a straight edge in an image that&nbsp;<br/>usually denotes the boundary of an object.&nbsp;<br/>•&nbsp;<br/>The calculations involved for identifying lines can be a&nbsp;<br/>bit complex. The reason is&nbsp;<br/>•&nbsp;<br/>because an edge is really a list of (x, y) coordinates, and&nbsp;<br/>any two coordinates could possibly be connected by a&nbsp;<br/>straight line.&nbsp;<br/>Left: Four coordinates; Center: One possible scenario for lines connecting the points;&nbsp;<br/>Right: An alternative scenario&nbsp;

<br/>Hough transform&nbsp;

<br/>•&nbsp;<br/>The way this problem is handled behind-the-scenes&nbsp;<br/>is by using the Hough transform technique.&nbsp;<br/>•&nbsp;<br/>This technique effectively looks at all of the possible&nbsp;<br/>lines for the points and then figures out which lines&nbsp;<br/>show up the most often. The more frequent a line is,&nbsp;<br/>the more likely the line is an actual feature.&nbsp;

68&nbsp;<br/>68&nbsp;<br/>n&nbsp;

<br/>Utilizes the Hough transform and returns a FeatureSet ofthe lines found&nbsp;

•&nbsp;<br/>coordinates()&nbsp;<br/>•&nbsp;<br/>Returns the (x, y) coordinates of the starting point of the&nbsp;<br/>line(s).&nbsp;<br/>•&nbsp;<br/>width()&nbsp;<br/>•&nbsp;<br/>Returns the width of the line, which in this context is the&nbsp;<br/>difference between the starting and ending x coordinates&nbsp;<br/>of the line.&nbsp;<br/>•&nbsp;<br/>height()&nbsp;<br/>•&nbsp;<br/>Returns the height of the line, or the difference between the&nbsp;<br/>starting and ending y coordinates of the line.&nbsp;<br/>•&nbsp;<br/>length()&nbsp;<br/>•&nbsp;<br/>Returns the length of the line in pixels.&nbsp;

69&nbsp;<br/>69&nbsp;

•&nbsp;<br/>The example looks for lines on a&nbsp;<br/>block of wood.&nbsp;<br/>from SimpleCV import Imageimg = Image("block.png")<br/>lines = img.findLines()<br/>lines.draw(width=3)<br/>img.show()&nbsp;

•&nbsp;<br/>The findLines() function returns a&nbsp;<br/>FeatureSet of the line features.&nbsp;<br/>•&nbsp;<br/>This draws the lines in green on the&nbsp;<br/>image, with each line having a&nbsp;<br/>width of 3 pixels.&nbsp;

70&nbsp;<br/>70&nbsp;<br/>s&nbsp;

<br/>•&nbsp;<br/>Threshold&nbsp;<br/>•&nbsp;<br/>This sets how strong the edge should before it is recognized as a&nbsp;<br/>line (default = 80)&nbsp;<br/>•&nbsp;<br/>Minlinelength&nbsp;<br/>•&nbsp;<br/>Sets what the minimum length of recognized lines should be.&nbsp;<br/>•&nbsp;<br/>Maxlinegap&nbsp;<br/>•&nbsp;<br/>Determines how much of a gap will be tolerated in a line.&nbsp;<br/>•&nbsp;<br/>Cannyth1&nbsp;<br/>•&nbsp;<br/>This is a threshold parameter that is used with the edge detection&nbsp;<br/>step. It sets what the minimum “edge strength” should be.&nbsp;<br/>•&nbsp;<br/>Cannyth2&nbsp;<br/>•&nbsp;<br/>This is a second parameter for the edge detection which sets the&nbsp;<br/>“edge persistence.”&nbsp;

71&nbsp;<br/>71&nbsp;

<br/>from SimpleCV import Image<br/>img = Image("block.png"<br/>)

<br/># Set a low threshold&nbsp;

<br/>lines = img.findLines(threshold=10)<br/>lines.draw(width=3)<br/>img.show(<br/>)&nbsp;



Line detection at a lower threshold&nbsp;



Circles&nbsp;

<br/>72&nbsp;<br/>•&nbsp;<br/>The method to find circular features is called&nbsp;<br/>findCircle()&nbsp;<br/>•&nbsp;<br/>It returns a FeatureSet of the circular features it&nbsp;<br/>finds, and it also has parameters to help set its&nbsp;<br/>sensitivity.&nbsp;

73&nbsp;<br/>73&nbsp;<br/>s&nbsp;

<br/>•&nbsp;<br/>Canny&nbsp;<br/>•&nbsp;<br/>This is a threshold parameter for the Canny edge detector. The&nbsp;<br/>default value is 100. If this is set to a lower number, it will find a&nbsp;<br/>greater number of circles. Higher values instead result in fewer&nbsp;<br/>circles.&nbsp;<br/>•&nbsp;<br/>Thresh&nbsp;<br/>•&nbsp;<br/>This is the equivalent of the threshold parameter for findLines(). It&nbsp;<br/>sets how strong an edge must be before a circle is recognized.&nbsp;<br/>The default value for this parameter is 350.&nbsp;<br/>•&nbsp;<br/>Distance&nbsp;<br/>•&nbsp;<br/>Similar to the maxlinegap parameter for findLines(). It determines&nbsp;<br/>how close circles can be before they are treated as the same&nbsp;<br/>circle. If left undefined, the system tries to find the best value,<br/>based on the image being analyzed.&nbsp;

74&nbsp;<br/>74&nbsp;<br/>t&nbsp;

<br/>•&nbsp;<br/>radius()&nbsp;<br/>•&nbsp;<br/>diameter()&nbsp;<br/>•&nbsp;<br/>perimeter()&nbsp;<br/>•&nbsp;<br/>It may seem strange that this isn’t called circumference,&nbsp;<br/>but the term perimeter makes more sense when dealing&nbsp;<br/>with a non-circular features. Using perimeter here&nbsp;<br/>allows for a standardized naming convention.&nbsp;

75&nbsp;<br/>75&nbsp;

•&nbsp;<br/>from SimpleCV import Image<br/>•&nbsp;<br/>img = Image("pong.png")<br/>1. circles =&nbsp;<br/>img.findCircle(canny=200,thresh=250,distance=15)<br/>2. circles = circles.sortArea()<br/>3. circles.draw(width=4)<br/>4. circles[0].draw(color=Color.RED, width=4)<br/>5. img_with_circles = img.applyLayers()<br/>6. edges_in_image = img.edges(t2=200)<br/>7. final =&nbsp;<br/>img.sideBySide(edges_in_image.sideBySide(img_with_circles)).scale(0.5)<br/>•&nbsp;<br/>final.show()&nbsp;<br/>applyLayers() Render all of the layers onto the current image and return the result.&nbsp;<br/>Indicies can be a list of integers specifying the layers to be used.&nbsp;<br/>sideBySide() Combine two images as a side by side images.&nbsp;



76&nbsp;<br/>76&nbsp;<br/>)&nbsp;



Image showing the detected circles&nbsp;



Corners&nbsp;

<br/>77&nbsp;<br/>•&nbsp;<br/>are places in an image where two lines meet.&nbsp;<br/>•&nbsp;<br/>unlike edges, are relatively unique and effective for&nbsp;<br/>identifying parts of an image.&nbsp;<br/>•&nbsp;<br/>For instance, when trying to analyze a square, a vertical line&nbsp;<br/>could represent either the left or right side of the square.&nbsp;<br/>•&nbsp;<br/>Likewise, detecting a horizontal line can indicate either the top or&nbsp;<br/>the bottom.&nbsp;<br/>•&nbsp;<br/>Each corner is unique. For example, the upper left corner could&nbsp;<br/>not be mistaken for the lower right, and vice versa. This makes&nbsp;<br/>corners helpful when trying to uniquely identify certain parts of a&nbsp;<br/>feature.&nbsp;<br/>•&nbsp;<br/>Note: a corner does not need to be a right angle at 90&nbsp;<br/>degrees&nbsp;

78&nbsp;<br/>78&nbsp;<br/>n&nbsp;

<br/>•&nbsp;<br/>analyzes an image and returns the locations of all&nbsp;<br/>of the corners it can find&nbsp;<br/>•&nbsp;<br/>returns a FeatureSet of all of the corner features it&nbsp;<br/>finds&nbsp;<br/>•&nbsp;<br/>has parameters to help fine-tune the corners that&nbsp;<br/>are found in an image.&nbsp;

79&nbsp;<br/>79&nbsp;<br/>e&nbsp;

<br/>from SimpleCV import Image= Image('corners.png')<br/>imgimg.findCorners.show()&nbsp;

•&nbsp;<br/>Notice that the example&nbsp;<br/>finds a lot of corners&nbsp;<br/>(default: 50)&nbsp;<br/>•&nbsp;<br/>Based on visual inspection,<br/>it appears that there arefour main corners.&nbsp;<br/>•&nbsp;<br/>To restrict the number of&nbsp;<br/>corners returned, we can&nbsp;<br/>use the maxnum&nbsp;<br/>parameter.&nbsp;

80&nbsp;<br/>80&nbsp;<br/>)&nbsp;

<br/>from SimpleCV import Imageimg = Image('corners.png')<br/>img.findCorners.(maxnum=9).show()&nbsp;

<br/>Limiting findCorners() to a maximum of&nbsp;<br/>nine corners&nbsp;



The XBox Kinect 81&nbsp;

Introduction&nbsp;

<br/>82&nbsp;<br/>•&nbsp;<br/>Historically, the computer vision market has been dominated&nbsp;<br/>by 2D vision systems.&nbsp;<br/>•&nbsp;<br/>3D cameras were often expensive, relegating them to niche&nbsp;<br/>market applications.&nbsp;<br/>•&nbsp;<br/>More recently, however, basic 3D cameras have become&nbsp;<br/>available on the consumer market, most notably with the&nbsp;<br/>XBox Kinect.&nbsp;<br/>•&nbsp;<br/>The Kinect is built with two different cameras.&nbsp;<br/>•&nbsp;<br/>The first camera acts like a traditional 2D 640×480 webcam.&nbsp;<br/>•&nbsp;<br/>The second camera generates a 640×480 depth map, which&nbsp;<br/>maps the distance between the camera and the object.&nbsp;<br/>•&nbsp;<br/>This obviously will not provide a Hollywood style 3D movie, but it&nbsp;<br/>does provide an additional degree of information that is useful&nbsp;<br/>for things like feature detection, 3D modeling, and so on.&nbsp;

Installation&nbsp;

<br/>83&nbsp;<br/>•&nbsp;<br/>The Open Kinect project provides free drivers that&nbsp;<br/>are required to use the Kinect.&nbsp;<br/>•&nbsp;<br/>The standard installation on both Mac and Linux&nbsp;<br/>includes the Freenect drivers, so no additional&nbsp;<br/>installation should be required.&nbsp;<br/>•&nbsp;<br/>For Windows users, however, additional drivers must&nbsp;<br/>be installed.&nbsp;<br/>•&nbsp;<br/>Because the installation requirements from Open&nbsp;<br/>Kinect may change, please see their website for&nbsp;<br/>installation requirements at [http://openkinect.org.&nbsp http://openkinect.org.&nbsp];

84&nbsp;<br/>84&nbsp;

•&nbsp;<br/>The overall structure of working with the 2D camera&nbsp;<br/>is similar to a local camera. However, initializing the&nbsp;<br/>camera is slightly different:&nbsp;<br/>from SimpleCV import Kinect&nbsp;<br/># Initialize the Kinect&nbsp;<br/>kin = Kinect()<br/># Snap a picture with the Kinectimg = kin.getImage()<br/>img.show()&nbsp;<br/>Kinect() constructor&nbsp;<br/>(does not take any&nbsp;<br/>arguments)&nbsp;<br/>snap a picture&nbsp;<br/>with the Kinect’s&nbsp;<br/>2D camera&nbsp;

85&nbsp;<br/>85&nbsp;

<br/>•&nbsp;<br/>Using the Kinect simply as a standard 2D camera is a&nbsp;<br/>pretty big waste of money. The Kinect is a great tool&nbsp;<br/>for capturing basic depth information about an object.&nbsp;<br/>•&nbsp;<br/>It measures depth as a number between 0 and 1023, with 0&nbsp;<br/>being the closest to the camera and 1023 being the farthest&nbsp;<br/>away.&nbsp;<br/>•&nbsp;<br/>SimpleCV automatically scales that range down to a 0 to&nbsp;<br/>255 range.&nbsp;<br/>•&nbsp;<br/>Why? Instead of treating the depth map as an array of numbers,&nbsp;<br/>it is often desirable to display it as a grayscale image. In this&nbsp;<br/>visualization, nearby objects will appear as dark grays, whereas&nbsp;<br/>objects in the distance will be light gray or white.&nbsp;

Depth Information Extraction (2)&nbsp;

<br/>86&nbsp;<br/>from SimpleCV import Kinect&nbsp;

#Initialize the Kinect&nbsp;

kin = Kinect()

#This works like getImage, but returns depth information

depth = kin.getDepth()<br/>depth.show()&nbsp;

•&nbsp;<br/>The Kinect’s depth map&nbsp;<br/>is scaled so that it can&nbsp;<br/>fit into a 0 to 255&nbsp;<br/>grayscale image.&nbsp;<br/>•&nbsp;<br/>This reduces the&nbsp;<br/>granularity of the&nbsp;<br/>depth map.&nbsp;<br/>A depth image from the Kinect



87&nbsp;<br/>87&nbsp;

<br/>•&nbsp;<br/>It is possible to get the original 0 to 1023 range&nbsp;<br/>depth map.&nbsp;<br/>•&nbsp;<br/>The function getDepthMatrix() returns a NumPy&nbsp;<br/>matrix with the original full range of depth values.&nbsp;<br/>•&nbsp;<br/>This matrix represents the 2×2 grid of each pixel’s&nbsp;<br/>depth.&nbsp;<br/>from SimpleCV import Kinect&nbsp;

#Initialize the Kinect&nbsp;

kin = Kinect()

#This returns the 0 to 1023 range depth map

depthMatrix = kin.getDepthMatrix()<br/>print depthMatrix&nbsp;

<br/>88&nbsp;<br/>88&nbsp;

from SimpleCV import Kinect&nbsp;

#Initialize the Kinect&nbsp;

kin = Kinect()

#Initialize the display

display = kin.getDepth().show()

#Run in a continuous loop forever

while (True):

#Snaps a picture, and returns the grayscale depth map

depth = kin.getDepth()

#Show the actual image on the screen

depth.save(display)&nbsp;

<br/>Networked Cameras 89&nbsp;

Introduction&nbsp;

<br/>90&nbsp;<br/>•&nbsp;<br/>The previous examples in this lecture have assumed&nbsp;<br/>that the camera is directly connected to the&nbsp;<br/>computer.&nbsp;<br/>•&nbsp;<br/>However, SimpleCV can also control Internet&nbsp;<br/>Protocol (IP) Cameras.&nbsp;<br/>•&nbsp;<br/>Popular for security applications, IP cameras contain a&nbsp;<br/>small web server and a camera sensor.&nbsp;<br/>•&nbsp;<br/>They stream the images from the camera over a web feed.&nbsp;<br/>•&nbsp;<br/>These cameras have recently dropped substantially in&nbsp;<br/>price.&nbsp;<br/>•&nbsp;<br/>Low end cameras can be purchased for as little as for&nbsp;<br/>a wired camera and for a wireless camera.&nbsp;

91&nbsp;<br/>91&nbsp;<br/>s&nbsp;

<br/>•&nbsp;<br/>Two-way audio via a single network cable allows&nbsp;<br/>users to communicate with what they are seeing.&nbsp;<br/>•&nbsp;<br/>Flexibility: IP cameras can be moved around&nbsp;<br/>anywhere on an IP network (including wireless).&nbsp;<br/>•&nbsp;<br/>Distributed intelligence: with IP cameras, video&nbsp;<br/>analytics can be placed in the camera itself&nbsp;<br/>allowing scalability in analytics solutions.&nbsp;<br/>•&nbsp;<br/>Transmission of commands for PTZ (pan, tilt, zoom)&nbsp;<br/>cameras via a single network cable.&nbsp;

92&nbsp;<br/>92&nbsp;<br/>)&nbsp;

<br/>•&nbsp;<br/>Encryption & authentication: IP cameras offer secure&nbsp;<br/>data transmission through encryption and authentication&nbsp;<br/>methods such as WEP, WPA, WPA2, TKIP, AES.&nbsp;<br/>•&nbsp;<br/>Remote accessibility: live video from selected cameras&nbsp;<br/>can be viewed from any computer, anywhere, and also&nbsp;<br/>from many mobile smartphones and other devices.&nbsp;<br/>•&nbsp;<br/>IP cameras are able to function on a wireless network.&nbsp;<br/>•&nbsp;<br/>PoE -Power over ethernet. Modern IP cameras have the&nbsp;<br/>ability to operate without an additional power supply.&nbsp;<br/>They can work with the PoE-protocol which gives power&nbsp;<br/>via the ethernet-cable&nbsp;

93&nbsp;<br/>93&nbsp;

<br/>•&nbsp;<br/>Higher initial cost per camera, except where cheaper&nbsp;<br/>webcams are used.&nbsp;<br/>•&nbsp;<br/>High network bandwidth requirements: a typical CCTV&nbsp;<br/>camera with resolution of 640x480 pixels and 10 frames&nbsp;<br/>per second (10 frame/s) in MJPEG mode requires about 3&nbsp;<br/>Mbit/s.&nbsp;<br/>•&nbsp;<br/>As with a CCTV/DVR system, if the video is transmitted over&nbsp;<br/>the public Internet rather than a private IP LAN, the system&nbsp;<br/>becomes open to a wider audience of hackers and hoaxers.&nbsp;<br/>•&nbsp;<br/>Criminals can hack into a CCTV system to observe security&nbsp;<br/>measures and personnel, thereby facilitating criminal acts and&nbsp;<br/>rendering the surveillance counterproductive.&nbsp;

94&nbsp;<br/>94&nbsp;<br/>)&nbsp;

<br/>•&nbsp;<br/>Most IP cameras support a standard HTTP transport&nbsp;<br/>mode, and stream video via the Motion JPEG&nbsp;<br/>(MJPG) format.&nbsp;<br/>•&nbsp;<br/>To access a MJPG stream, use the&nbsp;<br/>JpegStreamCamera library.&nbsp;<br/>•&nbsp;<br/>The basic setup is the same as before, except that&nbsp;<br/>now the constructor must provide&nbsp;<br/>•&nbsp;<br/>the address of the camera and&nbsp;<br/>•&nbsp;<br/>the name of the MJPG file.&nbsp;<br/>MJPG: video format in which each video frame or interlaced field of a digital&nbsp;<br/>video sequence is separately compressed as a JPEG image.&nbsp;

<br/>95&nbsp;<br/>95&nbsp;<br/>)&nbsp;

<br/>•&nbsp;<br/>In general, initializing an IP camera requires the&nbsp;<br/>following information:&nbsp;<br/>•&nbsp;<br/>The IP address or hostname of the camera&nbsp;<br/>(mycamera)&nbsp;<br/>•&nbsp;<br/>The path to the Motion JPEG feed (video.mjpg)&nbsp;<br/>•&nbsp;<br/>The username and password, if required.&nbsp;<br/>from SimpleCV import JpegStreamCamera

#Initialize the webcam by providing URL to the camera&nbsp;

cam = JpegStreamCamera("[http://mycamera/video.mjpg http://mycamera/video.mjpg]")<br/>cam.getImage().show()&nbsp;

<br/>96&nbsp;<br/>96&nbsp;

•&nbsp;<br/>Try loading the URL in a web browser. It should&nbsp;<br/>show the video stream.&nbsp;<br/>•&nbsp;<br/>If the video stream does not appear, it may be that&nbsp;<br/>the URL is incorrect or that there are other&nbsp;<br/>configuration issues.&nbsp;<br/>•&nbsp;<br/>One possible issue is that the URL requires a login to&nbsp;<br/>access it.&nbsp;

Authentication information&nbsp;

<br/>97&nbsp;<br/>•&nbsp;<br/>If the video stream requires a username and&nbsp;<br/>password to access it, then provide that&nbsp;<br/>authentication information in the URL.&nbsp;<br/>from SimpleCV import JpegStreamCamera&nbsp;

#Initialize the camera with login info in the URL&nbsp;

cam = JpegStreamCamera("[http://admin:1234@192.168.1.10/video.mjpg http://admin:1234@192.168.1.10/video.mjpg]")&nbsp;<br/>cam.getImage().show()&nbsp;

<br/>98&nbsp;<br/>98&nbsp;

<br/>•&nbsp;<br/>Many phones and mobile devices&nbsp;<br/>today include a built-in camera.&nbsp;<br/>•&nbsp;<br/>Tablet computers and both the iOSand Android smart phones can be&nbsp;<br/>used as network cameras with apps&nbsp;<br/>that stream the camera output to an&nbsp;<br/>MJPG server.&nbsp;<br/>•&nbsp;<br/>To install one of these apps, searchfor “IP Cam” in the app marketplace&nbsp;<br/>on an iPhone/iPad or search for “IP&nbsp;<br/>Webcam” on Android devices.&nbsp;<br/>•&nbsp;<br/>Some of these apps are for viewing&nbsp;<br/>feeds from other IP cameras, so make&nbsp;<br/>sure that the app is designed as a&nbsp;<br/>server and not a viewer.&nbsp;<br/>IP Cam Pro&nbsp;

by Senstic&nbsp;

<br/>IP Webcam&nbsp;

by Pavel Khlebovich&nbsp;

<br/>99&nbsp;

Advanced Features 100&nbsp;

Introduction&nbsp;

<br/>101&nbsp;<br/>•&nbsp;<br/>Previous lectures introduced feature detection and&nbsp;<br/>extraction, but mostly focused on common geometric&nbsp;<br/>shapes like lines and circles.&nbsp;<br/>•&nbsp;<br/>Even blobs assume that there is a contiguous grouping of&nbsp;<br/>similar pixels.&nbsp;<br/>•&nbsp;<br/>This lecture builds on those results by looking for more&nbsp;<br/>complex objects. Most of this detection is performed by&nbsp;<br/>searching for a template of a known form in a larger&nbsp;<br/>image.&nbsp;<br/>•&nbsp;<br/>This lecture also provides an overview of optical flow,&nbsp;<br/>which attempts to identify objects that change between&nbsp;<br/>two frames.&nbsp;

102&nbsp;<br/>102&nbsp;<br/>s&nbsp;

<br/>•&nbsp;<br/>Finding instances of template images in a larger&nbsp;<br/>image Using Haar classifiers, particularly to identify&nbsp;<br/>faces&nbsp;<br/>•&nbsp;<br/>Barcode scanning for 1D and 2D barcodes&nbsp;<br/>•&nbsp;<br/>Finding keypoints, which is a more robust form of&nbsp;<br/>template matching&nbsp;<br/>•&nbsp;<br/>Tracking objects that move&nbsp;

103&nbsp;<br/>103&nbsp;<br/>g&nbsp;

<br/>•&nbsp;<br/>Goal&nbsp;<br/>•&nbsp;<br/>learn how to use SimpleCV template matching functions&nbsp;<br/>to search for matches between an image patch and an&nbsp;<br/>input image&nbsp;<br/>•&nbsp;<br/>What is template matching?&nbsp;<br/>•&nbsp;<br/>Template matching is a technique for finding areas of&nbsp;<br/>an image that match (are similar) to a template image&nbsp;<br/>(patch).&nbsp;

How does it work?&nbsp;

<br/>104&nbsp;<br/>•&nbsp;<br/>We need two primary components:&nbsp;<br/>•&nbsp;<br/>Source image (I): The image in which we expect to find&nbsp;<br/>a match to the template image&nbsp;<br/>•&nbsp;<br/>Template image (T): The patch image which will be&nbsp;<br/>compared to the template image&nbsp;<br/>•&nbsp;<br/>Our goal is to detect the highest matching area:&nbsp;

105&nbsp;<br/>105&nbsp;<br/>)&nbsp;

<br/>•&nbsp;<br/>To identify the matching area, we have to compare the&nbsp;<br/>template image against the source image by sliding it:&nbsp;<br/>•&nbsp;<br/>By sliding, we mean moving the patch one pixel at a time&nbsp;<br/>(left to right, up to down). At each location, a metric is&nbsp;<br/>calculated so it represents how “good” or “bad” the match&nbsp;<br/>at that location is (or how similar the patch is to that&nbsp;<br/>particular area of the source image).&nbsp;

Bitmap Template Matching&nbsp;

<br/>106&nbsp;<br/>•&nbsp;<br/>This algorithm works by searching for instances&nbsp;<br/>where a bitmap template—a small image ofthe object to be found—can be found within a&nbsp;<br/>larger image.&nbsp;<br/>•&nbsp;<br/>For example, if trying to create a vision system to&nbsp;<br/>play Where’s Waldo, the template image would&nbsp;<br/>be a picture of Waldo.&nbsp;<br/>•&nbsp;<br/>To match his most important feature, his face, the&nbsp;<br/>Waldo template would be cropped to right&nbsp;<br/>around his head and include a minimal amount of&nbsp;<br/>the background.&nbsp;<br/>•&nbsp;<br/>A template with his whole body would only match&nbsp;<br/>instances where his whole body was visible and&nbsp;<br/>positioned exactly the same way. The other&nbsp;<br/>component in template matching is the image to&nbsp;<br/>be searched.&nbsp;

findTemplate() function&nbsp;

<br/>107&nbsp;<br/>•&nbsp;<br/>The template matching&nbsp;<br/>feature works by calling the&nbsp;<br/>findTemplate() function on&nbsp;<br/>the Image object to be&nbsp;<br/>searched.&nbsp;<br/>Pieces on a Go board&nbsp;

•&nbsp;<br/>Next, pass as a parameter&nbsp;<br/>the template of the object to&nbsp;<br/>be found.&nbsp;<br/>Template of black piece&nbsp;



108&nbsp;<br/>108&nbsp;<br/>)&nbsp;

<br/>from SimpleCV import Image# Get the template and imagegoBoard = Image('go.png')<br/>black = Image('go-black.png')<br/># Find the matches and draw them&nbsp;<br/>matches = goBoard.findTemplate(black)<br/>matches.draw()<br/># Show the board with matches print the numbergoBoard.show()<br/>print str(len(matches)) + " matches found."&nbsp;<br/># Should output: 9 matches found.&nbsp;<br/>Matches for black pieces&nbsp;



109&nbsp;<br/>109&nbsp;<br/>)&nbsp;

<br/>•&nbsp;<br/>The findTemplate() function also takes two optional&nbsp;<br/>arguments:&nbsp;<br/>•&nbsp;<br/>method&nbsp;<br/>•&nbsp;<br/>defines the algorithm to use for the matching&nbsp;<br/>•&nbsp;<br/>details about the various available matching algorithms can by found&nbsp;<br/>by typing help Image.findTemplate in the SimpleCV shell.&nbsp;<br/>•&nbsp;<br/>Threshold&nbsp;<br/>•&nbsp;<br/>fine-tunes the quality of the matches&nbsp;<br/>•&nbsp;<br/>works like thresholds with other feature matching functions&nbsp;<br/>•&nbsp;<br/>decreasing the threshold results in more matches, but could also result in&nbsp;<br/>more false positives.&nbsp;<br/>•&nbsp;<br/>These tuning parameters can help the quality of results, but&nbsp;<br/>template matching is error prone in all but the most&nbsp;<br/>controlled, consistent environments.&nbsp;<br/>•&nbsp;<br/>Keypoint matching, which is described in the next section, is&nbsp;<br/>a more robust approach.&nbsp;

110&nbsp;<br/>110&nbsp;<br/>s&nbsp;

<br/>•&nbsp;<br/>Square difference matching method (CV_TM_SQDIFF)&nbsp;<br/>•&nbsp;<br/>These methods match the squared difference, so a perfect&nbsp;<br/>match will be 0 and bad matches will be large:&nbsp;<br/>•&nbsp;<br/>Correlation matching methods(CV_TM_CCORR)&nbsp;<br/>•&nbsp;<br/>These methods multiplicatively match the template against&nbsp;<br/>the image, so a perfect match will be large and bad&nbsp;<br/>matches will be small or 0.&nbsp;

111&nbsp;<br/>111&nbsp;

<br/>•&nbsp;<br/>Correlation coefficient matching methods&nbsp;<br/>(CV_TM_CCOEFF)&nbsp;<br/>•&nbsp;<br/>These methods match a template relative to its mean&nbsp;<br/>against the image relative to its mean, so a perfect&nbsp;<br/>match will be 1 and a perfect mismatch will be –1; a&nbsp;<br/>value of 0 simply means that there is no correlation&nbsp;<br/>(random alignments).&nbsp;<br/>where&nbsp;

Normalized methods&nbsp;

<br/>112&nbsp;<br/>•&nbsp;<br/>For each of the three methods just described, there&nbsp;<br/>are also normalized versions.&nbsp;<br/>•&nbsp;<br/>The normalized methods are useful because they&nbsp;<br/>can help reduce the effects of lighting differences&nbsp;<br/>between the template and the image.&nbsp;<br/>•&nbsp;<br/>In each case, the normalization coefficient is the&nbsp;<br/>same:&nbsp;

Values of the method parameter for&nbsp;<br/>normalized template matching&nbsp;<br/>113&nbsp;

Values of the method parameter for&nbsp;<br/>normalized template matching&nbsp;<br/>113&nbsp;<br/>•&nbsp;<br/>As usual, we obtain more accurate matches (at the cost&nbsp;<br/>of more computations) as we move from simpler&nbsp;<br/>measures (square difference) to the more sophisticatedones (correlation coefficient).&nbsp;

Limitations&nbsp;

<br/>114&nbsp;<br/>•&nbsp;<br/>This approach supports searching for a wide variety of&nbsp;<br/>different objects but:&nbsp;<br/>•&nbsp;<br/>The image being searched always needs to be larger than&nbsp;<br/>the template image for there to be a match.&nbsp;<br/>•&nbsp;<br/>It is not scale or rotation invariant.&nbsp;<br/>•&nbsp;<br/>The size of the object in the template must equal the size it&nbsp;<br/>is in the image.&nbsp;<br/>•&nbsp;<br/>Lighting conditions also can have an impact because the&nbsp;<br/>image brightness or the reflection on specular objects can&nbsp;<br/>stop a match from being found.&nbsp;<br/>•&nbsp;<br/>As a result, the matching works best when used in an&nbsp;<br/>extremely controlled environment.&nbsp;

115&nbsp;<br/>115&nbsp;<br/>g&nbsp;

<br/>•&nbsp;<br/>Tracking an object as it moves between two images is a&nbsp;<br/>hard problem for a computer vision system.&nbsp;<br/>•&nbsp;<br/>This is a challenge that requires identifying an object in one&nbsp;<br/>image, finding that same object in the second image, and then&nbsp;<br/>computing the amount of movement.&nbsp;<br/>•&nbsp;<br/>We can detect that something has changed in an image,<br/>using techniques such as subtracting one image from another.&nbsp;<br/>•&nbsp;<br/>While the feature detectors we’ve looked at so far are&nbsp;<br/>useful for identifying objects in a single image, they are&nbsp;<br/>often sensitive to different degrees of rotation or variable&nbsp;<br/>lighting conditions.&nbsp;<br/>•&nbsp;<br/>As these are both common issues when tracking an object in&nbsp;<br/>motion, a more robust feature extractor is needed. One&nbsp;<br/>solution is to use keypoints.&nbsp;

116&nbsp;<br/>116&nbsp;

<br/>•&nbsp;<br/>A keypoint describes an object in terms that are&nbsp;<br/>independent of position, rotation, and lighting.&nbsp;<br/>•&nbsp;<br/>For example, in many environments, detecting corners makegood keypoints.&nbsp;<br/>•&nbsp;<br/>As it was described before, a corner is made from two intersecting&nbsp;<br/>lines at any angle.&nbsp;<br/>•&nbsp;<br/>Move a corner from the top-left to the bottom-right of the screen&nbsp;<br/>and the angle between the two intersecting lines remains the&nbsp;<br/>same.&nbsp;<br/>•&nbsp;<br/>Rotate the image, and the angle remains the same.&nbsp;<br/>•&nbsp;<br/>Shine more light on the corner, and it’s still the same angle.&nbsp;<br/>•&nbsp;<br/>Scale the image to twice its size, and again, the angle remains the&nbsp;<br/>same.&nbsp;<br/>•&nbsp;<br/>Corners are robust to many environmental conditions and image&nbsp;<br/>transformations.&nbsp;

117&nbsp;<br/>117&nbsp;<br/>)&nbsp;

<br/>•&nbsp;<br/>Keypoints can be more than just corners, but corners&nbsp;<br/>provide an intuitive framework for understudying&nbsp;<br/>the underpinnings of keypoint detection.&nbsp;<br/>•&nbsp;<br/>The keypoints are extracted using the&nbsp;<br/>findKeypoints() function from the Image library.&nbsp;<br/>•&nbsp;<br/>In addition to the typical feature properties, such as&nbsp;<br/>size and location, a keypoint also has a descriptor()&nbsp;<br/>function that outputs the actual points that are&nbsp;<br/>robust to location, rotation, scale, and so on.&nbsp;

The extracted keypoints&nbsp;<br/>A common hotel room keycard&nbsp;<br/>118&nbsp;<br/>The extracted keypoints&nbsp;<br/>A common hotel room keycard&nbsp;<br/>118&nbsp;<br/>findKeypoints() example&nbsp;

from SimpleCV import Imagecard = Image('keycard.png')<br/>keys = card.findKeypoints()<br/>keys.draw()<br/>1&nbsp;<br/>card.show()&nbsp;<br/>2&nbsp;<br/>1.&nbsp;<br/>Find the keypoints on the image using&nbsp;<br/>the findKeypoints() method.&nbsp;<br/>2.&nbsp;<br/>Draw those keypoints on the screen.&nbsp;<br/>They will appear as green circles at&nbsp;<br/>each point. The size of the circle&nbsp;<br/>represents the quality of the keypoint.&nbsp;

findKeypoints() function example (2)&nbsp;

<br/>119&nbsp;<br/>•&nbsp;<br/>The above keypoints are not particularly valuable on&nbsp;<br/>their own, but the next step is to apply this concept to&nbsp;<br/>perform template matching.&nbsp;<br/>•&nbsp;<br/>As with the findTemplate() approach, a template image&nbsp;<br/>is used to find keypoint matches. However, unlike the&nbsp;<br/>previous example, keypoint matching does not work&nbsp;<br/>directly off the template image.&nbsp;<br/>•&nbsp;<br/>Instead, the process extracts the keypoints from the&nbsp;<br/>template image, and then looks for those keypoints in&nbsp;<br/>the target image. This results in a much more robust&nbsp;<br/>matching system.&nbsp;

120&nbsp;<br/>120&nbsp;

<br/>•&nbsp;<br/>Keypoint matching works best when the object has a lot&nbsp;<br/>of texture with diverse colors and shapes.&nbsp;<br/>•&nbsp;<br/>Objects with uniform color and simple shapes do not&nbsp;<br/>have enough keypoints to find good matches.&nbsp;<br/>•&nbsp;<br/>The matching works best with small rotations, usually&nbsp;<br/>less than 45 degrees. Greater or larger rotations could&nbsp;<br/>work, but it will be harder for the algorithm to find a&nbsp;<br/>match.&nbsp;<br/>•&nbsp;<br/>Whereas the findTemplate() function looks for multiple&nbsp;<br/>matches of the template, the findKeypointMatch()&nbsp;<br/>function returns only the best match for the template.&nbsp;

121&nbsp;<br/>121&nbsp;

<br/>•&nbsp;<br/>template (required)&nbsp;<br/>•&nbsp;<br/>The template image to search for in the target image.&nbsp;<br/>•&nbsp;<br/>quality&nbsp;<br/>•&nbsp;<br/>Configures the quality threshold for matches.&nbsp;<br/>•&nbsp;<br/>Default: 500; range for best results: [300:500]&nbsp;<br/>•&nbsp;<br/>minDist&nbsp;<br/>•&nbsp;<br/>The minimum distance between two feature vectors necessary in&nbsp;<br/>order to treat them as a match. The lower the value, the better&nbsp;<br/>the quality. Too low a value, though, prevents good matches from&nbsp;<br/>being returned.&nbsp;<br/>•&nbsp;<br/>Default: 0.2, range for best results: [0.05:0.3]&nbsp;<br/>•&nbsp;<br/>minMatch&nbsp;<br/>•&nbsp;<br/>The minimum percentage of feature matches that must be found&nbsp;<br/>to match an object with the template.&nbsp;<br/>•&nbsp;<br/>Default: 0.4 (40%); good values typically range: [0.3:0.7]&nbsp;

122&nbsp;<br/>122&nbsp;

<br/>•&nbsp;<br/>Flavor: a string indicating the method to use to&nbsp;<br/>extract features.&nbsp;<br/>•&nbsp;<br/>“SURF” -extract the SURF features and descriptors. If&nbsp;<br/>you don’t know what to use, use this.&nbsp;<br/>•&nbsp;<br/>[http://en.wikipedia.org/wiki/SURF&nbsp http://en.wikipedia.org/wiki/SURF&nbsp];<br/>•&nbsp;<br/>“STAR” -The STAR feature extraction algorithm&nbsp;<br/>•&nbsp;<br/>[http://pr.willowgarage.com/wiki/Star_Detector&nbsp http://pr.willowgarage.com/wiki/Star_Detector&nbsp];<br/>•&nbsp;<br/>“FAST” -The FAST keypoint extraction algorithm&nbsp;<br/>•&nbsp;<br/>[http://en.wikipedia.org/wiki/Corner_detection#AST_based&nbsp http://en.wikipedia.org/wiki/Corner_detection#AST_based&nbsp];<br/>_feature_detectors&nbsp;

123&nbsp;<br/>123&nbsp;

<br/>•&nbsp;<br/>shows a side-by-side image, with lines drawn between&nbsp;<br/>the two Images to indicate where it finds a match.&nbsp;<br/>•&nbsp;<br/>If it draws lots of lines, the matching algorithm should&nbsp;<br/>work.&nbsp;

124&nbsp;<br/>124&nbsp;

<br/>..shows a side-by-side image,<br/>with lines drawn between the&nbsp;<br/>two Images to indicate where it&nbsp;<br/>finds a match.&nbsp;<br/>..If it draws lots of lines, the&nbsp;<br/>matching algorithm should&nbsp;<br/>work.&nbsp;<br/>from SimpleCV import Imagetemplate = Image('ch10-card.png')<br/>img = Image('ch10-card-on-table.png')<br/>match = img.findKeypointMatch(template)<br/>match.draw(width=3)<br/>img.show()&nbsp;<br/>draw a box around the detected object.&nbsp;

125&nbsp;<br/>125&nbsp;

<br/>•&nbsp;<br/>Note that keypoint matching only finds the single&nbsp;<br/>best match for the image. If multiple keycards were&nbsp;<br/>on the table, it would only report the closest match.&nbsp;<br/>The detected match for the keycard&nbsp;

[http://www.youtube.com/watch?v=CxPeoQDc2-Y&nbsp http://www.youtube.com/watch?v=CxPeoQDc2-Y&nbsp];

<br/>126&nbsp;<br/>126&nbsp;<br/>w&nbsp;

<br/>•&nbsp;<br/>The next logical step beyond template matching is to&nbsp;<br/>understand how to track objects between frames.&nbsp;<br/>•&nbsp;<br/>Optical flow is very similar to template matching in that&nbsp;<br/>it takes a small area of one image and then scans the&nbsp;<br/>same region in a second image in an attempt to find a&nbsp;<br/>match.&nbsp;<br/>•&nbsp;<br/>If a match is found, the system indicates the direction of&nbsp;<br/>travel, as measured in (X, Y) points.&nbsp;<br/>•&nbsp;<br/>Only the two-dimensional travel distance is recorded. If&nbsp;<br/>the object also moved closer to or further away from&nbsp;<br/>the camera, this distance is not recorded.&nbsp;

127&nbsp;<br/>127&nbsp;<br/>n&nbsp;

<br/>•&nbsp;<br/>computes the optical flow&nbsp;<br/>•&nbsp;<br/>has a single required parameter,&nbsp;<br/>•&nbsp;<br/>previous_frame, which is the image used for&nbsp;<br/>comparison.&nbsp;<br/>•&nbsp;<br/>The previous frame must be the same size.&nbsp;

128&nbsp;<br/>from SimpleCV import Camera, Color, Displaycam = Camera()<br/>previous = cam.getImage()<br/>disp = Display(previous.size())<br/>while not disp.isDone():<br/>current = cam.getImage()<br/>motion = current.findMotion(previous)<br/>for m in motion:&nbsp;<br/>m.draw(color=Color.RED,normalize=False)<br/>current.save(disp)<br/>previous = current Draw the little red motion&nbsp;<br/>lines on the screen to&nbsp;<br/>indicate where the motion&nbsp;<br/>occurred.&nbsp;<br/>128&nbsp;<br/>from SimpleCV import Camera, Color, Displaycam = Camera()<br/>previous = cam.getImage()<br/>disp = Display(previous.size())<br/>while not disp.isDone():<br/>current = cam.getImage()<br/>motion = current.findMotion(previous)<br/>for m in motion:&nbsp;<br/>m.draw(color=Color.RED,normalize=False)<br/>current.save(disp)<br/>previous = current Draw the little red motion&nbsp;<br/>lines on the screen to&nbsp;<br/>indicate where the motion&nbsp;<br/>occurred.&nbsp;

129&nbsp;<br/>129&nbsp;<br/>e&nbsp;



Optical flow example&nbsp;

•&nbsp;<br/>The findMotion function supports several different algorithms to detect&nbsp;<br/>motion. For additional information, type help Image in the SimpleCV shell.&nbsp;<br/>[http://www.youtube.com/watch?v=V4r2HXGA8jw&nbsp http://www.youtube.com/watch?v=V4r2HXGA8jw&nbsp];



130&nbsp;<br/>130&nbsp;<br/>s&nbsp;

<br/>•&nbsp;<br/>previous_frame -The last frame as an Image.&nbsp;<br/>•&nbsp;<br/>window -The block size for the algorithm. For the the HS and LK&nbsp;<br/>methods this is the regular sample grid at which we return motion&nbsp;<br/>samples. For the block matching method this is the matching windowsize.&nbsp;<br/>•&nbsp;<br/>method -The algorithm to use as a string. Your choices are:&nbsp;<br/>•&nbsp;<br/>‘BM’ -default block matching robust but slow -if you are unsure use this.&nbsp;<br/>•&nbsp;<br/>[http://en.wikipedia.org/wiki/Block-matching_algorithm&nbsp http://en.wikipedia.org/wiki/Block-matching_algorithm&nbsp];<br/>•&nbsp;<br/>‘LK’ -Lucas-Kanade method&nbsp;<br/>•&nbsp;<br/>[http://en.wikipedia.org/wiki/Lucas–Kanade_method&nbsp http://en.wikipedia.org/wiki/Lucas%E2%80%93Kanade_method&nbsp];<br/>•&nbsp;<br/>‘HS’ -Horn-Schunck method&nbsp;<br/>•&nbsp;<br/>[http://en.wikipedia.org/wiki/Horn–Schunck_method&nbsp http://en.wikipedia.org/wiki/Horn%E2%80%93Schunck_method&nbsp];<br/>•&nbsp;<br/>aggregate -If aggregate is true, each of our motion features is the&nbsp;<br/>average of motion around the sample grid defined by window. Ifaggregate is false we just return the value as sampled at the&nbsp;<br/>window grid interval. For block matching this flag is ignored.&nbsp;

Haar-like Features&nbsp;

<br/>131&nbsp;<br/>•&nbsp;<br/>Unlike template matching, Haar-like Features are&nbsp;<br/>used to classify more generic objects.&nbsp;<br/>•&nbsp;<br/>They are particularly popular for face detection,&nbsp;<br/>where the system determines whether an object is a&nbsp;<br/>generic face.&nbsp;<br/>•&nbsp;<br/>This is different from face recognition, which tries to&nbsp;<br/>identify whose face is in the image and is a much more&nbsp;<br/>complicated process.&nbsp;<br/>•&nbsp;<br/>Simply knowing that an object is a face is useful for&nbsp;<br/>segmenting the image, narrowing down a region of&nbsp;<br/>interest, or simply doing some other fun tricks.&nbsp;

132&nbsp;<br/>132&nbsp;<br/>)&nbsp;

<br/>•&nbsp;<br/>Technically, Haar-like features refer to a way of slicing&nbsp;<br/>and dicing an image to identify the key patterns.&nbsp;<br/>•&nbsp;<br/>The template information is stored in a file known as a&nbsp;<br/>Haar Cascade, usually formatted as an XML file.&nbsp;<br/>•&nbsp;<br/>This requires a fair amount of work to train a classifier&nbsp;<br/>system and generate the cascade file.&nbsp;<br/>•&nbsp;<br/>Fortunately, SimpleCV includes some common face detection&nbsp;<br/>cascades, and additional ones are available on the Internet.&nbsp;<br/>•&nbsp;<br/>[http://en.wikipedia.org/wiki/Haar-like_features&nbsp http://en.wikipedia.org/wiki/Haar-like_features&nbsp];<br/>•&nbsp;<br/>[http://alereimondo.no-ip.org/OpenCV/34&nbsp http://alereimondo.no-ip.org/OpenCV/34&nbsp];

built-in cascades&nbsp;

<br/>133&nbsp;<br/>•&nbsp;<br/>The built-in cascades with SimpleCV include:&nbsp;<br/>•&nbsp;<br/>Forward-looking faces&nbsp;<br/>•&nbsp;<br/>Profile faces&nbsp;<br/>•&nbsp;<br/>Eyes&nbsp;<br/>•&nbsp;<br/>Noses&nbsp;<br/>•&nbsp;<br/>Mouths&nbsp;<br/>•&nbsp;<br/>Ears&nbsp;<br/>•&nbsp;<br/>Upper and lower bodies&nbsp;

134&nbsp;<br/>134&nbsp;<br/>n&nbsp;

<br/>•&nbsp;<br/>Haar-like features are detected with the findHaarFeatures() functionof the Image library.&nbsp;<br/>•&nbsp;<br/>Parameters:&nbsp;<br/>•&nbsp;<br/>cascade&nbsp;<br/>•&nbsp;<br/>The path the Haar Cascade XML file.&nbsp;<br/>•&nbsp;<br/>scale_factor&nbsp;<br/>•&nbsp;<br/>The Haar Cascades are technically sensitive to the image’s scale. To simulate&nbsp;<br/>scale invariance, the algorithm is run multiple times, scaling the template up&nbsp;<br/>with each run. The amount that the template should be scaled is controlled bythe scale_factor. Default: 1.2 (it scales up the template 20% each time).&nbsp;<br/>•&nbsp;<br/>min_neighbors&nbsp;<br/>•&nbsp;<br/>This is like a threshold value in other feature detectors. Technically, it deals&nbsp;<br/>with the number of adjacent detections needed to classify the object, but&nbsp;<br/>conceptually it is easier to think of as a threshold parameter. Default: 2.&nbsp;<br/>•&nbsp;<br/>use_canny&nbsp;<br/>•&nbsp;<br/>The default value is to use Canny pruning to reduce false positives in&nbsp;<br/>potentially noisy images. This is usually always the best option.&nbsp;

135&nbsp;<br/>from SimpleCV import Camera, Displaycam = Camera()<br/>disp = Display(cam.getImage().size())<br/>while disp.isNotDone():<br/>img = cam.getImage()<br/># Look for a face&nbsp;<br/>faces = img.findHaarFeatures('face')<br/>if faces is not None:&nbsp;<br/># Get the largest face&nbsp;<br/>faces = faces.sortArea()<br/>bigFace = faces[-1]<br/># Draw a green box around the face&nbsp;<br/>bigFace.draw()<br/>img.save(disp)&nbsp;<br/>loads one of the built-in&nbsp;<br/>Haar Cascade files&nbsp;<br/>135&nbsp;<br/>from SimpleCV import Camera, Displaycam = Camera()<br/>disp = Display(cam.getImage().size())<br/>while disp.isNotDone():<br/>img = cam.getImage()<br/># Look for a face&nbsp;<br/>faces = img.findHaarFeatures('face')<br/>if faces is not None:&nbsp;<br/># Get the largest face&nbsp;<br/>faces = faces.sortArea()<br/>bigFace = faces[-1]<br/># Draw a green box around the face&nbsp;<br/>bigFace.draw()<br/>img.save(disp)&nbsp;<br/>loads one of the built-in&nbsp;<br/>Haar Cascade files&nbsp;

findHaarFeatures() function example&nbsp;

<br/>(2)<br/>136&nbsp;<br/>•&nbsp;<br/>If working with a Haar Cascade that was&nbsp;<br/>downloaded from the Internet or created manually,&nbsp;<br/>simply specify the full path to the file. }&nbsp;<br/>•&nbsp;<br/>findHaarFeatures("/path/to/haarcascade_frontalface_alt.xml"<br/>•&nbsp;<br/>The detection works like most other feature&nbsp;<br/>detectors. Simply pass the cascade file loaded&nbsp;<br/>earlier and it returns a FeatureSet with the matches.&nbsp;<br/>[http://www.youtube.com/watch?v=c4LobbqeKZc&nbsp http://www.youtube.com/watch?v=c4LobbqeKZc&nbsp];

[http://www.youtube.com/watch?v=aTErTqOIkss&nbsp http://www.youtube.com/watch?v=aTErTqOIkss&nbsp];

<br/>Limitations&nbsp;

<br/>137&nbsp;<br/>•&nbsp;<br/>Haar Cascades also work best in controlled&nbsp;<br/>environments.&nbsp;<br/>•&nbsp;<br/>The Haar Cascade for detecting forward-looking faces&nbsp;<br/>will not work well on an image with a face looking to&nbsp;<br/>the side.&nbsp;<br/>•&nbsp;<br/>Size and rotation of the object can also create&nbsp;<br/>complications, though the underlying algorithms are&nbsp;<br/>more flexible than with template matching.&nbsp;

Barcode&nbsp;

<br/>138&nbsp;<br/>•&nbsp;<br/>One-dimensional barcodes have become a ubiquitous part of the&nbsp;<br/>modern shopping experience.&nbsp;<br/>•&nbsp;<br/>Two-dimensional barcodes are becoming increasingly popular for&nbsp;<br/>storing contact information, URL’s, and other small bits of information.&nbsp;<br/>•&nbsp;<br/>This growing popularity is helped by the availability of open source&nbsp;<br/>tools that can be used to extract information from these barcodes.&nbsp;<br/>•&nbsp;<br/>One example of these tools is the ZXing library (pronounced “ZebraCrossing”), which is an image processing library for barcodes.&nbsp;<br/>•&nbsp;<br/>The SimpleCV framework works with the ZXing library, making it easy to&nbsp;<br/>process images of one-and two-dimensional barcodes as part of a&nbsp;<br/>vision system.&nbsp;<br/>•&nbsp;<br/>As of SimpleCV version 1.3, ZXing is not automatically installed. If it is&nbsp;<br/>not installed, trying to use the barcode functions will throw a warning&nbsp;<br/>and not work. For instructions on installing ZXing, type help&nbsp;<br/>Image.findBarcode om/p/zxinfrom the SimpleCV shell, or go to&nbsp;<br/>[http://code.google http://code.google] .cg/&nbsp;

139&nbsp;<br/>139&nbsp;<br/>)&nbsp;

<br/>•&nbsp;<br/>To extract the information from a barcode, use the&nbsp;<br/>findBarcode() function.&nbsp;<br/>•&nbsp;<br/>It works with both one-dimensional and two-dimensional&nbsp;<br/>barcodes.&nbsp;<br/>•&nbsp;<br/>The image to be scanned can contain more than just a&nbsp;<br/>barcode, but the detector works best when there is not&nbsp;<br/>a lot of extra noise around it.&nbsp;<br/>•&nbsp;<br/>In addition, while most barcodes are designed to work&nbsp;<br/>in spite of a partial obstruction of the barcode, the&nbsp;<br/>detector works best when it has a clear view of the&nbsp;<br/>barcode.&nbsp;

140&nbsp;<br/>140&nbsp;<br/>)&nbsp;

<br/>from SimpleCV import Image, Barcode# Load a one-dimensional barcode&nbsp;<br/>img = Image('upc.png')<br/>barcode = img.findBarcode()<br/>print barcode.data# Should output: 987654321098&nbsp;<br/>Example of a one-<br/>dimensional barcode&nbsp;

<br/>from SimpleCV import Image, Barcode# Load a QR barcode&nbsp;<br/>img = Image('qr.png')<br/>barcode = img.findBarcode()<br/>print barcode.data.rstrip()<br/># Should output: [http://www.simplecv.org&nbsp http://www.simplecv.org&nbsp];<br/>Example of a QR&nbsp;<br/>barcode&nbsp;



Why Learn Computer Vision?&nbsp;

<br/>141&nbsp;<br/>•&nbsp;<br/>Computer vision is moving from a niche tool to an&nbsp;<br/>increasingly common tool for a diverse range ofapplications:&nbsp;<br/>•&nbsp;<br/>facial recognition programs or gaming interfaces like the&nbsp;<br/>Kinect&nbsp;<br/>•&nbsp;<br/>automotive safety systems where a car detects when the&nbsp;<br/>driver starts to drift from the lane, or when is getting drowsy&nbsp;<br/>•&nbsp;<br/>point-and-shoot cameras to help detect faces or other central&nbsp;<br/>objects to focus on&nbsp;<br/>•&nbsp;<br/>high tech special effects or basic effects, such as the virtual&nbsp;<br/>yellow first-and-ten line in football games, or the motion blurs&nbsp;<br/>on a hockey puck.&nbsp;<br/>•&nbsp;<br/>industrial automation, biometrics, medicine, and even&nbsp;<br/>planetary exploration&nbsp;<br/>•&nbsp;<br/>food and agriculture, where it is used to inspect and grade&nbsp;<br/>fruits and vegetables&nbsp;<br/>•&nbsp;<br/>It's a diverse field, with more and more interesting&nbsp;<br/>applications popping up every day.&nbsp;

142&nbsp;<br/>142&nbsp;<br/>?&nbsp;

<br/>•&nbsp;<br/>Computer vision is built upon the fields of mathematics,<br/>physics, biology, engineering, and of course, computer&nbsp;<br/>science.&nbsp;<br/>•&nbsp;<br/>There are many fields related to computer vision, such as&nbsp;<br/>machine learning, signal processing, robotics, and artificial&nbsp;<br/>intelligence.&nbsp;<br/>•&nbsp;<br/>Even though it is a field built on advanced concepts, more&nbsp;<br/>and more tools are making it accessible to everyone from&nbsp;<br/>hobbyists to vision engineers to academic researchers.&nbsp;<br/>•&nbsp;<br/>It is an exciting time in this field, and there are an endless&nbsp;<br/>number of possibilities for applications.&nbsp;<br/>•&nbsp;<br/>One of the things that makes it exciting is that these days,&nbsp;<br/>the hardware requirements are inexpensive enough to allow&nbsp;<br/>more casual developers entry into the field, opening the&nbsp;<br/>door to many new applications and innovations.&nbsp;