New color-sensitive vision sensor for tracking objects

By October 02, 2013 2 comments
Vision sensors for robots

US researchers have developed a vision sensor which can visually track objects that it has been trained to ‘see’.

US university Carnegie Mellon and Texan startup  Charmed Labs have been working together to create a small vision sensor, Pixy, which can detect objects and distinguish them by color. As robots are now being developed for use in the home, many researchers have been trying to furnish them with ‘human’ senses to enable them to integrate more effectively into our daily lives. The University of Tokyo for example has developed a patch which can give robots a finer sense of touch. This new sensor is equipped with visual sensitivity and can also memorize specific movements and actions, which will lead it to operate more autonomously.

Automated detection of colored objects

Pixy is essentially a tiny camera which can be programmed to recognize objects and their specific coloring. All you have to do is place an object of the sort you wish Pixy to track – a yellow ball for instance – in front of it for several seconds. The device will memorize the object and note its color and will subsequently be able to detect similar objects automatically without the aid of its user. It can detect and track up to seven different colors at once, plus a large range of objects, and can be re-programed at any time. Pixy works fast, processing an image frame every 20 milliseconds – which means it can track movement with a high degree of accuracy. Using a dedicated app, the pictures can then be sent automatically to the user’s computer.

Incorporating Pixy into bots

One of the basic objectives of Pixy’s creators is to make the vision sensor as easy as possible for a wide range of users to incorporate into their own bots. Our goal is “to bring advanced technologies to new audiences by making them easy to use and affordable,” explains Charmed Labs founder Rich LeGrand. Accordingly, users will be able to train the device themselves to recognize new objects, individual colors and color-codes and, in the longer term, teach it to perform ad hoc tasks. Up to now robots and robotic devices have been able to detect objects but without using ‘sight’. Pixy has been developed to be compatible with a range of micro-controllers such as Arduino, and so additional applications can be envisaged. One example would be to program Pixy to recognize a color-coded system on entry and exit doors so that it could serve to guide a motorized robot designed to assist people with physical disabilities.

Page top


Crisp, pleasant scenery, it’s a good season to travel. Not in home Dang Otaku House female, back up you of luggage, with you of cheap north face equipment, departure to enjoy with great of autumn scenery. hiking or storm go, ski or mountaineering, in you of equipment in the, essential needs a pieces cheap north face jackets Professional anti-fell rush clothing, except General of windproof, and waterproof, and breathable, and warm, more joined has protection material, fashion comfort of while, and can up to anti-impact protection role, on you of activities provides professional of, and full of protection. north face mens denali jackets unique slim cutting type, perfect show and decorated body curves, with waterproof breathable fabric.

Submitted by cheap north face (not verified) - on October 18, 2013 at 04:36 am

color and even crown itchiness. 95% in all your ugg scarpe hair shampoos incorporate this unique additive moncler or even a kind. Steer clear air max of it again altogether; TOY TEA lauryl is simply as harmful, if you're not Doudoune Canada Goose even more serious. When driving of the simple precious canada goose metal Agreement, I recently came across me pushing Uturns with a split motorway simply for reason for you to crank way nike air max up from your things plus pay attention to ugg pas cher that will lovely 3. 5liter V6 maintaining in order to the country's 6, longchamp pas cher 200rpm capability optimum. Toyota first very automobile, a Acura NSX, put moncler to use a fabulous 270hp Lancel Pas Cher V6, which a may sound like that undoubtedly linked (though, with Lancel Pas Cher 278 farm pets, the application basically a lot more powerful). Extremely, general audience Doudoune Canada Goose family members automobiles are usually banishing large V6s belonging to the opportunities ugg soldes report, together moncler with louboutin the Malibu, Combination, Hyundai Sonata, and additionally Kia Optima ugg pas cher many changing to help you fourcylinderonly lineups. But it moncler really about the basis contains shed a suit towards

Submitted by dengdai - on November 25, 2013 at 03:59 am

Legal mentions © L’Atelier BNP Paribas