Over the past year or so there has been an explosion of electronic development boards so you can build your own DIY projects and feed the hobbyists desires. I have been no exception and have quite a few boards including the Raspberry Pi, Arduino, LaunchPad from Texas Instruments and the latest addition of the Teensy 3.0. I have added a bit about each board and how I have used them.
As we have seen more and more applications and devices using voice recognition especially on Android and iOS and because I have been working with applications that use voice recognition I have put together some links that maybe useful for applications using voice recognition. I have used several of these for applications including the project glass inspired work.
This library is for arduino and provides an interface for voice recognition using the Arduino, which does voice recognition in a way different from most high powered voice recognition methods. It calculates the complexity of the signal is determined by taking the absolute derivative of the signal multiplying it by a fixed point saclar and then dividing it by the absolute integral of the signal. This project is hosted on github so go take a look. http://arjo129.github.com/uSpeech/
Part of one of the most successful apps on android, iOS and Playbook iSpeech provides a Text to Speech cloud service that is easy to use and integrate. They offer mobile SDKs to get you up and running quickly. http://www.ispeech.org/
At Keytree we have created a new application called Store Trek that delivers a 3D shopping experience in your home using the microsoft Kinect.
Powered by K-Motion Store technology. This is the first incarnation of a 3D store that crosses the divide between in store and online shopping. Online is quick and convenient and products are recommended to you but the experience is not very engaging or immersive. In store you can see entire product ranges but they are not tailored to you, you have to travel to the store and get stuck in the queue at checkout. Store Trek takes the benefits of in store by delivering tailored virtual shelves in a virtual store layout driven by a personalisation engine you would have with an online store.
The kinect allows you to walk round the TV with the shelves automatically adjusting to give you the rich 3D experience. Rendering tens of thousands of products from real retailers in realtime you can purchase items by reaching out towards the shelf and the product will be added directly to your basket.
This eCommerce solution based in the cloud could be used to shop for your groceries from Tesco or items from Amazon or Ebay.
Additionally to CEO Vision core application we used the framework to create an iPad application that acts as a controller for a 3D augmented reality way to construct a kitchen. The 3D augment of the kitchen actually sits on top of the ipad and using the controls on iPad you can change aspects like the flooring and the wall colour. This application is delivered to the user’s glasses in full 3D so each eye sees a different image based on their separation so it makes the kitchen look as real as the iPad.
The live objects works slightly differently. The concept behind this was to be able to show you what objects looked like in real situations in your own home. In the video below we show the application working with a door. The door is tracked and an virtual door is overlaid. The user can open and close the door and it gives the experience of having the genuine article before buying.
This application is powered by the spatial operating system of CEO Vision.
I have been the lead developer on CEO Vision. It combines the Microsoft Kinect, Augmented Reality with the SAP HANA. Check out the website to see more about the technology (Click here to visit microsite)
This video stars Nic Doodson and myself. We demo the object recognition, face tracking and face recognition along with the Microsoft Kinect to allow users to literally reach out and touch their HANA powered reality.