UPDATE Voice Command Running Jacket Prototype – Phase 3 – using the functional prototype

New Update on my Voice Command Running Jacket project.  The first update being that the entire project has essentially turned into a “Voice Command Directional Apparatus” module.  I found this to be a better direction for the project as you can take the device and use it on almost anything that can sustain a balanced state while being shaken.   Objects like a helmet, a jacket, a shirt it really doesn’t matter where you put it as long as the voice recognition Arduino modules can pick up your voice which works from about 15ft away.

Before I begin with my prototype I want to show you some of the really great products and ideas out there already, so there is a basis for my project.  I hope what you’ll see is that each product has it’s advantages and disadvantages.  Mine would be literally hands free, and the ability to use it in conjunction with different kinds of objects and situations makes it more versatile.

FIRST PRODUCT COMPARISON:
This product has similarities but, relies on the functionality to be stuffed into a sweatshirt
Dr. Leah Buechley used this device to test out her Lilypad – an Arduino designed for wearables and e-textiles. In this use the Lilypad powers a set of left and right turn LEDs as well as power and switch indicator LEDs on the jacket.

http://lifehacker.com/5913591/create-a-bicycling-jacket-with-turn-signals

SECOND PRODUCT COMPARISON:
Seil Bag has been designed to display left and right signals, well actually various signals that the rider wants to display instead of using hand signals, it comes in the form of a backpack. There’s a small controller which can be used to transmit basic signals to LED display

http://www.tuvie.com/seil-bag-for-bike-riders-displays-turn-signals-to-inform-others/

 

MY PROJECT PROTOTYPE IN COMPARISON:

Video of me putting the Voice Command Directional Apparatus on a Columbia Fleece, and simulating night time running.

Video of my beautiful wife wearing the Voice Command Directional Apparatus on a Columbia Fleece and being my first test subject.  It took some convincing… but after calling me a dork a few times she agreed.

THE FUTURE OF THE PROJECT – PHASE 4

At this point I am going to start putting  refined versions of this project and a few variations of it in the Fall Milwaukee Gallery Night.  If you would like to see this project in person and have a drink with some exceptional people, stop down to Thirsty Boy in the thirdward.

I have also posted this project to quirky.com, Please vote on it.  If you haven’t used quirky.com before check it out, it is like Kickstarter but better.

 

HERE ARE MY MOLESKIN SKETCHES – Showing the now modular apparatus being used in other situations.

WP_20140717_001

 

 

UPDATE Voice Command Running Jacket Prototype – Phase 2 – adding the voice command module

I have an update to my Voice Command Running Jacket Prototype.

The Arduino UNO finally has Phase 2 parts added.  The last time I posted about the project on Word Press I had the two 8×8 matrix displays setup to receive scrolling directions based on text input commands sent through the Serial Monitor.

WP_20140419_009WP_20140419_007
WP_20140419_012
WP_20140419_011

Building upon that code, I now have those functions that were being called on text input now setup to act inside a switch case block inside the event for voice capture and recognition.  The great part about starting the project off with text input through the Serial Monitor is that the Voice Command Module still operates through the serial port thus making the original code for this project very scalable.


CODE BREAK DOWN AND PITFALLS:
There are a couple of really good Classes/libraries that I am using in this project. The first is the Parola Library:
http://parola.codeplex.com/

This Library is a pretty robust scrolling library. The ability to scroll text, isn’t to hard to do from scratch, but the creators of this library have easing, inverted text and support for fonts to name a few.

* If you are going to use this library, there are a couple of pitfalls that you should keep in mind. The library was originally designed to work with a specific 8×8 LED matrix display, it has been updated to use any generic 8×8 but you have to update the .h file.

The next Library in the list is the SoftwareSerial, which actually is an internal Arduino Class that you import. Using this class helps assign RX and TX to other slots on the board.
*This is another pitfall area that I want to call out. All Arduino boards have dedicated TX and RX slots. The catch is the dedicated slots don’t allow interrupts back and forth. This for the most part was undocumented until I found an Ardunio forum page online that explains it in detail which slots on what boards do support interrupts.

HARDWARE BREAK DOWN AND PITFALLS:

The Voice Command Module is really easy to use,  It has 4 connection points ( GND, VCC, TX, RX) which fit as they should on the Arduino board and you can get up and running within 45min… If you have the information I have in the next two paragraphs… before you start…

* The catch here is that in order to interact with the Module you have to use a specific serial monitor app that ships with the device, which isn’t the best piece of software… and the Manual lacks some specific explanation as to the exact format of the HEX CODES the Voice Command Module needs inorder to set it up.  The Manual has a detailed table showing all the Commands ( 0x36 )but doesn’t express that the format  isn’t what is in the table but looks like this ( AAx36 ) instead…

*Also another pitfall that was undocumented was the act of “NOT” flipping the TX and RX connection points on the USB TTL adapter.  In almost every project that I have used on the Arduino you flip RX and TX, but for the recording and saving voice commands from your PC to the Voice Command Module, you don’t…  This took me 2 hrs of trial and error to find this bug.  This was really hard to find because the software is so bad, the issue looks as though it is your RX display settings.

All in all this project has been really fun, and shows the power of prototyping with Arduino and it’s plethora of compliant modules.

The previous video and older Blog post can be found here:
https://darkriderdesign.wordpress.com/2014/04/20/voice-command-running-jacket-prototype-arduino-mixed-with-voice-commands-and-scrolling-led-matrix/

 

HARDWARE PARTS LIST:

Arduino UNO:
https://www.sparkfun.com/products/11021

8×8 Matrix Displays:
http://www.ebay.com/itm/like/181221282262?lpid=82

Voice Command Module:
http://www.elechouse.com/elechouse/index.php?main_page=product_info&cPath=168_170&products_id=2151

 

 

If you like this comment, and let me know what you think.

 

cheers

UPDATE: HTML5 Game – First Level – Ready For a Little Player Testing – Mothra and The Windy Day

The first level is about 80% done, and is ready for the first round beta testing.

The game is currently being tested on:

  • iPads 2, 3, 4
  • Desktop: FF, Safari, Chrome and IE 9, 10, 11

The fun and hopefully interesting aspect about Mothra and The Windy Day is that the main character is a moth larva… Let’s face it… ( larva are essentially non moving )  which translated into a game setting means ( so slow that it could be bothersome ).This simple aspect about nature fascinates me, in that how does a moth larva actually manage to survive long enough to do anything… let alone spin a cocoon and turn into a moth?Think about it? Given the stacked odds against something intensely slow, with no arms, no sharp teeth, etc. in order to survive a moth larva must have something close to Yoda force skills… I had to spin Star Wars and Yoda into this Blog Post somehow…

Screen Shot 2014-04-03 at 8.56.37 AM
click to play

 

BASIC GAME STRATEGY:

Because Mothra is really slow, there is a sort of “fight or flight” concept at work in which the player has to take damage, inorder to beat the clock… But how much and when is determined by the game player.  If you spend to much time dodging the Bird, you’ll run out of time.  Likewise if you try and beat the clock to early by not dodging the bird and taking damage you’ll die to soon.  By touching the screen and breaking the floating leaves you feed Mothra making him gain weight, which eventually gives him the ability to Super Jump which can defeat the Bird’s attack once and for all.

 

HelpScreen

StartScreen

CompletedScreen

Screen Shot 2014-04-08 at 5.03.01 PM

 

OTHER ASPECTS OF DEVELOPING MOTHRA:

During the past year and a half, I have come to the realization that, with tools like Edge Animate, Google Web Developer and Flash CC exporting to Canvas and CreateJS, that Javascript and HTML5 are here to stay.  With that said I feel as part of the Old Flash Vanguard it’s essential that the things that we used to build in Flash on a regular basis now have a place in this new world of online…

You have to start somewhere.  You can’t be afraid of building something that may fail. Mothra and The Windy Day is based on Adobe Edge’s DOM based animation framework.  So the game is not using HTML5 Canvas instead it is actually pushing div elements around on the screen…

Whether DOM in this situation is better, or Canvas is an argument i feel of the scale of the Game.  With Mothra this game is essentially an experiment to see how far I could push Adobe Edge before the Edge framework buckles under the stress of Javascript DOM computations.

If your reading this article… play the game, crack open the console window and watch the console.log script of the game unfold.  There are Intervals, counters, an attempt at randomization, key board key capturing, dynamically setting properties of text fields, animation, cookie setting, and html 5 video.

 

Please give me some pointers, comments, suggestions and responses.

 

 

 

 

Prequel to HTML5 Mothra Game – Idea Character Development

I’ve been working on a series of simple Nano touch games. Games are fun, there is no better way to rough out the edges of your development skills than to build a game…

There are so many levels to game development, from trying to think of creative ways to make the game interesting to simply solving “if-then-than-that” situations that arise when dealing with something complex.

Here is the link for the first round rough draft of Mothra: Keep in mind that this will ultimately be the second game.
http://www.darkriderdesign.com/STUFF/Mothra/page1.html

The sketches below are concepts for the game meant to be the prequel to the Moth flying. The potential animations at the end of having a FAT caterpillar/larva spinning a Cocoon and then emerging from it a beautiful moth could be so awesome, and it would have such an Eric Carl sort of feeling you can’t help but think of reading the “Very Hungary Caterpillar”

WP_20140224_001

WP_20140224_002

WP_20140224_003