Professional Portfolio

Technology interests and experiences include augmented, virtual, and mixed reality, machine learning, game development, speech recognition/synthesis, blockchain, data and embedded systems.

                    expertise includes advanced C# scripting, 3D content integration, animation, textures, shaders, lighting, plugins, particle system, physics system, AR, VR, MR, XML/JSON/Binary data serialization, dynamic mesh generation, 3D Terrain, 3D AR/VR interfaces, dynamic and Editor based UI, cloud based streaming content, data-driven development, network API integrationmulti-player, speech recognition, Unity Services, and Android/iOS native messaging. 

Blackbear The Pirate is copyrighted by author Steve Buckley

Powerful Plants is copyrighted by Burpee

View-Master all rights reserved by Mattel

Curious George is copyrighted by Houghton Mifflin Harcourt

The Forgotten Christmas Presents is copyrighted by author CJ Mills

Legend of the Lost Heart is home grown and copyrighted by Edutainment Systems

Developed WHEN app to help gardeners know when to plant specific seeds based on frost dates and their zip code

Integration of location services and geocoding from Google to translate geolocation into zipcode

Integration of push notification services

Burpee WHEN App (Unity 3D, C#)

Producer for a 2D animated adventure game 

Managed design, writing, art production, animation, voice acting (English and Spanish) 

Integration of speech/reading recognition and augmented reality 

Developed an iOS Unity 3D Native Plugin to integrate OpenEars speech recognition with Unity 

Legend of the Lost Heart AR Book Featuring Reading Recognition (Unity 3D, C#, Objective-C, Vuforia SDK, OpenEars SDK)

  • Java implementation of PocketSphinx speech recognition with Android Studio

PocketSphinx Speech Recognition Implementation (Java, PocketSphinx)

Recorded using a Theta 360 video camera

Developed software to publish 360 video content for real estate as a VR app

360 VR Real Estate Experience (Unity 3D, C#)

Developed AR app to bring characters to life on organic vegetable seeds

Managed all aspects of app including integration of animation and voice acting content, user interface design

Learn more at www.powerfulplants.net

Powerful Plants AR App (Unity 3D, C#, Vuforia SDK)

Updated app to stream videos from Vimeo API rather then embed videos

Much smaller app footprint

Powerful Plants AR App Cloud Update (Unity 3D, C#, Vuforia SDK, Vimeo API)

3D AR Animation synchronized with AR video using a chroma key shader 

Interactive AR (3D augmented globe with buttons) 

AR Shooter Minigame using ARKit 

MARS Candy Prototype (Unity 3D, C#, Vuforia SDK)

Augmented Reality Fairy Plant Tags 

Developed face poses using Maya animation system for lip syncing 

Programming, including lip syncing automation using Facefx (www.facefxcom) and animation blending in Unity 

Optimized 3D mesh and texture data 

Hybels 3D AR Fairy Plant Tags (Unity 3D, C#, Vuforia SDK, Maya, FaceFX)

  • Augmented Reality Signs for Retail 

  • AR Videos for Boulder International Film Festival 

  • AR Game 

Chefy AR App (Unity 3D, C#, Vuforia SDK)

  • Development and integration of mobile app speech recognition (Unity and Objective-C plugin) with a cloud-based database to store speech profiles, accuracy, performance, and user voice recordings. 

Speech Recognition Testing Platform (Unity 3D, C#, Objective-C, PHP, OpenEars SDK, mySQL)

  • Augmented reality of a cylinder based object 

Krema Peanut Butter Cylinder AR (Unity 3D, C#, Vuforia SDK)

  • Lip syncing is automated through custom viseme parser and animator

  • Utilizes the ES Children's Book Platform

  • Animated AR book with voice narration, and word highlighting

The Forgotten Christmas Presents AR Book App (Unity 3D, C#, Vuforia SDK)

  • Developed an Adobe Native Extension to provide augmented reality to Flash/Flex based mobile apps

  • Utilized the Metaio AR SDK and wrapped with custom code to provide ANE and AR capability

Flash ANE (Adobe Native Extension) for Augmented Reality

Developed ARKit Facial Recognition app for horror masks

Includes facial tracking for opening and closing mouth synchronized with real users mouth

ARKit Facial Recognition App

Integration of geospatial content for 3D visualization and interactivity

Support changes to existing software

Develop new data-driven version

Integration with Azure SQL Server

Dynamic mesh generation and spline contour lines based on geospatial data files

Interpolation engine to generate data from contours and geo maps.

3D Visualization Software using geospatial data (Unity 3D, C#)

Demonstration of VR for a 3D children's book

Developed base VR interaction framework that can be used for various content for interactive VR

Google Cardboard VR (Unity 3D, C#, Maya)

Integrated OpenEars via a custom plugin to provide embedded speech recognition in VR

Developed VR user interface to visualize speech data and parameters

Developed an algorithm to tweak the noise filtering for the speech system based on changing noise levels in the environment. Like the human ear, the software will pay more attention to a particular sound channel when there are several competing sounds

VR Speech Recognition (Unity 3D, C#, Objective-C, Google Cardboard SDK, OpenEars SDK)

Migrated web-site from Drupal to WordPress

Developed custom Drupal template

Managed content development and technical implementation

Powerful Plants Web Development (Drupal and Wordpress)

Utilizes ARKit Plugin for Unity 3D to demonstrate a talking 3D character on a table without the user of an image marker

ARKit Demo (Unity 3D, C#, ARKit Plugin)

3D AR Animation synchronized with AR video using a chroma key shader 

Interactive AR (3D augmented globe with buttons) 

AR Shooter Minigame using ARKit 

MARS AR Candy Prototype 2 (Unity 3D, C#, Vuforia SDK)

Film festival app featuring schedule, film trailers, and augmented reality for the printed program 

Cloud based XML data feed to drive user experience 

AR Program Guide with augmented reality trailers 

Boulder Film AR Program Guide (Unity 3D, C#, Vuforia SDK)

  • Unity 3D Particle System, Multiplayer API, and Physics System 

  • Large AR playmat for multi-player AR Games 

  • Hungry-Hungry Croc’s AR Game 

  • Castles and Towers AR Game 

Mattell AR Playmat Prototype (Unity 3D, C#, Vuforia SDK)

  • Platform allows content producers and publishers to build companion apps for printed children's books

  • Provides common features across any book regardless of the images or 3D content including 3D animated AR, Voice Narration, Spanish and English modes, Voice Recorder (Hear the story in user’s voice). 

  • Developed an XML based story timeline and engine integrating 3D animation, multi-lingual voice acting, narration and word highlighting 

AR Children's Book Platform (Unity 3D, C#, Vuforia SDK)

  • Tool takes in PDF files, voice narration, and ePub3's and outputs ePub3 updates including SMIL file creation with proper word timing data to highlight words as they are being read aloud

  • Developed custom shell scripts that utilize pdf command line tools to automate the process of converting aPDF file to an ePub3 with Word Timing data for Media Overlay (SMIL)

  • Integration with Speechmatics speech to text API

  • Produces SMIL files and updates ePub3 files to add voice narration and word highlighting

  • Unity 3D tool that reads data produced to visualize and play voice narration to test our output

PDF to ePub3 Automatic Word Highlighting for Voice Narrated eBooks (Linux Shell Scripts, PDF command line tools, Speechmatics API, Unity 3D, C#)

  • Lip syncing is automated through custom viseme parser and animator

  • Utilizes the ES Children's Book Platform

  • 3D AR book with animation, voice narration, and word highlighting

Coco's Lullaby AR Book App (Unity 3D, C#, Vuforia SDK)

  • Integrated the Metaio AR SDK into native Objective-C and Android Java 

  • Wrote 3D rendering and memory management code

Native iOS and Android AR Children's Book (Objective-C, Java, Xcode, Android Studio, Metaio AR SDK)

Ported iOS based Unity application to Windows

Integrating Revit models into Unity 3D

Re-integrated custom sound plugin

Added additional features including integration with Google Analytics and a Favorites system

Virtual Acoustics & Revit model integration (Unity 3D, C#, 3D Sound Plugin, Revit)

Retail kiosk triggers instructional video showing shoppers how to augment at the kiosk

Allows shoppers to try augmented reality in the store without having to download the app

Software developed for Android devices utilizes the proximity and ambient light sensors for motion detection.

Native Android code was developed to keep the kiosk software running circumventing users from exiting the app

AR Retail Kiosk (Android, Java, Android Studio, Unity 3D, C#, Vuforia SDK)

Demonstration of "gyro" based VR when a VR headset is not available

Utilizes the Edutainment children's book XR platform providing common features for augmented and virtual reality versions of children's books

Gyro based VR Without Headset (Unity 3D, C#, Maya)

User begins by looking at the book using a VR headset in AR mode

User sees the book pages through the VR headset along with virtual user interface buttons

User can gaze at buttons on book to trigger VR mode

Takes advantage of stereoscopic AR and VR to provide a mixed reality experience

AR to VR Children's Book Experience (Unity 3D, C#, Google Cardboard SDK, Vuforia SDK)

Configured consumer and resellers online shopping system in Volusion

Developed custom user interface to match main site and add additional functionality using HTML/CSS/JS and Volusion's custom template system

Powerful Plants eCommerce Implementation (Volusion, HTML, CSS, JS)

CONFIDENTIAL/NON-DISCLOSURE

Implemented Unity 3D and Vuforia cloud for cloud recognition

Parses XML associated with AR image targets (print advertisements) for app user experience

Displays company information for each image target using dynamic UI generation

Loads cloud based videos and Unity Asset Bundles to dynamically render AR videos and 3D content

Media Service Company AR Advertising (Unity 3D, C#, Vuforia SDK, Vuforia Cloud API, AWS Files)

Touch sensor on 3D AR button using Unity touch and ray casting API 

Interactive AR buttons with trigger for coupon 

Particle system using several custom smoke textures for realistic looking mist 

Particle system for fireworks 

Hennessy AR Prototype (Unity 3D, C#, Vuforia SDK)

  • CONFIDENTIAL

  • Externalization of Unity 3D functions into XML and C# engine code allowing for dynamic and interactive AR (and non-AR) experiences to be crafted using XML without internal working knowledge of Unity 3D and Vuforia. 

  • De-serialize XML into C# objects using Unity/.NET serialization API 

  • The engine parses the XML and launches the experiences defined there using 100% run-time code without any game objects (except the engine) defined in the Unity scene hierarchy. 

  • The purpose of this project is to build a library of re-useable code for new projects that is consistent, easy to maintain, and easy to extend. 

Core AR Platform (Unity 3D, C#, Vuforia SDK, Vuforia Cloud API)

  • 2D animated characters on packaging and multi-marker detection and tracking for individual character stickers 

  • Developed 2D automatic lip-syncing system using speech recognition and sprite animation to automate 2D lip-syncing animation instead of manually key-framing every frame

MyFruityFaces AR Prototype (Unity 3D, C#, Vuforia SDK)

  • Integration of speech/reading recognition and augmented reality 

Curious George AR Demo (Unity 3D, C#, Vuforia SDK)

  • Developed ePub XML and CSS including SMIL based media overlay (read-a-long word highlighting) 

The Forgotten Christmas Presents ePub3 eBook with Media Overlay (HTML, CSS, XML)

  • Visual editor and adventure game engine for visually building complex adventure games with many scenes, characters, animation, voice acting, inventory objects, puzzles, and quests

2D Adventure Game Engine and WYSIWYG real-time editor (Flash/Animate, Flex/Flash Builder, ActionScript)