Creating a touchless gesture platform for developers.


Research, UX Design, Visual Design 


Sketch, InVision, Illustator, InDesign 


August - December 2017 (5 months)


CTO, Two Marketing Specialist, One Engineer, One Designer (Me)


Xesto is a machine learning startup that provides developers with a cloud-based device-agnostic platform to recognize and record the gestures they want in their applications while bypassing the process of creating hardware compatibility.

During my time at Xesto, I had the privilege of work with a diverse group of people that continuously challenged me and stimulated my growth as a designer. Over the course of 5 months, I led the redesign of their marketing site and assisted in the creation of their API portal, Wave.


Currently, touchless user interface development is very costly, time-consuming, and tedious. Up to 35% of total development time is allocated to creating and implementing gestural recognition solutions that are tethered to specific hardware. 



There were two main projects I tackled while I was working at Xesto. Each of them came with a different set of challenges. For the marketing website, I started by delving into how we can enhance the marketing website so that it provides a clear and concise message for potential audiences to understand.

The biggest challenge I had with creating the Wave API Portal was starting from scratch. It was multi-faceted and more complex than the marketing site, so I asked a different set of questions. How might we create a strong user experience for the Wave API portal without losing out on some of the important features, while balancing technical requirements?


The first step of my research was to interview the CEO and CTO of the company. I wanted to understand what kind of problems they were currently experiencing with their marketing site, as well as the short and long-term goals of the company. Some of the qualitative questions I asked included:

  • What specific areas of your current site do you feel are successful and why? 
  • What are the current challenges developers are experiencing with your product?
  • What are your business goals? (i.e. Increased sales, marketing/branding recognition, etc)
  • What are the actions users should take when coming to your site? Describe the user’s flow.

Through the research, I determined that the marketing website lacked clarity due to the copy. I spent a full day with the Xesto team to hash out how we can clarify the brand messaging.

Product Goals

Short term goals

  • Marketing & brand awareness
  • Launching the beta of Wave AI for VR and desktop applications 

Long term goals

  • Long term goal: Increased users
  • API Portal device agnostic
  •  Collect the largest gesture ML database through iPhone X application
  • Trace AI: A new way for machine learning models to self-improve 
04_Xesto_Landing page
Identifying the User

Xesto has 2 main target groups, developers and hobbyists.


Developers who spend long hours working on touchless gesture models. Hobbyists who are interested in touchless user interfaces and enjoy tinkering and playing around with new products.


Developers would use Xesto to create quick interactions of touchless gestures.


The API portal would be used at the office or at home.


The users will need a computer and a leap motion. (In the future, it will work on multiple platforms such as the iPhone).

Site Structure

The site structure of the Xesto API portal was designed to be simple and straightforward.

API Portal

Low-Fidelity Wireframe

From the site map, I created sketches to figure out the layout and flow of the API Portal.

Gesture Library 01
Gesture Library 02
Train Gesture

Design Outcome

During the three months, I helped map out the user flow and iterate on the first version of the platform. 

Project Library

The project library holds all the training sets a user has recorded.

v copy
v copy 4

Working with Xesto had allowed me to apply what I learned from my summer internship at Half Hunter to the marketing site and API Portal. As the only designer on the team, I was often challenged and asked to articulate my design decisions. There were many times where I bounced concepts back and forth between different team members.

Working at an early stage startup meant that I was juggling multiple roles at the same time. Looking back, I would have liked to focus more of my time conducting research and field studies with Xesto’s target audience.

All  /  Vax  /  Cetaris  /  Portr  /  Travel App  /  Xesto  /  Boston Children's Museum

Email  |  LinkedIn  |  Twitter

Gillian Wu © 2020