Hi, I'm Lu.
Creating new experiences is what I (love to) do.
We were sitting in a small, single person office the team had worked to convert into a comfortable demo room. It had a couch and a few chairs crammed in around the center piece - a glowing box. Our demo machine was the size of a small coffee table and the demo required people to be on all sides of the 'table'. I was showing off how you could use your fingers and objects to interact with the surface of the table - a completely new experience that was simple and engaging, but underneath the hood was driven by very powerful imaging and input software. My guest was watching like a scientist observing a chemical reaction unfolding in a beaker. My guest was a very special person, Don Norman. I had read his book, Design for Everyday Things and was thrilled to be entertaining an idol.
My favorite work was on the original Microsoft Surface table (below) which uniquely recognized multiple fingers and objects that touched the table surface. Prior to this product, most personal computing was done through an intermediary - the mouse and keyboard. Surface allowed a person to directly touch their content or use a physical object to interact with digital content (like a physical air hockey paddle and a digital puck).
Technology can be made more exciting by being super easy to use, almost magical, even if it is extremely complicated underneath. This is my unique skill set. For example, most recently having led Audio Magic Eraser on Pixel phones. 'AME' as we like to call it, allows you to magically erase (or enhance), specific sounds in a video that you've taken - like a dog barking or excessive wind noise. It uses AI to separate out the sounds and identify them with the click of a button.
Albert Einstein
"Everything should be made as simple as possible, but not simpler."
Software Examples
MICROSOFT SURFACE
Natural User Interface
Overview
Surface created a completely new user experience and more personal, social computing that let people sit facing each other and interact with digital content.
Technology
-
Multi-touch input
-
Object recognition
-
Image processing (five cameras)
My Part
I led the apps, system "shell' UI, and SDK development from concept to launch. The roadmap defined included the tablet product you can buy today.
GOOGLE PIXEL
Audio Magic Eraser (AI)
Overview
Easily remove distracting sounds from your videos after you've shot them. We used AI to identify the sounds in a video and then let a user reduce or remove each sound individually.
Technology
-
Machine learning (e.g. AI)
-
Sound separation & identification
-
Runs on-device (Tensor)
My Part
Drove the definition, development and collaboration of this exciting AI feature in collaboration with the Photos, Research, and Technology Engineering teams.
ROKU
Web-based User Interface
Overview
The Roku channel is owned & operated by Roku but was only on Roku players and TVs. We expanded it's reach to other TV platforms: Samsung TVs (Tizen), Xbox, and the web.
Technology
-
Web-based middleware (data)
-
Connected services
My Part
Defined and launched the Roku Channel off-platform, Wireless Speakers, and the Roku TV Ready.
Hardware Examples
Hardware
-
Custom projection surface (translucent and IR transparent)
-
Custom industrial furniture + technology design
-
5 synchronized imaging cameras
-
Ultra-short throw, color projector
Challenges
-
A single, translucent surface for both imaging and sensing (user sees the image and the cameras see the user)
-
Cost of Good exceeded $7,000
-
Heaviest device Microsoft had ever shipped - 100 pounds
Highlights
-
Deployed to Disneyland, AT&T Retail Stores, and Harrah's properties
Hardware
-
Behind the head, swappable mono speaker
-
Noise-cancelling microphone
-
Snaps into Xbox Controller
Challenges
-
A single ear-wing design that could be shipped worldwide and fit people of different shapes and sizes
Highlights
-
Drove Xbox Live Subscriptions
-
Allow gamers in-game voice chat without having to open a separate app
Hardware
-
Wireless surround sounds speakers
-
Sealed enclosure
-
Same performance as Sonos One but half the price
Challenges
-
One design for front and rear speakers
Highlights
-
Super simple wireless setup with Roku TVs
-
Plug into power and click a buttons using the TV remote control to set up
-
Leveraged to build a Walmart Onn version