17 / Professional & research

lookNcontrol

DesignAI

Look at the object. Speak naturally. Let attention resolve the ambiguity.

lookNcontrol is a contextual voice-assistant concept based on the idea that looking at an appliance can provide disambiguating context for voice interaction.

lookNcontrol prototype demonstration.

The problem

Voice assistants are often ambiguous. If several devices are present, a spoken command may be clear in intention but unclear in target.

Design & implementation

lookNcontrol explores a simple but powerful idea: combine voice with attention. If the system knows which appliance the user is looking at, that object can become the implicit target of the command.

That shifts voice control away from purely verbal specification and toward a more situated interaction model.

What it does

  • Voice interaction grounded by visual attention
  • Appliance targeting through looking direction
  • Smart-home interaction prototype
  • Strong disambiguation-focused concept

Why I built it

lookNcontrol matters because it points toward more natural voice systems. Instead of requiring users to say everything explicitly, it lets context carry part of the command.