Jesse T. Gonzalez

PhD Candidate, Carnegie Mellon University


Hi! I'm Jesse.

I'm a researcher at Carnegie Mellon, where I build shape-changing robotic architecture. These structures look like everyday surfaces (such as walls or floors), but they can physically reconfigure themselves to in order to support human activities. The goal is to imbue the built environment with a new type of ambient intelligence, and enable fluent collaboration between people and their surroundings.

Recently, I've been developing new frameworks for orchestrating these systems — leveraging multimodal machine learning to recognize user intentions and dynamically compose robotic behaviors.

I'm advised by Professors Scott Hudson and Alexandra Ion.

You can view some of my publications here.

Before my PhD, I worked on a variety of creative mechatronic projects for small startups and independent artists (electric motorcycles, musical synthesizers, interactive installations, and more).

My undergraduate background is in Mechanical Engineering, from the University of Maryland.

Publications


Constraint-Driven Robotic Surfaces, At Human-Scale
Jesse T. Gonzalez, 
Sonia Prashant, 
Sapna Tayal, 
Juhi Kedia, 
Alexandra Ion, 
Scott E. Hudson
ACM UIST '23, San Francisco, USA
Layer By Layer, Patterned Valves Enable Programmable Soft Surfaces
Jesse T. Gonzalez, 
Scott E. Hudson
ACM UbiComp '22, Atlanta, USA
Sculptable Mesh Structures for Room-Scale Form-Finding
Jesse T. Gonzalez, 
Yanzhen Zhang, 
Dian Zhu, 
Alice Yu, 
Sapna Tayal, 
Nazm Furniturewala, 
Ziying Qi, 
Somin Ella Moon, 
Leyi Han, 
Alexandra Ion, 
Scott E. Hudson
ACM UIST '25, Busan, Korea
Towards Unobtrusive Physical AI: Augmenting Everyday Objects with Intelligence and Robotic Movement for Proactive Assistance
Violet Yinuo Han, 
Jesse T. Gonzalez, 
Christina Yang, 
Zhiruo Wang, 
Scott E. Hudson, 
Alexandra Ion
ACM UIST '25, Busan, Korea
ConeAct: A Multistable Actuator for Dynamic Materials
Yuyu Lin, 
Jesse T. Gonzalez, 
Zhitong Cui, 
Yash Rajeev Banka, 
Alexandra Ion
ACM CHI '24, Honolulu, USA
Vibrosight++: City-Scale Sensing Using Existing Retroreflective Signs and Markers
Yang Zhang, 
Sven Mayer, 
Jesse T. Gonzalez, 
Chris Harrison
ACM CHI '21, Yokohama, Japan
Transforming Everyday Objects into Dynamic Interfaces using Smart Flat-Foldable Structures
Violet Yinuo Han, 
Amber Yinglei Chen, 
Mason Zadan, 
Jesse T. Gonzalez, 
Dinesh K. Patel, 
Wendy Fangwen Yu, 
Carmel Majidi, 
Alexandra Ion
ACM UIST '25, Busan, Korea
Tensions and Resolutions in Hybrid Basketry: Joining 3D Printing and Handweaving
Lea Albaugh, 
Jesse T. Gonzalez, 
Scott E. Hudson
ACM TEI '23, Cork, Ireland