Designing Intelligent Applications for Health and Well Being at SJTU

Description:Visual intelligence (VI) is an application of artificial intelligence (AI) for the interaction with visual data in an application. With VI features, users can instantly understand and interact with the world in front of them: turning a physical poster into a digital calendar event, querying real-time information from objects around them, or generating recipe ideas based on items in their fridge. These VI features can empower users to better communicate, work, and express themselves.To design applications that leverage VI, user interaction (UI) and user experience (UX) designers should craft experiences that are smart, private, and capable of working without internet connectivity. Through modern AI-powered software development tools, designers can themselves tap into these models with minimal code to power intelligent VI features, making it easier than ever to implement intelligent experiences right into existing applications and games.While these features are novel, fundamental human interface design (HID) principles still apply to this new category of application features. Developers must design their experiences responsibly, orienting their workflow around crafting AI experiences that are inclusive, designed with care, and inherently private. They should keep users in control—giving them the ability to dismiss unwanted generated content, revert or retry content transformations, and clearly identify when and where AI is being utilized. Developers must also ensure an inclusive experience for all, seeking clarity before making assumptions that may reinforce common stereotypes. Finally, applications should offer elegant non-AI fallbacks so users can always enjoy the core functionality of the app or game when generative features are unavailable or opted out of.This workshop introduces students to the workflows and design principles required to embed these intelligent VI features into user-facing applications across diverse hardware platforms, ranging from mobile and tablet form factors to spatial computing interfaces. Participants will explore how to leverage the capabilities made possible by Generative AI to design intelligent, adaptive, and beautiful user interfaces.About the ProfessorDr. Gabriel LipkowitzAssistant Professor,Division of Industrial Design, College of Design and Engineering, NationalUniversityof Singapore, SingaporeJoint appointment in Smart Systems Institute, NationalUniversityof Singapore, SingaporeGabriel (Gabe) Lipkowitz is an Assistant Professor and Principal Investigator of the Interactive 3D Design Lab in the Division of Industrial Design at the National University of Singapore. Gabe received his PhD from Stanford University specialising in interactive 3D design and technology. His research interests include spatial computing design, generative 3D design, and 3D UI/UX design, aiming to develop computational tools and systems that translate innovative design concepts into impactful interactive 3D experiences for users. Born in New York, Gabriel received an MSc in Computational Science and Engineering from Imperial College London and an BA from Princeton University.