Media artist and designer
pensyl.com
Sumner Hill Studio
Boston MA | Singapore
Research areas: Software Design, Interaction Design, Facial recognition; biometric data capture; emotion response detection; ultrasonic tracking, positioning and localization; mixed reality; sensor/vision fusion; physical computing; markerless tracking for mixed reality. The work represented in this section is work created by developing custom sofware and hardware.
Writing Samples
Design and User Experience in Software for Medical and Psychological Research
Presentation slides for NeuroTalk paper
Facial Recognition and Emotion
Detection In Environmental Installation
User Centric Content Delivery Using Biometric DataCapture and Intelligent Analysis
Robust Hybrid Tracking in Mixed Reality Environments
“interAct” – The history and analysis of interaction art and design.
A comprehensive history of interaction design, experience and media. Anticipated publish date – late 2024 or early 2025.
This text presents exhaustive survey of current digital, interactive artifacts created by modern cultures and a comprehensive history of cultural practices and behaviors that inform and illuminate their development. In this historiography, the survey includes not only development of software technologies over time but to looks at these from material culture, culture-historical archaeology and cultural ontological perspective where the objects of study are digital artifacts themselves. Digital artifacts are indicators of not only the development of technology, but also are clues to individual and organizational behaviors – and the cultures where they are created and used. Through the analysis of precursors throughout history up to current software, tools and devices, the text seeks to assist the reader to understand how these solutions solved existing problems in the ensuing time eras.
Analyses employed in this study include Formal Analysis, Analysis of Constraints and Affordances, Frame Analysis, Edgar Schein’s Three Levels of Culture and Organizational Psychology, Murray’s Three layers of Media Design: Inscription, Transmission and Representation, Digital Artifacts Ontologies, Semantic Web Vocabularies (Ontology), and Design Process as an Analysis tool.
Applied research in vision/sensor fusion for science/medical applications and artistic practice.
Ongoing research in vison/sensor fusion, real–time biometric data collection for a variety applications, software design and user experience.
My most recent work is the design and development of software used in scientific and medical research for real–time biometric data collection using vision and a variety of sensor systems. This includes work in data collection during electro-stimulation during drug testing and physiotherapy in human patients. The work entails interaction and planning of software and hardware applications for medical and scientific researchers and developers of turn-key diagnostic and treatment systems used in medicine.
Leveraging on several years of research and development of software using facial recognition, emotion detection, sensors, and vision systems, we are designing and developing a series of works that merge art, science, technology, and devices that are so ubiquitous to be in medicine in the current milieu. Over the last eight years, our teams have designed software and mediated interactive experiences for research in psychology, and in medical research. This include the develop of four iterations that led to creation of the software, Emota™ v4.0, an intelligent system for extracting emotion states from visual cues in humans. this includes considerations of how the design, specification, planning and implementation of this software occurred while working with software developers and psychologists.
In the example images is a prototype electro–stimulation headset designed in partnership with a start-up company with researchers from MIT, Harvard and Boston Hospitals.
