Flow Chemistry | Max J. Chen

Years Active: 2022-2024

FlowAR is a mixed reality (MR) training application developed for Microsoft HoloLens 2. It enables students to learn the assembly of modular flow chemistry reactors through immersive, step-by-step holographic instructions. Users can watch animated instructions, hear voice narration, and manipulate real components simultaneously, creating a true mixed-reality learning environment.

Traditional chemistry labs often rely on batch processes and written protocols, leaving a significant training gap as the industry moves towards continuous, modular flow systems. FlowAR addresses this gap by delivering hands-free, voice-controlled, self-paced guidance that combines digital animation with physical practice, letting users “learn by doing” in real time. The system was evaluated in a user study with 34 participants, showing significantly higher recall, clarity, and enjoyment compared to conventional instruction methods.

My Role: Programmer (Unity, HoloLens integration)
Platforms: Microsoft HoloLens 2 (Mixed Reality, AR)
Tech Stack: Unity (C#), Blender, Custom 3D animations, Microsoft MRTK, HoloLens voice/eye-tracking APIs
Collaborators: Yichen Li, Hilson Shrestha, Noëlle Rakotondravony, Karen Royer, Laurie Mazza, Shano Liang, Varun Bhat, Andrew Teixeira, Lane Harrison, Robert E. Dempski

Project Highlights

🌟 This article is featured on the cover of the Journal of Chemical Education!

Immersive Step-by-Step Training
FlowAR presents 3D animations of each assembly step, aligned with real tools and components, paired with voice and text instructions. Users control the pace using simple voice commands like “next”, “back”, and “show labels”.
Hands-Free, Asynchronous Learning
Leveraging the HoloLens 2’s voice recognition and spatial mapping, FlowAR allows learners to practice complex assembly in the lab or classroom without the need for instructor supervision.
Measured Impact
A controlled user study found that students using FlowAR recalled procedures and components more effectively, rated the content as clearer, and reported a more enjoyable learning experience than those using text-based protocols.
Generalizable Design
The FlowAR pipeline can be reused for other types of assembly and training by swapping 3D models and instructions—enabling broad applications in STEM and industrial skills education.

If you’re interested in the full research study, read the publication: (Chen et al., 2024).

Media

WPI News: WPI Researchers Publish Study on Mixed Reality Industrial Workforce Training

References

2024

FlowAR: A Mixed Reality Program to Introduce Continuous Flow Concepts

Max Chen, Yichen Li, Hilson Shrestha, Noëlle Rakotondravony, Andrew Teixeira, and 2 more authors

Journal of Chemical Education, 2024

Abs DOI Bib

Industrial and academic laboratories are undergoing a paradigm shift in process technology from batch to modular flow. Implementation of modular flow processes can enable more efficient operation with superior throughput, scalability, and safety factors owing to superior transport and reaction kinetics. However, both fine chemical and pharmaceutical industries have historically run exclusively batch processes, highlighting a substantive knowledge gap in industrial workforce training in designing and building modular flow systems. To address this gap in knowledge, we developed an augmented reality (AR) program, FlowAR, that aims to teach users how to build modular flow packed bed reactors. FlowAR is a voice-activated program in which users assemble physical objects to build the modular flow reactor that are observed in the FlowAR program with accompanying narration of each step. To compare the learning experience and effectiveness of FlowAR when compared to traditional assembly methods, 34 participants were randomly assigned to AR (experimental) and non-AR (control, i.e., written instructions) conditions to learn and assemble a flow chemistry packed bed column. We obtained pre- and post-questionnaires from the participants with quantitative and qualitative questions on their learning experience. Inspection of the data from our assessments revealed that users in the experimental condition recall the procedure and parts at a higher level when compared to the control condition. In addition, FlowAR resulted in more content clarity and a much more enjoyable and effective experience compared to the control conditions. This provides evidence that voice-activated AR programs can be used to enable students to better assemble complex instruments in an asynchronous format.
@article{chen2024flowar, author = {Chen, Max and Li, Yichen and Shrestha, Hilson and Rakotondravony, Noëlle and Teixeira, Andrew and Harrison, Lane and Dempski, Robert E.}, title = {FlowAR: A Mixed Reality Program to Introduce Continuous Flow Concepts}, journal = {Journal of Chemical Education}, volume = {101}, number = {5}, pages = {1865-1874}, year = {2024}, doi = {10.1021/acs.jchemed.3c00807}, url = {https://doi.org/10.1021/acs.jchemed.3c00807}, eprint = {https://doi.org/10.1021/acs.jchemed.3c00807}, publisher = {ACS Publications}, }