Cartocloud Simulator - J&J

VR Training for Medical Professionals, 2024.

Softwares: Jira, Confluence, Figma, Illustrator, Unity, Shapes XR, Miro, Google Docs, AWS

Client: Biosense Webster - J&J

Company: Fundamental Surgery

What

I was the primary designer for a project to deliver immersive VR training and assessment for Biosense Webster’s Clinical Account Specialists (CAS) on the Carto 3 system. The objective was to create a flight simulator-like training environment, closely simulating real-world scenarios encountered while working alongside Electrophysiologists (EPs) in EP Cath labs. This experience is designed for a single user in a seated position.

Why

Currently, Clinical Account Specialists undergo low-fidelity training, primarily involving the playback of live cases through a real-time player and heart mapping exercises. However, this training lacks the stress simulation necessary to replicate real-life scenarios, where CAS must quickly follow EPs during heart mapping procedures in Cath labs.

Process

Release-based approach (sprint-based releases, scrum)

Release 1: Proof of Concept (POC)
During this phase, we focused on addressing the client's request to include a virtual mouse and keyboard inside VR for training purposes. Extensive design exploration was conducted to devise user-friendly and efficient solutions adaptable to technological advancements. Various options for virtual mouse and keyboard interfaces were explored.
Actions Taken:

• Design Exploration: virtual keyboard and mouse solutions including touch screen solution in VR, pen-touch screen, using the controller as mouse with ergonomic placement and more.

• Created a VR mockup using Shapes XR to experiment with positioning, height, dimensions, proportions, and field of view where I ensured proper arrangement of elements without obstructing the user's view, considering the seated position and the need for Cath lab visibility.

  Challenges encountered included:

  • Proportions

  • Field of view adjustments

  • Object placement

  • Synchronization between real-life and VR play areas

Release 2: Minimum Viable Product (MVP)
Based on client feedback, we transitioned from a virtual to a Bluetooth mouse and keyboard setup for interaction with the Carto software within VR. This required redesigning the user interface (UI) to accommodate these changes and provide seamless interaction while ensuring visibility of essential software components.

Challenges Addressed:

1. The lack of API access for Carto software necessitated the design of a new UI for Bluetooth mouse and keyboard interaction within the computer screen in the VR environment.

   Actions taken to tackle the challenge:

   1. Created a Jobs to Be Done table, to collate all the features that need to be included in our UI (Miro)

   2. Produced a user flow solution map (worked closely with the medical expert in our team) (Miro)

   3. Formulated a custom design system based on the client’s branding (Figma)

   4. Designed mockups and wireframes (Figma)

   5. Designed a clickable prototype (Figma)

   6. Composed feature Specifications (Confluence)

   7. Implemented those mockups in Unity in VR (unity)

2. Seamless integration of the play area with Bluetooth hardware .

   Actions taken to tackle the challenge:

   1. Experimentation with Unity's passthrough feature and research on how Meta uses the passthrough feature in Quest.

   2. Instructional manual creation for the client and users

Additional Challenge: The client requested a PC version of the VR MVP, leading to UI adjustments to comply with Windows app design guidelines while ensuring compatibility and usability.

For this solution, the UI panels will need to be included in a Windows window, of a specific aspect ratio (that FVR will set) and of rectangular shape. (Figma mockups)

More limitations include:

• The window cannot be skinned.

• We cannot have multiple of these windows in the simulation.

• The window's default setting will be pinned on top of the Carto Simulation to avoid risking the user losing the window. The window can still be minimized into a tab icon at the bottom of the screen.

• Pop-up dialog & modal boxes must also be part of this window panel

• The user can move the window, wherever they want on the screen

Release 3: Final Release

The primary challenge in this phase was redesigning the client's complex case playback interface from the real Carto simulator to a simplified version integrated into our UI. This involved streamlining features such as play/pause controls, timeline scrubbing, and case selection for improved usability.

Key Changes:

• Simplification of the case playback interface to enhance user experience and streamline functionality.

Takeaway

This project highlighted the importance of iterative design, client collaboration, and adaptability to evolving requirements. By addressing challenges through a release-based approach, we delivered a VR training solution tailored to the client's needs while incorporating user feedback and technological advancements.

*If you are interested in viewing video playthroughs, please ask. Due to IP policies/restrictions with our client, I cannot include videos publicly available.