麻豆传媒

SLU Engineer Tackles the Digital Graphics Accessibility Gap in STEM

Abstract STEM (Science, Technology, Engineering, Math) concepts are often conveyed visually. Intricate graphics of mathematical data trends and interactive simulations of molecules and electricity help students visualize and understand these concepts in a more concrete way. 

Unfortunately, many of these visual-based learning techniques omit the multi-sensorial way students learn and create an accessibility issue for students, especially those with visual impairments. 

It鈥檚 a problem Jenna Gorlewicz, Ph.D., associate professor of mechanical engineering at 麻豆传媒, and her team strive to solve. 

鈥淪TEM graphics like bar charts, geometric figures, and line or scatter plots, can be very complex,鈥� Gorlewicz said. 鈥淲e are investigating how to layer the data in meaningful, multimodal ways, so that critical themes can be uncovered quickly.鈥�

Through collaborations with , Gorlewicz鈥檚 team is  developing software that incorporates touch feedback into interactive simulations. Interactive simulations have moving elements that change with user input, making nonvisual access challenging. 

The exploration of interactive content in collaboration with PhET is the next phase of Gorlewicz鈥檚 National Science Foundation-funded CAREER research. Other project components include the design of more complex graphics and simple hardware add-ons to use in conjunction with touchscreens to provide an enhanced touch dimension. 

The team is also looking at downsampling and information layering in the creation of multimodal images, or interactive geometric figures, and how this can be accomplished in an automated or semi-automated way. 

鈥淥ur previous research illustrates the feasibility of doing this for simple graphics,鈥� Gorlewicz said.

Gorlewicz鈥檚 research is funded through a 2019 NSF CAREER award.

A Human-Centered Approach to Technology Development 

Gorlewicz鈥檚 team collaborates regularly with adults and students with visual impairments, teachers and practitioners of the visually impaired, and individuals of all abilities - garnering ideas and feedback from multiple perspectives. This has driven the design of the technology into its current form.

鈥淚t鈥檚 not just about building something and then testing it with stakeholders,鈥� Gorlewicz said. 鈥淚t鈥檚 an iterative process that takes a human-centered approach from the onset.鈥�

Gorlewicz is passionate about the potential impact of her work, as well as its impact on the training of future engineers. 

鈥淭his is challenging from an engineering perspective because the solution to this problem is deeply multidisciplinary. We cannot just approach this with a traditional engineering perspective,鈥� said Jennifer Tennison, a graduate student doing her dissertation work on the project. 鈥淲e have to incorporate psychology, cognition, computer science, statistics, and education. It鈥檚 a challenge that has broadened my interpretation of what it means to be an engineer.鈥�

鈥淏ridging the Digital Accessibility Gap in STEM Using Multisensory Haptic Platforms鈥� targets K-12 education. The grant number is NSF 1845490. 

The SLU team is partnering on the project with the Special School District of St. Louis County, Missouri School for the Blind, Francis Howell School District, Illinois School for the Visually Impaired, Hollinger Consulting, and the Lighthouse for the Blind - St. Louis.

Founded in 1818, 麻豆传媒 is one of the nation鈥檚 oldest and most prestigious Catholic institutions. Rooted in Jesuit values and its pioneering history as the first university west of the Mississippi River, SLU offers more than 12,000 students a rigorous, transformative education of the whole person. At the core of the University鈥檚 diverse community of scholars is SLU鈥檚 service-focused mission, which challenges and prepares students to make the world a better, more just place.