Skip to main content
Lilly Nekervis depicted with a robot dog

Undergraduate Lilly Nekervis is enhancing Spot the robot’s capabilities to assist people with visual impairments (photo by Megan Mendenhall, UNC Research)

Lilly Nekervis is modifying a robot dog to help people who are visually impaired navigate their surroundings. 

In fall 2023, Lilly Nekervis was taking a web development class in Sitterson Hall when she glanced at a building map and noticed a robotics lab on the second floor. Intrigued, she decided to check it out — and found a headless, tailless, four-legged dog-like machine lying on the floor. 

“It was a Spot robot!” Nekervis exclaimed when retelling the story. “And I wanted to work on it.” 

She knocked on the door of Carolina computer scientist Daniel Szafir, who leads the Interactive Robotics and Novel Technologies (IRON) Lab. After an interview, Szafir offered Nekervis a position as an undergraduate research assistant.  

These Spot robots are equipped with cameras and sensors that enable them to comprehend and navigate their environments. They are trained to complete a range of tasks, from inspecting hazardous areas to aiding in search and rescue operations to transporting equipment. But little research has been done on how they can be used to support individuals with disabilities. 

This past summer, Nekervis — a senior majoring in information science — began a research project to enhance the robot’s capabilities to assist individuals with visual impairments. She is modifying, creating and testing existing software and hardware to transform the motorized animal into a guide dog. 

Thanks to a Summer Undergraduate Research Fellowship (SURF) from the Office for Undergraduate Research in the College, Nekervis stayed in Chapel Hill to finish the robot’s reboot. SURFs are open to students of all majors. 

“I hope to bring awareness to those with visual impairments, create more assistive technology and bridge the gap between robotics and assistive technology,” Nekervis said. 

Innovative adaptations 

Nekervis’ goal is not to replace guide dogs but rather to provide people with an additional mobility aid.  

“Spot is loud — it makes noise — and it would bring attention to people with visual impairments,” she said. “It also allows people to create this sort of autonomous system if they are allergic to dogs, can’t have dogs around or are not able to take care of a dog.” 

Transforming Spot into a guide dog required Nekervis to tackle several challenges. First, she needed to develop software and code, allowing it to safely maneuver around an obstacle while a person was beside it. Next, she integrated cameras to help it detect its environment, a high-performance computing platform to quickly process data, and a speaker and microphone to facilitate interactions between the user and Spot. 

“We had to connect all these things together using several different nodes to let the robot interpret and analyze the information coming into it to create a seeing eye dog,” Nekervis said. 

With the assistance of Jim Mahaney, director of the Applied Engineering Lab in the department of computer science, she built a specialized aluminum harness using a lathe, drill press and welding equipment in the lab’s machine shop.  

When testing the modifications, participants wore blindfolds and held onto the harness while being guided by Spot from one location to another. Participants also wore a QR code patch on their pantlegs, allowing the robot to keep track of their positions. 

“The most exciting part is getting to work with Spot,” Nekervis said. “I got to learn so much for this project — everything from working in the machine shop to working in [programming languages] Python, C, and C++.” 

Nekervis will continue her computer science research this fall. She hopes to pursue a Ph.D. in computer science with a focus on robotics, although she remains open to industry roles that align with her interests. 

“I love research too much to let go of it,” she said.  

By Megan Mendenhall, UNC Research 

Watch a UNC Research video about Nekervis’ research.

 


Published in the Fall 2024 issue | Student Up Close, Tar Heels Up Close

Read More

Lois Lovelace Duke sits next to a man in an ornate room.

Lois Lovelace Duke establishes professorship to pay it forward for future scholars

Through establishing the Lois Lovelace Duke Distinguished Professorship at UNC,…

Eden sits at a chair in a classroom

Teaching religion through a media lens

Eden Consenstein’s work focuses on the intersections of American religion,…

A horse walks away on the shore of Shackleford Banks, a small stretch of barrier islands. Across the water, through the mist, a lighthouse can be seen.

‘Down East’ immersion enriches K-12 teachers’ N.C. knowledge and spirits

Carolina K-12, a program based in the College of Arts…

Comments are closed.