Enhancing Human-Robot Collaborative Assembly in Manufacturing Systems Using Large Language Models

Jonghan Lim, Sujani Patel, Alex Evans, John Pimley, Yifei Li, Ilya Kovalenko

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Scopus citations

Abstract

The development of human-robot collaboration has the ability to improve manufacturing system performance by leveraging the unique strengths of both humans and robots. On the shop floor, human operators contribute with their adaptability and flexibility in dynamic situations, while robots provide precision and the ability to perform repetitive tasks. However, the communication gap between human operators and robots limits the collaboration and coordination of human-robot teams in manufacturing systems. Our research presents a human-robot collaborative assembly framework that utilizes a large language model for enhancing communication in manufacturing environments. The framework facilitates human-robot communication by integrating voice commands through natural language for task management. A case study for an assembly task demonstrates the framework's ability to process natural language inputs and address real-time assembly challenges, emphasizing adaptability to language variation and efficiency in error resolution. The results suggest that large language models have the potential to improve human-robot interaction for collaborative manufacturing assembly applications.

Original languageEnglish (US)
Title of host publication2024 IEEE 20th International Conference on Automation Science and Engineering, CASE 2024
PublisherIEEE Computer Society
Pages2581-2587
Number of pages7
ISBN (Electronic)9798350358513
DOIs
StatePublished - 2024
Event20th IEEE International Conference on Automation Science and Engineering, CASE 2024 - Bari, Italy
Duration: Aug 28 2024Sep 1 2024

Publication series

NameIEEE International Conference on Automation Science and Engineering
ISSN (Print)2161-8070
ISSN (Electronic)2161-8089

Conference

Conference20th IEEE International Conference on Automation Science and Engineering, CASE 2024
Country/TerritoryItaly
CityBari
Period8/28/249/1/24

All Science Journal Classification (ASJC) codes

  • Control and Systems Engineering
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'Enhancing Human-Robot Collaborative Assembly in Manufacturing Systems Using Large Language Models'. Together they form a unique fingerprint.

Cite this