Smart Library: Identifying Books on Library Shelves Using Supervised Deep Learning for Scene Text Reading

Xiao Yang, Dafang He, Wenyi Huang, Alexander Ororbia, Zihan Zhou, Daniel Kifer, C. Lee Giles

Research output: Chapter in Book/Report/Conference proceedingConference contribution

29 Scopus citations

Abstract

Physical library collections are valuable and long standing resources for knowledge and learning. However, managing and finding books or other volumes on a large collection of bookshelves often leads to tedious manual work, especially for large collections where books or others might be missing or misplaced. Recently, deep neural-based models have been successful in detecting and recognizing text in images taken from natural scenes. Based on this, we investigate deep learning for facilitating book management. This task introduces further challenges including image distortion and varied lighting conditions. We present a library inventory building and retrieval system based on scene text reading. We specifically design our text recognition model using rich supervision to accelerate training and achieve state-of-the- art performance on several benchmark datasets. Our proposed system has the potential to greatly reduce the amount of manual labor required for managing book inventories.

Original languageEnglish (US)
Title of host publication2017 ACM/IEEE Joint Conference on Digital Libraries, JCDL 2017
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781538638613
DOIs
StatePublished - Jul 25 2017
Event17th ACM/IEEE Joint Conference on Digital Libraries, JCDL 2017 - Toronto, Canada
Duration: Jun 19 2017Jun 23 2017

Publication series

NameProceedings of the ACM/IEEE Joint Conference on Digital Libraries
ISSN (Print)1552-5996

Other

Other17th ACM/IEEE Joint Conference on Digital Libraries, JCDL 2017
Country/TerritoryCanada
CityToronto
Period6/19/176/23/17

All Science Journal Classification (ASJC) codes

  • General Engineering

Fingerprint

Dive into the research topics of 'Smart Library: Identifying Books on Library Shelves Using Supervised Deep Learning for Scene Text Reading'. Together they form a unique fingerprint.

Cite this