CAPTAIN: Comprehensive Composition Assistance for Photo Taking

Farshid Farhat, Mohammad Mahdi Kamani, James Z. Wang

Research output: Contribution to journalArticlepeer-review

2 Scopus citations


Many people are interested in taking astonishing photos and sharing them with others. Emerging high-Tech hardware and software facilitate the ubiquitousness and functionality of digital photography. Because composition matters in photography, researchers have leveraged some common composition techniques, such as the rule of thirds and the perspective-related techniques, in providing photo-Taking assistance. However, composition techniques developed by professionals are far more diverse than well-documented techniques can cover. We present a new approach to leverage the underexplored photography ideas, which are virtually unlimited, diverse, and correlated. We propose a comprehensive fork-join framework, named CAPTAIN (Composition Assistance for Photo Taking), to guide a photographer with a variety of photography ideas. The framework consists of a few components: integrated object detection, photo genre classification, artistic pose clustering, and personalized aesthetics-Aware image retrieval. CAPTAIN is backed by a large managed dataset crawled from a Website with ideas from photography enthusiasts and professionals. The work proposes steps to decompose a given amateurish shot into composition ingredients and compose them to bring the photographer a list of useful and related ideas. The work addresses personal preferences for composition by presenting a user-specified preference list of photography ideas. We have conducted many experiments on the newly proposed components and reported findings. A user study demonstrates that the work is useful to those taking photos.

Original languageEnglish (US)
Article number14
JournalACM Transactions on Multimedia Computing, Communications and Applications
Issue number1
StatePublished - Jan 2022

All Science Journal Classification (ASJC) codes

  • Hardware and Architecture
  • Computer Networks and Communications


Dive into the research topics of 'CAPTAIN: Comprehensive Composition Assistance for Photo Taking'. Together they form a unique fingerprint.

Cite this