TY - GEN
T1 - A comparison of variety metrics in engineering design
AU - Henderson, Daniel
AU - Helm, Kevin
AU - Jablokow, Kathryn
AU - McKilligan, Seda
AU - Daly, Shanna
AU - Silk, Eli
N1 - Publisher Copyright:
Copyright © 2017 ASME.
PY - 2017
Y1 - 2017
N2 - This paper focuses on comparing and contrasting methods for assessing the variety of a group of design ideas. Variety is an important attribute of design ideas, because it indicates the extent to which the solution space has been explored. There is a greater likelihood of successfully solving a design problem when a more diverse set of ideas is generated in the early stages of design. While there are three existing metrics for variety, it has not been established how well they correlate with each other, so it is unknown whether they provide similar assessments of variety. This uncertainty inspired our investigation of the three existing metrics and, eventually, the development of a new variety metric - all of which we compared statistically and qualitatively. In particular, 104 design ideas collected from 29 sophomore mechanical engineering students were analyzed using the existing and new variety metrics. We conducted correlation analyses to determine if the four metrics were related and to what degree. We also considered the qualitative differences among these metrics, along with where they might be used most effectively. We found varying levels of statistically significant correlations among the four metrics, indicating that they are dependent. Even so, each metric offers a unique perspective on variety and may be useful in different situations.
AB - This paper focuses on comparing and contrasting methods for assessing the variety of a group of design ideas. Variety is an important attribute of design ideas, because it indicates the extent to which the solution space has been explored. There is a greater likelihood of successfully solving a design problem when a more diverse set of ideas is generated in the early stages of design. While there are three existing metrics for variety, it has not been established how well they correlate with each other, so it is unknown whether they provide similar assessments of variety. This uncertainty inspired our investigation of the three existing metrics and, eventually, the development of a new variety metric - all of which we compared statistically and qualitatively. In particular, 104 design ideas collected from 29 sophomore mechanical engineering students were analyzed using the existing and new variety metrics. We conducted correlation analyses to determine if the four metrics were related and to what degree. We also considered the qualitative differences among these metrics, along with where they might be used most effectively. We found varying levels of statistically significant correlations among the four metrics, indicating that they are dependent. Even so, each metric offers a unique perspective on variety and may be useful in different situations.
UR - http://www.scopus.com/inward/record.url?scp=85035342668&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85035342668&partnerID=8YFLogxK
U2 - 10.1115/DETC2017-67502
DO - 10.1115/DETC2017-67502
M3 - Conference contribution
AN - SCOPUS:85035342668
T3 - Proceedings of the ASME Design Engineering Technical Conference
BT - 29th International Conference on Design Theory and Methodology
PB - American Society of Mechanical Engineers (ASME)
T2 - ASME 2017 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, IDETC/CIE 2017
Y2 - 6 August 2017 through 9 August 2017
ER -