TY - JOUR
T1 - The first single particle analysis Map Challenge
T2 - A summary of the assessments
AU - Heymann, J. Bernard
AU - Marabini, Roberto
AU - Kazemi, Mohsen
AU - Sorzano, Carlos Oscar S.
AU - Holmdahl, Maya
AU - Mendez, Joshua H.
AU - Stagg, Scott M.
AU - Jonic, Slavica
AU - Palovcak, Eugene
AU - Armache, Jean Paul
AU - Zhao, Jianhua
AU - Cheng, Yifan
AU - Pintilie, Grigore
AU - Chiu, Wah
AU - Patwardhan, Ardan
AU - Carazo, Jose Maria
N1 - Publisher Copyright:
© 2018
PY - 2018/11
Y1 - 2018/11
N2 - The recent successes of cryo-electron microscopy fostered great expectation of solving many new and previously recalcitrant biomolecular structures. However, it also brings with it the danger of compromising the validity of the outcomes if not done properly. The Map Challenge is a first step in assessing the state of the art and to shape future developments in data processing. The organizers presented seven cases for single particle reconstruction, and 27 members of the community responded with 66 submissions. Seven groups analyzed these submissions, resulting in several assessment reports, summarized here. We devised a range of analyses to evaluate the submitted maps, including visual impressions, Fourier shell correlation, pairwise similarity and interpretation through modeling. Unfortunately, we did not find strong trends. We ascribe this to the complexity of the challenge, dealing with multiple cases, software packages and processing approaches. This puts the user in the spotlight, where his/her choices becomes the determinant of map quality. The future focus should therefore be on promulgating best practices and encapsulating these in the software. Such practices include adherence to validation principles, most notably the processing of independent sets, proper resolution-limited alignment, appropriate masking and map sharpening. We consider the Map Challenge to be a highly valuable exercise that should be repeated frequently or on an ongoing basis.
AB - The recent successes of cryo-electron microscopy fostered great expectation of solving many new and previously recalcitrant biomolecular structures. However, it also brings with it the danger of compromising the validity of the outcomes if not done properly. The Map Challenge is a first step in assessing the state of the art and to shape future developments in data processing. The organizers presented seven cases for single particle reconstruction, and 27 members of the community responded with 66 submissions. Seven groups analyzed these submissions, resulting in several assessment reports, summarized here. We devised a range of analyses to evaluate the submitted maps, including visual impressions, Fourier shell correlation, pairwise similarity and interpretation through modeling. Unfortunately, we did not find strong trends. We ascribe this to the complexity of the challenge, dealing with multiple cases, software packages and processing approaches. This puts the user in the spotlight, where his/her choices becomes the determinant of map quality. The future focus should therefore be on promulgating best practices and encapsulating these in the software. Such practices include adherence to validation principles, most notably the processing of independent sets, proper resolution-limited alignment, appropriate masking and map sharpening. We consider the Map Challenge to be a highly valuable exercise that should be repeated frequently or on an ongoing basis.
UR - http://www.scopus.com/inward/record.url?scp=85051715850&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85051715850&partnerID=8YFLogxK
U2 - 10.1016/j.jsb.2018.08.010
DO - 10.1016/j.jsb.2018.08.010
M3 - Article
C2 - 30114512
AN - SCOPUS:85051715850
SN - 1047-8477
VL - 204
SP - 291
EP - 300
JO - Journal of Structural Biology
JF - Journal of Structural Biology
IS - 2
ER -