Recent issues regarding r _WG, r* _WG, r _WG(J), and r* _WG(J)

A recent article by Lindell and Brandt raised two concerns regarding the use of James, Demaree, and Wolf's interrater agreement indices r _WG and r _WG(J). First, they noted that the multi-item r _WG(J) equation is mathematically equivalent to inserting r _WG into the Spearman-Brown prophecy formula and questioned whether applying a formula developed for a reliability index was also appropriate for an agreement index. Second, they questioned the appropriateness of James et al.'s suggestion of replacing obtained negative values of r _WG with zeros. This article addresses these concerns by demonstrating that r _WG(J) can be derived independently from the Spearman-Brown prophecy formula and that negative values of r _WG can be avoided by reparameterizing the structural equation underlying the data when there is systematic disagreement between subgroups of raters.