Great post, Lee! When I started leading evaluations of highly controversial school voucher programs back in 2004, I constructed a Research Advisory Board (a.k.a. "Red Team") for each study. They definitely enhanced the validity and impact of the studies. After the first meeting of my "Red Team" advising my Milwaukee voucher evaluation, I invited John Witte, known for his skepticism towards vouchers, to join my research team as Co-PI. I had created an Adversarial Collaboration without even knowing it! I just assumed that "Red Teams" and ACs were how people did social science, because they made sense to me!
Pretty much. Not *completely* but mostly. And there is a sorta silver lining. I take all this to mean that, despite the justifiable handwringing and skepticism produced by the Replication Crisis, our methods are pretty much up to the job. Its mostly the researchers themselves, and not (mostly) the inherent suboptimality of the methods that are the source of the problem.
Great post, Lee! When I started leading evaluations of highly controversial school voucher programs back in 2004, I constructed a Research Advisory Board (a.k.a. "Red Team") for each study. They definitely enhanced the validity and impact of the studies. After the first meeting of my "Red Team" advising my Milwaukee voucher evaluation, I invited John Witte, known for his skepticism towards vouchers, to join my research team as Co-PI. I had created an Adversarial Collaboration without even knowing it! I just assumed that "Red Teams" and ACs were how people did social science, because they made sense to me!
So, in other words, when real scientific approaches are used, the leftist social justice narrative falls apart.
Pretty much. Not *completely* but mostly. And there is a sorta silver lining. I take all this to mean that, despite the justifiable handwringing and skepticism produced by the Replication Crisis, our methods are pretty much up to the job. Its mostly the researchers themselves, and not (mostly) the inherent suboptimality of the methods that are the source of the problem.