Help Us Patch the Pipeline

We need to talk about implicit bias in STEM.


Photo by Amplitude Magazin on Unsplash

At first, my mom wasn’t sure if she should name me ‘Victoria’ or ‘Sydney’.

Privy to prejudices, she understood that a gender-neutral name could help inoculate her daughter against the discrimination she may face in her future career. Today I am a first-year neuroscientist seeking a doctorate degree from Emory University. I love my field: every day is a blessing as I get to run experiments in the lab, discuss literature with my friends, and learn from some of the best scientists in my field. This truly is the good-life.

Luckily, my upbringing largely sheltered me from the gender bias. Growing up, my parents poured their support into my interests without consideration of gender expectations. I revered my older brothers who invited my company as we built forts, shot nerf guns, played video games, and became backyard arsonists. I grew up with the expectation that wherever my interests may take me, a welcoming community will receive me as an equal. Now as an adult, I notice troubling trends that threaten women and minorities in their scientific careers. We need to discuss the effects of implicit bias in STEM

Most of my peers and all my former faculty members treated me with the utmost respect. Sometimes in a casual conversation with a colleague, implicit prejudices rang in the subtext. For example, when I shared the news of my first publication with a colleague at my undergraduate institution, he suggested that I got into that lab because I was an attractive woman. It seemed easier for him to believe that my success resulted from my outward appearance rather than years of hard work.  Although sexist, my colleague’s assumption relies on the fact that, statistically speaking, my PI is a heterosexual man. According to UNESCO Institute for Statistics (UIS), less than 30% of the world’s researchers are women (1). Although women receive over half of all Ph.D. degrees, only 22% and 15% reach tenure or become department chairs, respectively (2). Of all the graduate students pursuing STEM doctoral degrees, just 2% are Hispanic and 2% women of color (3). Our pipeline hemorrhages talent before it can reach the graduate level. What factors undermine women and minority access to a scientific career? 

.

Women and minorities pursuing STEM fields contend with a barrage of biases at each career milestone. Upon applying to graduate school prospective students, take the General Record Exam (GRE). One scientifically demonstrated harm of societal prejudice is the stereotype threat in which the fear of living up to a stereotype impairs performance: an effect documented in standardized testing (4). The stereotype threat was one factor that contributed to my own anxiety I experienced while preparing for and taking the GRE. I took studying for the GRE seriously, as I enrolled in a GRE course, studied from several books, utilized online sources, and took dozens of practice exams. I began having regular panic attacks during studying and class-room sessions. I could not finish a practice exam without having an anxious episode. In addition to studying, I began seeking cognitive behavioral therapy so I could learn strategies to control my anxiety. After six months of studying and mental health work, I got to the point where I could finish on-site practice exams with satisfying percentile scores. Frustratingly, when it came time for the first quantitative section on the real test, anxious thoughts flooded my cognitive space. Many pressures contribute to my test-anxiety: one threat was the suspicion that stereotypes against women performing in quantitative fields might be true, and that my failure would contribute to this stereotype. Despite my love for mathematics and calculus in my college courses, racing thoughts of inadequacy interfered with my ability to focus on the test questions. A fear of having a panic attack in the test-center compounded these anxieties and I lost my composure. To avoid distracting the other test-takers, I felt that all I could do was leave the test center with my exam unfinished.  


Osborne, Jason W. (2007). “Linking Stereotype Threat and Anxiety”. Educational Psychology2

Photo by Sharon McCutcheon on Unsplash

It was only after starting my doctoral degree that I learned about problematic correlations between under-represented demographics and GRE scores. Meta-analysis conducted by the Educational Testing Service (ETS), the organization administering the test, reveal that women score on average 80 points lower in the physical sciences than men, and African Americans score 200 points below white test takers (5). Graduate admissions committees often use GRE scores to screen-out applicants. Recently, the use of the GRE as a talent-sieve has been criticized after several studies documented the tests’ failure in predicting any measure of graduate school success (6,7). Graver threats await women after admission into graduate school. A survey of field-researchers conducted in 2014 found that 26% of women reported sexual assault and 75% reported sexual harassment (8).  Although sexual misconduct isn’t unique to the sciences, the hierarchical power structure inherent to academic science can dissuade women from seeking lawful retribution; coming forward puts their careers at risk. Still, the unseen obstacles extend beyond sexual assault, as the effects of implicit bias permeate the workforce. Women get less invitations to speak at conferences, receive fewer paper citations, are less likely to be published as first author, receive fewer award nominations, are awarded less funding, and hiring committees exhibit favorable bias toward men (9,10,11,12,13,141617). The literature abounds with data describing professional barriers which can dampen the success of women and minorities.Despite the evidence, a few high-profile academics disregard these factors when reflecting on the dearth of women in science. Harvard Psychologist Dr. Steven Pinker posed that innate biological differences in aptitude and motivation explain the fall in gender-parity with rank ascension, citing IQ , SAT, personality test scores (18). In response to Pinker’s statements, Harvard psychologist Dr. Elizabeth Spelke and the late Stanford Neurobiologist Dr. Ben Barres refuted the ‘innate differences’ explanation and instead cited studies showing that women perform as good as men on a variety of mathematical aptitude tests, and cited a compendium of studies implicating implicit biases as professional barriers (19). Comments like those made by Dr. Pinker contribute to a climate of prejudice against women in science. They puncture holes in the pipeline.  

Personally, the statements like those made by Dr. Pinker strike me as clearly inaccurate. Every day I work alongside dozens of women who apply exacting scientific rigor and creative problem-solving to their science. I notice women who come in early to devour literature so that they can mentor a new scientist during the day and stay after-hours to perform their own experiments. I see women attending seminars to stay on top of their fields, engaging the community in out-reach events, and assuming leadership positions on committees to build a more inclusive system. My female colleagues are exemplars of aptitude and motivation; despite the professional barriers they must overcome. It should come as no surprise that their sterling work-ethic and robust resilience reflect in the impact of their scientific contributions. Just in my short life, I saw the field of biology revolutionized by the minds of Dr.’s Jennifer Doudna and Emmanuel Charpentier with the invention of the CRISPR Cas9 system as the gene-editing technology that may forever shape humanity. I read of Maryam Mirzakhani who won the Fields Medal in 2014 for her contributions to the geometry of Reimann surfaces. And recently, I delighted in the news of the first picture of the black-hole; a triumph made possible by Dr. Katy Bouman’s imaging algorithms. One need not look far to find evidence of motivated, competent women with revolutionary contributions. 


Photo by Samuel Zeller on Unsplash

As I go forward in my career, I cherish the collaborative relationships I get to build with my fellow-scientists. Ten of the fourteen doctoral students in my cohort are women, and I benefit from the supportive environment we built together. I don’t know how many of us will stay in academia or land a tenured-professorship at a university down the line. I do know that my colleagues are brilliant, hard-working scientists with the potential to build any career they would like. What can we do to address the dearth of women in STEM? As a society, we can be better at acknowledging, publicizing, and celebrating the accomplishments of women and minorities in all professions. When considering nominating a colleague for an award, or inviting a speaker to an event, we can pause to consider the diversity of our candidates. How many women and minorities work in this field? Do my considerations reflect those demographics? We can continue to engage people from all backgrounds in STEM through outreach opportunities and by opening dialogues in-person and online. We can challenge ourselves to mentor those who come from different backgrounds than our own. We can call on women when they have something to say and listen to them sincerely without interruption. Closing the gender and ethnicity gaps seen in STEM careers demands a concerted and consistent effort from all of us. Together, we must think, speak, and act inclusively to see results.


Photo by Micheile Henderson on Unsplash

This article was originally published at The Xylom

Originally published at The Xylom, cover photo taken by
Tim Mossholder on Unsplash

GRE scores don’t correlate with graduate school success

My car inundated with GRE supplies

“When I get students in the lab…I will warn them that the skills that made them academically bright are not going to be the skills that will help them as scientists”
-Dr. Daniel Colón-Ramos; Yale Professor of Neuroscience and Cell Biology

Each year, graduate admissions committees rely on Graduate Record Examinations (GRE) scores as an “objective” mark to screen out applications. Growing skeptical of the predictive power the test promises, several universities recently launched studies investigating if several measures of PhD success correlate with GRE scores.

PART ONE: GRE scores don’t correlate significantly with grad school success.

Figure 1. A Multi-institutional analysis of STEM graduate student PhD completion as a function of GRE Quantitatative scores.

One study authored by Petersen et al. (1) gathered data of the degree completion rates in STEM programs from four flagship research universities. The team used a logistic regression to model degree completion as a function of “institution, gender and GRE V or GRE Q scores”. The results showed that men who scored in the lowest GRE Q percentile also had significantly higher rates of PhD completion (Figure 1). Women’s performance on the GRE Q section showed no significant correlation with degree completion in STEM programs. GRE scores also did not predict degree completion time.

Another study authored by Moneta-Koehler et. al (2) gathered data from 683 students enrolled in their Interdisciplinary Graduate Program (IGP) from 2003 until 2011. The team compared their performance on the GRE Quantitative, Verbal, and Analytical Writing sections with various measures of graduate school success. The measures assessed included ” (1) graduation with a Ph.D., (2) passing the qualifying exam, (3) time to defense, (4) number of presentations at national or international meetings at time of defense, (5) number of first author peer-reviewed publications at time of defense, (6) obtaining an individual grant or fellowship, (7) performance in the first semester coursework, (8) cumulative graduate GPA, and (9) final assessment of the competence of the student as a scientist as evaluated by the research mentor “. The results showed no correlation between GRE Q scores with time to defense, number of presentations, or first author publications (Figure 2). Another study authored by Joshua Hall et al. (3) at University of North Carolina Chapel Hill also found no correlation between the number of first author publications and GRE scores of 280 students in their biomedical PhD program (Figure 3).

Figure 2. Results from a study conducted by Vanderbilt University correlating GRE Q scores with various metrics of graduate school success.
Figure 3. Results from a study conducted by a research team at University of North Carolina Chapel Hill found no correlation between GRE scores and first author papers

It seems as though performance on the GRE fails to predict or even correlate with the success of the admitted graduate students in their STEM programs. Does performance on these tests correlate with anything? Yes.

PART TWO: Okay, so, what DO GRE scores predict?

Your skin color and gender. Nature study authored by physicists Casey Miller and Keivan Stassun (3) found troubling disparities in test performance across demographics. STEM graduate admissions programs often place a lot of stock in the quantitative portion of the GRE when deciding whether or not an applicant should be admitted. Data from the Educational Test Service (ETS), the developers of the GRE, show that women score “80 points lower on average in the physical sciences than do men, and African Americans score 200 points below white people” (Figure 4).

Figure 4. Data sourced from the ETS showing the respective GRE Q performances of various ethnic groups.

In the physical sciences, only 26% of women score above a 700 on the GRE, wheras 73% of men make this measure. If the admissions committees do not account for gender and ethnicity, then using GRE scores as a metric to screen out “under-qualified” applicants bottlenecks the diversity of their graduate student body.

PART THREE: The Great GRExit

In light of these troubling revelations, universities and agencies which fund them are dropping the GRE as an application requirement. To name a few programs, the University of Michigan’s biomedical sciences program dropped the test in 2017, with the program director stating “[asking]
students to invest money and effort in a test whose usefulness our faculty cannot agree on [would be] a questionable policy,” . The University of San Francisco dropped the requirement for these programs, and 7/8 schools of Emory University’s GDBBS program are also dropping the test. The National Institute of Health (NIH) changed its GRE policies for attaining individual fellowships and training grants in 2015, and the National Science Foundation (NSF) dropped the test in 2010 (4). A comprehensive list of STEM programs no longer requiring the GRE may be found here.

References:
1) Petersen SL, Erenrich ES, Levine DL, Vigoreaux J, Gile K (2018) Multi-institutional study of GRE scores as predictors of STEM PhD degree completion: GRE gets a low mark. PLoS ONE 13(10): e0206570. https://doi.org/10.1371/journal.pone.0206570

2) Moneta-Koehler L, Brown AM, Petrie KA, Evans BJ, Chalkley R (2017) The Limitations of the GRE in Predicting Success in Biomedical Graduate School. PLoS ONE 12(1): e0166742. https://doi.org/10.1371/journal.pone.0166742

3) Casey Miller & Keivan Stassun (2014) A Test that Fails. Nature 510, 303-304. https://www.nature.com/naturejobs/science/articles/10.1038/nj7504-303a

4)https://www.sciencemag.org/careers/2017/08/updated-biomedical-phd-program-major-research-university-drops-gre-requirement