How can I tell if my outreach to women is effective?
This is an Ask a Geek Feminist question answered by guest poster Erin Hardee, who works in university STEM outreach and blogs at Let’s Talk About Science.
How do you know that volunteer work you’re doing to encourage women to enter technology is effective? I get asked fairly often to volunteer from programs such as technology summer camps, mentoring, promotional websites and science fairs, and I’ve often wondered whether they are worthwhile.
While I like to think that every little bit helps, the fact is that programs targeted towards youth often have unintended consequences. Take the example of “girls in technology summer camp”. Maybe girls that attend technology summer camp would rather spend their vacation doing other things, and walk away annoyed and less inclined towards careers in technology than they were before. Maybe the girls that choose to attend are all girls that were planning to enter [science, technology, engineering and mathematics (STEM)] careers in the first place, and it has no effect. Even worse, maybe summer camps cause girls to make poorly-informed decisions to go into technical careers. Maybe they present an incomplete view which causes attendees to pursue STEM degrees, only to drop out when they realize what the degree is really about. Maybe they don’t realistically present the aptitudes required, and encourage attendees who are unlikely to succeed to pursue certain careers.
While the outcomes above might not be likely, they are possible, and as I do more of this type of work, I’d like to better understand its impact. As a minimum, I’d like to make sure that my work isn’t actually discouraging girls from entering the field, and at best I’d like to figure out what type of activity, per hour spent, has the most impact.
Does anyone know of any research on this subject, or have any thoughts in general?
Firstly, kudos for getting involved in outreach work – it’s great that you’re so committed to helping encourage the next generation of women into exciting and rewarding STEM careers!
Secondly, this is an interesting question. One of my favourite things about science in general and scientists in particular is the desire for evidence to support their stances. It’s perfectly reasonable to inquire about effective outreach and indeed, any outreach programme worth its salt should be asking the questions ‘is this effective?’ and ‘how do we make it more so?’. Unfortunately, those questions then lead to the meta-questions of ‘how do we define effectiveness?’ and ‘how do we measure it?’, which are far more woolly and hard to pin down.
From your question it seems like you have several different criteria for what could make a programme effective, and none of these are invalid. It could be that it provides an accurate, well-rounded view of what a particular degree is like in order to appeal to the ‘right kind’ of person, or it encourages everybody regardless of pre-existing interest to consider STEM subjects. These of course are two different aims, and it’s important to consider which we want our outreach to achieve when we’re planning and executing it. Is one necessarily better than the other?
Add to the mix the fact that there are so many types of outreach you could be doing and that they all link to different intended outcomes and it becomes very hard to measure them all to one standard. An outreach programme for a particular engineering school within a university may consider ‘success’ to be an increase in women applying for their school, whereas a wider-reaching, more generalised outreach programme may measure success in the number of woman who tick ‘I am more interested in science than I was before’ after attending an activity. The outcomes are also rather self-selecting; a summer camp may look more successful at recruiting young people into STEM subjects, but usually because the people who choose to attend them are already interested in those subjects to begin with. So unfortunately the question about which activity has the most impact per hour spent is nearly impossible to answer, at least when considering the wide range of possible outreach activities and the huge range of audiences and goals.
Page 1 of 3 | Next page