Dylan and Gregory have been amazing in their generosity and willingness to share their vast knowledge in this space. We were honored to present a session on asking survey questions about sex and gender at Evaluation 2021, the annual conference of the American Evaluation Association. We’ve been fortunate to stay in touch with them since!
The survey scenario: North Clackamas School District has worked with Youth Truth for years to gather insights about their schools from students and families. Youth Truth is a project of the Center for Effective Philanthropy, with seeding funding and backing of several large education funders (e.g., Bill & Melinda Gates Foundation). As their website states:
Kim here, writing once again with my survey design BFF Sheila, of Custom Professional Learning, LLC. Every book published contains a typo. OK, maybe not every book, but we would wager that most probably do. Every song recorded probably has a mistake or two as well. But you wouldn’t imagine that an author’s first draft…
We know that poorly written survey questions can lead to inaccurate data, cause survey fatigue, and result in non-response. Question makeover #1 There are two significant problems with this question. Let’s start with the question stem. Here, our first instinct is to answer in our heads “Well I am NOW!” We know they meant “before…
Have you ever heard that all of your survey questions should use the same rating scale to make it easier for people to respond? Or that if you include demographic questions, you need to include all possible demographics, and always at the end (or beginning) of the survey? Or that you can only measure one…