{"id":1960,"date":"2014-09-02t23:07:29","date_gmt":"2014-09-03t06:07:29","guid":{"rendered":"\/\/www.catharsisit.com\/?p=1960"},"modified":"2014-09-02t23:07:29","modified_gmt":"2014-09-03t06:07:29","slug":"make-sure-test-prep-is-working","status":"publish","type":"post","link":"\/\/www.catharsisit.com\/blog\/make-sure-test-prep-is-working\/","title":{"rendered":"3 ways to make sure your school\u2019s test-prep programs are really working"},"content":{"rendered":"
as business development manager at magoosh, it\u2019s my job to make sure schools and universities get the most out of test prep. part of that means helping staff members decide on the best prep program for their students. but determining what\u2019s \u201cbest\u201d can be complex for the schools i work with — especially when they don\u2019t know what data to look at to make that decision, or when the program they\u2019re currently using doesn\u2019t provide strong metrics.<\/p>\n
moreover, many educators can be resistant to change. magoosh is disrupting traditional test prep by providing online learning experiences that are both excellent and affordable, but many faculty i speak with are hesitant to change what they think is already working. so how do we know if the college prep program you\u2019re using is really working? and if it isn\u2019t, how do we know what will?<\/p>\n
<\/p>\n
1. legitimate score increases<\/b><\/p>\n
there are lots of ways to quantify test-prep effectiveness, but score improvement is definitely the most common. give students a diagnostic, help them study, and then see what they get on the actual test. but we want to make sure the score increases are legitimate, and there are some big problems with this method.<\/p>\n
first, diagnostic tests aren\u2019t the same as real tests. modern students can feel so over-tested that they are hesitant to try their best on a diagnostic. it\u2019s also possible that the diagnostic could be harder or easier (or just plain different) than the real exam. in fact, some test prep companies have been accused of making their diagnostics too hard on purpose — a harder pre-test means inflated student growth numbers, after all. definitely a test-prep ethics no-no.<\/p>\n
<\/p>\n
at magoosh, we prefer to focus on student growth and conceptual learning instead of unofficial diagnostics. the best before-and-after method is to compare two official exams. most students take the sat more than once<\/a>, as do many gre and gmat students, so official pre-scores are often easy to come by. if you can\u2019t get previous scores, use an officially released exam as a benchmark (here are links to free released gre<\/a>, sat<\/a>, and gmat<\/a> exams). just be careful to use diagnostics the right way<\/a>.<\/p>\n 2. student engagement<\/b><\/p>\n if you don\u2019t have previous real-life scores to compare to, another great metric to determine whether your program is working is student engagement. you can measure this in lots of ways — student attendance, homework completion, or even just watching their faces while they do the work.<\/p>\n <\/p>\n because magoosh is all online, we can help schools track engagement with a lot of different metrics. how many questions have students answered? how many lessons have they watched? when did they last log in, and how long was their session? these are all important yardsticks to help determine how engaged students are with the material, and to help teachers and facilitators hold students accountable.<\/p>\n 3. cost efficiency<\/b><\/p>\n let\u2019s face it: if you work in a school or university, you have probably faced budget cuts in recent years.<\/p>\n <\/p>\n to determine if your program is cost effective, start by thinking about how much you\u2019d be willing to pay for some incremental improvement per student. how much would a 10 point sat bump be worth, or a 1 point gre boost for each of your students? then compare that to what you\u2019re actually paying per student for the average increases you\u2019re getting. you may have to estimate, but you can at least come up with a ballpark of what you\u2019re paying per point, per student. how satisfied are you with this cost?<\/p>\n at magoosh, we guarantee<\/a> that students who fully use our program will earn a 150 point score increase on the sat, a 5 point increase for gre scores, or a 50 point increase for gmat. divided by the cost per student — less than $100 for now — and that\u2019s a ratio our customers are very happy with.<\/p>\n every school program and group of students is different, so the question isn\u2019t which prep program is best — it\u2019s which prep program works best for you. these metrics are great tools for making that determination. are there others that you use? please share them in the comments!<\/p>\n read more education articles by peter:<\/p>\n online learning can work for everyone<\/a><\/p>\n 5 creative ideas for funding your college prep programs<\/a><\/p>\n image credits: 1<\/a>, 2<\/a>, 3<\/a>, 4<\/a>, 5<\/a>. <\/i><\/p>\n","protected":false},"excerpt":{"rendered":" find out whether your school’s test-prep program is helping students succeed with these three tips.<\/p>\n","protected":false},"author":77,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[12],"tags":[46,29,47,48,43,49,50,51,52,53],"ppma_author":[503],"acf":[],"yoast_head":"\n