Blog

Quantifying the effectiveness of coaching

Quantifying the Effectiveness of Coaching for College Students with Attention Deficit/Hyperactivity Disorder

Posted by | Apr 2, 2012

Final Report to the Edge Foundation
August 31, 2010
Submitted by
Sharon Field, Ed.D.,
David Parker, Ph.D.,
Shlomo Sawilowsky, Ph.D,
Laura Rolands, M.A.

EXECUTIVE SUMMARY

Abstract: Researchers from Wayne State University in Michigan conducted the study over two years in 10 universities and community colleges throughout the country and tracked the progress of 110 students with ADHD. It is the largest and most comprehensive study of ADHD coaching conducted to-date. The research team measured students’ progress through both quantitative and qualitative analysis and determined that the Edge coaching model was highly effective in helping students improve executive functioning and related skills as measured by the Learning and Study Strategies Inventory (LASSI; Weinstein & Palmer, 2002).

Executive Summary

This report describes results from a study to examine the effectiveness of the Edge coaching model on the academic success of students with ADHD in college and university settings. The study clearly demonstrated that Edge coaching services had a significant and meaningful impact on students’ self-regulation, executive functioning skills, and well-being.

Students from eight universities and two community colleges from a variety of geographic regions across the United States participated in the study. A total of 127 participated in the study. Students were randomly assigned to either the treatment group (N=88) or the comparison group (N=39). It is the largest study to date to examine the effects of ADHD coaching.

This study demonstrated that coaching services provided according to the Edge model were highly effective in helping students improve their self-regulation, study skills and will. It helped to build students’ confidence and enhanced their organizational and time management skills. Participation in Edge coaching services resulted in improvement in students’ approach to learning. It also enhanced their sense of well-being and resulted in more positive emotional states, which have been linked by research (Fredrickson & Branigan, 2005) to more effective learning.

This study demonstrated that the coaching services provided according to the Edge model were a highly effective intervention to help students improve executive functioning and related skills as measured by the Learning and Study Strategies Inventory (LASSI; Weinstein & Palmer, 2002). The LASSI measures Executive Functioning Skills as they are applied in academic environments. Executive functioning is an umbrella construct reflecting self-regulatory mechanisms that organize, direct, and manage other cognitive activities, emotional responses, and overt behaviors (Gioia, Isquith, & Guy 2001). The difference in gain on total LASSI scores between the Edge coaching group and the comparison group was statistically significant (p < .01.The Edge coaching group had a mean gain of 182.67 points pre to post, whereas the comparison group’s mean gain was only 64.05 points. The LASSI is comprised of three cluster scores: Self-regulation, Skill and Will. There were also significant differences between the Edge coaching group and the comparison group, in favor of the treatment group, on all three cluster scores. The differences between the treatment and comparison groups were significant (p < .05) for the Skill and Will clusters Self-Regulation (p < .01) cluster. Partial Eta2, is a measure of treatment impact that is useful for determining the practical significance following a statistically significant finding. This analysis revealed that the Edge coaching intervention demonstrated a moderate treatment outcome for the Skills and Will clusters and as a large treatment outcome for the Self-Regulation cluster. For comparison:

  • Very large effect size: use of cues, mentoring, reinforcement
  • Large effect size: cooperative learning, positive corrective feedback, phonemic awareness
  • Moderate: frequent testing, goal setting, staff development, tutoring
  • Small: audio-visual aids, parental education, pressure to achieve, school climate, school leadership, student attitude
  • Nil or negative: additive-free diet, class size, team teaching

Qualitative analysis of interview findings corroborated the findings from the LASSI. Students’ comments and artifacts indicated that Edge coaching services helped them establish more effective goals and pursue those goals in more efficient, less stressful ways. Students attributed this outcome to coaches’ proficiency in helping them reflect on themselves and their goals more often, in more realistic and positive ways, and to regulate their feelings and behaviors more effectively while pursuing those goals. Thematic analysis of interviews resulted in a major emphasis on self-regulated behavior with a focus within self-regulation on improved routines and structures and more effective self-talk. Results from this study also demonstrated that participation in Edge coaching services enhanced students’ sense of well-being and resulted in more positive emotional states. Edge students’ overall mean score on the College Well-being Survey (Field, Sawilowsky, Parker, & Roland, 2010) was statistically significantly higher than comparison students’ mean Well Being score, when corrected for initial differences in executive functioning. Again, qualitative analysis corroborated that Edge coaching services increased students’ subjective well-being. Thematic analysis of interviews resulted in the designation of positive feelings as an area of major impact of the Edge coaching model. Major themes within the category of positive feelings were less stress, greater empowerment, increased confidence and more balanced lives.

There were no statistically significant differences (p>.05) in GPA between the Edge and comparison students, number of credits earned in Semesters 1 or 2 (p>.05), or on eligibility to continue (p>.05). However, the Edge coaching model as currently implemented was not designed to impact GPA when delivered on a short term basis. It is possible that differences in GPA may be observed in a longitudinal study, or if the model was implemented for a longer duration.

The evidence is abundantly clear that the Edge coaching model made an important difference in the way students approach the learning process. It helped students to be more organized and efficient resulting in increased feelings of control and confidence. Given the difficulty that students with ADHD typically experience in self-regulation and executive functioning, it is anticipated that these findings will be of high importance to those concerned with factors that contribute to success for persons with ADHD.

For more information:

http://www.edgefoundation.org/research/

http://www.edgefoundation.org/parents/get-more-information/

Source: http://www.edgefoundation.org/wp-content/uploads/2011/03/Edge-Report-11-10a-exec-summary.pdf (PDF File)

Reviews

Evoke has been absolutely essential to the academic success of all three of our children. Evoke’s skilled staff and tutors were able to assess and remediate gaps and challenges that... read more

Laura Harvey Avatar Laura Harvey
November 17, 2023

Vic has been an amazing support for our teen. I catch bits of their sessions together and Vic is so compassionate, engaging, practical and intentional. Our teen truly... read more

Bruce Sellery Avatar Bruce Sellery
October 22, 2023

This tutoring has been a game changer for my son. The staff are fabulous; kind and patient with him and his learning needs. Highly recommend! And we love Lea!

Amanda Tulk-O'Reilly Avatar Amanda Tulk-O'Reilly
October 6, 2022

My son was diagnosed with ADHD-Combined, and we were very fortunate to discover Evoke Learning. Over the past 1.5 years, Evoke Learning has been instrumental in helping my... read more

JT Avatar JT
April 6, 2022

I worked with Richard at Evoke over several months and he was immensely helpful. Besides being professional and effective, Richard was very compassionate and empathetic. During my time working with... read more

Bree Avatar Bree
April 6, 2022

My son was diagnosed with ADHD plus an LD and he was having difficulty with his high school classes. After searching for tutors for my son and coming up... read more

Trecia Downes Avatar Trecia Downes
April 6, 2022

Our experience with Evoke has been fantastic. Everyone from the administrative staff, to the assessment staff to the tutors are incredible professional, and knowledgeable. The virtual experience was great, my... read more

Anne-Marie Gabrini Avatar Anne-Marie Gabrini
April 6, 2022

My name is Jessica and I’ve had Richard as my academic coach for the last 1.5 years. I am completing my Master’s and as someone with ADHD, I was very... read more

Kimberley Gemmell Avatar Kimberley Gemmell
April 6, 2022

I went to Evoke for several months for ADHD counselling. I had Richard Comeau, who was unbelievably helpful with improving my work ethic, organizational skills, motivation, and note taking/studying strategies.... read more

Evan Applebaum Avatar Evan Applebaum
April 6, 2022

The reading program at Evoke helped me feel empowered and strengthen my reading. This program truly has impacted my life in such a positive way. This program not only helped... read more

Vanessa Garritano Avatar Vanessa Garritano
April 6, 2022

I had the chance to work with Richard this year on improving my learning skills and over that time I've become a different person with a completely different mindset on... read more

Naomi Tomeo Avatar Naomi Tomeo
April 6, 2022

My 14 year old son has been working with Andrew for a couple of years to get help with math and science and he loves it so much my 16... read more

Dorothy Steel Avatar Dorothy Steel
April 6, 2022

I worked with Richard at Evoke over several months and he was immensely helpful. Besides being professional and effective, Richard was very compassionate and empathetic. During my time working with... read more

Bree Lawrence Avatar Bree Lawrence
November 22, 2021

I feel so much gratitude for the services of Evoke Learning. Our child developed reading skills during our time with Evoke which was a huge milestone. Dollar for... read more

Lee May Nikoletos Avatar Lee May Nikoletos
April 6, 2021

A friend recommended Evoke after I shared concerns with my daughter’s reading development. She had used Evoke more than five years ago and still raves about the positive impact for... read more

Shalini Mitchell Avatar Shalini Mitchell
April 6, 2021

I have nothing but positive things to say about our Evoke Learning experience. From the initial phone call, to the intake meeting to, in our instance, the weekly sessions, there... read more

Mike Dietrich Avatar Mike Dietrich
April 6, 2021

Kate is quite possibly the most helpful person I have worked with in the 20+ years of managing my ADHD. She is down to earth, intelligent, compassionate and truly incredible... read more

Emmett Johnston Avatar Emmett Johnston
April 6, 2021

I had the pleasure of being mentored by Richard. He taught me how to maximize my school performance, and to learn how to work with my ADHD and learning... read more

Cameron Oland Avatar Cameron Oland
April 6, 2021

I’ve had nothing but positive experiences at Evoke, having worked with two of their coaches (Aaron and Richard). With their professionalism, kindness, and expertise, I’ve been making real progress on... read more

C. James Avatar C. James
April 6, 2021

Our daughter has learning disabilities and ADHD. When she began having difficulties during university, Kate Lloyd was recommended. Kate’s counselling was excellent and enabled our daughter to graduate... read more

Marilyn Gillespie Avatar Marilyn Gillespie
April 6, 2020

I have been working with Evoke Learning for my ADHD for about five years. Before I started working with my tutor I was having a lot of difficulties at school... read more

Keegan Gardner-Elmer Avatar Keegan Gardner-Elmer
April 6, 2020

As a Mom of a student with learning disabilities, I highly recommend the coaching and tutoring services of Denise Harding and the staff at both the Evoke Learning Aurora and... read more

Glenna Davis Avatar Glenna Davis
April 6, 2020

****5 STARS HANDS DOWN!!!!**** Kate Lloyd, the owner of Evoke Learning- is one of the most amazing and outstanding human beings that I have ever met in my life.... read more

Malaika Jackson Avatar Malaika Jackson
April 6, 2020

It is difficult to sum up how much Evoke’s services have helped me to reach my goals and realize my full potential at university and beyond. From my in-person coaching... read more

Carli G Avatar Carli G
April 6, 2020

I have been using Evoke's services for the past two years while being in university. I have to say, Kate (the owner) has gone ABOVE and BEYOND for me! She... read more

Hailey Merten Avatar Hailey Merten
April 6, 2020

I worked with Evoke's learning for helping my niece. She wanted to be in the baseball team and we weren't ready to allow her as she is an ADHD kid.... read more

Linda Wells Avatar Linda Wells
April 6, 2020

We have made Evoke our go-to resource for several years. One of our children had been diagnosed with a learning difference and ADHD, in grade three, and needed a support... read more

Anouchka Freybe Avatar Anouchka Freybe
April 6, 2020

I had the pleasure of working as a coach and mentor at Evoke Learning. I was very impressed with the quality of training I received by Kate Lloyd, and have... read more

Uzma Abdullah Avatar Uzma Abdullah
April 6, 2020

I would give 10 stars if I could! Kate Lloyd is amazing at what she does. I had always struggled to take tests through University and Graduate school so... read more

Jaclyn Clarkson Avatar Jaclyn Clarkson
April 6, 2020

I hired Evoke Learning to help coach and organize my child when he went off to university. They did an excellent job and were very professional with their services, invoicing,... read more

Diana Lawrence Avatar Diana Lawrence
April 6, 2020

We have had the greatest pleasure of Learning about Evoke. They have been phenomenal working along with my daughter. Denise was a great mentor for my daughter... read more

Daniela Saker Avatar Daniela Saker
April 6, 2020

My daughter has been with Evoke Learning and with the academic coaching program for two years. In that time, I can say that she’s really become much stronger in her... read more

Lily McClelland Avatar Lily McClelland
April 6, 2020

Great coaching services for students with ADHD and/or executive function deficits. Denise is organized, structured and holds her clients accountable for their 'homework'. I highly recommend Evoke to parents who... read more

B “onekgirl” K Avatar B “onekgirl” K
April 6, 2020

I can say both my boys used Evoke Learning to sharpen their study skills and benefitted from the coaching they received. I would recommend Evoke Learning when a child needs... read more

Lily Polemidiotis Avatar Lily Polemidiotis
April 6, 2020

My Son Marco has been going to Evoke for English and Math, and we are so happy with his progress. He has worked with Bridgitt and Mohammed and they... read more

Amy Gesualdo Avatar Amy Gesualdo
April 6, 2020