Home > Advocacy Library  > Letters > Sped Decision-Making Should Be Empiracally Driven

Educational Decision Making Should Be Empirically Driven
Not Driven by Intuition or Tarot Card Reading

By Bill Matthew, Former Special Ed Director / School Psychologist

Print this page

Dear Pete & Pam,

I've taken a thorough look at your web page. I think it's outstanding, especially the court cases. I'm a special ed director who is constantly trying to improve our special education services via good, sound empirically-driven practices. That's the KEY.

Special Educaton Should Use Empirically-Driven Practices

Educational decision-making should be empirically driven - not driven by intuition or tarot card readin - the latter is part and parcel of much school psychology, especially assessment.

It galls me that special education training programs don't mandate coursework in applied behavior analysis which has a sound empirical base. Such training would greatly improve the education received by nearly all special ed populations.

We can train Shamu but we can't train a kid to be compliant or read?? Give me a break!!

Age and Grade Equivalent Scores May be Inaccurate

Discourage the use of grade & age equivalents -- they're also ordinal measures, terribly inaccurate, they promote inaccurate typological thinking and they're grossly inaccurate for measuring growth. I know parents like 'em, but they can lead to erroneous conceptions.

Subtest Scatter

The use of subtest scatter analysis - this is a common practice, and may be okay if one only looks at the variation in performance as a hypothesis-generator for more in-depth investigation.

Even then, the psychometric validity/reliability of the specific subtests must be considered on their own merit before deciding to put any real value on the subtest score. To do so in the absence of sound psychometric evidence is at the very least unethical.

The use of subtest scatter (e.g., WISC-III) in the attempt to "differentially" diagnose a disability/problem is not supported by the empirical literature, even though it has some intuitive appeal and "testimonials" from clinicians abound.

Projective Tests

Projective tests has no place in school psychology. If I were a parent and attended an IEP on my son where such data was presented, I'd be outraged. There's better stuff available.

I refer you to Howard Knoff's chapter on Personality Assessment in NASP's Best Practices-III for a thorough treatment of the personality assessment issue.

Tests That are Psychometrically Sound

In your section on private/independent assessments, you infer that school districts don't have the assessment capabilities that private practitioners have.

Keep in mind that "good" school districts will follow the law and will only use only tests that have been "validated for the purpose for which they're used" - tests that are psychometrically sound.

For example, my psychologists are not allowed to use many tests - projective included - simply because they don't have the necessary reliability (.85 test-retest or higher), validity, or standardization characteristics. This constraint - a good one - is a quality control issue.

Private practitioners are not bound by this. They have access to an array of tests that may have a lot of "face validity", but no real empirical support.

Warn Parents About Evaluations That Do Not Use Sound Psychometrics

Parents must be cautioned against seeking a private evaluation that only serves to support their position in the absence of good sound psychometrics.

Exceptions to this is in the area of conducting systematic behavioral observations in the classroom or other relevant environments. Most school psychs/diagnosticians are not trained to do this, and a private examiner may be if they've had good applied behavior analysis training. This data is infinitely more valuable (reliable and valid) in determining behavioral discrepancies in SED cases and in devising appropriate treatment plans (IEP's) and in measuring progress.

Advocating for Kids with Emotional Disorders

I would love to be an advocate for parents in SED cases where "appropriate" treatment is being determined. Here in CA that means a one hour session where a verbally based form of insight therapy is used, typically with an elementary-aged, low SES, conduct disorder/oppositional behavior type.

This is an unethical, ineffective treatment model for this population of kids.

Along that line, Pete's Letter to Bobbie about Behavior Problems and Discipline is excellent, especially the references to animal training.

If you want to do some good advocacy work, come out here and help the CA Dept. of Mental Health set up such parameters for the mental health treatment of special ed kids. I'd love it. Kids have a right to effective treatment, and traditional therapy is not where its at with these conduct disordered kids.

Really enjoy your web page -

Bill Matthew, PhD, NCSP, BCBA-D
Program Lead Faculty-Applied Behavior Analysis Program
Site Lead Faculty-School Psych. Program (Sacramento, San Jose, Bakersfield)
National University
Email: nupsych@gmail.com

Note: At the time that Bill wrote this letter to Pete and Pam, he was a school psychologist and the Director of Special Education, i.e., School Support Services, in Bakersfield, CA.

Related Articles

Tests & Measurements for the Parent, Teacher, Advocate and Attorney. To successfully negotiate for special ed services that provide educational benefit, you need to know how to interpret test scores. (To ensure that you have the graphics in this article, print the article from the screen.) #1 download!

What You Should Know About Evaluations. As a parent, you must make sure that all areas of possible need are assessed as quickly as possible. While some parents would rather not allow their school system to evaluate their child, a refusal to cooperate at this stage of the process can backfire . . . " Read article

Testing: Myths & Realities. Describes why tests are essential in measuring progress and learning; includes nine myths about testing.

Learn more about Tests & Assessments