Exploring
Evidenced-Based-Data Results
Many products in development claim Evidence-Based-Data
findings.
What is their data authenticity? What kind of testing, and
by whom?
This article is in response to my previous “Proof is in the
Pudding” discussion, where I self-monitored my internal responses in parallel
to the participants’.
Subsequently, my former personal anecdotal review can be validated
by lengthy clinical research findings.
Most product-building data collections, unfortunately, are heavily
anecdotal, or computerized self-tests, rather than having rigorous scientific analyses.
Participants can be assessed by informal tests in specific areas, by self or instructors. Compilations then become compiled by doctoral, or representative students in labs, or by computerized selection formats.
The BTA has applied both types of assessment extensively, through 13 test sites with many 3rd party evaluators, testing companies, and institutions.
The treatment outcomes
included both criteria- referenced elements (continued to the present time), and
highly recognized diagnostic standardized tests, monitored in depth by three independent
testing companies, and five universities.
Although the confirmed results are precedingly dated, they remain
substantive, as they were evaluated at so many assessment levels, with high
level statisticians/evaluators, and circumstances.
Participant longitudinal data is hard to come by, as the
learner often changes locations. Parochial schools are preferred, as students
often move lock-step from grade- to- grade.
In the 2-Parochial school study, the goal was to determine
if the results generalized to higher achievement scores.
Out of 14 classrooms,
only three adhered to implementation protocols and obtained results (two fourth
grades and a 6th grade).These students, moved forward with new teachers, and were followed
by assigned numbers for 2-4 years longitudinally, as long as they remained at
the middle school level.
The implementation problem was embedded in the poor technical
media applications available in 1996.
Only three teachers could manage juggling
video and audio tapes with an overhead projector, for 48 lessons on a daily
basis.
And, following heavy on-site teacher training, applying students’
handwriting on worksheets.
Surprisingly, these written worksheets, revealed important cognitive
changes within the first 20 days.
Interestingly, the two schools with the 4th and 6th
grades’ high results, elected to verify my outcomes with an independent testing
company; Educational Testing Service (ETS) of Princeton, NJ.
Outcomes
The subsequent verification of my results indicated that I
needed to wait for the right technology to emerge, even if it took a waiting
time.
Broadband internet availability, with finding the right
photographer/sound editor, who could incorporate the many embedded instructional
layers into one brief, daily filming lesson, was crucial.
Then, hopefully, creating high fidelity, excellent
phonological sound quality, with streamlined, engaging, and timing with puppetry.
Subsequently, I waited, and completed the problematic, on-going
project’, now prepared for broader digital transformation.
Drahozal, E. (Vice President, Iowa Test of Basic
Skills - ITBS testing service, personal communications, technical assistance,
April 18, 1998, May 17, and May 27, 1999 and June 8, 1999). Ithaca, IL:
Riverside Publishing Company.
Erland, J K. (c February 1986, 1989). Contrapuntal Thinking and Definition of
Sweeping Thoughts. Lawrence, KS
Erland, J.
K. (1994). Analytical skills training through video-tape
instruction develops higher-order thinking skills capability. Journal of the Society for Accelerative
Learning and Teaching, 19, (2), 155-227.
Erland, J . K. (1995).
Cognitive skills training improves listening and visual memory for
academic and career success. in ERIC
Clearinghouse, Journal of Accelerative Learning and Teaching, 20,
(1 & 2) 87-101.
Erland, J.
K. (October 1997). Fitting into
the high-performance workplace. The American Society For Training and
Development. KC-ASTD’s VISION. p. 1
Erland, J. K. (Fall, 1998).
Cognitive skills and accelerated learning memory training using
interactive media improves academic performance in reading and math. Journal of Accelerative Learning and
Teaching,23, (3 & 4), 3-57.
Erland, J. K.
(Spring, 1999). High performance
thinking counts. Performance In Practice. The
American Society for Training and Development. and KC-ASTD’s VISION,
February, 1999.
Erland, J.
K. (Spring, 1999). Brain-Based learning longitudinal study
reveals solid academic achievement maintenance with Accelerated Learning
practice. Journal of Accelerative
Learning and Teaching, 24, (1).
Erland, J. K. (Summer-Fall 2007). Five generations,
27-years of iterative experimentation demonstrates cognitive skill improvement
enhances academic achievement and career goals.
Frisbie, D.
(Ed., ITBS, personal communication, technical assistance, June 10, 1998
and August 9, 1999). Iowa City, IA: Iowa Testing Service.
Hoover, H. D., Hieronymus, D. A. Frisbie, D. A., &
Dunbar, S. B., (1993) Iowa Tests of
Basic Skills Content Classifications with Item Norms. Complete/Core/Survey Batteries, Levels
5-14. Form K. Chicago, IL: The Riverside Publishing
Company.
Riverside 2000. (1994). Iowa Tests of Basic Skills Integrated
Assessment Program, Technical Summary I.
Chicago, IL: The Riverside Publishing Co.
Science Research Associates Standardized
Achievement Testing (1985). Survey of Basic Skills. Chicago,
IL: SRA.