Memspan Podcast 3 of 3. Series 1 - Faces, Voices, and Data Outcomes Revealed

A Case for Digital Transformation

Exploring Evidenced-Based-Data Results

 

Many products in development claim Evidence-Based-Data findings.

What is their data authenticity? What kind of testing, and by whom?

This article is in response to my previous “Proof is in the Pudding” discussion, where I self-monitored my internal responses in parallel to the participants’.

Subsequently, my former personal anecdotal review can be validated by lengthy clinical research findings.

Most product-building data collections, unfortunately, are heavily anecdotal, or computerized self-tests, rather than having rigorous scientific analyses.  

Participants can be assessed by informal tests in specific areas, by self or instructors.  Compilations then become compiled by doctoral, or representative students in labs, or by computerized selection formats.

The BTA has applied both types of assessment extensively, through 13 test sites with many 3^rd party evaluators, testing companies, and institutions. 

The treatment outcomes included both criteria- referenced elements (continued to the present time), and highly recognized diagnostic standardized tests, monitored in depth by three independent testing companies, and five universities.

Although the confirmed results are precedingly dated, they remain substantive, as they were evaluated at so many assessment levels, with high level statisticians/evaluators, and circumstances.

Participant longitudinal data is hard to come by, as the learner often changes locations. Parochial schools are preferred, as students often move lock-step from grade- to- grade.

In the 2-Parochial school study, the goal was to determine if the results generalized to higher achievement scores. 

Out of 14 classrooms, only three adhered to implementation protocols and obtained results (two fourth grades and a 6^th grade).

These students, moved forward with new teachers, and were followed by assigned numbers for 2-4 years longitudinally, as long as they remained at the middle school level.

The implementation problem was embedded in the poor technical media applications available in 1996. 

Only three teachers could manage juggling video and audio tapes with an overhead projector, for 48 lessons on a daily basis. 

And, following heavy on-site teacher training, applying students’ handwriting on worksheets.

Surprisingly, these written worksheets, revealed important cognitive changes within the first 20 days.

Interestingly, the two schools with the 4^th and 6^th grades’ high results, elected to verify my outcomes with an independent testing company; Educational Testing Service (ETS) of Princeton, NJ.

Outcomes

The subsequent verification of my results indicated that I needed to wait for the right technology to emerge, even if it took a waiting time.

Broadband internet availability, with finding the right photographer/sound editor, who could incorporate the many embedded instructional layers into one brief, daily filming lesson, was crucial.

Then, hopefully, creating high fidelity, excellent phonological sound quality, with streamlined, engaging, and timing with puppetry.

Subsequently, I waited, and completed the problematic, on-going project’, now prepared for broader digital transformation.

Drahozal, E. (Vice President, Iowa Test of Basic Skills - ITBS testing service, personal communications, technical assistance, April 18, 1998, May 17, and May 27, 1999 and June 8, 1999). Ithaca, IL: Riverside Publishing Company.

Erland, J K. (c February 1986, 1989).  Contrapuntal Thinking and Definition of Sweeping Thoughts.  Lawrence, KS

Erland, J.  K.  (1994).  Analytical skills training through video-tape instruction develops higher-order thinking skills capability.  Journal of the Society for Accelerative Learning and Teaching, 19, (2), 155-227.

Erland, J . K. (1995).  Cognitive skills training improves listening and visual memory for academic and career success.  in ERIC Clearinghouse, Journal of Accelerative Learning and Teaching, 20, (1 & 2) 87-101.

Erland, J.  K.  (October 1997). Fitting into the high-performance workplace. The American Society For Training and Development. KC-ASTD’s VISION. p. 1

Erland, J.  K.  (Fall, 1998).  Cognitive skills and accelerated learning memory training using interactive media improves academic performance in reading and math.  Journal of Accelerative Learning and Teaching,23, (3 & 4), 3-57.

Erland, J. K.  (Spring, 1999).  High performance thinking counts.  Performance In Practice.  The American Society for Training and Development. and KC-ASTD’s VISION, February, 1999.

Erland, J.  K.  (Spring, 1999).  Brain-Based learning longitudinal study reveals solid academic achievement maintenance with Accelerated Learning practice.  Journal of Accelerative Learning and Teaching, 24, (1).

Erland, J. K. (Summer-Fall 2007). Five generations, 27-years of iterative experimentation demonstrates cognitive skill improvement enhances academic achievement and career goals.

Frisbie, D.  (Ed., ITBS, personal communication, technical assistance, June 10, 1998 and August 9, 1999). Iowa City, IA: Iowa Testing Service.

Hoover, H. D., Hieronymus, D. A. Frisbie, D. A., & Dunbar, S. B., (1993)  Iowa Tests of Basic Skills Content Classifications with Item Norms.  Complete/Core/Survey Batteries, Levels 5-14.  Form K.  Chicago, IL: The Riverside Publishing Company.

Riverside 2000. (1994). Iowa Tests of Basic Skills Integrated Assessment Program, Technical Summary I.   Chicago, IL: The Riverside Publishing Co.

Science Research Associates Standardized Achievement Testing (1985). Survey of Basic Skills. Chicago, IL: SRA.