At the end of this course, the students; 1) understand basic testing, measurement, assessment, and statistical concepts and principles; 2) understand situations where educational and/or psychological tests can be used and helpful in making decisions about individuals and/or programs; 3) understand and use reliability and validity concepts and methods; 4) interpret and use scores obtained on a test; 5) distinguish norm-referenced testing from criterion-referenced testing and describe the ways in which each type of test is developed, evaluated and used; 6) understand current testing issues and developments; 7) understand basics of Item Response Theory; 8) distinguish characteristics of classical test theory and Item Response Theory; 9) describe cognitive skills and affective characteristics measured by tests; 10) use basic statistical methods on test and item scores; 11) understand basics of objective versus constructed response item formats;
MODE OF DELIVERY
Face to face
PRE-REQUISITES OF THE COURSE
No
RECOMMENDED OPTIONAL PROGRAMME COMPONENT
No
COURSE DEFINITION
This course has been designed to provide comprehensive information about the classical test theory, methods of instrument development, test adaptation and evaluation to the graduate level students in educational sciences. Basics of Item Response Theory are also covered in the course.
Developing an achievement test or attitudinal questionnaires are emphasized during the semester, as well as analyzing the item level data obtained on achievement and attitude tests. The special emphasis is given to cognitive skills assessed by achievement tests. The affective characteristics assessed by attitudinal measurement will also be covered.
COURSE CONTENTS
WEEK
TOPICS
1st Week
Basic concepts and principles of measurement, assessment and evaluation
2nd Week
Planning Tests I, Determining the purpose of the test, Preparing test blue-print
3rd Week
Planning Tests II, Preparing test specification, Operational definitions of the test specifications
4th Week
Classical Test Theory and its? applications
5th Week
Classical Test Theory and its? applications
6th Week
Introduction to Item Response Theory
7th Week
Reliablility of test scores
8th Week
Validity of test scores
9th Week
Item and test score analyses
10th Week
Basic approaches in attitudinal measurement
11th Week
Current testing issues in Turkey
12th Week
Test translations and adaptations in educational research
13th Week
Practicum in test development
14th Week
Practicum in test and item score analyses, Project report
RECOMENDED OR REQUIRED READING
Berberoğlu, G. (2203). Planning Classroom Test. (pp:726-731). In Encyclopedia of Psychological Assessment. Rocio Fernandez- Ballesteros (Ed.) Sage Publication.
CrCCrocker, L. & Algina, J. (1986). Introduction to classical and modern test theory. New-York: Holt, Rinehart, and Winston.
International Test Commission. (2017). The ITC Guidelines for Translating and Adapting Tests (Second edition). [www.InTestCom.org]
McCoach, D.B.,Gable, R.K., Madura, J.P. (2013). Instrument development in the affective domain: School corporate applications. New York: Springer
Ma Marzano, R.J. & Kendall, J.S. (2008). Designing and assessing educational objectives: Applying the new taxonomy. Thousand Oaks: Sage Publication
PLANNED LEARNING ACTIVITIES AND TEACHING METHODS
Öğrencilerin dönem sonunda bir portfolyo çalışmasını başarılı bir şekilde tamamlamaları gerekmektedir. Portfolya aşağıdakileri içerecektir:
(1) Amaç, test planı ve soruları içeren test geliştirme projesi
(2) Gerçek ya da simule edilmiş verilerin kullanılarak gerçekleştirildiği 0,1 gibi ya da kategorik puanlanan soruları kapsayan veri setinin analizini içeren test analizi projesi. Bu proje madde analizini, faktör analizini ve kapsam geçerliğini içerecektir.
(3) Türkiye?deki geniş ölçekli sınavları kritik eden irdeleyici yazı.
Projectlerdeki gelişmeleri öğrencilerin dönem boyunca sınıfta sunmaları beklenmektedir. Her hafta okuma görevi olacaktır.,Presentation,Report Preparation,Practice,Lecture,Questions/Answers
ASSESSMENT METHODS AND CRITERIA
Quantity
Percentage(%)
Mid-term
1
30
Project
1
40
Total(%)
70
Contribution of In-term Studies to Overall Grade(%)
70
Contribution of Final Examination to Overall Grade(%)
30
Total(%)
100
ECTS WORKLOAD
Activities
Number
Hours
Workload
Midterm exam
1
12
12
Preparation for Quiz
3
3
9
Individual or group work
14
4
56
Preparation for Final exam
1
30
30
Course hours
14
1
14
Preparation for Midterm exam
1
30
30
Laboratory (including preparation)
14
2
28
Final exam
1
15
15
Homework
6
6
36
Quiz
5
2
10
Report writing
10
6
60
Total Workload
300
Total Workload / 30
10
ECTS Credits of the Course
10
LANGUAGE OF INSTRUCTION
Turkish
WORK PLACEMENT(S)
No
KEY LEARNING OUTCOMES (KLO) / MATRIX OF LEARNING OUTCOMES (LO)
