4. The multiple-choice format Focusgroupinterviews. How can Norwegian teachers’ reflections about the MKT items contribute to our understanding of challenges related to the multiple-choice format?
5. Item ResponceTheory (IRT) How can information about items psychometric properties give new insight when adapting U.S. developed MKT measure for use in Norway? An item performance is described by an item characteristic function (with different difficulty and slopes). Monotonically increasing function – as the MKT increase the probability of correct answer increase. Slope and difficulty is of importance.
7. IRT findings We found that items can be divided into three groups: Items that do not seem to function in Norway Items that function well, but have relatively high difference in item characteristics in Norway compared to the U.S., and Items that seem to function well and that have item characteristics close to what is reported in the U.S. Quantitative + qualitative analyses!
8. Teachers’ MKT Focus group interviews: We expected that teachers with strong MKT in one content area would be strong in other content areas relevant for their level of teaching. The teachers argued that some of the content areas were not relevant and more difficult compared to others - our motivation to study correlations
10. Correlations (Pearson, p-value<0.005) Correlations Teachers’ MKT scores in differentcontent areas arecorrelated All correlationsaresignificant – weakestcorrelationbetween PFA and NCOP
11. Conclusion We find that teachers’ MKT scores in the three content areas are correlated Teachers with high MKT in one content area have high MKT in other content areas and vice versa Despite comments from teachers that not finding PFA items relevant for their teaching, their PFA MKT is related to MKT in the other content areas