SlideShare una empresa de Scribd logo
1 de 13
The Relationship between Anxiety and Speaking Performance in Online and Face-to-face Interviews Jungtae Kim (Pai Chai University) jungtaekim@ pcu .ac.kr   Daniel Craig (Sangmyung University) [email_address]
Overview ,[object Object],[object Object],[object Object],[object Object],[object Object]
Introduction ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Theoretical Framework ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],* Test anxiety can be seen as trait or state.  It is a trait if seen as a general response that invokes state anxiety; however, it is state if you measure anxiety for a particular instance.  In our context, we used both.
Research Questions ,[object Object],[object Object]
Methodology ,[object Object],[object Object],[object Object],[object Object]
Results: Forms, Interviewers, & Raters ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Results: Performance Between Modes ,[object Object],[object Object]
Results: Anxiety & Mode ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Results: Anxiety, Mode, & Performance  ,[object Object],[object Object],[object Object],[object Object],[object Object]
Discussion: Mode & Anxiety ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Discussion: Mode, Anxiety, & Performance ,[object Object],[object Object],[object Object]
THE END ,[object Object],[object Object],Dan Craig Sangmyung University [email_address] http://www.danielcraig.com Jungtae Kim Pai Chai University jungtaekim@ pcu .ac.kr

Más contenido relacionado

La actualidad más candente

Questionary design
Questionary designQuestionary design
Questionary designPintu Sheel
 
RELIABILITY IN LANGUAGE TESTING-TITIN'S GROUP
RELIABILITY IN LANGUAGE TESTING-TITIN'S GROUPRELIABILITY IN LANGUAGE TESTING-TITIN'S GROUP
RELIABILITY IN LANGUAGE TESTING-TITIN'S GROUPTitin Rohayati
 
Handling missing Social Network data
Handling missing Social Network dataHandling missing Social Network data
Handling missing Social Network dataChristina Manteli
 
Not Good Enough but Try Again! Mitigating the Impact of Rejections on New Con...
Not Good Enough but Try Again! Mitigating the Impact of Rejections on New Con...Not Good Enough but Try Again! Mitigating the Impact of Rejections on New Con...
Not Good Enough but Try Again! Mitigating the Impact of Rejections on New Con...Aleksi Aaltonen
 
Unit iii internship training for internship (poorva vyas)
Unit iii internship training for internship (poorva vyas)Unit iii internship training for internship (poorva vyas)
Unit iii internship training for internship (poorva vyas)poorvavyas4
 
Design and Application of Experiments and User Studies
Design and Application of Experiments and User StudiesDesign and Application of Experiments and User Studies
Design and Application of Experiments and User StudiesVictor Adriel Oliveira
 
Towards Privacy-Preserving Evaluation for Information Retrieval Models over I...
Towards Privacy-Preserving Evaluation for Information Retrieval Models over I...Towards Privacy-Preserving Evaluation for Information Retrieval Models over I...
Towards Privacy-Preserving Evaluation for Information Retrieval Models over I...Twitter Inc.
 
Carma internet research module n-bias
Carma internet research module   n-biasCarma internet research module   n-bias
Carma internet research module n-biasSyracuse University
 
Assessment task 1analyse databsbdat501stu
Assessment task 1analyse databsbdat501stuAssessment task 1analyse databsbdat501stu
Assessment task 1analyse databsbdat501stuhoney690131
 
Instrument development process
Instrument development processInstrument development process
Instrument development processmunsif123
 
Site2011 tomidaokibayashitamura
Site2011 tomidaokibayashitamuraSite2011 tomidaokibayashitamura
Site2011 tomidaokibayashitamuraEiji Tomida
 
State of the art on the cognitive walkthrough method by MAHATODY, SAGAR and ...
State of the  art on the cognitive walkthrough method by MAHATODY, SAGAR and ...State of the  art on the cognitive walkthrough method by MAHATODY, SAGAR and ...
State of the art on the cognitive walkthrough method by MAHATODY, SAGAR and ...Fran Maciel
 

La actualidad más candente (19)

Questionary design
Questionary designQuestionary design
Questionary design
 
RELIABILITY IN LANGUAGE TESTING-TITIN'S GROUP
RELIABILITY IN LANGUAGE TESTING-TITIN'S GROUPRELIABILITY IN LANGUAGE TESTING-TITIN'S GROUP
RELIABILITY IN LANGUAGE TESTING-TITIN'S GROUP
 
Handling missing Social Network data
Handling missing Social Network dataHandling missing Social Network data
Handling missing Social Network data
 
Not Good Enough but Try Again! Mitigating the Impact of Rejections on New Con...
Not Good Enough but Try Again! Mitigating the Impact of Rejections on New Con...Not Good Enough but Try Again! Mitigating the Impact of Rejections on New Con...
Not Good Enough but Try Again! Mitigating the Impact of Rejections on New Con...
 
Malhotra03
Malhotra03Malhotra03
Malhotra03
 
Unit iii internship training for internship (poorva vyas)
Unit iii internship training for internship (poorva vyas)Unit iii internship training for internship (poorva vyas)
Unit iii internship training for internship (poorva vyas)
 
Design and Application of Experiments and User Studies
Design and Application of Experiments and User StudiesDesign and Application of Experiments and User Studies
Design and Application of Experiments and User Studies
 
Towards Privacy-Preserving Evaluation for Information Retrieval Models over I...
Towards Privacy-Preserving Evaluation for Information Retrieval Models over I...Towards Privacy-Preserving Evaluation for Information Retrieval Models over I...
Towards Privacy-Preserving Evaluation for Information Retrieval Models over I...
 
From measurement model to structural model
From  measurement model to structural modelFrom  measurement model to structural model
From measurement model to structural model
 
Carma internet research module n-bias
Carma internet research module   n-biasCarma internet research module   n-bias
Carma internet research module n-bias
 
Mb0050
Mb0050Mb0050
Mb0050
 
Malhotra02.....
Malhotra02.....Malhotra02.....
Malhotra02.....
 
Types of survey questions research
Types of survey questions researchTypes of survey questions research
Types of survey questions research
 
Assessment task 1analyse databsbdat501stu
Assessment task 1analyse databsbdat501stuAssessment task 1analyse databsbdat501stu
Assessment task 1analyse databsbdat501stu
 
Issue-based metrics
Issue-based metricsIssue-based metrics
Issue-based metrics
 
Instrument development process
Instrument development processInstrument development process
Instrument development process
 
Site2011 tomidaokibayashitamura
Site2011 tomidaokibayashitamuraSite2011 tomidaokibayashitamura
Site2011 tomidaokibayashitamura
 
Malhotra06
Malhotra06Malhotra06
Malhotra06
 
State of the art on the cognitive walkthrough method by MAHATODY, SAGAR and ...
State of the  art on the cognitive walkthrough method by MAHATODY, SAGAR and ...State of the  art on the cognitive walkthrough method by MAHATODY, SAGAR and ...
State of the art on the cognitive walkthrough method by MAHATODY, SAGAR and ...
 

Destacado

Estrategias de aprendizaje
Estrategias de aprendizajeEstrategias de aprendizaje
Estrategias de aprendizajeHessen
 
Improving your writing online
Improving your writing onlineImproving your writing online
Improving your writing onlineDaniel Craig
 
KOTESOL 2007 Presentation
KOTESOL 2007 PresentationKOTESOL 2007 Presentation
KOTESOL 2007 PresentationDaniel Craig
 
Twitter In Medical Education
Twitter In Medical EducationTwitter In Medical Education
Twitter In Medical EducationJulie Hewett
 
Twitter for academic writing
Twitter for academic writingTwitter for academic writing
Twitter for academic writingDaniel Craig
 

Destacado (7)

CALL Connections
CALL ConnectionsCALL Connections
CALL Connections
 
Estrategias de aprendizaje
Estrategias de aprendizajeEstrategias de aprendizaje
Estrategias de aprendizaje
 
Improving your writing online
Improving your writing onlineImproving your writing online
Improving your writing online
 
KOTESOL 2007 Presentation
KOTESOL 2007 PresentationKOTESOL 2007 Presentation
KOTESOL 2007 Presentation
 
Twitter In Medical Education
Twitter In Medical EducationTwitter In Medical Education
Twitter In Medical Education
 
Clase1
Clase1Clase1
Clase1
 
Twitter for academic writing
Twitter for academic writingTwitter for academic writing
Twitter for academic writing
 

Similar a 2009 KAMALL - Relationship between anxiety and speaking performance in online and face-to-face interviews

Download the presentation
Download the presentationDownload the presentation
Download the presentationbutest
 
Executive communicationsurvey (2)
Executive communicationsurvey (2)Executive communicationsurvey (2)
Executive communicationsurvey (2)972vickie
 
Lecture Defense June 2011
Lecture Defense June 2011Lecture Defense June 2011
Lecture Defense June 2011Louis Ventura
 
Matching Attentional Draw with Utility in Interruption
Matching Attentional Draw with Utility in InterruptionMatching Attentional Draw with Utility in Interruption
Matching Attentional Draw with Utility in Interruptionjengluck
 
Measuring the impact of instant high quality feedback.
Measuring the impact of instant high quality feedback.Measuring the impact of instant high quality feedback.
Measuring the impact of instant high quality feedback.Stephen Nutbrown
 
Running Head REPLY TO OPINION 5.1 FOR KIMBRILEE SCHMITZ 1REPLY.docx
Running Head REPLY TO OPINION 5.1 FOR KIMBRILEE SCHMITZ 1REPLY.docxRunning Head REPLY TO OPINION 5.1 FOR KIMBRILEE SCHMITZ 1REPLY.docx
Running Head REPLY TO OPINION 5.1 FOR KIMBRILEE SCHMITZ 1REPLY.docxtoltonkendal
 
Technology-based assessments-special educationNew technologies r.docx
Technology-based assessments-special educationNew technologies r.docxTechnology-based assessments-special educationNew technologies r.docx
Technology-based assessments-special educationNew technologies r.docxssuserf9c51d
 
Employment Interview In Greece
Employment Interview In GreeceEmployment Interview In Greece
Employment Interview In GreeceIoannis Nikolaou
 
Effects Based Planning And Assessment
Effects Based Planning And AssessmentEffects Based Planning And Assessment
Effects Based Planning And Assessmentahmad bassiouny
 
Detecting incorrectly implemented experiments
Detecting incorrectly implemented experimentsDetecting incorrectly implemented experiments
Detecting incorrectly implemented experimentsOptimizely
 
Using PowerPoint as a game design tool in science education.
Using PowerPoint as a game design tool in science education. Using PowerPoint as a game design tool in science education.
Using PowerPoint as a game design tool in science education. sikojp
 
CHI'07: Biases in Human Estimation of Interruptibility
CHI'07: Biases in Human Estimation of InterruptibilityCHI'07: Biases in Human Estimation of Interruptibility
CHI'07: Biases in Human Estimation of Interruptibilitycpt.positive
 
Fairness in Search & RecSys 네이버 검색 콜로키움 김진영
Fairness in Search & RecSys 네이버 검색 콜로키움 김진영Fairness in Search & RecSys 네이버 검색 콜로키움 김진영
Fairness in Search & RecSys 네이버 검색 콜로키움 김진영Jin Young Kim
 

Similar a 2009 KAMALL - Relationship between anxiety and speaking performance in online and face-to-face interviews (20)

Download the presentation
Download the presentationDownload the presentation
Download the presentation
 
Role of voice in the marketplace
Role of voice in the marketplaceRole of voice in the marketplace
Role of voice in the marketplace
 
Executive communicationsurvey (2)
Executive communicationsurvey (2)Executive communicationsurvey (2)
Executive communicationsurvey (2)
 
Lecture Defense June 2011
Lecture Defense June 2011Lecture Defense June 2011
Lecture Defense June 2011
 
Matching Attentional Draw with Utility in Interruption
Matching Attentional Draw with Utility in InterruptionMatching Attentional Draw with Utility in Interruption
Matching Attentional Draw with Utility in Interruption
 
Measuring the impact of instant high quality feedback.
Measuring the impact of instant high quality feedback.Measuring the impact of instant high quality feedback.
Measuring the impact of instant high quality feedback.
 
Running Head REPLY TO OPINION 5.1 FOR KIMBRILEE SCHMITZ 1REPLY.docx
Running Head REPLY TO OPINION 5.1 FOR KIMBRILEE SCHMITZ 1REPLY.docxRunning Head REPLY TO OPINION 5.1 FOR KIMBRILEE SCHMITZ 1REPLY.docx
Running Head REPLY TO OPINION 5.1 FOR KIMBRILEE SCHMITZ 1REPLY.docx
 
Technology-based assessments-special educationNew technologies r.docx
Technology-based assessments-special educationNew technologies r.docxTechnology-based assessments-special educationNew technologies r.docx
Technology-based assessments-special educationNew technologies r.docx
 
Employment Interview In Greece
Employment Interview In GreeceEmployment Interview In Greece
Employment Interview In Greece
 
Effectiveness of admission procedures among master of ot programs
Effectiveness of admission procedures among master of ot programs Effectiveness of admission procedures among master of ot programs
Effectiveness of admission procedures among master of ot programs
 
Test for AI model
Test for AI modelTest for AI model
Test for AI model
 
Effects Based Planning And Assessment
Effects Based Planning And AssessmentEffects Based Planning And Assessment
Effects Based Planning And Assessment
 
Research methodology presentation
Research methodology presentationResearch methodology presentation
Research methodology presentation
 
Detecting incorrectly implemented experiments
Detecting incorrectly implemented experimentsDetecting incorrectly implemented experiments
Detecting incorrectly implemented experiments
 
Brown Myford NCME presentation
Brown Myford NCME presentationBrown Myford NCME presentation
Brown Myford NCME presentation
 
Using PowerPoint as a game design tool in science education.
Using PowerPoint as a game design tool in science education. Using PowerPoint as a game design tool in science education.
Using PowerPoint as a game design tool in science education.
 
Capstone presentation
Capstone presentation Capstone presentation
Capstone presentation
 
CHI'07: Biases in Human Estimation of Interruptibility
CHI'07: Biases in Human Estimation of InterruptibilityCHI'07: Biases in Human Estimation of Interruptibility
CHI'07: Biases in Human Estimation of Interruptibility
 
Fairness in Search & RecSys 네이버 검색 콜로키움 김진영
Fairness in Search & RecSys 네이버 검색 콜로키움 김진영Fairness in Search & RecSys 네이버 검색 콜로키움 김진영
Fairness in Search & RecSys 네이버 검색 콜로키움 김진영
 
My experiment
My experimentMy experiment
My experiment
 

2009 KAMALL - Relationship between anxiety and speaking performance in online and face-to-face interviews

  • 1. The Relationship between Anxiety and Speaking Performance in Online and Face-to-face Interviews Jungtae Kim (Pai Chai University) jungtaekim@ pcu .ac.kr Daniel Craig (Sangmyung University) [email_address]
  • 2.
  • 3.
  • 4.
  • 5.
  • 6.
  • 7.
  • 8.
  • 9.
  • 10.
  • 11.
  • 12.
  • 13.

Notas del editor

  1. Affective Filter Hypothesis Krashen posits, as part of his Monitor Theory, that the affective filter acts against the acquisition of language by blocking the deep processing of input. Though much of the Monitor Theory has been thoroughly criticized (Gregg, 1984), the concept of an affective filter in learning has received little. The metaphor of a filter is quite apt. This theorized construct does not stop input from getting through, but instead regulates how much or the quality of the input going through to the language acquisition device (LAD) (Laine, 1988). Therefore, it behooves language educators to help learners open up this filter as much as possible for optimal input processing. While this filter has other aspects, the primary constituent is anxiety. Trait Anxiety Trait anxiety is as, “stable differences in the tendency to respond with state anxiety in the anticipation of threatening situations” (Koballa & Glynn, 2007). As the name indicates, it is much more of a personality trait than a reaction to immediate stimulus. Much of the work on anxiety’s role in language learning and performance has focused on trait anxieties such as test anxiety*. State Anxiety State anxiety, on the other hand, is just that, a reaction to a context (Spielberger, 1983). State anxiety changes depending on the situation and variables present. Foreign Language Classroom Anxiety Scale (FLCAS)(Horwitz, 2001). Specific anxieties negatively affect performance on: vocabulary recall (MacIntyre & Gardner, 1989), final grades (Aida, 1994; Saito & Samimy, 1996; Kim, 1998 [Korean context]; Coulombe, 2000), student and teacher perceptions of performance (Trylong, 1987; MacIntyre, Noels, & Clement, 1997), recall of text (Oh, 1990 [Korean context]), and listening (Kim, 2000 [Korean context]). As noted in the previous list, a number of these studies were carried out with Korean learners of a foreign language. This is of special concern given that this current study was conducted in Korea. Korean learners have been found to have higher foreign language anxiety as measured with the FLCAS (Truitt, 1995) FLCAS was administered as the measure of foreign language anxiety in this study and evaluated for influence in test performance. Specific Test Anxiety Neither measures of test anxiety or foreign language anxiety address anxiety at the time of each test. Both instruments refer to general feelings and beliefs, which would be the same regardless of the mode utilized. A brief survey was developed and administered which measured perceived anxiety before, during, and after interviews. Could also talk about distance education theories on distance and the effect it has on interaction. From this point of view, video would reduce
  2. 1. Participants Forty (32f/8m) Korean college students participated in the study. Korean was their first language for all but one native speaker of Chinese. 24 freshmen; 10 sophomores; 3 juniors; and 3 seniors. Age 19-38, mean=21.85 Majors: 35 English related majors, 3 tourism, 1 music, and 1 childhood ed. TOEIC scores all of which were less than 700. Two interviewers participated in the study. The interviewers both had MA degrees in the field of TESOL and each had been teaching English for over ten years. They were well trained in interviewing test takers in oral tests.   2. Procedure and Materials 1) Test Development Two forms of oral interview: f2f & online videoconferenced.   2) Test Administration and Anxiety Survey Two interviewers were trained before the test administration for one hour. In the training session, they became familiar with the test, rating benchmarks, and the test takers’ characteristics. They were given the information on the test forms, topics, and procedures, test takers’ ages, genders, grades, English language proficiency, and majors. The participants were randomly divided into two groups. Each group participated in a face-to-face oral interview and an online videconferenced oral interview a month apart. Two native speakers of English interviewed them for about five to ten minutes and rated their performance. The face-to-face interview was video-taped and the online videoconference was recorded by means of Adobe Connect virtual classroom software. The one-to-one online interview was simultaneously carried out between the interviewer and the participants via webcams and microphones. After each interview, all the participants were asked to fill out two anxiety surveys. One survey was about test anxiety and the other foreign language learning anxiety (Revised from Maeng, 2007). Additionally, a series of questions were included to assess state anxiety before, during, and after the interview. The rating scale was from 1 the lowest to 6 the highest. For questions 1 and 2, scale 1 was the most comfortable while scale 6 the most nervous. For questions 3, 4, 5, and 6, the anxiety levels were opposite: scale 1 the most nervous, scale 6 the most comfortable.   State Anxiety Survey questions were; 1. How nervous did you feel before the test began? 2. How nervous did you feel after the test was completed? 3. How comfortable did the interviewer make you? 4. How comfortable was the testing environment? 5. How comfortable are you with this kind of speaking test? 6. How comfortable are you with the interviewer’s pronunciation?   3) Rating Rating was done after the interview was finished. Two raters analytically graded each speech sample and the average score between them was taken as a holistic score for each participant. The scoring constructs were fluency, functional competence, accuracy, coherence, and interactiveness. The rating scale was from 2 the lowest to 6 the highest.   4) Data Collection and Analysis Procedure All the data were collected, including test scores for both interview forms and the results of the participants’ anxiety surveys. The test and survey results were analyzed using SPSS 15.0, a statistical analysis tool, to produce descriptive statistics and mean differences of their performances between the test modes and anxiety levels between the modes. Additionally, the relationship between the anxiety level differences and their performances according to the different test forms was analyzed.
  3. Test forms were equivalent with Cronbach’s α=.83 overall, .73 for the face-to-face form, and .77 for the online form. Means and Standard Deviation for the 3 forms were 3.23(.62), 3.26(.70), and 3.20(.66) respectively. The correlation coefficient between face-to-face and online interview was .66 ( p =.000 < .01). Additionally, there was a high reliability between interviewers overall (α=.84), while the correlation between the two interviewers was .69 ( p =.000 < .01). There was high reliability between raters (α=.83) and the correlation coefficient between rater 1 and rater 2 was .68 ( p =.000 < .01).
  4. There was no significant difference in participants’ performance between the modes (face-to-face & online). A Paired Sample t-test revealed no significant relationship between performance and mode ( t (39)=.64 ( p =.53 > .05).
  5. Low Levels of Anxiety for both Modes Survey results indicated little anxiety both pre-interview and post-interview (table 2) test conditions were rated as generally comfortable (table 2 and 3). Test Factors mean scores for anxiety before and after the tests were higher for face-to-face interviews than online interviews (questions 1 and 2 in tables 2). Only for question 1, there was significant mean difference between the modes ( t (39) = 2.48, p =.02 < .05).   Test Conditions participants expressed that they were more comfortable for face-to-face interviews than online interviews (questions 3, 4, 5, and 6 in table 3). Only for question 3, there was significant mean difference between the modes ( t (39) = 2.66, p =.01 < .05).
  6. Test Modes Correlate Significant (p=.000) moderate, positive correlation (.539) between scores on face-to-face and online interviews. Additionally, there were significant relationships between some, though not all, of the anxiety measures and interview performance. Anxiety Survey after F2F Interviews   Significant (p=.014) low, negative correlation (-.384) between the measure of pre-test anxiety and face-to-face interview performance, as well as a significant (p=.000) high, negative correlation (-.603) between the measure of pre-test anxiety and online interview performance. The relationship between post-test anxiety and both face-to-face and online interview performance was significant (p=.017, p=.044), with a low, negative correlation (-.377, -.320).   Anxiety Survey after Online Interviews Significant (p=.040) low, negative correlation (-.327) between participants’ post-test anxiety and their performance in the online interviews.
  7. Discussion: Mode & Anxiety Pre-test anxiety higher on face-to-face interview than online interview. No significant difference between post-test anxiety and mode nor a These results suggest that anticipation of online interactions could be less anxiety provoking, but also that it somewhat equalizes through the interview process.   One reason for this equalization could be because interviewers made participants significantly more comfortable in face-to-face interviews than in online interviews. Therefore, while the online mode is initially less anxiety provoking, it seems that face-to-face interviewers may mitigate this difference by making participants more comfortable.
  8. Discussion: Mode, Anxiety, & Performance Negative relationship between anxiety and performance. Online interview survey group showed no significant correlation between pre-test anxiety and performance in either mode, nor was there a significant correlation between post-test anxiety and performance on the face-to-face interview. Only between post-test anxiety and online interview performance was there a significant, though low, negative correlation.   Anxiety seems to be a good indicator of performance across modes when measured after a face-to-face interview, but a poor overall indicator when measured after an online interview. This discrepancy could suggest that performance in online interviews is less influenced by anxiety than other performance-related factors.