29 results for your search
Cultural And Linguistic Considerations When Developing, Adapting, And Validating Measures, Developing Methodologies for the Fair Testing of...
in Cultural And Linguistic Considerations When Developing, Adapting, And Validating Measures (Buros Center for Testing), 57 mins
This introductory-level presentation will discuss emerging methodologies that address the intersection of culture, language, and testing as critical to fairly assessing students classified as English learners (ELs). These new developments build on current knowledge from the fields of psychometrics, sociolinguistic...
Sample
in Cultural And Linguistic Considerations When Developing, Adapting, And Validating Measures (Buros Center for Testing), 57 mins
Description
This introductory-level presentation will discuss emerging methodologies that address the intersection of culture, language, and testing as critical to fairly assessing students classified as English learners (ELs). These new developments build on current knowledge from the fields of psychometrics, sociolinguistics, socio-cultural theory, and social semiotics. They include the notion of cultural validity as a form of validity that examines ways i...
This introductory-level presentation will discuss emerging methodologies that address the intersection of culture, language, and testing as critical to fairly assessing students classified as English learners (ELs). These new developments build on current knowledge from the fields of psychometrics, sociolinguistics, socio-cultural theory, and social semiotics. They include the notion of cultural validity as a form of validity that examines ways in which culture influences students interpretations of test items, and the use of generalizability theory (a psychometric theory of measurement error) to estimate the magnitude of measurement error that is due to language factors. These new developments also include the systematic use of a probabilistic reasoning about language and linguistic groups as critical to addressing the heterogeneity of EL populations and the use of social semiotics as key to examining ways of representing information in tests using multiple modalities through different forms of accommodations and accessibility resources.
Show more
Show less
Field of Study
Counseling & Therapy, Health Sciences
Publisher
Buros Center for Testing
Series
Cultural And Linguistic Considerations When Developing, Adapting, And Validating Measures
Copyright Message
Copyright © 2019. Used by permission of Buros Center for Testing.
×
Cultural And Linguistic Considerations When Developing, Adapting, And Validating Measures, The Culture-Language Interpretive Matrix and Engl...
in Cultural And Linguistic Considerations When Developing, Adapting, And Validating Measures (Buros Center for Testing), 1 hour 12 mins
The use of standardized tests of cognitive ability with English learners has long been recognized as a problem. Yet, the various solutions proposed over the past century to manage fairness (e.g., modifications/alterations to standard protocol, nonverbal assessment, testing in the dominant language) have all proven...
Sample
in Cultural And Linguistic Considerations When Developing, Adapting, And Validating Measures (Buros Center for Testing), 1 hour 12 mins
Description
The use of standardized tests of cognitive ability with English learners has long been recognized as a problem. Yet, the various solutions proposed over the past century to manage fairness (e.g., modifications/alterations to standard protocol, nonverbal assessment, testing in the dominant language) have all proven less than satisfactory in addressing the underlying issue: validity. Coupled with misplaced attention to causal factors related to eth...
The use of standardized tests of cognitive ability with English learners has long been recognized as a problem. Yet, the various solutions proposed over the past century to manage fairness (e.g., modifications/alterations to standard protocol, nonverbal assessment, testing in the dominant language) have all proven less than satisfactory in addressing the underlying issue: validity. Coupled with misplaced attention to causal factors related to ethnicity and race rather than language and acculturative knowledge development, there has been very little advancement in the use of research to guide practice with English learners. This may be due to the fact that the empirical literature on the cognitive performance of English learners has been conducted in English, not the native language. However, this knowledge base can be integrated into practice when it is understood and recognized that the measured performance of English learners without disabilities on tests given to them in English essentially represents the expected average range and provides a relative to the true peer comparison group. It is on this basis that the Culture-Language Interpretive Matrix (C-LIM) is predicated, and as such, it provides a method by which the validity of obtained test scores on English learners can be discerned directly and systematically. By arranging research on English learners performance on cognitive ability, language, and neuropsychological tests, in a manner that represents what is average,regardless of the values, practitioners can evaluate the extent to which cultural/linguistic factors affected performance and affected the validity of the intended constructs from the tests they typically administer and when administered in English. The purpose of this webinar is to explain and outline the empirical foundations of the C-LIM and describe its application to evaluation of English learners as one example of how research may be used to better and more fairly inform practice.
Show more
Show less
Field of Study
Counseling & Therapy, Health Sciences
Publisher
Buros Center for Testing
Series
Cultural And Linguistic Considerations When Developing, Adapting, And Validating Measures
Copyright Message
Copyright © 2019. Used by permission of Buros Center for Testing.
×
Evaluating Test Quality: Advice From Mental Measurements Yearbook Reviewers, Screening and Progress Monitoring Tools: Issues and Implication...
in Evaluating Test Quality: Advice From Mental Measurements Yearbook Reviewers (Buros Center for Testing), 54 mins
Settings in which screening and progress measures are used vary as does the purpose of the assessment. School psychologists may use measures to determine the need for additional assessment, or in the case of an omnibus instrument, as an evaluation of social-emotional functioning that is required as part of eligibi...
Sample
in Evaluating Test Quality: Advice From Mental Measurements Yearbook Reviewers (Buros Center for Testing), 54 mins
Description
Settings in which screening and progress measures are used vary as does the purpose of the assessment. School psychologists may use measures to determine the need for additional assessment, or in the case of an omnibus instrument, as an evaluation of social-emotional functioning that is required as part of eligibility evaluations. They also monitor the progress of interventions. Clinical psychologists use these same tools, although the emphasis i...
Settings in which screening and progress measures are used vary as does the purpose of the assessment. School psychologists may use measures to determine the need for additional assessment, or in the case of an omnibus instrument, as an evaluation of social-emotional functioning that is required as part of eligibility evaluations. They also monitor the progress of interventions. Clinical psychologists use these same tools, although the emphasis is typically on diagnosis and intervention planning/evaluation. In this intermediate-level presentation, issues to consider when selecting a test such as sensitivity, reliability and validity will be examined across the different types of measures and settings/purposes. Measures such as the BASC-3 and the BASC-PM can be used for these varied purposes and will be used as cases in point. The examination of data and its interpretation for purposes such as special education eligibility, diagnosis, selection and planning treatment, and monitoring the progress of interventions will be addressed.
Show more
Show less
Field of Study
Counseling & Therapy, Health Sciences
Publisher
Buros Center for Testing
Series
Evaluating Test Quality: Advice From Mental Measurements Yearbook Reviewers
Copyright Message
Copyright © 2017. Used by permission of Buros Center for Testing.
×
Evaluating Test Quality: Advice From Mental Measurements Yearbook Reviewers, The Argument-based Approach to Validation
in Evaluating Test Quality: Advice From Mental Measurements Yearbook Reviewers (Buros Center for Testing), 1 hour 2 mins
In his intermediate-level lecture, Dr. Michael Kane will discuss how explicit recognition of the inferences and assumptions underlying the interpretation and use of test scores can guide the process of validation by identifying which kinds of evidence are needed to evaluate the claims being made.
Sample
in Evaluating Test Quality: Advice From Mental Measurements Yearbook Reviewers (Buros Center for Testing), 1 hour 2 mins
Description
In his intermediate-level lecture, Dr. Michael Kane will discuss how explicit recognition of the inferences and assumptions underlying the interpretation and use of test scores can guide the process of validation by identifying which kinds of evidence are needed to evaluate the claims being made.
Field of Study
Counseling & Therapy, Health Sciences
Publisher
Buros Center for Testing
Series
Evaluating Test Quality: Advice From Mental Measurements Yearbook Reviewers
Copyright Message
Copyright © 2012. Used by permission of Buros Center for Testing.
×
Fairness Issues In Testing: Application And Practice Informed By Theory And Research, Fairness Evidence Expectations for Educational Tests
in Fairness Issues In Testing: Application And Practice Informed By Theory And Research (Buros Center for Testing), 1 hour 19 mins
This is an intermediate-level presentation on fairness. The assessment of student achievement continues to be a fundamental and significant source of information in our society. While recognizing that achievement data are powerful, we must always guide towards appropriate use and interpretation. Test designers, de...
Sample
in Fairness Issues In Testing: Application And Practice Informed By Theory And Research (Buros Center for Testing), 1 hour 19 mins
Description
This is an intermediate-level presentation on fairness. The assessment of student achievement continues to be a fundamental and significant source of information in our society. While recognizing that achievement data are powerful, we must always guide towards appropriate use and interpretation. Test designers, developers and researchers must balance the complexity of validating assessments while also recognizing that it is the information from a...
This is an intermediate-level presentation on fairness. The assessment of student achievement continues to be a fundamental and significant source of information in our society. While recognizing that achievement data are powerful, we must always guide towards appropriate use and interpretation. Test designers, developers and researchers must balance the complexity of validating assessments while also recognizing that it is the information from assessments that determines the contribution and value to our students, educators and policymakers. The role of measurement is to provide information that will permit decisions to be as informed and fair as possible. Every aspect of design and development contributes to fairness. From decisions made early in the design process with respect to purposes to be served by an assessment, fairness is a concern. Every decision made concerning the test specifications (for example, balance of content, item types, length of time, alignment, delivery mode, the number of forms, depth and breadth of item pools) also raises issues about fairness. In addition, the design of the research that addresses comparability, reported scores and interpretability directly affects fairness. This session will share considerations and strategies for addressing fairness in an ongoing, iterative process that should be addressed at all stages of development and evaluated in a systematic way.
Show more
Show less
Field of Study
Counseling & Therapy, Health Sciences
Publisher
Buros Center for Testing
Series
Fairness Issues In Testing: Application And Practice Informed By Theory And Research
Copyright Message
Copyright © 2018. Used by permission of Buros Center for Testing.
×
Improving Admissions And Learning In Higher Education, Assessment System Design for Improvement
in Improving Admissions And Learning In Higher Education (Buros Center for Testing), 44 mins
This is an introductory-level presentation. Assessment in K-12 education has been a dominant force for accountability, school improvement, and instructional change for over three decades. During this time, assessment purposes and methods have changed, and the impacts of such assessments on instruction and student...
Sample
in Improving Admissions And Learning In Higher Education (Buros Center for Testing), 44 mins
Description
This is an introductory-level presentation. Assessment in K-12 education has been a dominant force for accountability, school improvement, and instructional change for over three decades. During this time, assessment purposes and methods have changed, and the impacts of such assessments on instruction and student learning have changed as well. What lessons can be learned from these assessment designs, especially those that seek to promote a more...
This is an introductory-level presentation. Assessment in K-12 education has been a dominant force for accountability, school improvement, and instructional change for over three decades. During this time, assessment purposes and methods have changed, and the impacts of such assessments on instruction and student learning have changed as well. What lessons can be learned from these assessment designs, especially those that seek to promote a more balanced approach to assessment (balancing summative with formative measures)? How might these impact higher education?
Show more
Show less
Field of Study
Counseling & Therapy, Health Sciences
Publisher
Buros Center for Testing
Series
Improving Admissions And Learning In Higher Education
Copyright Message
Copyright © 2013. Used by permission of Buros Center for Testing.
×
Improving Admissions And Learning In Higher Education, Measurement Validity and Accountability in Higher Education
in Improving Admissions And Learning In Higher Education (Buros Center for Testing), 41 mins
There has been notable disparagement regarding the availability of valid information to inform comparisons among higher education institutions for consumers, policymakers, and other stakeholders. This intermediate-level session examines several well-meant but counter-productive attempts to develop measures of high...
Sample
in Improving Admissions And Learning In Higher Education (Buros Center for Testing), 41 mins
Description
There has been notable disparagement regarding the availability of valid information to inform comparisons among higher education institutions for consumers, policymakers, and other stakeholders. This intermediate-level session examines several well-meant but counter-productive attempts to develop measures of higher education institutional effectiveness and suggests a set of principles for producing better ones.
Field of Study
Counseling & Therapy, Health Sciences
Publisher
Buros Center for Testing
Series
Improving Admissions And Learning In Higher Education
Copyright Message
Copyright © 2013. Used by permission of Buros Center for Testing.
×
Monitoring Assessment Quality In The Age Of Accountability, Future Trends in Testing
in Monitoring Assessment Quality In The Age Of Accountability (Buros Center for Testing), 1 hour 3 mins
In this introductory-level presentation, Dr. Thorndike provides his perspective on a variety of issues in psychological assessment by reflecting on the past and present, critiquing specific practices and theories, describing relevant anecdotes, and speculating about future directions.
Sample
in Monitoring Assessment Quality In The Age Of Accountability (Buros Center for Testing), 1 hour 3 mins
Description
In this introductory-level presentation, Dr. Thorndike provides his perspective on a variety of issues in psychological assessment by reflecting on the past and present, critiquing specific practices and theories, describing relevant anecdotes, and speculating about future directions.
Field of Study
Counseling & Therapy, Health Sciences
Publisher
Buros Center for Testing
Series
Monitoring Assessment Quality In The Age Of Accountability
Copyright Message
Copyright © 2010. Used by permission of Buros Center for Testing.
×
Buros/ETS Lecture, Ensuring Valid and Fair Content Assessments for Language Minority Students
in Buros/ETS Lecture (Buros Center for Testing), 1 hour 26 mins
In this intermediate-level webinar, Dr. Young discusses and describes the testing needs of English Language Learners (ELL) and some accommodations offered to ELLs in different states in the U.S. His discussion includes an explanation of validation methods particularly in the context of testing ELL students and ide...
Sample
in Buros/ETS Lecture (Buros Center for Testing), 1 hour 26 mins
Description
In this intermediate-level webinar, Dr. Young discusses and describes the testing needs of English Language Learners (ELL) and some accommodations offered to ELLs in different states in the U.S. His discussion includes an explanation of validation methods particularly in the context of testing ELL students and identifies some potential problems that can occur. He concludes by presenting two ELL-relevant studies conducted by the College Board.
Field of Study
Counseling & Therapy, Health Sciences
Publisher
Buros Center for Testing
Series
Buros/ETS Lecture
Copyright Message
Copyright © 2009. Used by permission of Buros Center for Testing.
×
Cultural And Linguistic Considerations When Developing, Adapting, And Validating Measures, Using Interpreters in Psychological Assessment
in Cultural And Linguistic Considerations When Developing, Adapting, And Validating Measures (Buros Center for Testing), 1 hour 21 mins
This is an intermediate-level presentation. Given the linguistic diversity in the United States and the frequency of cultural discrepancies between mental health practitioners and their clients, evaluators are increasingly likely to consider conducting evaluations using language interpreters. Although best practic...
Sample
in Cultural And Linguistic Considerations When Developing, Adapting, And Validating Measures (Buros Center for Testing), 1 hour 21 mins
Description
This is an intermediate-level presentation. Given the linguistic diversity in the United States and the frequency of cultural discrepancies between mental health practitioners and their clients, evaluators are increasingly likely to consider conducting evaluations using language interpreters. Although best practice would suggest the use of bilingual psychologists and validated translated measures, these options are not always available, particula...
This is an intermediate-level presentation. Given the linguistic diversity in the United States and the frequency of cultural discrepancies between mental health practitioners and their clients, evaluators are increasingly likely to consider conducting evaluations using language interpreters. Although best practice would suggest the use of bilingual psychologists and validated translated measures, these options are not always available, particularly for languages that are less globally prevalent. The choice to use an interpreter is particularly complex when using standardized psychological measures. Few empirical studies have addressed the impact of interpreters on psychological measures, and test manuals rarely provide advice about the appropriateness or impact of interpreters. Using guidance from both psychology and language studies, this presentation will review important considerations and recommendations when using interpreters in psychological evaluations. Ethical responsibilities, legal requirements, logistical realities and best practices will be reviewed
Show more
Show less
Field of Study
Counseling & Therapy, Health Sciences
Publisher
Buros Center for Testing
Series
Cultural And Linguistic Considerations When Developing, Adapting, And Validating Measures
Copyright Message
Copyright © 2019. Used by permission of Buros Center for Testing.
×