|
|
 |
|
|
 |
Professor Raymond Adams |
|
| Professorial Fellow |
|
|
|
Assessment Research Centre (ARC)
Phone: +61 3 8344 2898
Fax: +61 3 9348 2753
Email: r.adams@unimelb.edu.au
|
|
|
Membership
Role
Professor Adams is a Professorial Fellow of the University of Melbourne and an independent consultant who specialises in psychometrics, educational statistics, large-scale testing and international comparative studies.
He has been the International Project Director for the OECD Programme for International Student Achievement (PISA) since its inception. PISA is perhaps the world's largest and most significant educational research project.
He has a PhD in educational measurement and educational statistics from the University of Chicago and has published widely on the technical aspects of educational measurement. His item response modelling software packages (Quest and ACER ConQuest) are amongst the most widely used in educational and psychological measurement.
In addition to his directorship of PISA he has acted as a consultant to numerous large-scale assessment projects both in Australia and internationally. He has served as chair of the technical advisory committee for the International Association for the Evaluation of Educational Achievement (IEA) and as Head of Measurement at the Australian Council for Educational Research (ACER).
Ray is currently chair of the expert advisory group guiding the development of Australian National Literacy and Numeracy tests, and he is chair of the ACER Psychometrics Institute.
Associations
• American Educational Research Association
• Psychometric Society
Qualifications
B.Sc.(Hons.)The University of Melbourne, M.Ed.The University of Melbourne, Dip.Ed.The University o Melbourne Ph.D.The University of Chicago, FACE
Teaching Areas
Research
Currently, Professor Ray Adams is the International Project Director for the OECD Programme for International Student Achievement (PISA). PISA is perhaps the world’s largest and most significant educational research project. PISA started in 1998 with a first data collection in 2000, when over 170,000 students from 28 OECD Member countries and four other countries were assessed. Subsequent data collections have occurred in 2003 and 2006 and planning is underway for a 2009 collection. It is expected that the 2009 collection will include in excess of 70 countries and 300,000 students.
AREAS OF SUPERVISION1. Large-scale sample survey methodology
2. Large-scale student testing and assessment
3. International comparative assessments
4. Item response modelling
Publications
Articles in Refereed JournalsAdams, R.J. (1985) Sex and Background Factors: Affect on ASAT Scores. Australian Journal of Education. 29(3) 221-230.
Griffin, P.E., Adams, R.J., Martin, L., and Tomlinson, B. (1985)The use of latent trait methods to examine second language proficiency. New Horizons 26, 46-62.
Adams, R.J. (1986) Contributions to Sex Differences in ASAT Scores. Studies in Educational Evaluation. 12(3) 267-274.
Adams, R.J., Griffin, P.E., Martin, L. (1987) A Latent Trait Method for Measuring a dimension of second language proficiency. Language Testing 4(1) 9-27.
Tomlinson, B., Griffin, P.E., Martin, L., and Adams, R.J. (1988) Developing an instrument to assess structural proficiency in English as a Second Language. Prospect 3(2), 157-174.
Griffin, P.E., Adams, R.J., Martin, L., and Tomlinson, B. (1988) An algorithmic approach to prescriptive assessment in English as a Second Language. Language Testing, 5(1), 1-18.
Adams, R.J. (1988) Applying the Partial Credit Model to Educational Diagnosis. Applied Measurement in Education 1(4), 347-361.
Doig, B.A. and Adams, R.J. (1991). The Victorian science achievement study: Implications for practice. Australian Science Teachers Journal. 37, 25-31.
Wilson, M.R., and Adams, R.J. (1993). Marginal maximum likelihood estimation for the ordered partition model. Journal of Educational Statistics. 18, 69-90.
Masters, G.N., Adams, R.J. & Lokan ,J. (1994). Mapping student achievement. International Journal of Educational Research. 21, 595-609.
Wilson, M.R., and Adams, R.J. (1995). Rasch models for item bundles Psychometrika, 60, 181-198.
Adams, R.J., Wilson, M.R. and Wu, M.L. (1997) Multilevel item response modelling: An approach to errors in variables regression. Journal of Educational and Behavioral Statistics, 22, 47-76.
Adams, R. J., & Wilson, M. R., & Wang, W. (1997). The multidimensional random coefficients multinomial logit model. Applied Psychological Measurement, 21, 1-24
Lokan, J., Adams, R.J., & Doig, B.D. (1999). Broadening Assessment, Improving Fairness? Some examples from school science. Assessment in Education, 6(1), 83-99.
Adams, R.J. (2003) Response to ‘Cautions on OECD’s Recent Educational Survey (PISA)’, Oxford Review of Education, 29, 377-389.
Adams, R.J. (2005) Reliability as a Measurement Design Effect. Studies in Educational Evaluation, 31, 162-172
Wu, M. L., & Adams, R., J. (2006). Modelling Mathematics Problem Solving Item Responses Using a Multidimensional IRT Model. Mathematics Education Research Journal, 18(2), 93-113.
Turner, R. & Adams, R. J., (2007). The programme for international student assessment: An overview. Journal of Applied Measurement, 8(3), 237-248.
Gebhardt. E, & Adams, R., J. (2007). The influence of equating methodology on reporting trends. Journal of Applied Measurement, 8(3), 305-322.
Butler, J, & Adams, R., J. (2007). The impact of differential investment of student effort on the outcomes of international studies. Journal of Applied Measurement, 8(3), 279-304.
Monseur, C., & Adams, R.J. (2009) Plausible Values: How to Deal with Their Limitations. Journal of Applied Measurement, 10(3), 320-334.
Books, Research Monographs, Computer Programs and TestsAdams, R.J. (1984) Sex Bias in ASAT? Australian Council for Educational Research, Monograph No. 24. ACER Hawthorn.
Griffin, P.E., Adams, R.J., Martin, L. and Tomlinson, B. (1986) Proficiency in English as a Second Language: The development of an interview test for adult migrants. Melbourne: Victorian Ministry of Education.
Griffin, P.E., Adams, R.J., Martin, L. and Tomlinson, B. (1986) Proficiency in English as a Second Language: The administration and generation of an interview test for adult migrants. Melbourne: Victorian Ministry of Education. (second edition 1991)
Griffin, P.E., Adams, R.J., Martin, L. and Tomlinson, B. 1986: Proficiency in English as a Second Language: An interview test for adult migrants. Melbourne: Victorian Ministry of Education. (second edition 1991)
Adams, R.J., Doig, B.A. and Rosier, M. (1991). Science Learning in Victorian Schools Research Monograph 41. Hawthorn: Australian Council for Educational Research.
Adams, R.J., and Khoo, S.T. (1993). Quest: The Interactive Test Analysis System. [computer program] Hawthorn: Australian Council for Educational Research.
Doig, B.A. and Adams, R.J. (1993). Tapping students’ science beliefs: A resource for teaching and learning. Hawthorn: Australian Council for Educational Research.
Wu, M.L., Adams, R.J., and Wilson, M.R. (1997). ConQuest: Multi-Aspect Test Software, [computer program] Camberwell: Australian Council for Educational Research.
Adams, R.J. & Wu, M.L. (editors) (2002) PISA 2000 Technical Report. OECD Publications. Paris.
Griffin , P., Tomlinson, B., Martin, L., Adams , R., & Storey, P. (2004). An interview test of English (ITEL-ed). Melbourne : Profile Press International.
Wu, M. L., Adams, R. J., Wilson, M. R., Haldane, S.A. (2007). ACER ConQuest Version 2: Generalised item response modelling software [computer program]. Camberwell: Australian Council for Educational Research.
Book ChaptersAdams, R.J., and Rowe K.J. (1988) Item Bias. In Keeves, J.P. (editor) Educational Research Methodology, Measurement and Evaluation: An International Handbook. (pp398-403) London.: Pergamon.
Adams, R.J., and Rowe K.J. (1990) Item Bias. In Walberg, H.J. and Haertel, G.D. (editor) The International Encyclopedia of Educational Evaluation. (pp133-139) London.: Pergamon.
Masters, G.N., Adams, R.J., and Wilson, M.R. (1990). Charting student progress. In T. Husen & T.N. Postlehwaite (editors) International Encyclopedia of Education: Research and Studies. Supplementary Volume 2. London: Pergamon Press.
Adams, R.J., and Wright, B.D. (1994) Misfit and the Rasch model: When does it make a difference? In, M. Wilson (Ed.), Objective measurement II: Theory into practice. Norwood, NJ: Ablex.
Adams, R.J., and Wilson, M.R. (1996) A random coefficients multinomial logit: A generalized approach to fitting Rasch models. In, G. Engelhard & M. Wilson (Eds.), pp 143-166. Objective measurement III: Theory into practice. Norwood,
NJ: Ablex.
Adams, R.J. & Gonzalez, E. (1996). Design of the TIMSS Achievement Instruments. In D.F. Robitaille and R.A. Garden (Eds.) The Third International Mathematics and Science Study. Research Monograph No 2. (pp 81-103). Vancouver.: Pacific Educational Press.
Adams, R.J., Wu, M.L., & Macaskill, G. (1997). Scaling methodology and procedures for the mathematics and science scales. In M.O. Martin & D. L. Kelly (Eds.), TIMSS technical report volume II: Implementation and analysis (pp. 111-145). Chestnut Hill, MA: Boston College.
Gonzalez, E., Adams, R.J., Wu, M., & Ludlow, L. (1997). Item response theory in the Third International Mathematics and Science Study. In M. Wilson, G. Engelhard & K. Draney (Eds.), Objective measurement IV Theory into practice. (pp 157-184 Norwood, NJ: Ablex.
Roberts, D., & Adams, R.J. (1997). Bias in weighted likelihood estimation when using the Rasch model. M. Wilson, G. Engelhard & K. Draney (Eds.), Objective measurement IV Theory into practice. Norwood, (pp 279-296) NJ: Ablex.
Wang, W.C., Wilson, M., & Adams, R.J. (1997). Rasch models for multidimensionality between items and within items. M. Wilson, G. Engelhard & K. Draney (Eds.), Objective measurement IV Theory into practice. (pp 139-156) Norwood, NJ: Ablex.
Wang, W.C., Wilson, M., & Adams, R.J. (2000). Interpretting the parameters of a Multidimensional Rasch Model. M. Wilson, & G. Engelhard (Eds.), Objective measurement V Theory into practice. Norwood, NJ: Ablex.
McNamara, T.F., & Adams, R.J. (2000). The implications of halo effects and item dependencis for objective measurement. M. Wilson, & G. Engelhard (Eds.), Objective measurement V Theory into practice. Norwood, NJ: Ablex.
Adams, R.J. (2002) The Programme for International Student Assessment: An Overview. In Adams, R.J. & Wu, M.L. (editors) PISA 2000 Technical Report. OECD Publications. Paris.
Adams, R.J. (2002) Scaling PISA Cognitive Data In Adams, R.J. & Wu, M.L. (editors) PISA 2000 Technical Report. OECD Publications. Paris.
Adams, R.J., & Carstenesen, C. (2002) Scaling Outcomes In Adams, R.J. & Wu, M.L. (editors) PISA 2000 Technical Report. OECD Publications. Paris.
Adams, R.J., Rust, K.& Monseur, C. (2002) Data Adjudication In Adams, R.J. & Wu, M.L. (editors) PISA 2000 Technical Report. OECD Publications. Paris.
Adams, R. J., & Wu, M. L. (2007). The mixed-coefficient multinomial logit model: A generalized form of the Rasch model. In M. v. Davier & C. H. Carstensen (Eds.), Multivariate and mixture distribution Rasch models: Extensions and applications (pp. 57 – 76): Springer Verlag.
Adams, R. J., Wu, M. L., & Carstensen, C. H. (2007). Application of multivariate Rasch models in international large scale educational assessment. In M. v. Davier. C. H. Carstensen (Ed.), Multivariate and mixture distribution Rasch models: Extensions and applications (pp. 271-280): Springer Verlag.
Adams, R. J., & Wu, M. L. (2008). The Construction and Implementation of User-Defined Fit Tests for Use with Marginal Maximum Likelihood Estimation and Generalised Item Response Models. In Duckor. B, & Brown, N. (Eds.), Advances in Rasch Measurement. Volume 2. In press.
Adams, R. (2009). PISA 2006: Frequently answered criticisms. In R. Bybee and B. McCrae (Eds.), PISA Science 2006: Implications for Science Teachers and Science Teaching. Arlington, VA (USA): National Science Teachers Association.
Tamassia, C.V., & Adams, R. J. (2009). International assessments and indicators: How will assessments and performance indicators improve educational policies and practices in a globalized society. In K.R. Ryan and J. B. Cousins (Eds.), The SAGE International Handbook of Educational Evaluation. (pp. 213-230): Sage.
Conference PapersAdams, R.J. (1983) Sex Differences in ASAT and Retentivity. Bound Conference papers. Annual Conference of the Australian Association for Research in Education. Canberra, November 1983.
Adams, R.J. (1984) Contributions to Sex Differences in ASAT Scores. Paper presented at the 10th Annual Conference of the International Association for Educational Assessment. Perth, June 1984.
Masters, G.N. and Adams, R.J. (1985). A Latent Trait Method for Computer-Administered Items with Feedback. Paper presented at the Annual Meeting of the American Educational Research Association. Chicago, March 1985.
Adams, R.J., Griffin, P.E., Tomlinson, B., and Martin, L. (1985) Measuring second language proficiency: Report on a research project in English as a Second Language. Paper presented at the Modern Language Teachers Association of Victoria, Annual Congress, Monash University, May 1985
Griffin, P.E.,
Adams, R.J., Martin, L. and Tomlinson, B. (1985) An alternative approach to identifying a dimension in second language proficiency. Paper presented at the fifth annual conference of the Applied Linguistics association of Australia, Brisbane, August, 1985
Adams, R.J. Griffin, P.E., Martin, L. (1985) A Latent Trait Approach to Measuring Second Language Proficiency. Paper presented at the Annual Conference of the Australian Association for Research in Education. Hobart, November 1985.
Adams, R.J. Griffin, P.E., Martin, L. (1986) A Latent Trait Method for Measuring a Dimension in Second Language Proficiency. Paper presented at the Annual Meeting of the American Educational Research Association. San Francisco, April 1986.
Adams, R.J. and Masters, G.N. (1986) Response spaces and competence mapping. Paper presented at the Annual Conference of the Australian Association for Research in Education. Melbourne, November 1986.
Adams, R.J. (1991) Misfit and the Rasch Model: When does it make a difference? Paper presented at the Sixth International Objective Measurement Workshop. Chicago, April 1991.
Wilson, M., & Adams, R.J. (1991). Describing Rasch models using a linear design matrix. Paper presented at the Sixth International Objective Measurement Workshop. Chicago, April 1991.
Adams, R.J. and Doig, B.A. (1991) Some aspects of students’ science beliefs. Paper presented at the Annual Conference of the American Educational Research Association. Chicago, April 1991.
McNamara, T.F. and Adams, R.J. (1991) Exploring rater behavior with Rasch techniques. Paper presented at the 13th Language Testing Research Colloquium, Educational Testing Service. Princeton, N.J.
Adams, R.J. and Doig, B.A. (1991, Nov). Measuring conceptual development in science. Paper presented at the Assessment in the Mathematical Sciences Conference. Geelong, Australia.
Doig, B.A. and Adams, R.J. (1991, Nov). Science learning in Victorian schools. Paper presented at the Annual Meeting of the Australian Association for Research in Education. Gold Coast, Queensland.
Adams, R.J., and Wilson, M.R. (1992, April) Assessing the fit of the random coefficients multinomial logit. Paper presented at the Annual Meeting of the American Educational Research Association. San Francisco, USA
Wilson, M.R. and Adams, R.J. (1992, April) Rasch models for item bundles. Paper presented at he Annual Meeting of the American Educational Research Association. San Francisco, USA.
Wilson, M.R. and Adams, R.J. (1992, June) Evaluating Progress with Alternative Assessments: A Model for Chapter 1. Invited address to the conference on Curriculum and Assessment Reform. Boulder, USA.
Wilson, M.R., and Adams, R.J. (1992, July). A multilevel perspective on the “two scientific disciplines of psychology”. Paper presented at the XXVth International Congress of Psychology, Brussels.
Adams, R.J. (1993, April) The test rotation design for the Third International Mathematics and Science Study: A proposal. Paper presented at the Annual Meeting of the American Educational Research Association. Atlanta, USA.
Adams, R.J., Wilson, M.R. and Wu, M.L. (1993, April) Multilevel item response modelling Paper presented at the Annual Meeting of the American Educational Research Association. Atlanta, USA.
Wu, M.L. and Adams, R.J. (1993, April) Simulating Parameter Recovery for the Random Coefficients Multinomial Logit. Paper presented at the Sixth International Objective Measurement Workshop. Atlanta, April 1993.
Adams, R.J. and Wilson, M.R. (1994, April) Multilevel item response modelling—Alternatives to Plausible Values Paper presented at the Annual Meeting of the American Educational Research Association. New Orleans, USA.
Wilson, M. R. and Adams, R.J.(1994, June) Beyond Plausibility. Paper presented at the Annual Meeting of the Psychometric Society. Urbana-Champaign, USA.
Roberts, D., & Adams, R.J. (1995, April). Bias in weighted likelihood estimation when using the Rasch model. Paper presented at the International Objective Measurement Workshop, University of California, Berkeley, CA.
Kaufman, P., Wilson, M., & Adams, R.J. (1995, April). Multilevel item response models of students “at risk”. Paper presented at the annual meeting of the American Educational Research Association, San Francisco, CA.
Wang, W., Wilson, M. R., & Adams, R.J. (1995, April). Item response modeling for multidimensional between-items and multidimensional within-items. Paper presented at the Annual Meeting of the American Educational Research Association, San Francisco, CA.
Wilson, M.R. and Adams, R.J. (1996). Issues in complex sampling involving latent variables. Paper presented at the Annual Meeting of the American Statistical Association. Orlando. FL.
Adams, R.J. & Wu, M.L. (1996, April). Fitting Latent Regression Models with Multilevel Item Response Models. Paper presented at the Annual Meeting of the American Educational Research Association, New York. NY.
Adams, R.J. & Wu, M.L. (1996, April). The Application of Multilevel Item Response Models in TIMSS. Paper presented at the Annual Meeting of the American Educational Research Association, New York. NY.
Adams, R.J., Wilson, M.R., Wu, M.L & Hoskens M. (1996, April) An Introduction to MATS. Workshop notes prepared for a mini-session at the Annual Meeting of the American Educational Research Association, New York. NY.
McNamara, T.F. and Adams, R.J. (1997). The implications of halo effects and item dependencies for objective measurement. Paper presented at the Annual Meeting of the American Educational Research Association, Chicago. IL.
Volodin, N. & Adams, R.J. (1997). The estimation of polytomous item response models with many dimensions. Paper presented at the Annual Meeting of the Psychomteric Society, Gatlinburg. TN.
Wu, M.L. & Adams, R.J. (1997) The Development and Application of a Fit Test for Use with Marginal Maximum Likelihood Estimation and Generalised Item Response Models. Paper presented at the Annual Meeting of the Psychomteric Society, Gatlinburg. TN.
Wu, M.L., and Adams, R.J., (2002). Plausible Values—why they are important. Paper presented at the International Objective Measurement Workshop New Orleans, Louisiana, April 6-7.
Monseur, C., and Adams, R.J., (2002). Plausible Values—how to deal with their limitations. Paper presented at the International Objective Measurement Workshop New Orleans, Louisiana, April 6-7.
Wu, M.L. & Adams, R.J., (2003, April). Modelling mathematics problem-solving item responses using a multidimensional IRT models. Paper presented at the American Educational Research Association Annual Conference, Chicago, IL, April 21-25.
Adams, R.J., (2003, July). Cohort Testing — Are you expecting too much. Paper presented at the Eighth National Roundtable on Assessment, Darwin, NT, July 14-16.
Adams, R.J. & Butler, J.C., (2004, November). Assessing assessment: the role of student effort in comparative studies Paper presented at the Ninth National Roundtable on Assessment, Sydney, NSW November 8-9.
Adams, R.J. (2006, April). Reliability and Item Response Modelling: Myths, Observations and Applications, Invited opening address for the Thirteenth International Objective Measurement Workshop, Berkeley, CA, April 5-6.
Butler, J.C. & Adams, R.J., (2006, April). Examining the role of student effort in PISA: The Impact on the validity of trends. Paper presented at the American Educational Research Association Annual Conference, San Francisco, CA, April 7-11.
Gebhardt, E., & Adams, R.J. (2006, April). The use of different models for estimating trends. Paper presented at the American Educational Research Association Annual Conference, San Francisco, CA, April 7-11.
Zoanetti, N., Griffin, P., & Adams, R.J. (2006, November). Applications of item response theory to identify and account for suspect rater data Paper presented at the Australian Association for Research in education, Adelaide, November 27-29.
Adams, R. J., & Wu, M. L., (2007, April). The Mixed-Coefficients Multinomial Logit Model. Paper presented at the AERA Annual Meeting, Chicago, April, 2007.
|
top of page
