Edward Henry Haertel

SELECTED PRESENTATIONS (CONTINUED):
Haertel, E. H. (1999, October). Reliability. Presentation at the Edward Reidy Memorial Conference sponsored by National Center for Improvement of Educational Assessments, Providence, RI.
Haertel, E. H. (2000, January). Testing and standards-based reform. Presentation to the Pew Network Council, Stanford, CA.
Haertel, E. H., & Lorié, W. A. (2000, April). Standards for student work versus standards for students: Conceptual confusions in standards-based reporting. Paper presented at the meeting of the American Educational Research Association, New Orleans.
Haertel, E. H. (2000, May). Discussion of "The controversy over the national standards set by the National Assessment Governing Board" by Mark D. Reckase. Brookings Papers on Education Policy: Conference on National Standards, Washington, DC.
Haertel, E. H. (2000, July). The Design of the Academic Performance Index used for ranking schools in California. Lecture presented by invitation at the National Center for University Entrance Examinations, Tokyo, Japan.
Haertel, E. H. (2000, July). How the SAT is used in undergraduate admissions at Stanford University. Lecture presented by invitation at the National Center for University Entrance Examinations, Tokyo, Japan.
Haertel, E. H. (2001, April). Standard setting as a participatory process: Implications for validation of standards-based accountability programs. Paper presented at the meeting of the American Educational Research Association, Seattle.
Haertel, E. H. (2001, April). "High stakes testing" and the Standards for educational and psychological testing. Keynote address to the National Association of Test Directors, Seattle.
Haertel, E. H. (2001, June). Seminar session on California's Academic Performance Index (API). Extended invited presentation to the State Board of Education, Sacramento, CA.
Haertel, E. H. (2001, December). Looking at NAEP 2001 mathematics results. Major address at the annual meeting of the California Mathematics Council, Asilomar, CA.
Haertel, E. H. (2002, April). Technical issues in the use of NAEP to confirm states' achievement gains. Paper presented at the meeting of the American Educational Research Association, New Orleans.
Haertel, E. H. (2003, January). The What Works Clearinghouse and scientifically based research. Presentation at the 2003 Reading Faculty Forum, Sacramento. (Cosponsored by the California State University Center for the Advancement of Reading, California Department of Education, and California Commission on Teacher Credentialing.)
Haertel, E. H. (2003, April). Differential prediction and opportunity to learn. Poster presentation at the meeting of the American Educational Research Association, Chicago.
Haertel, E. H. (2003, April). Evidentiary argument and the comparability of scores from standard versus nonstandard test administrations. Paper presented at the meeting of the American Educational Research Association, Chicago.
Ho, A. D., & Haertel, E. H. (2003, April). Criterion-referenced testing: An idea in need of a theory. Paper presented at the meeting of the American Educational Research Association, Chicago.

SELECTED PRESENTATIONS (CONTINUED):
Pullin, D., & Haertel, E. H. (2003, April). The idea of an "opportunity to learn": Historical and methodological perspectives on policy challenges and research inquiries. Paper presented at the meeting of the American Educational Research Association, Chicago.
Haertel, E. H., & Wiley, D. E. (2003, August). Comparability issues when scores are produced under varying testing conditions. Paper presented at the Psychometric Conference on Validity and Accommodations, University of Maryland.
Michaelides, M. P., & Haertel, E. H. (2004, April). Sampling of common items: An ignored source of error in test equating. Paper presented at the meeting of the National Council on Measurement in Education, San Diego.
Haertel, E. H. (2004, September). California's API: Recent developments and future prospects. Paper presented at the annual conference of the National Center for Research on Evaluation, Standards, and Student Testing (CRESST), Los Angeles.
Haertel, E. H. (2005, February). California's API: Recent developments and future prospects. Invited presentation at the American Institutes for Research, Palo Alto.
Haertel, E. H. (2005, April). High stakes tests as policy tools: Dilemmas of theory and practice. Paper presented at the meeting of the National Council on Measurement in Education, Montréal, Canada.
Ho, A. D., & Haertel, E. H. (2005, April). Metric-free methods for evaluating and interpreting gaps between test-score distributions. Paper presented at the meeting of the American Educational Research Association, Montréal, Canada.
Haertel, E. H. (2005, April). Assessment, equity, and opportunity to learn: Toward new views of knowing, teaching, and testing. Paper presented at the meeting of the American Educational Research Association, Montréal, Canada.
Haertel, E. H. (2005, September). The many ways of using tests for educational improvement. Paper presented at the annual conference of the National Center for Research on Evaluation, Standards, and Student Testing (CRESST), Los Angeles.
Wei, X., Shen, X., Lukoff, B., Ho, A. D., & Haertel, E. H. (2006, April). Using Test Content to Address Trend Discrepancies Between NAEP and California State Tests. Paper presented at the meeting of the American Educational Research Association, San Francisco.
Williams, T., Kirst, M. W., & Haertel, E. H. (2006, November). Similar Students, Different Results: Why do some schools do better? Keynote address at the meeting of the California Educational Research Association, Monterey.
Haertel, E. H. (2007, January). Standard Setting. Paper presented at the 2007 CRESST Conference, The Future of Test-Based Accountability: Festschrift in Honor of Robert L. Linn. National Center for Research on Evaluation, Standards, and Student Testing (CRESST), Los Angeles.
Haertel, E. H. (2007, April). Reliability. Paper presented at the meeting of the National Council on Measurement in Education, Chicago.
Shen, X., & Haertel, E. H. (2007, April). Comparing item response trends for validating score gains on a state high-stakes test. Paper presented at the meeting of the American Educational Research Association, Chicago.
SELECTED PRESENTATIONS (CONTINUED):
Haertel, E. H. (2007, May). Psychometric Audit of the GBX and FLYX. Invited presentation to the Committee of Bar Examiners of the State of California, San Diego.
Haertel, E. H. (2007, November). The crafting of an accountability system: Many actors, many parts. Invited address at the meeting of the California Educational Research Association, Dana Point, California, on occasion of receipt of 2007 CERA Lifetime Achievement Award.
Williams, T., & Haertel, E. H. (2007, November). Similar EL Students, Different Results: Why do some schools do better? Paper presented at the meeting of the California Educational Research Association, Dana Point, California.
Shen, X., & Haertel, E. H. (2008, April). Stability of School Academic Performances Across Subject Areas and Grade Levels. Paper presented at the meeting of the American Educational Research Association, New York.
Newton, X. A., Darling-Hammond, L., Haertel, E. H., & Thomas, E. A. C. (2008, April). Exploring Value-Added Methods: How Models Matter. Paper presented at the meeting of the American Educational Research Association, New York.
Haertel, E. H. (2008, October 6). Instability of Teacher Effects Estimates from Value-Added Models. Presentation at the Value-Added Methodology Seminar co-sponsored by Policy Analysis for California Education (PACE) and the Commission on Teacher Credentialing (CTC), Sacramento, California.
PROFESSIONAL SERVICE:
Proposal review for the National Science Foundation

Proposal and document review for the National Center for Education Statistics

Report review for the National Research Council

Reviewer, Applied Measurement in Education.

Reviewer, Journal of Educational Measurement.

Reviewer, Educational Measurement: Issues and Practice.

Reviewer, Journal of Educational Psychology.

Reviewer, Journal of Educational and Behavioral Statistics.

Editorial Board, Stanford Series on Education and Public Policy, Falmer Press, 1984-1992.

Editorial Board, Journal of Educational Measurement, 1985-1988.

Editorial Board, New Directions for Program Evaluation, 1988-1990.

Associate Editor, Journal of Educational Statistics, 1988 1991.

Editorial Board, Educational Assessment, 1994-present.

Management Committee, Journal of Educational and Behavioral Statistics, 1995-2005.

Editorial Board, Applied Measurement in Education, 2001-present.

Editorial Board, Measurement: Interdisciplinary Research and Perspectives, 2001-present.

Chair, Research Using National Assessment of Educational Progress Data, a Special Interest Group of the American Educational Research Association. April 1985-March 1987.
Co-Chair, Division D Section 2 (Theoretical Measurement), 1987 Program Committee of the American Educational Research Association. April 1986-March 1987.
Member (1987) and chair (1988), Palmer O. Johnson Award Committee, American Educational Research Association, 1987-88.
Chair, Selection Committee for the AERA Award for Distinguished Contributions to Educational Research, 1992-1994.

PROFESSIONAL SERVICE (CONTINUED):
Program Committee Co-Chair (1992-93) and Program Committee Chair (1993-94), AERA Special Interest Group on Lesbian and Gay Studies.
Member, Leadership Group, AERA Special Interest Group on Lesbian and Gay Studies, 1993-1996.
Member at Large, AERA General Council, 1993-1996; Member, AERA Executive Board, 1994-1996.
Chair, NCME Task Force on Policy and Technical Issues in Performance Assessment, 1990-1991.
Member, NCME Board of Directors, 1992-1995, 1997-2000; Executive Committee, 1997-2000.
Member, National Faculty, UCLA Center for Research on Evaluation, Standards, and Student Testing, 1986-1990.
CRESST Partner (National Center for Research on Evaluation, Standards, and Student Testing), 1996-2005.
Member, Advisory Panel for the Synthesis of reported evaluation and research evidence on the effectiveness of bilingual education basic projects, National Center for Bilingual Research, Los Alamitos, California, 1982.
Member, Assessment Panel, National Center for Improving Science Education, 1988-1990.
Member, Focus Group on Testing (convened by the National Academy of Education), 1989.
Member, Technical Advisory Group, California Assessment Program (1989-1993) and California Learning Assessment System (1993-1995).
Member, State of California Advisory Committee on Rewards and Interventions, 1997.
Member, State of California Advisory Committee on CAAAS Matrix Test, 1999.
Member, Proposal Review Committee for the CAAAS Matrix Test, 1999.
Member, State of California Advisory Committee for the Public Schools Accountability Act of 1999 and Co-Chair, Subcommittee on the Academic Performance Index, 1999-3; Chair, 2003-present..
Member, Technical Design Group for the Public Schools Accountability Act of 1999; Co-Chair 1999-2003; chair, 2003-present.
Member, Technical Advisory Group on Standards, National Assessment Governing Board, 1990-1991.
Member, National Academy of Education Panel on the Evaluation of the NAEP Trail State Assessment and Standard Setting, 1992-1994.
Member, Technical Review Panel for NAEP Validity Studies, Center for Research on Evaluation, Standards, and Student Testing and the RAND Corporation, 1990-1994.
Consultant to the National Academy of Education and American Institutes for Research on the evaluation of the Trial State Assessment, National Assessment of Educational Progress, 1990-1991.

PROFESSIONAL SERVICE (CONTINUED):
Member, Technical Planning Subgroup, Goal 4, for National Education Goals Panel, National Governors Association, 1991-1992.
Member, Technical Analysis Group, National Board for Professional Teaching Standards, 1991-1996.
Member, Technical Advisory Group, Kentucky Instructional Results Information System [KIRIS], 1992-1995.
Member, National Technical Working Group, Kentucky Department of Education, 1995-1997. (Technical advisory committee for the KIRIS)
Member, Joint Committee on the Standards for Educational and Psychological Testing, 1993-1999. (A Joint Committee of the American Psychological Association, the American Educational Research Association, and the National Council on Measurement in Education.)
Member, Board on International Comparative Studies in Education, National Research Council, 1988-1994.
Member, National Assessment Governing Board, 1997-2003.
Chair, Achievement Levels Committee; Member, Executive Committee of the National Assessment Governing Board, 1998-2000.
Chair, Committee on Standards, Design and Methodology; Member, Executive Committee of the National Assessment Governing Board, 2000-2003.
Member, National Test Panel convened by the CCSSO to oversee specifications for the National Tests in Reading (Grade 4) and Mathematics (Grade 8), 1997.
Member, Technical Advisory Committee, GreatSchools.net., 1999-2004.
Member, Technical Advisory Group, What Works Clearinghouse, 2002-2004.
Member, Board of Directors, National Center for the Improvement of Educational Assessment, 2001-2009.
Member, Board of Directors, National Academy of Education, 2001-2003.
Member, ETS Visiting Panel on Research, 2003-present.
Senior Technical Advisor to EdSource study on "Improving achievement for low-income students: What makes a difference?" 2004-2006.
Member, Accountability Working Group appointed by California Secretary of Education Alan Bersin, State Board of Education President Ruth Green, and California Superintendent of Public Instruction Jack O'Connell, to consider redesign of California's Academic Performance Index in response to the No Child Left Behind legislation, 2005-2006.
Member, Government Accountability Office Expert Panel on Assessing Students With Limited English Proficiency, January 20, 2006, University of California at Davis.
Member, Committee on Social Science Research Evidence on Racial Diversity in Schools, National Academy of Education, 2007.

UNIVERSITY SERVICE:
Member, Strategic Education Research Partnership (SERP) San Francisco Design Team, 2007-present.
Chair, Board on Testing and Assessment (BOTA), National Research Council, 2008-present
Member, NCME Newsletter Advisory Board, 2009-present
Member, Committee on Academic Appraisal and Achievement, Subcommittee on Evaluation and Improvement of Teaching, 1984 85.
Member, Committee on Academic Appraisal and Achievement, 1988 1992. (Co-chair, 1989-1990, Chair, 1990-1991, Co-chair, 1991-1992)
Member, Administrative Panel on Human Subjects in Nonmedical Research, 1987-1993.
Acting Chair, Committee on Research and Evaluation Methods, School of Education, Autumn 1990.
Acting Chair, Committee on Psychological Studies in Education, School of Education, Winter-Spring 1990-1991; Fall 1996; Spring 1997.
Chair, Committee on Psychological Studies in Education, School of Education, 1997-1999; 2003-2005.
Member, Committee on Educational Policy, School of Education, 1992-1994, 1997-1998, 2000-2004.
Member, Search Committee for University Registrar, 1993.
Member, Student Conduct Legislative Council, 1993-1994.
Freshman Advisor, 1993-2006.
Representative to Faculty Senate, 1993-1994, 1999-2000.
Chair, Ad Hoc Committee to Explore Quantitative Methods Course Offerings in the School of Education, 1995-1996.
Member, Committee on Undergraduate Admissions and Financial Aid (CUAFA), 1995-1999; Chair, 1998-1999.
Member, Dean's Advisory Committee, 1997-2000.
Member, Spencer Research Training Grant Coordinating Committee, 1997-2000; Chair, 1998-2000.
Member, Search Committee for Director of Lesbian, Gay, and Bisexual Community Center, 1998.
Faculty Sponsor, SchoolsOut (Gay, Lesbian, and Bisexual student organization for the Stanford University School of Education), 1998-present.
Member, Queer Awareness Days (QuAD) Advisory Committee for the Lesbian, Gay, and Bisexual Community Center (LGBCC), 1999-2000.
Member, Search Committee for the Dean of the School of Education, 1999-2000.
Member, Advisory Board of the Academic Council, 2003-2006; Chair, 2005-2006.

UNIVERSITY SERVICE (CONTINUED):
Associate Dean for Faculty Affairs, 2005-present.
Member, WASC Reaccreditation Steering Committee, 2007-present.
GRANTS AND CONTRACTS:
Wiley, D. E. Testing for Minimal Competency and Curriculum Evaluation: Technical and Policy Issues. Grant received by the ML-GROUP for Policy Studies in Education from the National Institute of Education (David E. Wiley was Principal Investigator; Haertel co-authored proposal with Wiley and Annegret Harnischfeger, and was named among key personnel.) 1977-1979.
Haertel, E. Discrete Ability Profile Models of Mathematics Attainment: Development and Application. Grant received from the Education Commission of the States. 1981-1982.
Haertel, E. Developing Mathematical Models for Describing Test Response Data. Grant received from the Spencer Foundation. 1983.
Haertel, E. Construct Validity and Classroom Testing. Grant received from the Spencer Foundation. 1984.
Haertel, E. H., & Rogosa, D. R. (listed alphabetically). Equipment grant for instructional uses of microcomputers under Stanford/IBM Ramus project. 1985.
Haertel, E. H. Tests of Divergent Thinking in High School English. Grant received from the Spencer Foundation. 1986.
Haertel, E. H. Evaluation of the Monterey County Science Implementation Project. Grant received from The David and Lucile Packard Foundation. 1987-1989.
Applebee, A., Langer, J., & Haertel, E. Policy and Practice in the Teaching of Writing. Grant received from the Spencer Foundation. 1987.
Applebee, A., Langer, J., & Haertel, E. Policy and Practice in the Teaching of Reading. Grant received from the Office of Educational Research and Improvement, U.S. Department of Education. 1988.
Shulman, L. S. California Center for the Development of Candidate Based New Teacher Assessment. Grant received by Stanford University from the State of California. (One of three Associate Directors assisting Lee S. Shulman, Principal Investigator) 1989.
Haertel, E. H. Alternative performance assessment systems: An evaluation of cost, technical quality, feasibility and acceptability. (Subcontract to Stanford University under National Science Foundation grant to the RAND Corporation, Stephen Klein, Principal Investigator.) 1992-1996.
Haertel, E. H. Achievement and assessment in school science: Modeling and mapping ability and performance. Grant from the National Science Foundation, 1992-1996.
Haertel, E. H. Evaluating communities of learners. Grant from the Andrew W. Mellon Foundation, 1994-2001.
Haertel, E. H. Evaluation of Schools for Thought Diffusion Project. Subcontract to Vanderbilt University (funded by Mellon Foundation), 1997-2001.

GRANTS AND CONTRACTS (CONTINUED):
Haertel, E. H. Spencer Mentor Award (Spencer Foundation award to support mentoring of doctoral students), 2000-2003.
Haertel, E. H. Judgmental Standard Setting for Educational Tests: Toward Rational Foundations and Defensible Methods (Major Research Grant from the Spencer Foundation), 2000-2003.
Haertel, E. H. The Behavior of Linking Items in Test Equating (Subcontract to the National Center for Research on Evaluation, Standards, and Student Testing [CRESST], UCLA), 2002-2004.
Haertel, E. H. Differential Prediction and Opportunity to Learn (Subcontract to the National Center for Research on Evaluation, Standards, and Student Testing [CRESST], UCLA), 2003-2006.
Haertel, E. H. Refine an Experimental Methodology that School Districts Can Use to Measure the Effectiveness of Instructional Programs (Subcontract to Empirical Education, Inc.) (2004-2008)
Haertel, E. H. Performance-based Assessment of Literacy Coaching: A Measurement Development Project (Major Research Grant from the Spencer Foundation), 2008-2009. (Anthony Bryk was the original principal investigator. I had been involved from the beginning, and assumed the role of PI when Bryk resigned from his faculty position at Stanford.)

3/09