Questions? Contact Designing Events at atp@designingevents.com or call them at 410-654-3336.


 

Platinum Sponsors

Computer Adaptive Technologies, Inc. (CAT)


The Chauncey Group International

Educational Testing Service (ETS)

Galton Technologies

NCS Pearson


Prometric, a Thomson Learning business

Questionmark

TestOut

Program Information

The Association of Test Publishers (ATP) is pleased to host the third annual industry conference - Computer-Based Testing: Assessment at Your Fingertips.

Schedule-At-A-Glance
Who Should Attend?
Key Focus Areas
Agenda
Keynote Presentations

Click on speaker name for a full bio.

Keynote Presentation: Technology, Legal, and Usage Issues: Psychological Testing in the Wake of 911
David Arnold, Ph.D., Vice President - Development and Professional Compliance, NCS Assessments

Keynote Presentation: Dealing with the News Media: The Good, the Bad and the Ugly
David Hakensen, Vice President of Public Relations, NCS Pearson
David Smith, President and CEO, NCS Pearson

Keynote Presentation: Distributed Simulation: The Need to Test for Teamwork Skills Using Technology-Based Assessments
Dr. Jack Thorpe, Consultant, Air Force

Keynote Presentation: Showcase of Innovations in Computer-Based Testing
Dick Devore, Ed.D., Simulations Development Leader, AICPA Examinations Team
Jerry Goldman, Northwestern University
James Olsen, Ph.D., Chief Scientist and Vice President, Alpine Media Corporation

Keynote Presentation: Academic Standards for the 21st Century
Willard R. Daggett, Ed.D., President, International Center for Leadership in Education

Workshops
A.T.P. General Meeting!
Sessions Preview
   Focus on Certification and Licensure
   Focus on Clinical
   Focus on Education
   Focus on Industrial/Organizational
   Cross Divisional Sessions
   Plantinum Sponsor Sessions

Post Conference Workshops
Join A.T.P. in recognition of Benjamin D. Wright, Ph.D


Schedule-At-A-Glance   
February 4 Workshops  8:00 AM - 3:00 PM 
February 4 Exhibit Center Open  8:00 AM - 6:00 PM 
February 4 ATP General
and Division Meeting
 
3:30 PM - 6:00 PM 
February 4 Evening Reception  6:00 PM - 7:30 PM 
February 5 General Sessions and
Breakout Sessions
 
8:00 AM - 5:00 PM 
February 5 Exhibit Center Open  8:00 AM - 5:00 PM 
February 5 Evening Reception 6:00 PM - 7:30 PM 
February 6 General Sessions and
Breakout Sessions
 
8:00 AM - 3:00 PM 
February 6 Exhibit Center Open  8:00 AM - 3:00 PM 

This year's event includes workshops, general sessions with informative and thought-provoking keynote presentations, concurrent sessions on relevant topics, and numerous breakout sessions and networking activities.

To help attendees plan their ATP conference experience, sessions (where applicable) will be identified having a clinical, industrial/organized, educational, or certification focus.


Who Should Attend?
Test Developers
Test Publishers
Test Sponsors
Users of Educational, Employment, Organizational, Psychological & Certification Testing
Informational and Educational Technologists
Training Managers Considering Computer-Based Testing
Professionals Interested in Computer-Based Testing


Key Focus Areas:
Test Design
Test Development
Test Delivery
Test Administration
ATP Computer-Based Testing Guidelines


Agenda:

The conference begins with half-day and full-day Workshops on Monday, February 4th. ATP will hold its annual General Meeting later that afternoon - all are welcome to attend. The Welcome Reception will be held on the evening of February 4th. The kick-off General Session and breakout sessions will be held on Tuesday and Wednesday, February 5th and 6th. The conference will conclude on the afternoon of the 6th with time later in the day for group and individual activities at the resort.


Keynote Presentations
Click on speaker name for a full bio.

Keynote: Technology, Legal, and Usage Issues: Psychological Testing in the Wake of 911
Click for abstract
David Arnold, Ph.D., Vice President - Development and Professional Compliance, NCS Assessments

This presentation will discuss the impact of the events of September 11 on various forms of psychological testing (clinical, industrial, education, and certification). Issues involving the demand for, and use of testing, the growing importance of technology-based platforms and legal/social standards will be discussed. Additionally, many of these issues will be evaluated in light of the recently enacted Aviation and Transportation Security Act.

Keynote Presentation: Dealing with the News Media: The Good, the Bad and the Ugly
Click for abstract
David Hakensen, Vice President of Public Relations, NCS Pearson; and David Smith, President and CEO, NCS Pearson

Increasingly, companies in the testing business are finding themselves the subject of media scrutiny as a result of isolated errors, misleading information and the efforts of anti-testing groups to oversimplify testing issues and demonize testing organizations.

How does an organization work effectively with the news media to tell its story? What recourse is there when negative or misleading media coverage occurs? What role should the CEO of the company have in presenting the organization’s point of view? These issues will be explored by two executives from NCS Pearson, which has been the subject of news media coverage the past year.

Keynote Presentation: Distributed Simulation: The Need to Test for Teamwork Skills Using Technology-Based Assessments
Click for abstract
Dr. Jack Thorpe, Consultant, Air Force

Dr. Jack Thorpe is a consultant involved in the definition and planning of advanced technology development projects. His expertise is in Distributed Simulation, and he was the Program Manager at the Defense Advanced Research Projects Agency (DARPA) that initiated the SIMNET simulator networking project; micro-travel; desktop simulators; video arcade trainers; interactive history; the electronic sand table; seamless simulation; the Defense Simulation Internet; and the "60% solution" development methodology.

He served in the Air Force with 26 years active duty as an R&D officer, the last 12 years as a program manager and office director at DARPA. He retired in 1993 at the rank of Colonel, and continues as a consultant on advanced technology development programs.

Keynote Presentation: Showcase of Innovations in Computer-Based Testing
Click for abstract
Dick Devore, Ed.D., Simulations Development Leader, AICPA Examinations Team; Jerry Goldman, Northwestern University; and James Olsen, Ph.D., Chief Scientist and Vice President, Alpine Media Corporation

The showcase will highlight the cutting edge of computer based testing:

James Olsen will present educational performance assessment tools and national standards based assessments in discovery learning environments. Students use computer tools (pen, ruler, compass, spreadsheet, calculator) to classify or create plane and solid geometric objects; to measure sides, angles, and radii; perform computations, record results, and write extended explanations showing their understanding.

Dick Devore will overview new item types for a new CPA examination. The AICPA will move the Uniform CPA examination from paper and pencil to CBT delivery in 2003. This change will permit the inclusion of simulations incorporating a number of new and innovative item types and delivery techniques. This presentation will demonstrate some of the item types that have been developed by the AICPA to facilitate the assessment of accounting skills in an environment familiar to most CPAs.

Jerry Goldman will demonstrate an example of AMbER -- advanced multimedia-based experimental research. AMbER uses a web client to deliver decision-making experiences and provides full back-end control to investigators (e.g., controlling access, selecting variables for testing). The prototype relies on a criminal justice example. Attributes such as race, dress and affect may be systematically varied or held constant, depending on the objectives of the investigator. All data are gathered, analyzed and reported in real time. Click-through data assist in identifying outliers.

Keynote Presentation: Academic Standards for the 21st Century
Click for abstract
Willard R. Daggett, Ed.D., President, International Center for Leadership in Education

Willard R. Daggett, Ed.D., is President of the International Center for Leadership in Education. He is recognized worldwide for his efforts to move education systems towards more rigorous and relevant skills and knowledge for all students.

Dr. Daggett has assisted several states and many school districts with their school reform initiatives as well as worked with education ministries in other countries. Dr. Daggett serves as the lead consultant for the International Center's network of highly successful model schools committed to rigorous and relevant curriculum for all students. These experiences give him a practical, broad-based perspective to the issues facing education.

Dr. Daggett is the creator of the Application Model, which provides a framework to determine the relevance of curriculum and assessment to real-world situations. The Application Model is part of the Rigor/Relevance Framework, which has become a cornerstone of reform initiatives throughout the United States and the world.

Dr. Daggett founded the International Center after serving in various management positions at the New York State Education Department, where he spearheaded a series of restructuring initiatives to focus the state's education system on the skills and knowledge students need in today's technological, information-based society. He has held both teaching and administrative positions at the secondary, two-year college, four-year liberal arts college and university levels.

Dr. Daggett is the author of 12 textbooks, four books on educational leadership, numerous research reports, and many articles in professional publications. He has addressed audiences in all 50 states and overseas. He also serves as a consultant to many business organizations.


Workshops

Improve your conference Return on Investment - and attend Monday's Workshops. The engaging workshops feature some of the industry's most influential thinkers and doers. It is your chance to network with senior testing professionals ... question participants on their current and future testing strategies ... talk to vendors and gain insights into future technologies - knowledge that will help you stay ahead. This year's workshop topics are guaranteed to provide you with thought-provoking material. Topics were selected based on surveys and focus groups held with last year's attendees.

Full-Day Workshops 8:00AM - 3:00PM

Computerized Adaptive Testing
Click for abstract
Richard Gershon, Ph.D., President, The Gershon Group; and Donna Surges Tatum, American Society of Clinical
Pathologists

Converting from Paper-Based Tests to Computer-Based Tests
Joan Knapp, CEO, Knapp & Associates; David Meissner, Executive Director of Client and Prog. Implement, Prometric, a Thomson Learning business; Linda Waters, Ph.D., Managing Principal, Chauncey Group International; and Bob Whelan, Vice President, General Manager, NCS Pearson

Designing Criterion-Referenced Tests
Click for abstract
Bill Coscarelli, Southern Illinois University; and Sharon Shrock, Southern Illinois University

Introduction to Item Response Theory
Click for abstract
Ronald Hambleton, University of Massachusetts, Amherst

Test Development from Scratch
Click for abstract
Susan Davis-Ali, Ph.D., Vice President for Test Development, Experior Assessments; Julia Leahy, Principal & Director, Test Development Services, The Chauncey Group International; Beth Ruiz, ACT; and David Swanson, Associate Vice President for Test Development, National Board of Medical Examiners

Half-Day Workshops 8:00AM - 11:00AM

Testing In-House - A 'How to' Guide
Click for abstract
Leon Gross, Ph.D., Director of Psychometrics & Research, National Board of Examiners in Optometry; and John Norcini, Ph.D., Senior Vice President for Evaluation and, American Board of Internal Medicine

Item Analysis Tools: An Overview of Currently Available Tools
Click for abstract

Managing the News Media: Taking Control of Your Media Coverage
Click for abstract
David Hakensen, Vice President of Public Relations, NCS Pearson

Half-Day Workshops 12:00PM - 3:00PM

Practical Concerns for Test Security
Click for abstract
Barbara Halsey, Computer-Based Testing Quality Director, The Chauncey Group International; and Fran Linhart, Director of Certification, CompTIA

Evaluating Item Types for Computer-Based Testing
Click for abstract

Building Computer-Based Performance Tests
Click for abstract
Jim Adair, Ph.D., IBM; Marcia Andberg, Ph.D., Director of Development, American Guidance Service; Karen Grygienc, Novell; and Craig Swenson, Novell



Come join us for the ATP General Meeting!

Whether you are just getting acquainted with ATP or have been a member for years, you won't want to miss this year's general meeting. We have a great line up of presentations. The program begins with an opening address from our Executive Director, William G. Harris; followed by a state of the organization address. Our keynote speaker will then discuss the legal implications of computer-based testing.

Additionally, this will be your opportunity to participate in division meetings, which focus more directly on specific activities of each division for the coming year.

I hope you can join us!

Jamie Mulkey, Ed.D.
President and Chairman, ATP Board of Directors
Worldwide Certification Program Manager, Hewlett-Packard Company


Session Preview

Focus on Certification/Licensing

Practical Lessons Learned in Computer-Based Testing
Click for abstract
Gerald Rosen, Ed.D., Vice President for Programs, Professional Examination Service; and Donna Surges Tatum, American Society of Clinical Pathologists

Setting Standards for Web- and Computer-Based Testing
Click for abstract
Paul Jones, Ph.D., Director of Psychometrics, Galton Technologies; Richard Luecht, Ph.D., Director/ Professor/Chair, University of North Carolina, Greensboro; and Stephen Sireci, Ph.D., Associate Professor, University of Massachusetts, Amherst

What Types of Validity Evidence Should You Have in Your Hip Pocket When the Lawyers Come To Call?
Click for abstract
Paul Naylor, Ph.D., President, Gainesville Independent Testing Service, LLC; and Thomas Zane, Ph.D., Director of Assessment, Teachers College for Western Governors University

Focus on Clinical

Neuropsychological and Other Performance Monitoring via Networks
Click for abstract
David Erlanger, Ph.D., President, Headminder, Inc.; Robert Kane, Ph.D., Baltimore VA; and Dennis Reeves, Ph.D., Naval Hospital Camp, Pendleton, CA

Objective Test Assessment on the Internet
Click for abstract
Leigh Jerome, Clinical Psychologist & Research Scientist, University of Hawaii; David Pfenniger, Ph.D.,
Founder/President, Performance Assessment Network (PAN); and Larry Weiss, Ph.D., Director of Research & Development, The Psychological Corporation

Training and Evaluation of Clinical Skills Using Interactive Multimedia
Click for abstract
Marcia Andberg, Ph.D., Director of Development, American Guidance Service

Focus on Education

Educational Assessment by Computer
Click for abstract
Gage Kingsbury, Northwest Evaluation Association

Electronic Testing in the K-12 Setting
Click for abstract
Michael Yoes, Psychometrician, NCS Pearson

The Future of Educational Assessment by Computer from the Publisher's Perspective
Click for abstract
Margaret Jorgensen, Vice President for Product Development, Psychometrics, and Computer-Based Testing; David Mott, Tests for Higher Standards; Robert Sykes, Ph.D., Senior Research Scientist, CTB; and Molly Zebrowski, NCS Pearson

Focus on Industrial/Organizational

Computer-Based Testing Practices in the Workplace
Click for abstract
Steven Ashworth, Sempra Energy

Legal Issues
Click for abstract
Tom Abrams, Vedder Price

Transition to Technology: Design and Application Issues with Employment Tests
Click for abstract
Wade Gibson, Psychological Services, Inc.; and John Weiner, Psychological Services, Inc.

Cross Divisional

A Comparative Analysis Between IT and Non-IT Programs
Click for abstract
Linda Althouse, SAS Institute

Anti-Piracy Campaign: An Update from the IT Security Council
Click for abstract
IT Cert Security Council

Assuring Excellence in Test Development, Delivery and Analysis
Click for abstract
James Impara, Ph.D., Buros Institute; and Cheryl Wild, Ph.D., CQA, Wild and Associates

ATP Computer-Based Testing Guidelines: Application across Multiple Disciplines
Click for abstract
Cyndy Fitzgerald, Ph.D., Microsoft Corporation, Michael Callans, Wonderlic Consulting; William G. Harris, Ph.D., Association of Test Publishers

Audience Definition: Alternative JTA Processes
Click for abstract
Jim Adair, Ph.D., IBM; Gary Moehnke (TBD), IBM; Linda Montgomery, Ph.D., Director of Research Services, The Chauncey Group International; and Ray Talke, Founder/President, Minds in Action, Inc.

Best Practices in Item Banking for Computer-Based Testing
Click for abstract
Betty Bergstrom, Ph.D., Computer Adaptive Technologies, Inc.; and Julia Leahy, Principal & Director, Test Development Services, The Chauncey Group International

Bias Issues with Computer-Based Testing
Click for abstract
Richard Gershon, Ph.D., President, The Gershon Group

Case Studies: Workplace Simulations
Click for abstract
Fritz Drasgow, Professor, University of Illinois

Case Study: Computer-Based Testing For Driver Examinations
Click for abstract
Gary Cleere, European Drivers' License Foundation, Ireland

Computer-Based Testing and Instruction in the Year 2005
Click for abstract
Shawn Bird, Ph.D., Co-Founder & President, Exam Solutions; Andrew Gibbons, Ph.D., Professor, Utah State University; M. David Merrill, Utah State University; and James Olsen, Ph.D., Chief Scientist and Vice President, Alpine Media Corporation

Cross Pollination - Lessons Learned From Computer-Based Testing in Different Markets
Click for abstract
Chris Gruber, Ph.D., Western Psychological Services; William G. Harris, Ph.D., Executive Director, Association of Test Publishers; Michael Segovia, M.A., Director of Business Development & Tech. Marketing, Consulting Psychologists Press, Inc.; Linda Waters, Ph.D., Managing Principal, Chauncey Group International; and Kathleen Williams, Ph.D., NCSP, Director, Product Development, American Guidance Service

Detecting Candidate Misconduct
Click for abstract
Ray Nicosia, Educational Testing Service, Office of Test Security

Evaluating Alternative Item Types in Computer-Based Testing
Click for abstract
Brian Bontempo, Ph.D., Microsoft Corporation; Cyndy Fitzgerald, Ph.D., Microsoft Corporation; Deborah Kerman, Ph.D., Microsoft Corporation; and Cynthia Parshall, University of South Florida

Key Problems and Practical Solutions in Computer-Based Testing Programs
Click for abstract
Ronald J. Nungester, Ph.D., , Senior Vice President, National Board of Medical Examiners; Craig Mills, Executive Director - CPA Exam, American Institute of Certified Public Accountants

Making Tests Accessible to Test Takers with Disabilities: New Challenges and New Opportunities Under the ADA
Click for abstract
Loring Brinkerhoff, Ph.D., Disability Accommodations Specialist, Educational Testing Service

Managing Large Scale Computer-Based Testing Programs
Click for abstract
Ellen Julian, Director, MCAT, AAMC; Fran Linhart, Director of Certification, Computing Technology Industry Association; Casey Marks, Director of Testing Services, National Council of State Boards of Nursing; and Don Moretti, Motorola

Online Assessments as an Organizational Development Tool: Demonstration and Application Overview
Click for abstract
Michael Segovia, M.A., Director of Business Development & Tech. Marketing, Consulting Psychologists Press, Inc.

Online Item and Test Development
Click for abstract
Deb Schnipke, Ph.D., CAT Senior Program Manager and Psychometrician, Computer Adaptive Technologies, Inc.; and David Scrams, Ph.D., Microsoft Program Manager and Psychometrician, Microsoft Corporation

Opportunities and Challenges of Computer-Based Testing
Click for abstract
Donna DeAngelis, LICSW, ACSW, Executive Director, Association of Social Work Boards; and Dawn Vinson, Liason Council on Certification for the Surgical Technologists

Psychometric Issues When Using Multiple Test Distribution Channels
Click for abstract
Jim Adair, Ph.D., IBM; and Cliff Donath, President, The Donath Group

Scoring Essays via Computer-Based Testing
Click for abstract
Mark Shermis, Ph.D., Florida International University

The Financial Model for Computer-Based Testing
Click for abstract
David Cox, Professional Testing Incorporated; Frank Hatcher, Consultant; Don Wagner, Executive Director, Business Development, VUE, and NCS Pearson Business; Linda Waters, The Chauncey Group International

The Key to Developing Computer-Based Tests - Automated Test Assembly Procedures
Click for abstract
Krista Breithaupt, Ph.D., Psychometrician, American Institute of CPA's; Richard Luecht, Ph.D., Director/ Professor/Chair, University of North Carolina, Chappel Hill; and Wim J. van der Linden, Professor/Chair, University of Twente, Netherlands

The Virtual Classroom: Using Web Conferencing for Certification Prep
Click for abstract
Jennifer Harrington, Program Manager, Hewlett-Packard Company; Jamie Mulkey, Ed.D., Worldwide Certification Program Manager, Hewlett-Packard Company; and Roc Paez, US UNIX Program Manager, Hewlett-Packard Company

Transitioning From Computer-Based to Web-Based Testing: Development and Delivery Issues
Click for abstract
Shawn Bird, Ph.D., Co-Founder & President, Exam Solutions; Alison Indrisano, Senior Vice President, Client Services & Support, Prometric, a Thomson Learning Business; and Anthony Zara, Ph.D., Vice President, NCS Pearson

Translating Credentialing Exams: Practical Guidelines and Steps to Insure Validity
Click for abstract
Ronald Hambleton, University of Massachusetts, Amherst, and Stephen Sireci, Ph.D., Associate Professor, University of Massachusetts, Amherst

What Clients of Testing Vendors Want
Click for abstract
Dean Polk, Second VP, Examinations, LOMA; and Susan Powell, Director of Account Management, Prometric, a Thomson Learning business

Who is Representing the Examinee?
Click for abstract
J. Patrick Jones, Ph.D., Executive Vice President, Professional Examination Service; and Barbara Plake, Ph.D., Professor/Director, University of Nebraska

Platinum Sponsor Session

Adventures In Cyberspace: Using the Internet for Job Analysis Projects and Survey Delivery via Web Conferencing - The Chauncey Group International
Click for abstract
Linda Montgomery, Ph.D., Director of Research Services, The Chauncey Group International

Automated Scoring Technologies Used for NAEP Performance Items - Educational Testing Service
Click for abstract
Claudia Leacock, Sr. Computational Linguist, ETS Technologies, Inc.

CAT At Your Fingertips - Computer Adaptive Technologies, Inc.
Click for abstract
Brigid Flood, Business Development Manager, Computer Adaptive Technologies, Inc.

Computerized Test Development - Galton Technologies
Click for abstract
Brian J. Adams, Director of Client Services, Galton Technologies

Implementing a Licensure or Certification Program - An Insider's Perspective - Prometric, a Thomson Learning business
Click for abstract
Dave Meissner, Executive Director of Client and Prog. Implementation, Prometric, a Thomson Learning business

Implementing Simulations in a Testing Environment: Going where few have gone before - TestOut Corporation
Click for abstract
Don Whitnah, Program Manager, TestOut Corporation; and Kathy Wright, Ph.D., VP of Research & Development, TestOut Corporation

Managing Your Item Bank: A Success Story with Chauncey's TestExpress - The Chauncey Group International
Click for abstract
Julia Leahy, Principal & Director, Test Development Services, The Chauncey Group International

Migrating to Computerized Testing - Galton Technologies
Click for abstract
David Foster, Ph.D., Co-Founder/President, Galton Technologies

Publishers' Use of XML-based Web Services in 2005 - Questionmark
Click for abstract
Eric Shepherd, Questionmark

Questionmark Perception in the Learning and Certification Process - Questionmark
Click for abstract
Eric Shepherd, Questionmark

Technological Advances in Computer-Based Testing - NCS Pearson
Charles Johnston, Ph.D., Vice President-Program Management, VUE, an NCS Pearson Business; Don Wagner, Executive Director, Business Development, VUE, an NCS Pearson Business; Bob Whelan, Vice President, General Manager, NCS Pearson; and Anthony Zara, Ph.D., Vice President-Professional Licensing & Cert., NCS Pearson

UTD: Explore the Possibilities of The Future Today - Prometric, a Thomson Learning business
Click for abstract
Eric Wenck, Executive Director of Product Strategy and Deployment, Prometric, a Thomson Learning business

Post Conference Workshops

Information Technology Certificaiton Security Council (ITCSC) Introductory Meeting
Click for abstract
IT Certification Security Council

Special Interest Group: Advancing Performance Testing
Click for abstract
Jim Adair, Ph.D., IBM


Join the Association of Test Publishers as we recognize
Click for abstract
Benjamin D. Wright, Ph.D. by honoring him with the Career Achievement Award in Computer-Based Testing.

Dr. Wright is Professor of Education and Psychology at the University of Chicago and Director of the Mesa Psychometric Laboratory. He has published 150 papers on Rasch measurement; authored 12 books, including Best Test Design and Rating Scale Analysis and developed the two most widely used Rasch measurement computer programs, WINSTEPS and Facets. Dr. Wright has taught annual workshops and courses on Rasch measurement since 1969 and chaired 70 doctoral dissertations on that topic. Many of his students are contemporary leaders in psychometrics.