Program
Information
The
Association of Test Publishers (ATP) is pleased to host the third
annual industry conference - Computer-Based Testing: Assessment
at Your Fingertips.
Schedule-At-A-Glance
Who
Should Attend?
Key
Focus Areas
Agenda
Keynote
Presentations
Click on speaker name for
a full bio.
Keynote
Presentation: Technology, Legal, and Usage Issues: Psychological
Testing in the Wake of 911
David
Arnold, Ph.D., Vice President - Development and Professional
Compliance, NCS Assessments
Keynote
Presentation: Dealing with the News Media: The Good, the Bad
and the Ugly
David
Hakensen, Vice President of Public Relations, NCS Pearson
David Smith, President and
CEO, NCS Pearson
Keynote
Presentation: Distributed Simulation: The Need to Test for Teamwork
Skills Using Technology-Based Assessments
Dr.
Jack Thorpe, Consultant, Air Force
Keynote
Presentation: Showcase of Innovations in Computer-Based Testing
Dick
Devore, Ed.D., Simulations Development Leader, AICPA Examinations
Team
Jerry Goldman, Northwestern
University
James Olsen, Ph.D., Chief
Scientist and Vice President, Alpine Media Corporation
Keynote
Presentation: Academic Standards for the 21st Century
Willard
R. Daggett, Ed.D., President, International Center for Leadership
in Education
Workshops
A.T.P.
General Meeting!
Sessions
Preview
Focus on Certification and Licensure
Focus on Clinical
Focus on Education
Focus on Industrial/Organizational
Cross Divisional Sessions
Plantinum Sponsor
Sessions
Post
Conference Workshops
Join A.T.P. in recognition of Benjamin
D. Wright, Ph.D
| Schedule-At-A-Glance |
|
| February
4 Workshops |
8:00
AM - 3:00 PM |
| February 4 Exhibit Center
Open |
8:00 AM - 6:00 PM |
February
4 ATP General
and Division Meeting |
3:30
PM - 6:00 PM |
| February 4 Evening Reception |
6:00 PM - 7:30 PM |
February
5 General Sessions and
Breakout Sessions |
8:00
AM - 5:00 PM |
| February 5 Exhibit Center
Open |
8:00 AM - 5:00 PM |
| February
5 Evening Reception |
6:00
PM - 7:30 PM |
February 6 General Sessions
and
Breakout Sessions |
8:00 AM - 3:00 PM |
| February
6 Exhibit Center Open |
8:00
AM - 3:00 PM |
This year's
event includes workshops, general sessions with informative and
thought-provoking keynote presentations, concurrent sessions
on relevant topics, and numerous breakout sessions and networking
activities.
To help
attendees plan their ATP conference experience, sessions (where
applicable) will be identified having a clinical, industrial/organized,
educational, or certification focus.
Who
Should Attend?
Test Developers
Test Publishers
Test Sponsors
Users of Educational, Employment, Organizational, Psychological
& Certification Testing
Informational and Educational Technologists
Training Managers Considering Computer-Based Testing
Professionals Interested in Computer-Based Testing
Key
Focus Areas:
Test Design
Test Development
Test Delivery
Test Administration
ATP Computer-Based Testing Guidelines
Agenda:
The conference
begins with half-day and full-day Workshops on Monday, February
4th. ATP will hold its annual General Meeting later that afternoon
- all are welcome to attend. The Welcome Reception will be held
on the evening of February 4th. The kick-off General Session
and breakout sessions will be held on Tuesday and Wednesday,
February 5th and 6th. The conference will conclude on the afternoon
of the 6th with time later in the day for group and individual
activities at the resort.
Keynote
Presentations
Click on speaker name
for a full bio.
Keynote:
Technology, Legal, and Usage Issues: Psychological Testing in
the Wake of 911
Click
for abstract
David
Arnold, Ph.D., Vice President - Development and Professional
Compliance, NCS Assessments
This presentation will discuss
the impact of the events of September 11 on various forms of
psychological testing (clinical, industrial, education, and certification).
Issues involving the demand for, and use of testing, the growing
importance of technology-based platforms and legal/social standards
will be discussed. Additionally, many of these issues will be
evaluated in light of the recently enacted Aviation and Transportation
Security Act.
Keynote
Presentation: Dealing with the News Media: The Good, the Bad
and the Ugly
Click
for abstract
David
Hakensen, Vice President of Public Relations, NCS Pearson;
and David Smith, President
and CEO, NCS Pearson
Increasingly, companies in the
testing business are finding themselves the subject of media
scrutiny as a result of isolated errors, misleading information
and the efforts of anti-testing groups to oversimplify testing
issues and demonize testing organizations.
How does an organization work
effectively with the news media to tell its story? What recourse
is there when negative or misleading media coverage occurs? What
role should the CEO of the company have in presenting the organizations
point of view? These issues will be explored by two executives
from NCS Pearson, which has been the subject of news media coverage
the past year.
Keynote
Presentation: Distributed Simulation: The Need to Test for Teamwork
Skills Using Technology-Based Assessments
Click
for abstract
Dr.
Jack Thorpe, Consultant, Air Force
Dr. Jack Thorpe is a consultant
involved in the definition and planning of advanced technology
development projects. His expertise is in Distributed Simulation,
and he was the Program Manager at the Defense Advanced Research
Projects Agency (DARPA) that initiated the SIMNET simulator networking
project; micro-travel; desktop simulators; video arcade trainers;
interactive history; the electronic sand table; seamless simulation;
the Defense Simulation Internet; and the "60% solution"
development methodology.
He served in the Air Force with
26 years active duty as an R&D officer, the last 12 years
as a program manager and office director at DARPA. He retired
in 1993 at the rank of Colonel, and continues as a consultant
on advanced technology development programs.
Keynote
Presentation: Showcase of Innovations in Computer-Based Testing
Click
for abstract
Dick
Devore, Ed.D., Simulations Development Leader, AICPA Examinations
Team; Jerry Goldman, Northwestern
University; and James Olsen,
Ph.D., Chief Scientist and Vice President, Alpine Media Corporation
The showcase will highlight the
cutting edge of computer based testing:
James Olsen will present educational
performance assessment tools and national standards based assessments
in discovery learning environments. Students use computer tools
(pen, ruler, compass, spreadsheet, calculator) to classify or
create plane and solid geometric objects; to measure sides, angles,
and radii; perform computations, record results, and write extended
explanations showing their understanding.
Dick Devore will overview new
item types for a new CPA examination. The AICPA will move the
Uniform CPA examination from paper and pencil to CBT delivery
in 2003. This change will permit the inclusion of simulations
incorporating a number of new and innovative item types and delivery
techniques. This presentation will demonstrate some of the item
types that have been developed by the AICPA to facilitate the
assessment of accounting skills in an environment familiar to
most CPAs.
Jerry
Goldman will demonstrate
an example of AMbER -- advanced multimedia-based experimental
research. AMbER uses a web client to deliver decision-making
experiences and provides full back-end control to investigators
(e.g., controlling access, selecting variables for testing).
The prototype relies on a criminal justice example. Attributes
such as race, dress and affect may be systematically varied or
held constant, depending on the objectives of the investigator.
All data are gathered, analyzed and reported in real time. Click-through
data assist in identifying outliers.
Keynote
Presentation: Academic Standards for the 21st Century
Click
for abstract
Willard
R. Daggett, Ed.D., President, International Center for Leadership
in Education
Willard
R. Daggett, Ed.D., is
President of the International Center for Leadership in Education.
He is recognized worldwide for his efforts to move education
systems towards more rigorous and relevant skills and knowledge
for all students.
Dr. Daggett has assisted several
states and many school districts with their school reform initiatives
as well as worked with education ministries in other countries.
Dr. Daggett serves as the lead consultant for the International
Center's network of highly successful model schools committed
to rigorous and relevant curriculum for all students. These experiences
give him a practical, broad-based perspective to the issues facing
education.
Dr. Daggett is the creator of
the Application Model, which provides a framework to determine
the relevance of curriculum and assessment to real-world situations.
The Application Model is part of the Rigor/Relevance Framework,
which has become a cornerstone of reform initiatives throughout
the United States and the world.
Dr. Daggett founded the International
Center after serving in various management positions at the New
York State Education Department, where he spearheaded a series
of restructuring initiatives to focus the state's education system
on the skills and knowledge students need in today's technological,
information-based society. He has held both teaching and administrative
positions at the secondary, two-year college, four-year liberal
arts college and university levels.
Dr. Daggett is the author of
12 textbooks, four books on educational leadership, numerous
research reports, and many articles in professional publications.
He has addressed audiences in all 50 states and overseas. He
also serves as a consultant to many business organizations.
Workshops
Improve
your conference Return on Investment - and attend Monday's Workshops.
The engaging workshops feature some of the industry's most influential
thinkers and doers. It is your chance to network with senior
testing professionals ... question participants on their current
and future testing strategies ... talk to vendors and gain insights
into future technologies - knowledge that will help you stay
ahead. This year's workshop topics are guaranteed to provide
you with thought-provoking material. Topics were selected based
on surveys and focus groups held with last year's attendees.
Full-Day
Workshops 8:00AM - 3:00PM
Computerized
Adaptive Testing
Click for abstract
Richard
Gershon, Ph.D., President, The Gershon Group; and Donna
Surges Tatum, American Society of Clinical
Pathologists
Converting
from Paper-Based Tests to Computer-Based Tests
Joan Knapp, CEO, Knapp &
Associates; David Meissner, Executive Director of Client and
Prog. Implement, Prometric, a Thomson Learning business; Linda Waters, Ph.D., Managing
Principal, Chauncey Group International; and Bob
Whelan, Vice President, General Manager, NCS Pearson
Designing
Criterion-Referenced Tests
Click for abstract
Bill
Coscarelli, Southern Illinois University; and Sharon
Shrock, Southern Illinois University
Introduction
to Item Response Theory
Click for abstract
Ronald
Hambleton, University of Massachusetts, Amherst
Test
Development from Scratch
Click for abstract
Susan
Davis-Ali, Ph.D., Vice President for Test Development, Experior
Assessments; Julia Leahy,
Principal & Director, Test Development Services, The Chauncey
Group International; Beth Ruiz,
ACT; and David Swanson,
Associate Vice President for Test Development, National Board
of Medical Examiners
Half-Day
Workshops 8:00AM - 11:00AM
Testing
In-House - A 'How to' Guide
Click for abstract
Leon
Gross, Ph.D., Director of Psychometrics & Research, National
Board of Examiners in Optometry; and John
Norcini, Ph.D., Senior Vice President for Evaluation and,
American Board of Internal Medicine
Item
Analysis Tools: An Overview of Currently Available Tools
Click for abstract
Managing
the News Media: Taking Control of Your Media Coverage
Click for abstract
David
Hakensen, Vice President of Public Relations, NCS Pearson
Half-Day
Workshops 12:00PM - 3:00PM
Practical
Concerns for Test Security
Click for abstract
Barbara
Halsey, Computer-Based Testing Quality Director, The Chauncey
Group International; and Fran
Linhart, Director of Certification, CompTIA
Evaluating
Item Types for Computer-Based Testing
Click for abstract
Building
Computer-Based Performance Tests
Click for abstract
Jim
Adair, Ph.D., IBM; Marcia
Andberg, Ph.D., Director of Development, American Guidance
Service; Karen Grygienc, Novell; and Craig Swenson, Novell
Come
join us for the ATP General Meeting!
Whether
you are just getting acquainted with ATP or have been a member
for years, you won't want to miss this year's general meeting.
We have a great line up of presentations. The program begins
with an opening address from our Executive Director, William
G. Harris; followed by a state of the organization address.
Our keynote speaker will then discuss the legal implications
of computer-based testing.
Additionally,
this will be your opportunity to participate in division meetings,
which focus more directly on specific activities of each division
for the coming year.
I hope
you can join us!
Jamie
Mulkey, Ed.D.
President and Chairman, ATP Board of Directors
Worldwide Certification Program Manager, Hewlett-Packard Company
Session
Preview
Focus on Certification/Licensing
Practical Lessons Learned
in Computer-Based Testing
Click for abstract
Gerald
Rosen, Ed.D., Vice President for Programs, Professional Examination
Service; and Donna Surges Tatum,
American Society of Clinical Pathologists
Setting Standards for Web-
and Computer-Based Testing
Click for abstract
Paul
Jones, Ph.D., Director of Psychometrics, Galton Technologies;
Richard Luecht, Ph.D., Director/
Professor/Chair, University of North Carolina, Greensboro; and
Stephen Sireci, Ph.D., Associate
Professor, University of Massachusetts, Amherst
What Types of Validity Evidence
Should You Have in Your Hip Pocket When the Lawyers Come To Call?
Click for abstract
Paul
Naylor, Ph.D., President, Gainesville Independent Testing
Service, LLC; and Thomas Zane,
Ph.D., Director of Assessment, Teachers College for Western
Governors University
Focus on Clinical
Neuropsychological and Other
Performance Monitoring via Networks
Click for abstract
David
Erlanger, Ph.D., President, Headminder, Inc.; Robert
Kane, Ph.D., Baltimore VA; and Dennis
Reeves, Ph.D., Naval Hospital Camp, Pendleton, CA
Objective Test Assessment
on the Internet
Click for abstract
Leigh
Jerome, Clinical Psychologist & Research Scientist, University
of Hawaii; David Pfenniger,
Ph.D.,
Founder/President, Performance Assessment Network (PAN); and
Larry Weiss, Ph.D., Director
of Research & Development, The Psychological Corporation
Training and Evaluation of
Clinical Skills Using Interactive Multimedia
Click for abstract
Marcia
Andberg, Ph.D., Director of Development, American Guidance
Service
Focus on Education
Educational Assessment by
Computer
Click for abstract
Gage
Kingsbury, Northwest Evaluation Association
Electronic Testing in the
K-12 Setting
Click for abstract
Michael
Yoes, Psychometrician, NCS Pearson
The Future of Educational
Assessment by Computer from the Publisher's Perspective
Click for abstract
Margaret
Jorgensen, Vice President for Product Development, Psychometrics,
and Computer-Based Testing; David
Mott, Tests for Higher Standards; Robert
Sykes, Ph.D., Senior Research Scientist, CTB; and Molly
Zebrowski, NCS Pearson
Focus on Industrial/Organizational
Computer-Based Testing Practices
in the Workplace
Click for abstract
Steven Ashworth, Sempra Energy
Legal Issues
Click for abstract
Tom Abrams, Vedder Price
Transition to Technology:
Design and Application Issues with Employment Tests
Click for abstract
Wade Gibson, Psychological Services,
Inc.; and John Weiner, Psychological Services, Inc.
Cross Divisional
A Comparative Analysis Between
IT and Non-IT Programs
Click for abstract
Linda
Althouse, SAS Institute
Anti-Piracy Campaign: An Update
from the IT Security Council
Click for abstract
IT Cert Security Council
Assuring Excellence in Test
Development, Delivery and Analysis
Click for abstract
James
Impara, Ph.D., Buros Institute; and Cheryl
Wild, Ph.D., CQA, Wild and Associates
ATP Computer-Based Testing
Guidelines: Application across Multiple Disciplines
Click for abstract
Cyndy
Fitzgerald, Ph.D., Microsoft Corporation, Michael
Callans, Wonderlic Consulting; William
G. Harris, Ph.D., Association of Test Publishers
Audience Definition: Alternative
JTA Processes
Click for abstract
Jim
Adair, Ph.D., IBM; Gary Moehnke (TBD), IBM; Linda
Montgomery, Ph.D., Director of Research Services, The Chauncey
Group International; and Ray
Talke, Founder/President, Minds in Action, Inc.
Best Practices in Item Banking
for Computer-Based Testing
Click for abstract
Betty
Bergstrom, Ph.D., Computer Adaptive Technologies, Inc.; and
Julia Leahy, Principal &
Director, Test Development Services, The Chauncey Group International
Bias Issues with Computer-Based
Testing
Click for abstract
Richard
Gershon, Ph.D., President, The Gershon Group
Case Studies: Workplace Simulations
Click for abstract
Fritz Drasgow, Professor, University
of Illinois
Case Study: Computer-Based
Testing For Driver Examinations
Click for abstract
Gary
Cleere, European Drivers' License Foundation, Ireland
Computer-Based Testing and
Instruction in the Year 2005
Click for abstract
Shawn
Bird, Ph.D., Co-Founder & President, Exam Solutions;
Andrew Gibbons, Ph.D., Professor,
Utah State University; M. David
Merrill, Utah State University; and James
Olsen, Ph.D., Chief Scientist and Vice President, Alpine
Media Corporation
Cross Pollination - Lessons
Learned From Computer-Based Testing in Different Markets
Click for abstract
Chris
Gruber, Ph.D., Western Psychological Services; William
G. Harris, Ph.D., Executive Director, Association of Test
Publishers; Michael Segovia,
M.A., Director of Business Development & Tech. Marketing,
Consulting Psychologists Press, Inc.; Linda
Waters, Ph.D., Managing Principal, Chauncey Group International;
and Kathleen Williams, Ph.D.,
NCSP, Director, Product Development, American Guidance Service
Detecting Candidate Misconduct
Click for abstract
Ray
Nicosia, Educational Testing Service, Office of Test Security
Evaluating Alternative Item
Types in Computer-Based Testing
Click for abstract
Brian
Bontempo, Ph.D., Microsoft Corporation; Cyndy
Fitzgerald, Ph.D., Microsoft Corporation; Deborah
Kerman, Ph.D., Microsoft Corporation; and Cynthia
Parshall, University of South Florida
Key Problems and Practical
Solutions in Computer-Based Testing Programs
Click for abstract
Ronald
J. Nungester, Ph.D., , Senior Vice President, National Board
of Medical Examiners; Craig
Mills, Executive Director - CPA Exam, American Institute
of Certified Public Accountants
Making Tests Accessible to
Test Takers with Disabilities: New Challenges and New Opportunities
Under the ADA
Click for abstract
Loring
Brinkerhoff, Ph.D.,
Disability Accommodations Specialist, Educational Testing Service
Managing Large Scale Computer-Based
Testing Programs
Click for abstract
Ellen Julian, Director, MCAT,
AAMC; Fran Linhart, Director
of Certification, Computing Technology Industry Association;
Casey Marks, Director of Testing Services, National Council of
State Boards of Nursing; and Don Moretti, Motorola
Online Assessments as an Organizational
Development Tool: Demonstration and Application Overview
Click for abstract
Michael
Segovia, M.A., Director of Business Development & Tech.
Marketing, Consulting Psychologists Press, Inc.
Online Item and Test Development
Click for abstract
Deb
Schnipke, Ph.D., CAT Senior Program Manager and Psychometrician,
Computer Adaptive Technologies, Inc.; and David
Scrams, Ph.D., Microsoft Program Manager and Psychometrician,
Microsoft Corporation
Opportunities and Challenges
of Computer-Based Testing
Click for abstract
Donna
DeAngelis, LICSW, ACSW, Executive Director, Association of
Social Work Boards; and Dawn
Vinson, Liason Council on Certification for the Surgical
Technologists
Psychometric Issues When Using
Multiple Test Distribution Channels
Click for abstract
Jim
Adair, Ph.D., IBM; and Cliff
Donath, President, The Donath Group
Scoring Essays via Computer-Based
Testing
Click for abstract
Mark
Shermis, Ph.D., Florida International University
The Financial Model for Computer-Based
Testing
Click for abstract
David Cox, Professional Testing
Incorporated; Frank Hatcher, Consultant; Don
Wagner, Executive Director, Business Development, VUE, and
NCS Pearson Business; Linda
Waters, The Chauncey Group International
The Key to Developing Computer-Based
Tests - Automated Test Assembly Procedures
Click for abstract
Krista
Breithaupt, Ph.D., Psychometrician, American Institute of
CPA's; Richard Luecht, Ph.D.,
Director/ Professor/Chair, University of North Carolina, Chappel
Hill; and Wim J. van der Linden,
Professor/Chair, University of Twente, Netherlands
The Virtual Classroom: Using
Web Conferencing for Certification Prep
Click for abstract
Jennifer
Harrington, Program Manager, Hewlett-Packard Company; Jamie Mulkey, Ed.D., Worldwide
Certification Program Manager, Hewlett-Packard Company; and Roc Paez, US UNIX Program Manager,
Hewlett-Packard Company
Transitioning From Computer-Based
to Web-Based Testing: Development and Delivery Issues
Click for abstract
Shawn
Bird, Ph.D., Co-Founder & President, Exam Solutions;
Alison Indrisano, Senior
Vice President, Client Services & Support, Prometric, a Thomson
Learning Business; and Anthony
Zara, Ph.D., Vice President, NCS Pearson
Translating Credentialing
Exams: Practical Guidelines and Steps to Insure Validity
Click for abstract
Ronald
Hambleton, University of Massachusetts, Amherst, and Stephen Sireci, Ph.D., Associate
Professor, University of Massachusetts, Amherst
What Clients of Testing Vendors
Want
Click for abstract
Dean
Polk, Second VP, Examinations, LOMA; and Susan
Powell, Director of Account Management, Prometric, a Thomson
Learning business
Who is Representing the Examinee?
Click for abstract
J.
Patrick Jones, Ph.D., Executive Vice President, Professional
Examination Service; and Barbara
Plake, Ph.D., Professor/Director, University of Nebraska
Platinum Sponsor
Session
Adventures In Cyberspace:
Using the Internet for Job Analysis Projects and Survey Delivery
via Web Conferencing - The Chauncey Group International
Click for abstract
Linda
Montgomery, Ph.D., Director of Research Services, The Chauncey
Group International
Automated Scoring Technologies
Used for NAEP Performance Items - Educational Testing Service
Click for abstract
Claudia Leacock, Sr. Computational
Linguist, ETS Technologies, Inc.
CAT At Your Fingertips - Computer
Adaptive Technologies, Inc.
Click for abstract
Brigid
Flood, Business Development Manager, Computer Adaptive Technologies,
Inc.
Computerized Test Development
- Galton Technologies
Click for abstract
Brian
J. Adams, Director of Client Services, Galton Technologies
Implementing a Licensure or
Certification Program - An Insider's Perspective - Prometric,
a Thomson Learning business
Click for abstract
Dave
Meissner, Executive Director of Client and Prog. Implementation,
Prometric, a Thomson Learning business
Implementing Simulations in
a Testing Environment: Going where few have gone before - TestOut
Corporation
Click for abstract
Don Whitnah, Program Manager,
TestOut Corporation; and Kathy
Wright, Ph.D., VP of Research & Development, TestOut
Corporation
Managing Your Item Bank: A
Success Story with Chauncey's TestExpress - The Chauncey Group
International
Click for abstract
Julia
Leahy, Principal & Director, Test Development Services,
The Chauncey Group International
Migrating to Computerized
Testing - Galton Technologies
Click for abstract
David
Foster, Ph.D., Co-Founder/President, Galton Technologies
Publishers' Use of XML-based
Web Services in 2005 - Questionmark
Click for abstract
Eric
Shepherd, Questionmark
Questionmark Perception in
the Learning and Certification Process - Questionmark
Click for abstract
Eric
Shepherd, Questionmark
Technological Advances in
Computer-Based Testing - NCS Pearson
Charles
Johnston, Ph.D., Vice President-Program Management, VUE,
an NCS Pearson Business; Don
Wagner, Executive Director, Business Development, VUE, an
NCS Pearson Business; Bob Whelan,
Vice President, General Manager, NCS Pearson; and Anthony
Zara, Ph.D., Vice President-Professional Licensing &
Cert., NCS Pearson
UTD: Explore the Possibilities
of The Future Today - Prometric, a Thomson Learning business
Click for abstract
Eric
Wenck, Executive Director of Product Strategy and Deployment,
Prometric, a Thomson Learning business
Post Conference Workshops
Information Technology Certificaiton
Security Council (ITCSC) Introductory Meeting
Click for abstract
IT Certification Security Council
Special Interest Group: Advancing
Performance Testing
Click for abstract
Jim
Adair, Ph.D., IBM
Join
the Association of Test Publishers as we recognize
Click
for abstract
Benjamin D. Wright, Ph.D. by honoring him
with the Career Achievement Award in Computer-Based Testing.
Dr. Wright
is Professor of Education and Psychology at the University of
Chicago and Director of the Mesa Psychometric Laboratory. He
has published 150 papers on Rasch measurement; authored 12 books,
including Best Test Design and Rating Scale Analysis and developed
the two most widely used Rasch measurement computer programs,
WINSTEPS and Facets. Dr. Wright has taught annual workshops and
courses on Rasch measurement since 1969 and chaired 70 doctoral
dissertations on that topic. Many of his students are contemporary
leaders in psychometrics.
|