Project Manager Testing
Resume:
ALAN C. BUGBEE, JR.
Naperville, IL 60540
312-***-**** (cell)
********@******.***
POST-DOCTORAL EMPLOYMENT
Psychometric Consultant
A. B. Consulting
July 1986 - May 1999, February 2001 - Present
I have served as Research, Assessment, Statistical, and Psychometric
Consultant to numerous governmental, public, and private clients. See Other
Activities section for detail.
Director of Psychometrics and Research
Board of Registry
American Society for Clinical Pathology
Chicago, IL
January 2007 - August 2009
Responsible for all aspects of psychometrics and research at the American
Society for Clinical Pathology-the oldest user of computer-adaptive testing
for certification in the world-including developing and overseeing the
questions and examinations used in the 20 Computer-Adaptive certification
tests given by ASCP. Also responsible for all research projects related to
testing and evaluation. Served as liaison to the Board of Governors
Research & Development Committee. Principal among my duties was to assure
understanding of the tests and questions and the results of the
certification in the fields of clinical pathology. I was also responsible
for conducting practice analysis/job analysis surveys for each examination
type given by ASCP and assisting in achieving and retaining ANSI
accreditation. In addition to my principle accountabilities in the Board of
Registry, I worked with different areas in ASCP to help with their
programs. This included research projects related to ASCP international
initiatives with the Research & Development Institute, analyses of national
proficiency testing results from US pathologists and cytotechnologists,
analyses of the national resident in service examination (RISE) for
pathologists, and qualitative and quantitative assessment of specific ASCP
educational products. As director, I was responsible for administering the
Examination Activities Departments, including test scoring and test
development. Served as consultant in surveys, research, statistics, and
psychometrics to all parts of the ASCP organization and boards.
Director of Psychometrics and Research
National Board of Osteopathic Medical Examiners
National Center for Clinical Skills Testing
Conshohocken, PA
January 2006 to June 2006
I was responsible for helping lead the National Center for Clinical Skills
Testing of the National Board of Osteopathic Medical Examiners in providing
the best examinations possible in the osteopathic medical areas. This
included responsibility for ensuring that the Clinical Skill examinations
at NBOME are psychometrically sound and offer the most accurate, valid,
reliable, and defensible measures of candidates' clinical skills. Major
parts of this were: maintenance of the scaling and equating parameters
(IRT, Classical, and Generalizability), data collection and aggregation
from multiple sources, and assurance that all parties involved in the
development and scoring procedures provide the highest level of
examinations available. I worked cooperatively with information systems
staff, test developers, and standardized patient trainers and managers to
ensure quality of the examinations. I was responsible for conducting and
reporting on research relating to the clinical skills tests and to their
relationships to other measures, field experience, education, candidate
internships, and residencies, and methods of testing. I disseminated
research and operations reports to medical and psychometric communities,
NBOME Board, senior staff, case developers, and standardized patient
trainers. I was also responsible for verifying and checking on incidents
which may occur within the testing encounters, including recommending and
implementing alternate scoring methods and strategies, and coordinating
policies and procedures for handling exam irregularities. In conjunction
with these activities, I was responsible for communicating the results of
the examinations to organizations, committees, and staff.
Assistant Dean of Assessment/Associate Professor
School of Education
North Carolina Agricultural and Technical State University
Greensboro, NC
August 2004 - December 2005
I was responsible for all aspects of assessment within the School of
Education, with special attention to NCATE and SACS accreditation. This
included the implementation of the teacher education assessment system
(tracking system) that collects and analyzes data on candidates from
initial identification/recruitment through two years of
employment/induction, in addition to data on faculty, program operations,
and school functions and operations. I worked extensively with other
schools and colleges within the University in mutual and university-wide
programs. I also taught a graduate core course in educational research,
design, and statistics, and helped develop and implement the research
components of the University's new Ph.D. program in Leadership Studies. I
was also responsible for identifying honors students and helping them gain
and retain summer internships, scholarships, and fellowships. I served on a
number of university committees, including the new interdisciplinary core
courses committee, the Academy of Teaching and Learning Advisory Board, and
the McNair Scholars Advisory Board. In addition, I worked on a number of
faculty committees within the School of Education, particularly the
Benchmarks and Barriers Committee for graduate students in the School of
Education. I also worked with a number of faculty members at the
University, helping them with research design, statistical analysis, and
measurement in their various research projects. In addition, I am Co-
Principal Investigator or Research/Statistician on a number of externally
funded projects and applications.
Vice President, Technical & Development Services
Environmental Health Testing, LLC/National Registry of Food Safety
Professionals
Orlando, FL
January 2002 - December 2003
As Vice President, Technology and Development Services, I was responsible
for all aspects of business related to research, development, and
certification. This included examination development, job analysis, test
validation, question development, item analysis, test scoring, testing
systems (paper-and-pencil & computerized), liaison with external vendors,
administrators, and providers, test reporting, research, and evaluation. A
primary accomplishment was earning accreditation (with six commendations)
for EHT from the Conference for Food Protection/American National Standards
Institute (ANSI-CFP), awarded on September 3, 2003. In 2002, I ran the
entire organization. During this period, the number of tests given by the
organization rose from 21,264 examinations per year to 37,210 examinations
per year, a 75% growth. Concurrently, I was responsible for stabilizing the
staff (100% retention), which had a high turn over rate (300%) before my
taking over management of the organization. At the same time, I maintained
EHT's recognition by the national accreditation body, the Conference for
Food Protection (CFP). I added nine new recognized examinations; seven in
English and two in Spanish. In accordance with EHT's need to protect the
public and certify appropriate food safety personnel, during my time, EHT
had tests in nine languages - English, Spanish, French, Chinese, Japanese,
Korean, Arabic, German, and Vietnamese. In conjunction with administering
EHT, I served as an active member of the CFP Food Protection Manager
Training, Testing and Certification Committee, to help assure that the
public is protected from food related problems, by certifying minimal
competence among the practitioners.
Vice President of Research and Development
Columbia Assessment Services
Research Triangle Park, NC
May 1999 - April 2001
I was responsible for all Research and Development functions of CAS,
including, but not limited to, responding to Request for Proposals (RFPs),
writing proposals, negotiating contracts, and developing and refining
business strategic plans. I planned new ventures for CAS, helping to set
the course of business. As Senior Psychometrician/Researcher, I was
responsible for all tasks dealing with computerized testing and complex
test and measurement concepts, and addressing these issues for clients. I
acted as project manager for client organizations using computerized
testing and a number of other clients, as needed. This included providing
on-going psychometric consultation and leadership, conducting program
evaluations, performing role delineation/job analysis studies, developing
test blueprints, developing and assembling examinations (written, computer
administered, simulation, practical), conducting cut-score workshops,
equating examination versions, and performing statistical and psychometric
analyses of examination results. As Vice President of Research &
Development, I represented CAS as professional conferences and meetings.
This included professional presentations and meeting with current and
potential clients. I also represented CAS in Research Organizations,
including NOCA, CLEAR, AERA, and NCME.
Director, Psychometric Services
American Registry of Radiologic Technologists
St. Paul, MN
April 1997 - December 1998
As Director of Psychometric Services, I had direct responsibly for the
assessment component of ARRT's certification programs. This included
examination and informational materials development, examination assembly
and production, examination scoring, analysis, and reporting, educational
technology, and institutional research. A principle duty was converting
ARRT's tests from paper-and-pencil to computerized examinations. I was
responsible for the management of psychometric personnel, budgeting and
procurement authorization for the division, strategic planning for the
department, setting of goals and objectives of the department, and
providing support to the Board of Trustees on testing, psychometrics,
research, and any other assigned issues. I led the job analyses projects
and led the planning, design, development, construction, analysis, and
administration of new examinations. I assisted the Executive Director in
the identification, long range/strategic planning, and implementation of
policies affecting Psychometric Services and any other areas, as assigned.
In addition, I conducted research for ARRT and served as consultant in
research design, statistics, educational technology, and analysis to the
ARRT staff.
Various Positions (see below)
The American College
Bryn Mawr, PA
July 1986 - April 1997
During my 11 years with The American College, I served in positions with
progressively more responsibility and authority in such diverse areas as
Examinations, Evaluation, Computer Science, Distance Education Technology,
and Student Counseling and Assistance. Of particular note are my creation
of the College's current testing program, which assesses the students by
computer throughout the world, the Student Evaluation Program, and the
Student Information System. The last positions I held were Director of
Educational Systems, Associate Professor of Psychology, and WebMaster. In
them, I was responsible for setting the standards for, overseeing,
budgeting, and evaluating the college's examination systems, evaluating the
college's educational programs, serving as principal consultant to the
college in technological matters which impact education, assisting the
faculty and students in the design and understanding of psychometric and
statistical research studies and findings, thesis advisor and educator of
Graduate students in research design and measurement, and conducting
original research in measurement, program evaluation, education, and
psychology. Several of my research studies have become the standard for the
administration of computerized testing by a number of leading vendors. I
served as the primary psychometrician and statistician for the college. As
WebMaster, I was in charge of planning, designing, constructing,
maintaining, and administering the College's Home Page on the Internet. I
also served on a number of college-wide activities including the
Recruitment and Retention Committee, Student Information Services Database
System Steering Committee, and Presidential Task Forces on Remote Site
Examination Delivery, Student Attrition and Retention, and Reaccredidation.
Other positions I held at The American College were: Assistant Professor of
Psychology (July 1986-June 1991); Director of EOD, Written Examinations,
and Research (January 1988-July 1988); Director of EOD (Computer-
Administered Testing) and Research (August 1987-December 1987); and
Director of Examination Research (July 1986-August 1987)
Quality and Measurement Specialist
Field Engineering Educational Services
Data General Corporation, Woodstock, CT.
January 1984 - June 1986
A multi-faceted position, drawing heavily on educational and experimental
background. The principle aspects of this job included: 1. Consultant on
test construction, working in conjunction with Curriculum Development
Department (new courses) and Field Engineering Training Center (existent
and revised courses); 2. Psychometrician responsible for the validation of
tests used in Field Engineering Training Center; 3. Evaluator of 6-month
follow-up studies on the effectiveness of: a. select courses in Field
Engineering Training Center and b. Computer Assisted Instruction (CAI)
courses; 4. Instructor in the construction, utilization, scoring, and
interpretation of tests and test items; 5. Lecturer on the uses and
interpretation of SPSS-X and programming in PL/1; 6. Programmer, in PL/1,
FORTRAN (5 & 77), and BASIC, of test scoring, item analysis, and
interactive statistical programs for use in evaluation and validation of
tests; 7. Author of two "How-to" guides and several manuals for test and
item construction and test system usage; 8. Consultant on testing aspects
of divisional projects.
Instructor in Anesthesiology/
Coordinator, Medical Student Program
Department of Anesthesiology
School of Medicine
University of Pittsburgh
Pittsburgh, PA
August, 1983 - December, 1983
Responsible for research in education of medical students and resident
training in Anesthesia and Critical Care Medicine at the University of
Pittsburgh. Administrator of programs in Anesthesiology for medical
students. Research Design, Measurement, and Statistics consultant and
analyst to the faculty of the Anesthesiology/Critical Care and Surgical
departments.
EDUCATION
Doctor of Philosophy, University of Pittsburgh; August 9, 1983.
Education Research Methodology
Academic Advisor: Dr. Richard C. Cox; Research Advisor: Dr. William Cooley
Doctoral student, University of Missouri-Columbia; August 1979 - August
1980.
Educational Psychology
Advisor: Dr. Mark Reckase
Master of Public Administration, George Washington University; September 30
1977.
Public Administration; Advisor: Dr. Michael Harmon
Master of Arts in Education, George Washington University; May 5, 1976.
Rehabilitation Counseling; Advisor: Dr. Daniel Sinick
Bachelor of Arts, University of Vermont; May 20, 1973.
Major: Comparative Religion; Minors: Philosophy, Art; Advisor: Dr. William
Paden
CERTIFICATION
School Psychological Examiner, Missouri
Issued April, 1980; Lifetime certification
Management System Lead Auditor ISO/IEC 17024, American National Standards
Institute/Excel Partnership, Inc. Washington, DC
Certificate No. 28717, Issued 06/27/2002, Renewed Annually
HONORS and AWARDS
Certificate of Appreciation, National Organization for Competency
Assurance, 2000
Excellence Award, net-tests.com, 1999
Scottish Rite Fellow, George Washington University, 1976, 1977 (M.P.A.)
National Institute of Mental Health Trainee, George Washington University,
1974 - 1976 (M.A.Ed.)
Bachelor of Arts, Summa cum laude, University of Vermont, 1973
Boulder Society (Senior Men's Honorary) University of Vermont, 1972
OTHER ACTIVITIES
Lead Assessor, American National Standards Institute, Refrigerating
Engineers & Technicians Association accreditation assessment, Salinas, CA,
2009-present.
Member, Association of Test Publishers Planning Committee, 2008-2009, 2009-
2010.
Chair, Survey Sub-Committee, Association of Test Publishers, 2008-2009.
Membership Committee, American Educational Research Association, Division
D, 2007-2009.
Author (with M. Lunz)/Invited Speaker. Does changing answers on a Computer
Adaptive Test make any differences? Does ability matter? III European
Congress of Methodology, Oviedo, Asturias, Spain, July 8 - 12, 2008.
Author, with R. A. Goulart, L. Lemon, R. Metzler (2007). Community
Performance Characteristics of Validated Slides in Proficiency Testing: The
American Society for Clinical Pathology GYN PT Program, American Society
for Cytopathology annual meeting, Houston, Texas
Principal Investigator, Laboratory Professionals Workforce Survey, Abbott
Fund grant, 2007.
Lead Assessor, American National Standards Institute, Crane Operator
Certification accreditation assessment, National Center for Construction
Education and Research, Gainesville, FL, 2007-present.
Co-Principal Investigator, with D. Boger, PI, R. Hagevik, Co-PI, and L.
Powers, Co-PI. Content mentoring and its impact on middle grades
mathematics and science teacher effectiveness. NSF ESI - 0554441, July 1,
2006 - June 30, 2009.
Lead Assessor, American National Standards Institute, Construction Manager
Certification Institute accreditation assessment, Construction Management
Association of America, McLean, VA, 2006-present.
Discussant, Polytomous IRT Methods for Scoring and Linking, Annual meeting
of the National Council on Measurement in Education, Montreal, April 2005.
Guest Speaker, The Anna Julia Cooper Research Seminars, "How to Do
Research," March 14, 2005.
Member, Academy for Teaching and Learning Advisory Board, 2004 - 2005.
Member, McNair Scholars Advisory Board, North Carolina A & T State
University, 2004 - 2005.
Co-Principal Investigator, with L. Vickers, PI, D. Boger, Co-PI, and L.
Powers, Co-PI. The relationship among mentoring, content, pedagogy, teacher
knowledge of growth and development, diversity and technology on student
outcomes - A planning grant. NSF ESI - 0353403.
Member, Teacher Education Council, North Carolina A & T State University,
2004 - 2005.
Board Member, Florida Fossil Hunters, 2004.
Assessor, American National Standards Institute, American Society for
Nondestructive Testing accreditation assessment, Columbus, OH, 2002-2007.
Member, Workshop Committee, National Organization for Competency Assurance,
2003.
Member, CFP Manager Training, Testing and Certification Committee,
Conference for Food Protection, 2002 - 2003.
Volunteer Psychometric Consultant, Accreditation Council, American Board of
Nursing Specialties, since 2001.
Psychometric Consultant, RMC Project Management, 2001.
Psychometric Consultant, National Council of Examiners for Engineering and
Surveying, 2001.
Examination Resources & Advisory Committee, Publications & Communications
Subcommittee, Credentialing & Examination Issues Subcommittee - Council
on Licensure, Enforcement and Regulation, 2000.
Invited Speaker, Conversion: Changing from paper-and-pencil to computerized
testing, Results '99 Conference, Palm Springs, CA, September 1999.
Nominating Committee, American Educational Research Association, Division
I, 1999 - 2001.
Psychometric Consultant, Columbia Assessment Services, Inc., Research
Triangle Park, NC 1999.
Psychometrics/Certification Consultant, Certification Program for Reverse
Mortgage Counselors, AARP Foundation, Washington, DC. 1998 - 2008.
Chair, Publications Committee, National Organization for Competency
Assurance, 1998 - 1999, 1999 - 2000; Member, 1997 - 1998, 2001 - 2002.
Nominating Committee, National Organization for Competency Assurance, 1998
- 1999.
Psychometric Consultant, The American College, Bryn Mawr, PA, 1997.
Reviewer, FY 1996 Safe and Drug-Free Schools Program's Federal Activities
grants, Office of Elementary and Secondary Education, U.S. Department of
Education.
Discussant, Technical Issues in Computer Adaptive Testing I, Annual meeting
of the National Council on Measurement in Education, New York, NY, April,
1996.
Consultant/Editor, National Organization for Competency Assurance
Editor/Author/Creator, Bytesize: Newsletter to Raise Awareness about
Technology
Reviewer, FY 1995 Family And Community Endeavor Schools Grant Programs:
Community Schools and FACES, Family and Youth Services Bureau,
Administration on Children, Youth and Families, U.S. Department of Health
and Human Services.
Reviewer, Head Start Expansion Competition for Served Areas, 1994
Discretionary Grants Program, Administration on Children, Youth and
Families, U.S. Department of Health and Human Services.
Psychometric Consultant, Bureau of Professional and Financial Regulation,
Bureau of Insurance, State of Maine, 1993 - 1994.
Reviewer, American Educational Research Association, Division I, Annual
Conference proposals. Since 1995.
Manuscript Reviewer, Journal of Educational Measurement. Since 1994.
Psychometric Consultant, Professional Examination Service, New York, NY.
1993 - 1994.
Reviewer, American Educational Research Association, Division D, Annual
Conference proposals. Since 1993.
Member, Budget and Finance Committee of the National Council on Measurement
in Education. 1993 - 1994, 1994 - 1995, 1995 - 1996.
Reviewer, Head Start and University Partnerships, 1992 Coordinated
Discretionary Funds Program, Administration on Children, Youth and
Families, U.S. Department of Health and Human Services.
Manuscript Reviewer, Educational measurement: Issues and Practice. Since
1992.
Psychometric Consultant, The Roach Organization, Schaumburg, IL. 1992 -
1993.
Psychometric Consultant, Banyan Systems, Inc., Westborough, MA. 1991.
Editorial Board, Duke University Press: National Collegiate Software. Since
1989.
Judge, Behavioral/Social Sciences, Delaware Valley Science Fairs. April
1990 - April 1996.
Reviewer, National Council on Measurement in Education, Annual meeting
presentations. Since 1988.
RESEARCH AND PUBLICATIONS
(in press). Law School Admission Test review. Test Critiques (Vol. XI).
Austin, TX: PRO-ED.
(in press). Role Delineation Study for Certification as Diplomate in
Chiropractic Rehabilitation. Morrisville, NC: CASTLE Learning, Inc.
(2009). Practice Analysis - Medical Technologist. Chicago: American Society
for Clinical Pathology.
(2009). Practice Analysis - Medical Laboratory Technician. Chicago:
American Society for Clinical Pathology.
(2009). Practice Analysis - Cytotechnologist. Chicago: American Society for
Clinical Pathology.
(2009). Practice Analysis - Pathologists' Assistant. Chicago: American
Society for Clinical Pathology.
(2009). Thompson, N. N., Tanabe, P., Holladay, E. B., Andrea Bennett, A. &
Steward, C. A. The current state of medical laboratory staffing with
certified versus noncertified personnel. Laboratory Medicine, 40(4), pp.
197-202.
(2009). With Bennett, A., Thompson, N. N., Holladay, E. B., & Steward, C.
A. ASCP wage & vacancy survey of the U.S. medical laboratories. Laboratory
Medicine, 40(3), pp. 133-141.
(2009, Spring). Joint Survey - ASCP BOR, NAACLS, NCA, AMA. BOR Newsletter,
p. 3.
(2008). Flow Cytometry needs assessment. Chicago: American Society for
Clinical Pathology.
(2008). Cytotechnology Work Force Study. Chicago: American Society for
Clinical Pathology.
(2008). Interpreting test and item statistics: Computer adaptive testing -
The Rasch model. Chicago: American Society for Clinical Pathology.
(2007). ASCP Board of Registry Research 1993-2007: An Annotated
Bibliography. Laboratory Medicine, 38(10)
(2007). ASCP Board of Registry's 2006 Annual Survey of Medical Laboratory
Science Programs. Laboratory Medicine, 38(8), pp. 463-471.
(2005). [Review of Illness Effects Questionnaire Skills - Multi-
Perspective]. In R. A. Spies & B. S. Plake (Eds.). The Sixteenth Mental
Measurements Yearbook (pp. 462-464). Lincoln, NE: Buros Institute of
Mental Measurement.
(2005). [Review of Iowa Tests of Educational Development - Forms A and B].
In R. A. Spies & B. S. Plake (Eds.). The Sixteenth Mental Measurements
Yearbook (pp. 485-488). Lincoln, NE: Buros Institute of Mental
Measurement.
with L. Vickers, L. Powers, & W. V. Cobitz (2005). Forest Park Elementary
School evaluation. Greensboro, NC: North Carolina A & T State University.
(2004). Reverse Mortgage Counselor Examination: Demographics and
performance. Washington, DC: AARP Foundation.
with S. Caulk & M. Smolenski (2004). American Board of Perianesthesia
Nursing Certification accreditation application for initial accreditation
of the CPAN and CAPA examination programs review. Washington, DC:
American Board of Nursing Specialists.
with L. Wehrle. (2004). Annual surveillance report for ANSI accreditation
renewal from American Society for Nondestructive Testing review.
Washington, DC: American National Standards Institute.
(2004). Reverse Mortgage Counselor Examination: Test statistic and item
analysis. Washington, DC: AARP Foundation.
(2003). Environmental Health Testing L.L.C. Application for ANSI (American
National Standards Institute)-CFP (Conference for Food Protection)
Accreditation. Orlando, FL: Environmental Health Testing.
(2003). 2002 Annual Examination Summary Report. Orlando, FL: Environmental
Health Testing.
with L. Wehrle. (2002). American Society for Nondestructive Testing
application for ANSI accreditation review. Washington, DC: American
National Standards Institute.
(2002). CostCo training vs. Fifteen hour training. Orlando, FL:
Environmental Health Testing, LLC.
with J. Parker & C. M. Murphy. (2002). Council for Certification of Nurse
Anesthetists application for renewal of approval by the American Board of
Nursing Specialists review. Washington, DC: American Board of Nursing
Specialists.
with S. Caulk & M. Smolenski (2002). American Board of Neuroscience Nursing
application for ABNS accreditation review. Washington, DC: American Board
of Nursing Specialists.
(2002). Developing the Reverse Mortgage Counselor Examination: Test
statistics, demographics and performance, and item analysis. Washington,
DC: AARP Foundation.
with A. H. Browning. (2001). Cost benefit analysis for psychometric
services. Clemson, SC: National Council of Examiners for Engineering and
Surveying.
with B. Bergstrom and P. Meehan. (2001). Certification testing on the
internet. Washington, DC: National Organization for Competency Assurance.
(2001). Certification examinations. Des Plaines, IL: Examination Board of
Professional Home Inspectors.
(2000). National Institute for Certification in Engineering Technologies
Program Review. Morrisville, NC: Columbia Assessment Services, Inc.
(2000). Custom Electronic Design and Installation Association: Job analysis
study for Installer II. Morrisville, NC: Columbia Assessment Services,
Inc.
(2000). Industrial Profile - Testing: The State of the Art in Measurement
2000. Morrisville, NC: Columbia Assessment Services, Inc.
(2000, December). American Board of Chiropractic Orthopedists Program
Evaluation. Morrisville, NC: CASTLE Learning, Inc..
with J. Henderson (2000, September). Steps in the development of the
certification examination for Psychiatric Rehabilitation Practitioners.
PSR Connection, Issue 5.
(2000, May). American Board of Industrial Hygiene: Job analysis study for
Associate -Level Industrial Hygienists. Morrisville, NC: Columbia
Assessment Services, Inc.
(2000, May). American Board of Industrial Hygiene: Job analysis study for
Certified Industrial Hygienists. Morrisville, NC: Columbia Assessment
Services, Inc.
(2000, April). Understanding your test score: Reverse Mortgage Counselors
examination. Washington, DC: AARP Foundation.
(2000, March). Relationship of types of training to performance on the
Reverse Mortgage Counselors examination. Washington, DC: AARP Foundation.
(2000, March). Reverse Mortgage Counselors pilot examination. Morrisville,
NC: Columbia Assessment Services, Inc.
(2000, February) Setting cut scores in percentage correct with item
response theory (2nd ed.). Morrisville, NC: Columbia Assessment Services,
Inc.
(2000, February) Equating (3rd ed.). Morrisville, NC: Columbia Assessment
Services, Inc.
(2000, January). Test and test question criteria (for AARP Foundation
Reverse Mortgage Counseling Examination). Morrisville, NC: Columbia
Assessment Services, Inc.
(1999, December). Estimating reliability of the cut score for a single
administration of a test: Classical theory. Morrisville, NC: Columbia
Assessment Services, Inc.
(1999, December). Board of Certified Safety Professionals (BCSP): Job
analysis study of the Certified Safety Professional and the Associate
Safety Professional. Morrisville, NC: Columbia Assessment Services, Inc.
(1999, December). Diagnostic and practice testing. Morrisville, NC:
Columbia Assessment Services, Inc.
(1999, December). With S. Bublitz and D. Fandel. You can teach an old dog
new tricks: Training raters for the National Athletic Trainers
Association. Paper presented at the annual conference of the National
Organization for Competency Assurance, San Diego.
(1999). Developing the Reverse Mortgage Counselor Examination: Interim
report. Washington, DC: AARP Foundation.
(1998, September). Sonography exam. Educator Update, 5.
(1998, September). Computer-based testing. Educator Update, 6-7.
(1998, September). Job analysis project. Educator Update, 7.
(1998). ARRT Job Analysis Project: Radiography. St. Paul, MN: American
Registry of Radiologic Technologists.
(1998). ARRT Job Analysis Project: Radiation Therapy Technology. St. Paul,
MN: American Registry of Radiologic Technologists.
(1998). ARRT Job Analysis Project: Nuclear Medicine Technology. St. Paul,
MN: American Registry of Radiologic Technologists.
(1998, June). Sonography. In American Registry of Radiologic Technologists
Board of Trustees Report (pp. 119-124.13, 478.1-485). St. Paul, MN:
American Registry of Radiologic Technologists.
(1998, June). Job Analysis Update. In American Registry of Radiologic
Technologists Board of Trustees Report (pp. 127-144, 487-520). St. Paul,
MN: American Registry of Radiologic Technologists.
(1998, June) Simulations. In American Registry of Radiologic Technologists
Board of Trustees Report (pp. 145-146, 521-525). St. Paul, MN: American
Registry of Radiologic Technologists.
(1998, June). Multiskilling (Bone Densitometry, EKG, Phlebotomy). In
American Registry of Radiologic Technologists Board of Trustees Report
(pp. 160-162, 527-530). St. Paul, MN: American Registry of Radiologic
Technologists.
(1998, June). Milestone or In-Training Examinations. In American Registry
of Radiologic Technologists Board of Trustees Report (pp. 119-124.13, 531-
533). St. Paul, MN: American Registry of Radiologic Technologists.
(1998, June). Selling Exam Services. In American Registry of Radiologic
Technologists Board of Trustees Report (pp. 119-124.13, 535-538). St.
Paul, MN: American Registry of Radiologic Technologists.
(1998). [Review of Ramsay Corporation Job Skills - Instrument Technician].
In J. C. Impara & B. S. Plake (Eds.). The Thirteenth Mental Measurements
Yearbook (pp. 515-517). Lincoln, NE: Buros Institute of Mental
Measurement.
(1998). [Review of Ramsay Corporation Job Skills - Mechanic Evaluation
Test]. In J. C. Impara & B. S. Plake (Eds.). The Thirteenth Mental
Measurements Yearbook (pp. 815-817). Lincoln, NE: Buros Institute of
Mental Measurement.
(1998, April). Computer-based testing. Annual report to Registered
Technologists, 6.
(1998, April). Job analysis project. Annual report to Registered
Technologists, 6.
(1998, April). 1997 examination results. Annual report to Registered
Technologists, 11-12.
(1998, March). Computer-based testing. Educator Update, 1, 5.
(1998, March). Job analysis project. Educator Update, 1, 5.
(1998, March). 1997 examinee trends. Educator Update, 4.
(1998, January). Computerized testing. In American Registry of Radiologic
Technologists Board of Trustees Report (pp. 70-74, 623-634). St. Paul,
MN: American Registry of Radiologic Technologists.
(1998, January). Sonography. In American Registry of Radiologic
Technologists Board of Trustees Report (pp. 95, 647-668). St. Paul, MN:
American Registry of Radiologic Technologists.
(1998, January). Job Analysis Update. In American Registry of Radiologic
Technologists Board of Trustees Report (pp. 97, 669-688). St. Paul, MN:
American Registry of Radiologic Technologists.
(1998, January). Multiskilling. In American Registry of Radiologic
Technologists Board of Trustees Report (pp. 110, 689-699). St. Paul, MN:
American Registry of Radiologic Technologists.
(1997). Using the Internet for Insurance and Financial Services. In J. J.
McFadden (Ed.). Financial Planning 2000: The American College's Guide to
The State of the Art for Financial Services Professionals (pp. 12.1-
12.23). Bryn Mawr, PA: The American College.
(1997, September). Computer-based testing. Educator Update, 1, 3-4.
(1997, September). Job analysis update. Educator Update, 1.
(1997, September). Sonography exam. Educator Update, 4.
(1997, April). Bytesize: Newsletter to Raise Awareness about Technology
3(1), Internet.
(1996, December). Bytesize: Newsletter to Raise Awareness about Technology
2(4), Databases.
(1996). With A. H. Browning and M. A. Mullins (Eds.). Certification: A NOCA
Handbook. Washington, DC: The National Organization for Competency
Assurance.
(1996). Interpreting test and item statistics IV. (Educational Systems
Technical Report 96-1). Bryn Mawr, PA: The American College.
(1996, August). Bytesize: Newsletter to Raise Awareness about Technology
2(3), Presentations.
(1996). The equivalence of paper-and-pencil and computer-based testing.
Journal of Research on Computing in Education, 28(3), pp. 282 - 299.
(1996, April). Bytesize: Newsletter to Raise Awareness about Technology,
2(2), Spreadsheets.
(1996, Spring). Faculty corner: We have a new address!
http://www.amercoll.edu. The American College Outlook. Bryn Mawr, PA: The
American College.
(1996, January). Bytesize: Newsletter to Raise Awareness about Technology,
2(1), Word Processing.
(1995). [Review of Allied Health Professions Admissions Test]. In J. C.
Conoley & J. C. Impara (Eds.). The Twelfth Mental Measurements Yearbook
(pp. 67 - 68). Lincoln, NE: Buros Institute of Mental Measurement.
(1995). [Review of Optometry Admission Test]. In J. C. Conoley & J. C.
Impara (Eds.). The Twelfth Mental Measurements Yearbook (pp. 713 - 715).
Lincoln, NE: Buros Institute of Mental Measurement.
(1995, October). Bytesize: Newsletter to Raise Awareness about Technology,
1(3), Computer Suites.
(1995, August). Bytesize: Newsletter to Raise Awareness about Technology,
1(2), Computer Networks.
(1995). [Review of Donald A. Norman's Things that make us smart]. Social
Science Computer Review, 13(1), pp. 123-126.
(1995). Pomp and circumstance: Guidelines, origin, and history of academic
costume and ceremony. Bryn Mawr, PA: The American College.
(1995, May). Bytesize: Newsletter to Raise Awareness about Technology,
1(1), What is Bytesize?
(1995). Interpreting test and item statistics III. (Educational Systems
Technical Report 95-1). Bryn Mawr, PA: The American College.
(1994). Chartered Financial Consultant: A statistical program evaluation.
(Examination Research Report No. 94-3). Bryn Mawr, PA: The American
College.
(1994). First-time takers. (Examination Research Report No. 94-2). Bryn
Mawr, PA: The American College.
(1994). [Review of Small Blue Planet: The Electronic Satellite Atlas].
Social Science Computer Review, 12(2), 319 - 322.
(1994). [Review of Computer Anxiety Index (Version AZ), Revised]. Test
Critiques (Vol. X, pp. 164 - 171). Austin, TX: PRO-ED.
(1994). Test vendors, test sites, and test performance. (Examination on
Demand Report 9). Bryn Mawr, PA: The American College.
(1994). Time and testing. (Examination Research Report No. 94-1). Bryn
Mawr, PA: The American College.
(1993). [Review of CRUNCH Statistical Package, Version 4]. Social Science
Computer Review, 11(4), 556-558.
(1993). Strategies for converting from paper-and-pencil to computerized
testing. New York: Professional Examination Service.
(1993). A study of the equivalence of paper-and-pencil and computer-based
testing. New York: Professional Examination Service.
with F. Bernt. (1993). Study practices and attitudes related to academic
success in a distance learning program. Distance Education, 14(1), 97-
112.
with F. Bernt. (1992). TIME'S UP! A comparison of the effects of time
constraints and mode of administration on student performance on and
perception of tests. Journal of Research on Computing in Education,
25(2), 243-253.
(1992). Examination on demand: Findings in ten years of testing 1982 -
1991. Schaumburg, IL: TRO Learning.
(1992). [Review of Dole Vocational Sentence Completion Blank]. Test
Critiques (Vol. IX, pp. 193 - 200). Austin, TX: PRO-ED.
(1991). [Review of Group Achievement Identification Measure (GAIM)]. Test
Critiques (Vol. VIII, pp. 235 - 240). Austin, TX: PRO-ED.
with F. Bernt. (1990). Testing by computer: Findings in six years of use
1982-1988. Journal of Research on Computing in Education, 23(1), 87-100.
with F. Bernt & R. D. Arceo. (1990). Factors influencing student resistance
to computer-administered testing. Journal of Research on Computing in
Education, 22(3), 265-275.
with F. Bernt. (1990, April). Study practices of adult learners in distance
education: Frequency of use and effectiveness. Paper presented at the
annual meeting of the American Educational Research Association, Boston.
(1989). Statistical Navigator, Version 1.0 review. Social Science Computer
Review, 7(3), 384 - 386.
(1989). The Satellite Testing experiment. (Examinations on Demand Report
8). Bryn Mawr, PA: American College.
(1989). Interpreting test and item statistics II. (Examination Systems
Technical Paper No. 89-1). Bryn Mawr, PA: American College.
with F. Bernt & J. Bajtelsmit. (1989). Distance education technology and
The American College. (Distance Education Technology Report No. 89-1).
Bryn Mawr, PA: American College.
with F. Bernt. (1989, April). Classical testing by computer: Findings in
six years of use 1982-1988. Paper presented at the meeting of the
International Association for Computing in Education, San Francisco.
with R. D. Arceo & F. Bernt. (1989). Which exam should I demand?
(Examination Research Report No. 89-1). Bryn Mawr, PA: American College.
(1988). Pass ratios and cutpoints. (Examination Systems Technical Paper No.
88-2). Bryn Mawr, PA: American College.
with F. Bernt. (1988). EOD survey results. (Examinations on Demand Research
Report 7). Bryn Mawr, PA: American College.
(1988). Interpreting test and item statistics. (Examination Systems
Technical Paper No. 88-1). Bryn Mawr, PA: American College.
with F. Bernt. (1988). Your time is up! An assessment of time limits for
American College examinations. (Examination Research Report No. 88-1).
Bryn Mawr, PA: American College.
(1987). Pilot study of objective examination for HS 332 (Examination
Research Report No. 87-1). Bryn Mawr, PA: American College.
with F. Bernt. (1987). Student's reactions to offline testing. (Exam Note
87: 8-1). Bryn Mawr, PA: American College.
with F. Bernt. (1987). Differences in EOD performance based on time of
testing (Exam Note 87: 33-2). Bryn Mawr, PA: American College.
with F. Bernt. (1986). What students think. (Examinations on Demand Report
5). Bryn Mawr, PA: American College.
with B. W. Shaw, D. J. Martin, J. M. Marquez, Y. G. Kang, S. Iwatsuki, B.
P. Griffith, R. L. Hardesty, H. T. Bahnson, & T. E. Starzl. (1985).
Advantages of venous bypass during orthotopic transplantation of the
liver. Seminars in Liver Disease, 5(4), 344-348.
with B. W. Shaw, D. J. Martin, J. M. Marquez, Y. G. Kang, S. Iwatsuki, B.
P. Griffith, R. L. Hardesty, H. T. Bahnson, & T. E. Starz. (1984). Venous
bypass in clinical liver transplantation. Annals of Surgery, 200(4), 524-
534.
with D. Rinchuse & T. Zullo. (1984). The significance of selected
demographic variables on toothpaste preference for sweetened and
unsweetened toothpastes. Clinical Preventive Dentistry, 6(5), 12 - 16.
(1983). The use of the analysis of covariance in quasi-experimental
research. Doctoral dissertation, University of Pittsburgh.
with T. C. Hsu, S. S. Abunnaja, & L. Zikri (1983). The analysis of
covariance. (Working paper). University of Pittsburgh.
with R. Marks. (1982). Attitudes toward aging and the elderly. In S. Newman
et al. Aging awareness (2nd ed.). Pittsburgh: Generations Together.
Contact this candidate