Print

Frequently Asked Questions

 

What is ABPath CertLink™?

CertLink is an online technology platform for the development and delivery of longitudinal assessment to support continuous learning and professional development. CertLink was created through a partnership of the American Board of Medical Specialties (ABMS) with FIGmd, a leading provider of clinical data registry platforms. The goal of ABPath CertLink is to transform assessment of our Diplomates’ knowledge and judgment into a program that is practical, meaningful, and relevant to their practice.


Through CertLink, participants answer questions, many with images, using a web browser. Once answered, they receive immediate feedback (an essential element to learning and retention). They have a personalized dashboard which summarizes their ongoing performance and identifies their knowledge gaps. ABPath CertLink leverages advances in technology to assess medical knowledge and judgement using a convenient, continuous, and dynamic program that incorporates learning into the assessment process.

 

What is longitudinal assessment? Is there research to support this form of assessment?

Longitudinal assessment is a testing approach supported by contemporary adult learning theory that fosters learning through a continuous assessment of knowledge. The method involves administering questions over a longer period of time in order to identify knowledge gaps. Longitudinal assessment can aid in comprehension, retention, and retrieval of knowledge. Longitudinal assessment models represent an evolution from traditional, point-in-time exams.

A variety of studies and literature support this approach in the adult learning and education arena. Two such studies that focused on medical professionals are:

The 2013 study, Brain Science Provides New Approach to Patient Safety Training, which found that in more than 16 randomized trials, physicians improved long-term knowledge retention by answering questions over spaced intervals of time; and

Comparative Effects of Test-Enhanced Learning and Self-Explanation on Long-Term Retention, which studied medical students, and found testing in combination with explaining the information is the most effective way to drive long-term retention of information.

What is the ABPath CertLink pilot?

The American Board of Pathology (ABP) is exploring the potential of a longitudinal assessment as an alternative to the CC Assessment of Knowledge, Judgment, and Skills. The length of the pilot will be 3-5 years, during which time we will:


    • Implement technology infrastructure
    • Gather feedback about the design of the program and participant experience
    • Develop a large item bank of questions to make the program relevant to our subspecialists
    • Perform research to evaluate the pilot’s success and validity
    • Determine next steps for use as an alternative to the CC exam


Participants will answer multiple choice questions every quarter (3 months). Once a question is answered, Diplomates will be asked how relevant that question is to the general practice of pathology, how relevant the question is to their practice, and how confident they were of their answer. Diplomates then receive immediate feedback about answering the question right or wrong, a short narrative about the topic (critique), and references. If they answered the question incorrectly, they have an opportunity to answer the question a second time. They will have a dashboard showing performance over time as compared to other participants.

How will these longitudinal assessment questions be delivered to diplomates?

The ABPath's CC Assessment pilot will be delivered via the ABMS Certlink™ platform, which will be accessible via web browser. Questions will be delivered at the beginning of each quarter and may be answered anytime during that quarter, either all at once or any
number at a time based on the diplomate's availability. Diplomates will have a personalized dashboard summarizing performance and identifying areas of strength and weakness.

Why is the American Board of Pathology launching this pilot?

The ABP’s goal is to improve our Diplomates’ CC experience, while retaining a reliable and valid assessment that allows for credible summative decisions about medical knowledge, judgment, and skills for continuing certification. The ABP heard your concerns about the current CC examination and relevance of CC to your practice. Assessments offered through the CertLink platform offer exposure to relevant information to support Diplomates’ lifelong learning. It also helps fulfill the ABP mission to protect the public by ensuring continuing certification represents quality long after initial certification. Conducting the pilot will provide necessary information to help make changes to the CC Program.


An advisory and development group made up of ABP staff and experts at ABMS, has met on a regular basis to design and implement ABPath CertLink. Everything from question structure, quality and delivery, references, computer displays, test security, and relevance for subspecialists with multiple certifications have been addressed. Valuable feedback from ABP Diplomates collected through surveys and focus groups has also been integrated into the pilot development process.

Who can participate in the ABPath CertLink pilot?

The ABPath CertLink pilot is open to all Diplomates. However, until we have enough question variety Diplomates cannot expect items will always be relevant to their subspecialty. After an anticipated pilot period of 3-5 years, during which the practicality, validity, and reliability will be assessed, it's anticipated that ABPath Certlink™ can be offered as an alternative to the current CC exam.

What is the cost to participate in ABPath CertLink pilot?

The cost of participation in ABPath CertLink is included in the CC Program's participation fee.

Non-time limited Diplomates may electively participate in ABPath CertLink, with no jeopardy to their life-time certification. An annual fee of $100 will be charged starting in 2019. Participants are not required to meet CC requirements, although they are encouraged to voluntarily enroll in the entire CC program at no additional cost and with no jeopardy to their life-time certification.

Are these assessments available for subspecialties?

Yes. ABPath CertLink will include practice areas relevant to subspecialties. However, in the first few years of the pilot there may not be enough questions in all practice areas to allow for complete relevency.

When will the pilot start?

Beginning July 2, 2018, the ABP will open the pilot to all Diplomates that wish to participate. The pilot will last for three to five years. During and after the pilot, participants will receive surveys and have the option to volunteer to participate in focus groups to gather feedback and revise the program. If the pilot is determined to be a success, the longitudinal assessment model is expected to be fully operational by 2021.

What does participation in the pilot entail?

Pilot volunteers will be expected to answer a minimum number of items each year, commit to the duration of the pilot, and provide feedback to the ABP. They will also be expected to participate in surveys and have the option to volunteer to participate in focus groups (virtual and/or inperson) during the pilot. Pilot participation will allow Diplomates to have a voice and active role in
creating the next generation of CC assessment.

Are there other ways to get involved beyond participating in CertLink?

The ABP is currently requesting that items be submitted through our crowdsourcing site. The tutorial found here: https://db.tt/KdcMmNyU should be viewed prior to submitting items. There is also a link to an ABMS-approved video on developing well-written test questions, which can be accessed here: http://www.abms.org/news-events/abms-osmosis-video-developing-well-written-test-questions/. After viewing the tutorial and video, go to www.pathcertlink.com, and create an account by clicking on Register and completing the form and Confidentiality Agreement.

How should I prepare to take the assessment through CertLink?

No preparation is necessary, because part of the process is to maintain knowledge and gain new knowledge. Answering the questions without preparation will help uncover areas of weakness. The simple act of participating in the assessment — answering test questions right or wrong, and then seeing them repeated in slightly changed format at a later time — has been shown to be one of the best methods for retaining information. Participants will be allowed to use resources (books, internet, etc.) while answering questions, but cannot answer questions along with another person.

How will the American Board of Pathology determine the pilot’s success?

There will be several factors that determine whether the pilot is successful including, but not limited to:
    • Diplomates report that ABPath CertLink is relevant to their practice
    • CertLink™ becomes a “go-to” resource Diplomates use to maintain or grow their knowledge
    • ABPath CertLink reliably measures the knowledge and judgment of Diplomates, assuring the public that certified pathologists are engaged in lifelong learning and staying current in the field of pathology.

How does the ABPath CertLink allow users to customize the questions to fit their daily practice?

To increase relevancy, the ABP has identified over 30 pathology practice areas from which Diplomates can elect to receive questions. Participants will be required to answer 20% of questions in their area of primary certification (AP and/or CP) and then may elect to receive the remaining 80% of questions from up to 8 elective practice areas in 10% increments. If a Diplomate has subspecialty certification, an additional 20% of questions will be for that subspecialty. If a Diplomate has more than one subspecialty certification, then an additional 10% of questions will be for each subspecialty area. The remaining percentage of questions can be selected from the numerous practice areas in 10% increments. All aspects of program design will be reviewed during the pilot and are subject to change. See examples below.

 CertLink Examples

 

A Diplomate’s performance on CertLink during the launch of the pilot will not have any bearing on the Diplomate’s certification status.

How is the CertLink assessment scored?

Test questions will be presented to Diplomates as parent questions and clone questions that together form test question families. Each parent question presented to a Diplomate during a given quarter measures a key objective or topic. Diplomates are asked to answer the parent question correctly on their first attempt. If a Diplomate answers incorrectly on the first attempt, the Diplomate will be permitted an immediate second attempt to answer the parent test question after having the opportunity to read the question critique. Only their first attempt to answer, however, will be scored as being a correct or incorrect response. If a Diplomate fails to answer a parent test question correctly, the Diplomate will be presented one or more clone test question(s) of the same family during a subsequent quarter. A correct response to a parent question will be scored as one full point while an incorrect response will be scored as zero. Presenting test question critiques, permitting immediate second attempts to answer parent test questions, and presenting clones when Diplomates incorrectly answer parent questions is intended to provide repeated exposure and assessment of important knowledge and skills for practice.

Results of Diplomates’ performances will be displayed via a Diplomate dashboard that is a component of the online CertLink platform. The dashboard will display results of Diplomates’ performances on the assessment overall, as well as results for elective practice areas to help target areas for improvement and further assessment.

How will assessment security be addressed?

Longitudinal assessment models represent an evolution from traditional, point-in-time secure exams. While the nature and format of longitudinal assessment does not conform to traditional examination security measures (due to the frequency of engagement required by the Diplomate), the longitudinal format and design helps mitigate concerns of unauthorized assistance in answering questions. With the help of ABMS, the ABP is evaluating several additional security measures. Ultimately, Diplomates are professionals and it is essential that they hold each other to the standards of professionalism listed in the CertLink End User License Agreement (EULA).