Posted on

Passed The Radexam Precall Quiz? You May Still Not Be Ready To Take Call!

radexam precall quiz

Ask ten different program directors on how they decide if their residents are ready to take calls and place them in the same room. You will most likely get ten different answers, plus a heated debate (maybe a fistfight or two!) But, I have witnessed some residents who have passed the Radexam precall quiz perform poorly on call. Likewise, I have seen residents with borderline or failing scores on Radexam make a stellar performance when they start overnights. So, what is it that the exam is missing? I think I have it all figured out!

When we look at the skills that you need to succeed at nighttime, there are three general categories: reading, picking up findings, and professionalism. The Radexam tests the first part, knowledge, and I believe it is acceptable for this purpose. But, it leaves out the other two essential categories. Fortunately, most residents are professional, and you can observe their professionalism during their first year, so that category is not usually difficult to assess. However, the ability to pick up findings is a whole other kettle of fish. Some residents can have a vast knowledge base, yet have a tough time making the calls on a film. If you don’t test for it or observe it, you may miss these prospective call-takers. Houston, there may be a problem!

What Can You Do To Improve Your Finding Skills?

If you think you might be in this boat, what can you do to improve your finding skills? Well, several different techniques can help to improve your skills. The first and most obvious way to improve this skill is to read through lots of cases without knowing the answer beforehand. In today’s environment, in some programs, it is effortless for some residents to slide by without having to make any decisions on their own during the first year. These residents will typically either sit by the attending and watch them make all the findings. Or, they will continue to read books during the day without being an active participant in the case. If you want to learn the skill of making findings, passive learning techniques such as these don’t cut it. You need to flip through the cases on your own!

Additionally, you need to use materials that use lots of images. Now, this is a widespread first-year mistake. Many first-year residents continue to study like interns and read lots of materials without looking at the pictures. In radiology, you need to do the opposite. You need to look at lots of pictures and then read the content. To find appendicitis, you should see at least a hundred different cases before you can readily identify it. Some instances are subtle, and others not so much. Looking at all different sorts of examples of a particular disease entity will eventually get you to the point where you can easily make the findings without as much mental effort.

And finally, there is a subgroup of residents who have not read one lick during their first year. If you don’t know what the different disease entities are, how will you find them? However, this group overlaps with the lack of professionalism and lack of knowledge groups. Most residency directors can pick these folks out. And then, it’s a natural remedy. Read more!

How Should Program Directors Test For This Skill?

Direct observation is the key. Just utilizing a test like Radexam only tests the knowledge component and cannot substitute for observing a resident taking real cases.

Now, at some programs, the faculty may not have much time. But that is not an excuse. Testing residents before overnights is the moral and ethical thing to do. How can you allow a resident without the proper tools to take care of patients? It is unjustifiable!

To test residents for finding skills, I typically take a series of 10 reasonable overnight sorts of cases and watch how they perform when looking for the findings. Usually, I make sure that the residents can get about 2/3 of them right. I’m sure there are other ways to do the same thing, but I have found it reasonably simple to find a group of typical on-call cases.

Also, in the real world, you do not have the luxury of infinite time. So, we make sure to limit the amount of time per case. This simple process can quickly identify residents that are falling off the bell curve because they take to long to look at a case.

Are You Ready To Take Call After Passing The Radexam Precall Quiz?

Well, for those of you that are finishing up their first year, right about now, make sure that you continue to go through cases even after taking the Radexam Precall Quiz. If you don’t have a formal method to check whether you are ready in your residency, please make sure to ask your faculty or a senior resident to observe you. Sometimes you need a second set of eyes to ensure you are on the right path. If you want to get an idea of some of the cases for testing in our residency program, I will refer you to the previous years’ pre-call quizzes on this website for a nominal fee. Check them out! Otherwise, make sure to go through your institution’s classic cases without knowing the diagnoses beforehand. This process works to make you a better on-call radiologist!

 

 

 

 

 

 

Posted on

AUR Update 2019: What’s In Store For Your Radiology Residency?

For those of you that don’t know, the Association of University Radiologists (AUR) annual meeting is the main forum for all radiology residency programs throughout the country to discuss the most critical issues affecting radiology residency programs, GME education, and radiology medical student education. These include anything from the radiology residency match to the job market as well as the hardcore academic issues.  So, once again, I would like to keep you up to date with the AUR update 2019 on what is new in radiology education and the main factors that may impact your training.

Radiology Match/Competitiveness

As I had previously promised in a previous blog on the match, I will provide with a summary of the numbers compared to past years. Slightly different from my experience in the match, the numbers pointed to an overall similar year for radiology residency competition. Compared the previous year, 18 spots were left open (previously ten places). And, the percentage of foreign graduates were also similar (32% vs. 29%). However, the number of applications per resident had increased significantly, perhaps driving somewhat more competitive applicants into the interview spots.

Given the numbers, however, the facts show no significant change in competitiveness from year to year. Interestingly enough, in my experience, the overall quality of the applications was higher. (my experience can differ from the overall statistics!) So, I believe that some increased self-selection has been happening, not measured by the statistics. In terms of competitiveness, one of the hot topics lectures stated that radiology this year was similar in competitiveness to emergency medicine.

The Job Market

Like the previous year, the future has become rosy for new radiology residency graduates. Droves of retiring radiologists and a good economy are leading to the robust job markets for new radiology resident graduates. Also, similar to the last year, there are nearly two jobs available for each diagnostic radiology residency graduate. I would say that is not too shabby!

Furthermore, the needs of practices remain similar to the past. Body imaging, neuroradiology, and interventional are the most common available first jobs. And, the greatest need for radiology practices remains breast imaging, body imaging, and neuroradiology. Most jobs posted are again available in the South and the least in New England.

What I found particularly interesting: 8% of all graduates were able to find a job with no fellowship training. I’m not sure what the statistics were for the previous years (probably a lower percentage in past years), but I have a feeling these folks would still have a hard time finding a position on the populated coasts. However, these statistics bode well overall for all graduates trying to find a job.

Change In Board Pass Rate Minimums

From an associate residency director of a “smallish” program, ACGME board passing changes have the potential to make some issues for smaller radiology residency programs. No longer is the minimum requirement an 80% pass rate for residencies by the end of the residency.  Instead, each program needs either an 80% first-time core examination pass rate or be over the 5th percentile for all residencies (that makes up about seven programs) with a look-back of five years. If you happen to have a “freak” year or two of a lower pass rate as a smaller program, the ACGME can target your residency for a new site visit. And, that can wreak all sorts of havoc!!!

Radexam

Now that the monthly evaluation exam has matured a bit, we have more details on this evaluation system. You can expect the availability of a more sophisticated assessment of individual scores and more customizable examinations to different institutions. You will see new exams in fluoroscopy, GI, and GU. Even the AIRP plans to have a distinct test to confirm that residents have attended the conference!
Also, they have instituted a new overall R3 level assessment test for these residents before going into the core exam. The examination will be available until June 20 and may be a great way to assess the progress of the resident for the core. We will see!

Unconscious bias

The quality of the speakers at the meeting varies widely. But, this year the AUR meeting provided us with a treat. Straight from the NPR news station, Shankar Vedantam gave an excellent lecture on unconscious bias and how that can affect radiologists when it comes to issues like the selection of diverse radiology residency applicants. No, it did not provide us with a formula for maintaining diversity in our residencies. But, it did give a new perspective on how we make the decisions that we do. If not this year or next year, I would expect some future changes in the rules for the overall process of residency selection and evaluation to incorporate some of the principles from this talk.

AUR Update 2019 and Change

The one constant in all radiology residencies is “change.” And, this year with the AUR update 2019 is no exception. Between the match, the improving job market, changing pass rate standards, an evolving Radexam, and new perspectives on unconscious biases, I foresee that our program, as well as all programs across North America, will have to roll with the punches and continue to adjust!

 

Posted on

Radexam- A Bridge To Getting Rid Of The Core Exam?

For years and years, programs throughout the country have been utilizing the ACR in-service exam as a way to find out if residents have been keeping up with the material. And, from my experience, the correlation of the test with the Dow Jones Industrial Average on any given day is higher than that measure. And, many program directors believe the same. Now, for the past year or so, programs throughout the country have been utilizing the new Radexam to drill down on radiology topics to check the same measures. But, is this exam all that it cracked up to be and what do we know about it? What would be the optimal exam if I had my druthers? Should we be using any monthly or annual review to test residents at all? Or, perhaps, we should eventually overhaul the current core exam process in favor of Radexam-like alternative?

What We Know About Radexam Currently

Unlike the previous in-service examination, the ACR created Radexam as a crowdsourced evaluation tool. Academic radiologists are constantly vetting the questions. Also, dissimilar to the in-service, the exam evaluates the resident based on her specific rotation. You will be able to tailor particular question banks to your individualized monthly requirements at your institution, whether modality or topic based. If you have a cardiovascular MR rotation, theoretically, you can create an exam that tests on that rotation. And finally, you can evaluate residents with this tool on a monthly basis.

After I have seen an exam from the batch, the test looks hopeful as a tool for making sure that residents are keeping up with the material. But, the only way to know for sure is to correlate the test with resident evaluations and the core examination. That should be coming to a theater near you soon!

The Optimal Exam

OK. Deciding upon the optimal exam is a tough one. But, let’s give it a whirl. Well, first and foremost, we have to remember the purpose of an examination for residency. And, no the target of an exam is not to correlate with board passage rates. Instead, we should be thinking farther down the road. Is the test evaluating residents on the skills that they will need to become a good radiologist? Test authors often get hung up on creating an exam for the exam’s sake and forget about this end purpose. If I were a test creator, I would have none of that.

What else? Well, I would create an examination such that if you were able to pass it, you could demonstrate to your government, colleagues, and patients that you have the necessary skills to practice radiology. Forget about curves and complicated statistical mumbo-jumbo. I would not care if the pass rate was 87 percent, 100 percent, or 2 percent. All I care about is that our residents have the abilities and skills that they need to practice. In the end, that is all the public should care about too.

Additionally, it would not happen at one sitting. No more travel to Chicago, Tuscon, etc. Instead, you would take it continually throughout your residency at your program as a way to show you have gradually mastered the competencies that you need to practice.

Finally, the exam should be relatively reasonably priced on resident budgets so that they can afford the fees to create it. Theoretically, this is a tough one, I know. But, with large amounts of student debt racked up over medical school and residency, it cannot be more critical.

How Does Radexam Match Up To The ABR Core Exam?

Well, this is the million dollar question that residency directors throughout the country are trying to answer. The success or failure of this exam hinges on this answer. Unfortunately, we don’t know the answer to this right now. But, I suspect that the correlation will be higher than the previous in-service exam. It does not take much. So, in that respect, you would be able to call it a success.

Advantages Of A Monthly Exam Versus Annual Exam

The more often that we evaluate a resident during residency, the more likely that we can closely follow the learning process. On the downside, however, no one likes to be placed underneath a microscope at all times. Additionally, testing creates an artificial environment that differs from the day-to-day practice of radiology and medicine in general. But overall, the more often you test, the better you can check to see if the resident is completing the learning tasks necessary to become a radiologist. And, that brings me to my next and final thought.

Should We Consider Overhauling The Core Exam And Replacing It With Radexam?

If the core exam, as we know it, does not satisfy many of the criteria for an optimal examination, should we consider looking for alternatives? I believe that the curt answer is yes. And, Radexam may fit the bill if we drill down on it a bit.

First of all, it tests residents more often than a core exam, so that it allows a more accurate evaluation of the resident’s medical knowledge and skills throughout residency. Second, you can have residents take it on a home computer in a more realistic setting instead of some impersonal test center of some sort, leading to test-taking anxieties. Third, Radexam is crowdsourced and overhauled continuously throughout the year. Instead, the core exam questions are vetted, but only at a few intervals. And, finally, you can attune the Radexam to your program. Not all programs teach the same material throughout the country. Moreover, not all the content on the core exam will be relevant to your future practice of radiology. Radexam may resolve that issue.

Final Thoughts About The Radexam

We are still not quite there yet when it comes to knowing about exactly how Radexam will play out. In any case, I am hopeful that the outcomes will match up with the medical knowledge and skills that residents need to learn. And, as a bonus, I also would like to see a better correlation of Radexam with the core exam outcomes. (which I think we will) If these correlations are high, perhaps, we should consider Radexam as an alternative to entirely replace the in-service that we use right now and maybe sometime down the road, the core exam. Although no test is perfect, many of its features are significantly closer to my optimal examination than the current ones. Let’s start the debate to consider our best options.

 

 

Posted on

AUR Meeting 2018- Themes And Undercurrents

Welcome to the second annual review of the Association Of University Radiologists meeting in 2018! So, why do I think we should review this meeting on an annual basis? Well, for one, many of the changes in residency you will experience stem from the academic realm.

Moreover, if you were to read the headlines and the summary of the lecture topics of the conference alone you would not get a good sense of what they will be changing. For example, this year, the heading of the meeting states “Health And Well-Being Of Profession And The Professional”. However, this theme is a small part of what actually happened at the meeting.

Yes, the lecturers did cover the topics of burnout and depression, relevant to the heading. But, if you dig a little bit deeper, compared to these themes, you would recognize that many other themes will impact future residents much more. So, what are the undercurrents that were most relevant? Basically, I am going to divide these topics as follows: continued improvement of the job market, increasing radiology residency match competition, the online longitudinal assessment, Radexam, and increasing time requirements for program directors.

The Hot Improving Radiology Job Market

Out of all the news, I think this is probably the most important. Based upon the hot topics lecture series at the AUR meeting, radiology has climbed out of its doldrums and now returns to a more normal job market. In the most recent year, over 1800 positions were available for new graduates. Very recently, the number of new hires amounted to the low 1100-1300. Furthermore, according to the conference, next year they predict that practices will need 2133 new hires. So, workforce demands are significantly increasing. My reasoning for the sudden increase in available jobs: a wave of retirements and willingness of practices to hire due to stable/good economic conditions. So, congratulations to all residents who chose radiology over the past 4-5 years! You can look forward to a great job market.

Continued Increasing Competitiveness Of Diagnostic Radiology Residency

Similar to the previous year, the competitiveness of radiology residency in the match continues to increase. As in the previous year, the unfilled spots continues to decrease and the percentage of US grads entering radiology residency continues to increase. All of these signs point to a much more difficult time for the US and foreign grads to match in radiology.

Online Longitudinal Assessment Replacing 10 Year Exam

Yes, I know that many of you have not yet thought about the maintenance of certification requirements once you have completed your residency. However, this new program will impact all residents today once you graduate and become board certified. No longer will ABR diplomates need to take an exam every 10 years to maintain certification (unless you do not satisfy the requirements of the new program). Rather, everyone who takes the online assessment will be able to skip the test and simply answer weekly questions that you receive via email.

Each year you will receive 104 question opportunities and you can choose to answer as few as 52 per year. You need to pass the scoring performance criteria based on 200 questions every 4 years. Fortunately, this system will replace the time sink of having to attend a test in Chicago every 10 years with all its expenses. I am certainly looking forward to bagging my unnecessary trip to Chicago for the recertification examination!

Radexam Now Operational

For residency programs throughout the country, many have implemented the new Radexam, replacing the old in-service examination. From my experience, the old in-service examination served a futile role in evaluating residents over the 4 years of residency. I believe no correlation existed between the passage of the core examination and the in-service exam. Now, this fact may change. The new Radexam crowdsources questions from numerous question writers throughout the country. And, the questions are vetted and evaluated for validity. In addition, the exam tests residents according to individual residency level. They can be used at the end of a rotation. Eventually, the exams can be tailored toward the types of rotations the radiology residency has (modality or organ based). I look forward to evaluating the quality of this new exam. More importantly, I believe it has the potential to revolutionize evaluation of residents, especially at smaller programs.

Increased Mandated Program Director Time Requirements Officially Implemented Starting July 1, 2018

Especially at the smaller programs like ours, the new ACGME rules about program director minimum time requirements will create an enormous impact on the management of residency programs throughout the country. Check out this webpage from the ACGME and the associated chart below:

https://www.acgme.org/Portals/0/PFAssets/ProgramRequirements/420_DiagnosticRadiology_2018-07-01.pdf?ver=2017-08-10-081454-583

0.3 full-time equivalent (FTE) for programs approved for eight to 15 residents; (Core)
0.4 FTE for programs approved for 16 to 23 residents; (Core)
0.5 FTE for programs approved for 24 to 31 residents; (Core)
0.6 FTE for programs approved for 32 to 39 residents; (Core)
0.7 FTE for programs approved for 40 to 47 residents; (Core)
0.8 FTE for programs approved for 48 to 55 residents; (Core)
0.9 FTE for programs approved for 56 to 63 residents; (Core)
1.0 FTE for programs approved for 64 to 71 residents; (Core)
1.1 FTE for programs approved for 72 or more residents. (Core)

 

Basically, the minimum required time for program directors to administrate programs has in many cases doubled. At our program, we are going from a 0.2 Full-Time Equivalent (FTE) (one day of administration time per week) to a 0.4 FTE (two days of administration time per week). As many programs have suffered from lack of administration time for programs directors, this change should enhance the quality of many radiology residencies. Some manpower/administrative issues that remained unresolved in radiology residencies can now be tackled due to decreased time pressures.

Final Thoughts About The AUR Meeting

Unlike previous meetings over the past four or five years, most of the doom and gloom has passed. Ironically, although the headline lectures were about depression and burnout, the mood was much more upbeat for new and graduating residents. Between the rising job market and the stable economy, the new MOC, increased program director time requirements, and the new Radexam, things are looking up. Even the wave of concerns about artificial intelligence replacing radiologist has seemed to pass us by! (No one believes that it will replace radiologists any time soon).  So, for all radiology residents, you are entering the field at a great time. And, this meeting certainly confirmed my suspicions!