Q&A: The quest to develop fair and ethical algorithms in medical imaging

We're in the midst of an AI boom.

AI is everywhere. If you've used autocorrect when typing or texting, looked for answers online using a search engine, or used facial recognition software to unlock your phone, then you've been using AI. The technology is ubiquitous and is evolving at breakneck speed.

The use of AI in the health care setting dates back more than 50 years. While chatbots like ChatGPT have garnered recent attention, the first medical chatbot, named ELIZA, was developed in the 1960s. Other AI tools soon followed: In the 1970s, a system dubbed MYCIN was designed to diagnose bacterial infections and recommend appropriate antibiotic treatment, and in the 1990s, the ImageChecker system was developed and became the first FDA-approved image AI system for the computer-aided detection of screening mammograms. Today, medical AI continues to advance, with basic science abilities like predicting the 3D shape of any protein to clinical applications like assisting with surgical procedures.

One of the first medical fields to deploy AI broadly was radiology, where machine learning algorithms are used to help interpret medical images. Medical images contain enormous amounts of data. These data can be mined for patterns and associations that can facilitate disease detection, predict clinical outcomes, and drive therapeutic decisions. But the development of algorithms to assist with these tasks has yet to be fully streamlined, and many questions remain: How are the algorithms regulated? Are the data secure? Are the models developed without bias?

We recently spoke with Maryellen Giger, Ph.D., a professor of radiology at the University of Chicago and the lead contact researcher of the Medical Imaging and Data Resource Center (MIDRC), a data repository that was developed during the COVID-19 pandemic. She told us about the creation of MIDRC, how the imaging repository and resources can be used to develop and test medical imaging algorithms, ways that bias can be introduced—and potentially mitigated—in medical imaging models, and what the future may hold.

The use of big data has exploded in recent years. But the power of big data can only be fully realized once the data itself has been checked and curated. As the field stands now, medical imaging data used to build clinical algorithms can lack the quality, quantity, and diversity needed to develop ethical and trustworthy products. The downstream effects of such artificial intelligence systems could have enormous ramifications, subjecting underrepresented populations to potential harm and perpetuating disparities in the medical setting.

At the end of 2019, NIBIB and its collaborators were searching for a use case—a specific clinical problem, like how to improve breast cancer diagnoses using mammogram images, for example—to spearhead the development of a robust medical imaging repository. This data repository would need to have diverse and curated imaging data paired with patient outcomes that could be freely accessed by researchers across the globe to facilitate the development of trustworthy machine learning algorithms.

And then the pandemic hit. Seemingly overnight, we had a use case—an urgent need to collect medical images and use AI to predict COVID-19 diagnosis, severity, and outcomes. To do that, we needed to create the infrastructure to collect, harmonize, and store huge amounts of images as well as associated clinical and demographic data. And so in August 2020, MIDRC was born.

At the time of this writing, we've collected chest images (both X-rays and CT scans) from nearly 55,000 patients across the U.S. These images have helped to create 27 in-house algorithms for the detection, diagnosis, monitoring, and prognosis of COVID-19.

The first step in building a good algorithm is finding good data. During the pandemic, when people were scrambling to develop algorithms, information was pulled from all sorts of sources, resulting in data sets that contained low-quality images, duplicate cases, or patient groups that were not representative of the general population. Garbage in, garbage out: In machine learning, you can't have a good output if you don't have a good input.

MIDRC is working to address this issue in multiple ways. We collect diagnostic imaging data from all over the country and organize these data so that researchers can easily extract what they need to develop an AI algorithm. Medical imaging algorithms are highly specific: they address a specific clinical question for a specific intended population. An algorithm may claim, for example, that it can predict COVID-19 severity from chest X-rays among Black women. The MIDRC database allows researchers to pull the specific data that they need to build an algorithm for their specific clinical use.

Beyond providing data for algorithm development, MIDRC also facilitates algorithm testing and validation. While approximately 80% of the data that we ingest are freely accessible to the public for research use, we keep the remaining 20% of the data in a separate, sequestered data set. This sequestered data set will never be used for algorithm development, as it will be only used for testing algorithms. Now that MIDRC is in its third year, our sequestered data set is large enough to begin evaluating how well a given algorithm is performing. A researcher can come to MIDRC with an algorithm that they've built, and we can extract the intended population from the sequestered data set and evaluate the algorithm to see if it works as anticipated. We've just begun working with companies to evaluate their algorithms and expedite the process of receiving regulatory approval from the FDA for clinical use.

Unfortunately, bias can sneak into an AI model in multiple different ways. In our recent paper, we outline about 30 separate factors that can introduce bias throughout the machine learning pipeline. In short, bias can be introduced in any and all steps of the process—from the data that is used to develop the algorithm to how the model is tested and ultimately deployed in the clinic. An algorithm that was developed with one or more sources of bias could ultimately affect patient care.

Some sources of bias seem obvious. An algorithm that was developed using data collected from white patients may not perform as described in a hospital system where the majority of patients are Hispanic. Models that can predict COVID-19 prognosis from chest X-rays shouldn't be expected to predict prognosis for lung cancer using the same type of scan. And algorithms that use images from the same patients to both develop and test the algorithm can't be expected to be generalizable and perform accurately across multiple patient populations.

Other sources of bias are more subtle. One example is temporal bias, where the data used to develop a model becomes outdated. Think of the early days of the pandemic—when patients checked into the hospital, they were presenting with acute and severe disease without any prior immunity. Today, if the same patient got COVID-19, they've likely had a vaccine or a previous bout of the disease, and the characteristics on their chest X-rays might look a lot different. Different variants throughout the pandemic have led to different disease presentations. In this way, data acquired in 2020 may no longer be as suitable for COVID-19 algorithm development as they were previously—and algorithms developed several years ago will likely need to be re-evaluated to see if they are still performing as intended.

Fortunately, there are ways to mitigate biases in AI models that have been developed to analyze medical images. MIDRC has created an online bias awareness tool that describes potential sources of bias, how these biases arise, and suggestions for how to best correct them. We hope that researchers will use this tool to better understand how bias can be introduced into their development pipelines and take actions to diminish or eliminate biases in their algorithms.

The overall goal of MIDRC is to support the medical imaging AI ecosystem. We've built the infrastructure to house and organize medical images, we've collected a huge amount of real-world imaging data, and we've put forth a concerted effort to educate users about the development of algorithms and potential sources of bias. The next big push is to implement the sequestered data set to enable algorithms to get through the FDA approval process.

As the pandemic continues, MIDRC now gathers data from patients with long COVID and is extending its interoperability with a number of other data repositories. Beyond collecting X-ray and CT images of the chest, we're starting to collect images of the brain and heart captured by additional imaging modalities, such as ultrasound and MRI. Now that MIDRC is incorporating multiple types of images from multiple different regions of the body, it will be poised to pivot to other diseases and clinical problems beyond COVID-19.

Even though the pandemic was the catalyst to build and launch MIDRC, it's more than a repository of COVID-19 images. The collaborations and infrastructure that have been established provide a solid foundation for the creation of more medical imaging data sets and the development of AI algorithms for all sorts of use cases.

The end of the COVID-19 pandemic doesn't spell the end of MIDRC's potential. With the infrastructure built, this could just be the beginning.

Provided by National Institute of Biomedical Imaging and Bioengineering

Citation: Q&A: The quest to develop fair and ethical algorithms in medical imaging (2023, June 8) retrieved 13 June 2023 from https://medicalxpress.com/news/2023-06-qa-quest-fair-ethical-algorithms.html

This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.

Best No Medical Exam Life Insurance of June 2023

Our experts answer readers' insurance questions and write unbiased product reviews (here's how we assess insurance products). In some cases, we receive a commission from our partners; however, our opinions are our own.

Many of the best life insurance companies offer no-exam life insurance, which has the obvious appeal of skipping medical exams. But don't conflate no medical exam with no medical history.

Even the most liberal underwriters evaluate risk based on preexisting medical conditions and other known risk factors. So as an applicant, you might answer many of the same questions you would for a standard life insurance policy.

You just don't have to set aside time to check your blood pressure, cholesterol, and other health markers with a licensed medical professional. For older applicants, this could mean skipping more invasive tests like an EKG. We're here to clear up common misconceptions and help consumers find the best no medical exam life insurance options.

Haven Life

JD Power Customer Satisfaction Rating

780

AM Best Financial Strength Rating

A++

Haven Life

JD Power Customer Satisfaction Rating

780

AM Best Financial Strength Rating

A++

compare policies and quotes with Haven Life

Haven Life

compare policies and quotes with Haven Life

Details

JD Power Customer Satisfaction Rating

780

AM Best Financial Strength Rating

A++

Pros

Cons

AARP Life Insurance

AARP Life Insurance

compare policies and rates with Policygenius

AARP Life Insurance

compare policies and rates with Policygenius

Pros

Cons

USAA Life Insurance

JD Power Customer Satisfaction Rating

881

AM Best Financial Strength Rating

A++

USAA Life Insurance

JD Power Customer Satisfaction Rating

881

AM Best Financial Strength Rating

A++

compare policies and rates with Policygenius

USAA Life Insurance

compare policies and rates with Policygenius

Details

JD Power Customer Satisfaction Rating

881

AM Best Financial Strength Rating

A++

Pros

Cons

More Information

Prudential Life Insurance

JD Power Customer Satisfaction Rating

773

AM Best Financial Strength Rating

A+

Prudential Life Insurance

JD Power Customer Satisfaction Rating

773

AM Best Financial Strength Rating

A+

compare policies and rates with Policygenius

Prudential Life Insurance

compare policies and rates with Policygenius

Details

JD Power Customer Satisfaction Rating

773

AM Best Financial Strength Rating

A+

Pros

Cons

Ethos Life

JD Power Customer Satisfaction Rating

Not Rated

AM Best Financial Strength Rating

A

Ethos Life

JD Power Customer Satisfaction Rating

Not Rated

AM Best Financial Strength Rating

A

compare policies and rates with Policygenius

Ethos Life

compare policies and rates with Policygenius

Details

JD Power Customer Satisfaction Rating

Not Rated

AM Best Financial Strength Rating

A

Pros

Cons

Mutual of Omaha Life Insurance

JD Power Customer Satisfaction Rating

795

AM Best Financial Strength Rating

A+

Mutual of Omaha Life Insurance

JD Power Customer Satisfaction Rating

795

AM Best Financial Strength Rating

A+

compare policies and rates with Policygenius

Mutual of Omaha Life Insurance

compare policies and rates with Policygenius

Details

JD Power Customer Satisfaction Rating

795

AM Best Financial Strength Rating

A+

Pros

Cons

AAA Life Insurance

JD Power Customer Satisfaction Rating

844

AM Best Financial Strength Rating

A

AAA Life Insurance

JD Power Customer Satisfaction Rating

844

AM Best Financial Strength Rating

A

compare policies and rates with Policygenius

AAA Life Insurance

compare policies and rates with Policygenius

Details

JD Power Customer Satisfaction Rating

844

AM Best Financial Strength Rating

A

Pros

Cons

The coverage and riders offered are vital parts of our evaluation. We also look at the speed of payouts, customer satisfaction, and financial strength ratings. All of these factor into the immediate and long-term performance of the life insurance companies we review.

If you're looking for more information about a specific life insurer, our individual reviews offer a deep dive into individual policies, riders, and more. The same considerations are used for all competitors to ensure readers have the edge to make informed decisions in an ever-changing market.

See our insurance rating methodology for more details.

Life insurance companies have introduced living benefits/accelerated death benefits and other options to use policies as investment tools. As the name suggests, death benefits do not pay until after the buyer's death. Regardless, Personal Finance Insider knows how important it is to identify the right insurance company for your needs.

All insurance reviews and articles are fact-checked, and rates are checked at the time of our review. Our responsibility is to our readers, which means providing the most accurate information to guide you in the right direction. Our editor's ratings are based on insurance guidelines, performance, and more.

A no medical exam life insurance policy could be right for you if you're able to qualify and don't need special coverage. These policies are the easiest to get for young applicants with no significant health issues. Older applicants can buy with some companies, but acceptance is not guaranteed. No medical exam policies offer less coverage with higher premiums in most cases. If you do not qualify for the no medical exam policy you want, insurance agents can help you explore alternatives. 

No medical exam means life insurance companies will not check your blood pressure, cholesterol, etc. However, companies have access to prescription history and other personal records, and underwriters base decisions partly on this history.

You'll have to decide whether you prefer a whole or term policy based on your situation if you're getting no medical life insurance. A term policy has an expiration date, and extensions or conversions to a whole life policy are not guaranteed. If anything, your rate may be higher if you try to convert your policy. The insurer looks at you just as it would any other applicant of your age, health, etc. A whole life policy locks in premiums and payouts.

There are alternatives to a new medical exam life insurance policy. Insurance agents can quote you medical exam policies if you're denied a no medical exam option. An experienced agent may be able to assess your application before starting the process to avoid official denials. If you're concerned about premium limits, you can explore options like IUL (indexed universal life) for permanent life insurance that increases your benefit as long as you make premium payments.

A no medical exam life insurance policy may hold a certain appeal for older applicants and those in failing health. However, the life insurance market is the opposite of what you might expect. These policies are best for young people (typically under 50 years old) in good health. The no medical exam process is often more efficient, streamlining your approval, and life insurance companies can only do this with low-risk applicants.

If a provider sees red flags that might disqualify you, it won't necessarily prevent you from getting coverage. Instead, the agent would most likely offer to run more conventional life insurance quotes for you.

Haven Life

Haven Life offers term policies for healthy adults with limits as high as $3 million. For those who prefer to avoid a medical exam, the limit is $500,000. The Haven Simple no medical exam policy is available in all states except California, Delaware, South Dakota, North Dakota, and New York. All applications are filed online. Accelerated death benefits are available with this policy if you become disabled, and riders can be added to eliminate future payment obligations if you become disabled.

Haven Life exclusively sells online policies with limited payouts. So if you're looking for larger benefits, extensive financial planning, or agent support, it may not meet the mark. However, its quick online application and ease of use has significant appeal for many people.

Haven Life Insurance Review

AARP

AARP caters to senior clients for insurance and many other financial products. Older adults between 50 and 74 may qualify as long as they are AARP members. Term policies are available with limits up to $150,000 in most states. Montana and New York residents may be eligible for up to $100,000. Whole life policy limits max out at $25,000.

Whole life policies can be issued without any health exams or medical questions. The term policies, on the other hand, may ask some health questions.

AARP Life Insurance Review

USAA

Military members and their immediate family members may qualify for competitive banking, insurance, and other financial services through USAA. Pricing is lower, payouts are higher, and customer service is strong. Of course, these services are only available to military and qualifying family members. For the children of a deceased military member to use any USAA products, the military member would need to be signed up before their death.

Guaranteed whole life policies are available in 49 states, excluding Montana. USAA life insurance coverage is available from $2,000 to $25,000 with no medical exam or questions. Applicants who want higher coverage limits can explore medical exam policy options with a licensed agent.

USAA Life Insurance Review

Prudential

Prudential offers up to $3 million in coverage for term life policies. Adults up to 60 years old are eligible for coverage with a short application involving some medical questions. For younger applicants, conversion options may also be available later to make term policies into whole life policies. However, due to the higher limits, Prudential's application process may also be longer.

Prudential Life Insurance Review

Ethos Life

One of the benefits of term life insurance is lower premiums for higher coverage. No medical exam life insurance is no exception. Like no medical exam policies, term policies are geared toward younger applicants looking to save money. Ethos Life accepts applicants up to age 65 with a 100% online application process. Limits are as high as $2 million.

Ethos Life asks a few basic medical questions, but coverage is effective immediately once approved. In addition, every customer buying policies like this from Ethos Life is eligible for a 30-day look period, which is another way to say you can cancel and get your money back in the first 30 days with no penalties.

Ethos Life Insurance Review

Mutual of Omaha

Mutual of Omaha has high financial stability and customer satisfaction ratings across different types of insurance. Guaranteed life policies are available for adults between the ages of 45 and 85. In New York state, the age range is 50-75. Policies can be as small as $2,000 in most states and as large as $25,000 with no health questions or medical exams.

Mutual of Omaha's no medical exam policies have a graded death benefit. If you die within two years of the policy start date, the company will not pay the full policy. Instead, it delivers 110% of the premiums paid. The Mutual of Omaha website boasts same-day payouts on most policies. Policies for children are also available.

Mutual of Omaha Life Insurance Review

AAA

AAA offers immediate death benefits for qualified applicants between 18 and 75. In other words, once your policy starts, you are eligible for the full policy benefit. Policies are available with limits as low as $25,000 and as high as $500,000. While a medical exam is not required, health questions are.

AAA offers term policies with limits as high as $500,000. For a whole life policy, the limit is $25,000. But applicants can add a rider doubling the payout for accidental death coverage. Younger people have no waiting period for benefits. For applicants over age 45, AAA pays out 130% of the premiums paid up to the date of death for the first two years.

Particularly when choosing life insurance, customization is critical. Buyers don't need to add every rider, but a little research goes a long way in selecting the right company. Some applicants will not qualify for a no medical exam life insurance policy. A life insurance agent can help you run quotes that make sense for you. Then agents can offer realistic insurance policy options and review the costs and benefits of each.

Asking friends and family which insurance agent they use could be your first step to finding the right life policy. Factors like age, medical history, and financial goals play key roles in your decision. So we do not recommend asking loved ones about individual policies. Instead, let a qualified insurance professional find the best policies for you.

Lina Roby

Insurance Editor, LIA, MLO

Evelyn He

Compliance Associate

Evelyn He is a compliance associate at Insider who supports the Personal Finance Insider team. Personal Finance Insider is Insider's personal finance section that incorporates affiliate and commerce partnerships into the news, insights, and advice about money that Insider readers already know and love. The compliance team's mission is to provide readers with stories that are fact-checked and current, so they can make informed financial decisions. The team also works to minimize risk for partners by making sure language is clear, precise, and fully compliant with regulatory and partner marketing guidelines that align with the editorial team. Before joining Insider, she served in various legal and compliance roles in different industries, including the legal and pharmaceutical industries.    Evelyn obtained her M.S. degree in Marketing at Boston University in 2022. Prior to combining and consolidating her knowledge of law and business, she spent one year finishing 1L courses at Suffolk University Law School to further her legal knowledge. She has also completed MBA business law courses while working on her Bachelor of Business Administration in Management at the University of Massachusetts, Amherst.  Outside of work, she enjoys spending time with her 14-year-old Shih Tzu named Money, and her 4-year-old Bichon named Tibber.

After passing another medical exam, ChatGPT is moving one step closer to ChatMD

Getty Images

ChatGPT is becoming a great medical test taker.

Its latest and most advanced version, ChatGPT-4, can already pass the US Medical Licensing Exam with flying colors. And now, it's moved one step closer to becoming a specialized physician. Well, sort of.

On Tuesday, scientists announced that the newest chatbot software from OpenAI can handily pass a Canadian or US-style radiology board exam – scoring more than ten points above the 70% passing threshold.

But there's a catch: Because ChatGPT is only designed to process language (so far), the AI's radiology exam didn't include any images. Feels like kind of a major oversight for a branch of medicine concerned with diagnosing based on X-rays, MRIs, and other body pictures.

SCIENCE PHOTO LIBRARY/Getty Images

ChatGPT has shown itself to be a formidable test taker — it's passed exams including the SAT, the bar exam, and even the challenging master sommelier tests.

On the radiology exam, ChatGPT-4 delivered a passing score of 81%. The bot scored particularly well on higher-order thinking questions that require skills beyond just memory recall, like analysis, synthesis, and evaluation; ChatGPT-4 did well at describing imaging findings (85%), and applying concepts (90%). But it didn't do so great on some of the more straightforward questions on the test, and actually got 12 of those questions wrong that its predecessor, GPT 3.5, got right.

"We were initially surprised by ChatGPT's accurate and confident answers to some challenging radiology questions," study author Dr. Rajesh Bhayana, an abdominal radiologist at Toronto General Hospital, said in a press release. "But then equally surprised by some very illogical and inaccurate assertions."

Story continues

At its core, ChatGPT is simply designed to predict the best next word to spit out – in other words, it's built to chat you up. That chattiness can easily be harnessed to pontificate on exams, producing a very confident (but sometimes wrong) test taker.

Brown computer science professor Ellie Pavlick, a natural language processing expert, says this issue isn't unique to chatbots. She's always struggled to tell whether students really grasp the concepts she's taught based on their written exam answers.

"If you give some well-constructed language, it seems like you know, but maybe you do, maybe you don't," Pavlick said during a recent ChatGPT roundtable at Brown University. "This is a nice indication of why we kind of want to attribute much more knowledge and awareness to ChatGPT than it actually really has, because there's just something about well-constructed language that can really mask [poor] understanding."

Doctors say that ChatGPT shouldn't be used to diagnose or treat patients, and should always have its medical accuracy checked by a person. But medical experts are also discovering how ChatGPT can be a nice tool for improving a doctor's communication with their patients. It is precisely because ChatGPT excels at banter that it is often regarded as more compassionate than hurried doctors.

Read the original article on Insider