Full recording
57:25 · follow along with the transcript belowPlays from YouTube when you press play. Cookie settings
Transcript
Edited for readability · 8,527 words00:05 · Ethan Drower
Great, thanks, Sean.
00:07 · Ethan Drower
And thanks everybody for giving us an hour on Friday.
00:11 · Ethan Drower
Make sure we're live here.
00:12 · Ethan Drower
Okay?
00:14 · Ethan Drower
All right, let's jump in 30 seconds on who I am.
00:18 · Ethan Drower
I'm Ethan.
00:19 · Ethan Drower
I run SiteMed and we build Evidence Cloud, which is a unified clinical evidence platform at the high level.
00:27 · Ethan Drower
Personally, I've been focused on MedTech clinical evaluation and post market surveillance for over 10 years now.
00:34 · Ethan Drower
But my background originally is in computer science and machine learning.
00:39 · Ethan Drower
Today I want to share with you all a somewhat of a big shift that we're seeing in the industry and give you some ideas as to how you can position your company and ideally your career from it as well.
00:53 · Ethan Drower
Some quick housekeeping notes as we go through.
00:55 · Ethan Drower
We're going to have a few polls that should show up in the zoom window.
00:59 · Ethan Drower
And if you have any questions, just drop them in the chat and Sean and team will be coordinating.
01:06 · Ethan Drower
Okay?
01:07 · Ethan Drower
All right, let's jump in.
01:10 · Ethan Drower
So, top level, when I say evidence, I just mean the simplest definition, which is really any kind of data that has some appraisal and analysis performed on it.
01:20 · Ethan Drower
So your study results, clinical literature, post market surveillance surveys, everybody's favorite, and customer testimonials, things you put on your website.
01:31 · Ethan Drower
Most of this industry's history, we see evidence as being something you file.
01:38 · Ethan Drower
It's kind of, it's almost after the fact, right?
01:41 · Ethan Drower
Clinical evaluation has mostly been reactive.
01:44 · Ethan Drower
Do the work, build the document, submit it, move on to the next stack of filings that you are weeks or months behind on already.
01:53 · Ethan Drower
So we all have lived some variation of this nightmare, okay.
01:59 · Ethan Drower
That's changing.
02:00 · Ethan Drower
From what we see, right?
02:01 · Ethan Drower
Across a lot of manufacturers that we've been working with, the evidence is having more and more of a direct impact on how they run the business itself.
02:11 · Ethan Drower
Right.
02:12 · Ethan Drower
Companies are seeing the impact of claims, which is the focus of today, in very good and also very, very bad ways.
02:21 · Ethan Drower
Right.
02:21 · Ethan Drower
This brings a lot of attention to the concept in general and that's kind of why it's such a such a hot topic, right?
02:29 · Ethan Drower
This shift in thinking and impact.
02:31 · Ethan Drower
Philosophically, this is what I like to call evidence based med tech.
02:36 · Ethan Drower
Okay?
02:37 · Ethan Drower
So evidence at its core, deciding what the company can say publicly, how you sell and market, who reimburses your product in different countries for how much.
02:49 · Ethan Drower
And it also decides what gets built next and what studies you run.
02:53 · Ethan Drower
Right?
02:54 · Ethan Drower
The concept of the claim sits at the center of it.
02:57 · Ethan Drower
You get this, right?
02:58 · Ethan Drower
It can mean a huge lift in revenue, which we love.
03:01 · Ethan Drower
You get it wrong, and it means penalties, delays, lost ground to competitors, tears are shed People get fired.
03:10 · Ethan Drower
You got it.
03:13 · Ethan Drower
The software, medical device and AI kind of enabled industry, They're a good example of how fast things are moving and the pace at which our industry is accelerating.
03:24 · Ethan Drower
AI enabled devices, your foundational models, they're moving at a pace that's never really been seen before in any commercial business, let alone Medtech, which is not exactly a speedy, quick to adopt industry.
03:38 · Ethan Drower
So this is a big deal.
03:40 · Ethan Drower
With more products in the AI world, competition is only increasing, not decreasing.
03:45 · Ethan Drower
There's lots of me toos, lots of 510ks.
03:49 · Ethan Drower
And where there is competition, there's a growing and infinite need to differentiate your product from, from the others and highlight its benefits.
03:58 · Ethan Drower
Okay.
03:58 · Ethan Drower
That's your claims.
04:02 · Ethan Drower
So I want to stay focused on the trends in the system.
04:05 · Ethan Drower
That's really what we want to talk about.
04:06 · Ethan Drower
But from a high level, this is the concept that we are trying to solve for.
04:11 · Ethan Drower
Okay.
04:12 · Ethan Drower
A claim is what you say directly, indirectly.
04:14 · Ethan Drower
It can come from a lot of places.
04:18 · Ethan Drower
On the other side is the support.
04:20 · Ethan Drower
How do we prove that our claim is correct and reasonable?
04:25 · Ethan Drower
Right.
04:26 · Ethan Drower
And there's a whole pile of different types of evidence that can stack up to equal sufficient support.
04:33 · Ethan Drower
Looks easy enough.
04:35 · Ethan Drower
Right?
04:36 · Ethan Drower
Anyone that's been around a bit knows this beautiful diagram is skipping over a few very key, very painful components in the connection between what we claim and what we can prove.
04:49 · Ethan Drower
Right.
04:51 · Ethan Drower
The big problem is efficiency.
04:53 · Ethan Drower
Right?
04:54 · Ethan Drower
Supporting every claim about every product all the time.
04:58 · Ethan Drower
In a market that keeps getting faster and more competitive, for most teams, it's not feasible.
05:03 · Ethan Drower
There's not enough people, there's not enough efficiency in the world to really stay on top of that.
05:09 · Ethan Drower
Right.
05:11 · Ethan Drower
That's a big problem.
05:12 · Ethan Drower
However, it's also a very interesting opportunity in our perspective.
05:17 · Ethan Drower
The manufacturers who can handle this process and perform this evidence based work better in our contention will outpace the ones who don't.
05:26 · Ethan Drower
They'll be able to claim more, they'll be able to move faster.
05:32 · Ethan Drower
Okay, poll time.
05:35 · Ethan Drower
John, you want to drop this one up on the screen here?
05:44 · Ethan Drower
There we go.
05:46 · Ethan Drower
Okay, we'll give everybody a second to click through here.
05:58 · Ethan Drower
I'm gonna say, Do we get results to come through?
06:11 · Madison Hedrick, MA
I can't click anything.
06:14 · Ethan Drower
Yeah, I think as you're a panelist, Madison, we don't want you skewing the data here.
06:23 · Madison Hedrick, MA
What an, what an honor.
06:24 · Madison Hedrick, MA
Sorry,.
06:26 · Ethan Drower
Your input is not welcome in the polls.
06:29 · Madison Hedrick, MA
I.
06:29 · Ethan Drower
Just.
06:29 · Madison Hedrick, MA
Keep them in my head and make them up.
06:30 · Madison Hedrick, MA
No, I'm just kidding.
06:36 · Ethan Drower
Okay, great.
06:40 · Ethan Drower
John, you guys can, you guys can tabulate the results.
06:44 · Ethan Drower
Our own numbers that we've kind of compiled over the last year, they pretty much align with viva's, the majority of companies when it comes to linking claims and evidence, if they do it at all, which is a, which is a big if it's a hand grown type of, type of process or type of situation or a single person in a lot of cases.
07:13 · Ethan Drower
Okay, let's keep moving.
07:15 · Sean Smith
END Poll Share results.
07:19 · Sean Smith
Are you seeing the results?
07:21 · Ethan Drower
I got them.
07:22 · Ethan Drower
Here we go.
07:23 · Ethan Drower
I'll just put them up here.
07:25 · Sean Smith
Right.
07:27 · Ethan Drower
Okay.
07:28 · Ethan Drower
So we've got a two way tie between a spreadsheet, we trace it through the cer, IFU and files when asked.
07:35 · Ethan Drower
Yeah.
07:35 · Ethan Drower
And this is this, in our opinion, this is the correct way to do this.
07:40 · Ethan Drower
Spreadsheets are easy to centralize.
07:42 · Ethan Drower
Your CER is where the final approved evidence lives, so it makes sense to trace it through there.
07:52 · Ethan Drower
There's some downsides to that.
07:53 · Ethan Drower
The cers get very unwieldy and not everybody accesses them and uses them.
07:58 · Ethan Drower
But that's the correct place to define this stuff.
08:04 · Ethan Drower
Okay, let's talk about the stakes.
08:07 · Ethan Drower
So this idea of claims and their importance is becoming very timely, right?
08:12 · Ethan Drower
To say the absolute least.
08:14 · Ethan Drower
Most companies, their first experience with the power of this concept is when they get in trouble for saying something that they can't support.
08:23 · Ethan Drower
Right?
08:24 · Ethan Drower
Back in the day this happened, but it wasn't really feasible for FDA or government agencies to stay on top of every piece of literature, every piece of marketing collateral, your website, things your company put out and podcasts, whatever.
08:41 · Ethan Drower
In the day of social media and mass surveillance, it's very feasible.
08:47 · Ethan Drower
Okay.
08:49 · Ethan Drower
As an overall trend, regulators are looking more carefully and more efficiently using tech.
08:55 · Ethan Drower
This isn't even really that big of a deal.
08:57 · Ethan Drower
Right.
08:58 · Ethan Drower
For reference, at Site Med, we run surveillance on all public materials across all customer devices.
09:07 · Ethan Drower
And we do it on a machine that's really not much more powerful than this laptop and it's incredibly efficient.
09:13 · Ethan Drower
So our budget isn't quite the same as fda.
09:17 · Ethan Drower
So I think it's safe to assume that most of these agencies are managing to monitor these claims effectively as well.
09:26 · Ethan Drower
Right.
09:28 · Ethan Drower
And on top of that, your competitors are looking as well.
09:31 · Ethan Drower
Right.
09:31 · Ethan Drower
So technology works both ways.
09:34 · Ethan Drower
If your competitors can read it and they're reasonably sophisticated, you better believe that they're going to be telling on you to mom and dad if you step out of line.
09:45 · Ethan Drower
Okay, quick story time.
09:48 · Ethan Drower
Cautionary tale.
09:50 · Ethan Drower
This is the last fear mongering slide, I promise.
09:54 · Ethan Drower
This is an example of what we call poor defense by a company.
09:57 · Ethan Drower
Okay, this is outset had a fabulous product, loved by Customers.
10:04 · Ethan Drower
Great testimonials.
10:05 · Ethan Drower
People used it.
10:06 · Ethan Drower
It's fantastic.
10:08 · Ethan Drower
One of the testimonials carried what we call an implied claim, which was directly against what they were indicated for.
10:17 · Ethan Drower
Okay.
10:18 · Ethan Drower
The customer said it, but they published it.
10:20 · Ethan Drower
Right.
10:21 · Ethan Drower
Which means they say it.
10:23 · Ethan Drower
FDA does not like direct contradictions to what they say.
10:26 · Ethan Drower
You can't do.
10:27 · Ethan Drower
As you can imagine.
10:29 · Ethan Drower
Not a fun time for anybody there.
10:35 · Ethan Drower
50% Drop in share price.
10:37 · Ethan Drower
Lovely.
10:39 · Ethan Drower
Okay, so that's defense.
10:41 · Ethan Drower
But it's not all doom and gloom when it comes to claims.
10:44 · Ethan Drower
Some of your company's biggest revenue wins can come from approved claims.
10:50 · Ethan Drower
And especially in the h EOR the reimbursement approval world.
10:55 · Ethan Drower
Right.
10:55 · Ethan Drower
It's.
10:55 · Ethan Drower
It's also much easier to sell a product that is legitimately better and actually works.
11:01 · Ethan Drower
Right.
11:02 · Ethan Drower
Go figure on the contrast.
11:05 · Ethan Drower
It's much harder to sell a product that you can't say anything positively about.
11:09 · Ethan Drower
Right.
11:10 · Ethan Drower
Here's an example of Dexcom, who did a very good job with this.
11:14 · Ethan Drower
I think this was 2016.
11:16 · Ethan Drower
Yeah.
11:17 · Ethan Drower
They put in a huge amount of work.
11:19 · Ethan Drower
They built an evidence base, they ran trials, they compiled a lot of their evidence, and they were attempting to show that their glucose monitor matched the state of the art, which was finger stick testing.
11:31 · Ethan Drower
Okay.
11:31 · Ethan Drower
This was really hard to do.
11:33 · Ethan Drower
It took them a while and it was not easy.
11:35 · Ethan Drower
I mean, they really, they really bled for it.
11:39 · Ethan Drower
Okay.
11:40 · Ethan Drower
So they were able to present their evidence and convince an advisory committee and they won the indication.
11:49 · Ethan Drower
Okay.
11:49 · Ethan Drower
A few years, a few weeks later, very coincidental timing.
11:53 · Ethan Drower
Medicare announced they would cover monitors if they were indicated for replacement of finger stick testing.
11:59 · Ethan Drower
So as you can imagine, massive revenue pool opens up for Dexcom.
12:03 · Ethan Drower
And at the time, it took, I think it took about nine months to a year for Abbott, their.
12:08 · Ethan Drower
Their biggest competitor to follow on.
12:11 · Ethan Drower
Right.
12:12 · Ethan Drower
This whole situation, something I spent years working wondering about as I worked with manufacturers.
12:18 · Ethan Drower
Right.
12:19 · Ethan Drower
If claims matter so much in terms of potential revenue and they carry with them so much risk in regulatory, why do I get blank and sometimes awkward responses when I ask manufacturers about how they're creating and caring for their claims?
12:42 · Ethan Drower
Okay, one more quick poll, Sean.
12:47 · Ethan Drower
So this is a question we ask everybody we work with.
12:50 · Ethan Drower
It's.
12:51 · Ethan Drower
It's also part of our evidence maturity model, which is our free assessment framework.
12:56 · Ethan Drower
It helps med tech leaders build the internal case for improvement projects, budget increases, product purchases, etc.
13:05 · Ethan Drower
Okay, so what happens when this shows up?
13:13 · Ethan Drower
I don't know if we have any results on this yet.
13:16 · Ethan Drower
Let's see.
13:23 · Ethan Drower
Okay, so industry benchmark.
13:25 · Ethan Drower
Yeah.
13:26 · Ethan Drower
65% Of assets need multiple rounds.
13:29 · Ethan Drower
This is very true in our experience as well.
13:34 · Ethan Drower
So I would agree with this number.
13:36 · Ethan Drower
We'll see, we'll see what everybody else thinks.
13:41 · Ethan Drower
I won't show you the percentage of companies that do no rounds of approvals.
13:46 · Ethan Drower
We'll, we'll leave that for later.
13:48 · Ethan Drower
But it's a non zero percentage.
13:52 · Sean Smith
So right now leading by 68% is regulatory checks the evidence and says how far it can go.
14:01 · Ethan Drower
Yeah.
14:01 · Sean Smith
That is the clear winner in the 69% saying that, 8% saying the first one, 12% or 15% saying rounds of edits and 8% saying it goes out before regulatory sees it.
14:19 · Sean Smith
Which clearly not.
14:22 · Ethan Drower
Feel, I feel forever is having to type that in.
14:26 · Sean Smith
But the.
14:28 · Sean Smith
Yeah, so there are the results.
14:31 · Ethan Drower
Yeah, that great.
14:33 · Ethan Drower
That matches.
14:34 · Ethan Drower
That matches exactly with what we're seeing.
14:36 · Ethan Drower
And that's not even, that's not necessarily a problem.
14:40 · Ethan Drower
That's.
14:40 · Ethan Drower
Regulatory should be evaluating these things and should be providing feedback.
14:45 · Ethan Drower
The problem I have with that is that it's a very rough process.
14:49 · Ethan Drower
Regulatory is busy and if they thoughtfully replied to every possible question or idea that marketing had, they would do virtually nothing else.
14:59 · Ethan Drower
I mean, show of hands, who enjoys fielding all of these questions on top of all of your submission requirements and in your daily activities?
15:08 · Ethan Drower
It's not exactly a fun part of the job.
15:11 · Ethan Drower
Right.
15:12 · Ethan Drower
So that's been true and that's what we've heard from you.
15:16 · Ethan Drower
And leading up to this, you know, about a year ago, I spent weeks wondering why this process is so rough.
15:24 · Ethan Drower
Right.
15:25 · Ethan Drower
I stayed up late into the evening.
15:26 · Ethan Drower
I stared off into the horizon reflectively.
15:30 · Ethan Drower
Food had no taste.
15:32 · Ethan Drower
Right.
15:32 · Ethan Drower
The colors of the world were muted until I could understand why nobody has figured out how to make this process, you know, less painful.
15:42 · Ethan Drower
Fortunately, inspiration did strike eventually.
15:48 · Ethan Drower
The reason this is so messy in my opinion is because we have three groups of people.
15:54 · Ethan Drower
Okay.
15:54 · Ethan Drower
I promised myself I wouldn't use the word stakeholders today, but that's what it is.
15:59 · Ethan Drower
Sorry, Sean.
16:00 · Ethan Drower
That have a very real and conflict.
16:02 · Ethan Drower
They have very real and conflicting priorities.
16:04 · Ethan Drower
We've got three big groups here, okay.
16:07 · Ethan Drower
We have your regulatory team.
16:09 · Ethan Drower
Their job is to get the device on the market and keep it there.
16:12 · Ethan Drower
If they don't do this, they get fired.
16:15 · Ethan Drower
Right.
16:15 · Ethan Drower
So naturally they're incentivized to make the safest, most risk free claim possible.
16:20 · Ethan Drower
If they could put on the label our device is a device, they would do it.
16:24 · Ethan Drower
And you can't fault them for that.
16:28 · Ethan Drower
On the other side of the coin, we have sales and marketing functions.
16:31 · Ethan Drower
Their job is to sell the daylights out of this product, which likely has multiple competitors that are either exactly the same or better.
16:41 · Ethan Drower
And if they can't do that, they get fired.
16:44 · Ethan Drower
So what's their incentive?
16:45 · Ethan Drower
Their incentive is to position the product as the best possible product.
16:50 · Ethan Drower
And here's why.
16:51 · Ethan Drower
Right.
16:51 · Ethan Drower
Damn the risks.
16:54 · Ethan Drower
And so those are conflicting.
16:56 · Ethan Drower
On top of that, then we have leadership, right?
16:59 · Ethan Drower
They care about getting both of these groups to do all of that with no people and no staff.
17:05 · Ethan Drower
Right.
17:06 · Ethan Drower
They need to reduce budgets, they need to make things on time, and then they need to create outsized results so they can get their bonuses and their equity incentives.
17:14 · Ethan Drower
Right.
17:16 · Ethan Drower
Of course, all of these great companies, you know, all these people are shared with the goal of improving the lives of patients actually having good outcomes.
17:25 · Ethan Drower
Right?
17:26 · Ethan Drower
But to understand the internal motivations here, we have to dig deeper than.
17:29 · Ethan Drower
Deeper than mission statements.
17:31 · Ethan Drower
Okay?
17:32 · Ethan Drower
So do we see the conflict here?
17:35 · Ethan Drower
Do we see the issue?
17:37 · Ethan Drower
Right.
17:40 · Ethan Drower
This conflict shows up in that exact poll that we just talked about.
17:44 · Ethan Drower
Right?
17:44 · Ethan Drower
Okay.
17:44 · Ethan Drower
It's the interaction between these groups.
17:46 · Ethan Drower
Okay?
17:47 · Ethan Drower
You've got marketing that pings something to regulatory.
17:49 · Ethan Drower
Regulatory does the work, sends it back to marketing.
17:53 · Ethan Drower
Marketing says, great, but can we also say that this works for children?
17:56 · Ethan Drower
Then they ping it back to regulatory, and regulatory spins and cranks and smokes, and then they send it back to marketing and say, no, we can't say any of that.
18:05 · Ethan Drower
You know, go home, try again.
18:07 · Ethan Drower
Right.
18:08 · Ethan Drower
Okay.
18:09 · Ethan Drower
I played with this slide a lot when I was putting it together.
18:10 · Ethan Drower
I really like it.
18:11 · Ethan Drower
Okay.
18:12 · Ethan Drower
At the end of all of that, then we have leadership that says we can accept zero risk in the regulatory submission and portfolio, and we can't spend any money on proving otherwise.
18:24 · Ethan Drower
But we'd like you to increase sales either way.
18:28 · Ethan Drower
Okay?
18:29 · Ethan Drower
Clear misalignment here.
18:31 · Ethan Drower
And the core of this is these departments don't usually have a shared understanding of what is the risk here, what is the risk we're willing to accept and how can we operate around that when it comes to what we're claiming and supporting for our product?
18:48 · Ethan Drower
Right.
18:50 · Ethan Drower
On top of that, nobody has the time to do any of this.
18:55 · Ethan Drower
Right?
18:55 · Ethan Drower
Even if we did care and we were aligned, supporting every claim properly for every product day in and day out, it's an enormous amount of work.
19:03 · Ethan Drower
Right?
19:04 · Ethan Drower
And the more things we add, the more we have to spend, the more work that needs to be done.
19:12 · Ethan Drower
Right?
19:12 · Ethan Drower
Another quick show of hands.
19:14 · Ethan Drower
Who feels like they have sufficient free time in their schedule to proactively respond to and process all things related to their claims?
19:24 · Ethan Drower
If you're a regulatory person, you probably just Jumped out of this webinar because you're mad at me.
19:28 · Ethan Drower
So sorry about that.
19:30 · Ethan Drower
But it's just not sustainable.
19:32 · Ethan Drower
Right.
19:33 · Ethan Drower
And so what happens in reality?
19:36 · Ethan Drower
A company's either guessing at their claims.
19:38 · Ethan Drower
Yikes.
19:39 · Ethan Drower
And they take on more risk than they should in how they go to market, or a lot of companies also go the other way.
19:45 · Ethan Drower
Right.
19:46 · Ethan Drower
They over modulate and they go to market with less compelling claims than their evidence even supports.
19:52 · Ethan Drower
So they're leaving opportunity on the table.
19:55 · Ethan Drower
Neither's.
19:56 · Ethan Drower
Neither's a good option.
19:58 · Ethan Drower
Right.
20:01 · Ethan Drower
I love this one too, but I couldn't get the.
20:03 · Ethan Drower
The guy to run properly as a stick figure.
20:06 · Ethan Drower
So sorry about that.
20:10 · Ethan Drower
So what do we do?
20:10 · Ethan Drower
Right.
20:11 · Ethan Drower
In my view, the only way to keep everybody happy and improving is technology and process.
20:17 · Ethan Drower
They have to save the day.
20:19 · Ethan Drower
Right.
20:20 · Ethan Drower
Our ideal scenario is creating a system, a claims system that can maximize our marketing message.
20:28 · Ethan Drower
While ENS regulatory risk is kept in check.
20:31 · Ethan Drower
Doesn't mean bring it to zero.
20:32 · Ethan Drower
It means bring it to a measurable level that leadership can agree on and that both marketing and regulatory can operate within so they don't have to fight each other every time we want to change something.
20:45 · Ethan Drower
Okay.
20:47 · Ethan Drower
This graph, if you can pull it off, makes leadership very happy.
20:52 · Ethan Drower
Okay, So let's build this thing.
21:00 · Ethan Drower
Now that we understand the groups and their motivations.
21:04 · Ethan Drower
So how do we design this, this mythical system?
21:06 · Ethan Drower
How do we build this?
21:07 · Ethan Drower
Okay, here's how.
21:09 · Ethan Drower
We've built ours at the high level, and I've broken it into the major components that you can figure out and operate, you know, within your own company's constraints.
21:20 · Ethan Drower
Right.
21:20 · Ethan Drower
First we've got detection and ingestion.
21:23 · Ethan Drower
Where are the claims coming from?
21:25 · Ethan Drower
So you've got your public materials, your internal documents, your label, random ideas from leadership, quarterly meetings, etc.
21:34 · Ethan Drower
You've got your analysis, right?
21:35 · Ethan Drower
That's covering any review assessments of those materials.
21:39 · Ethan Drower
They come in.
21:40 · Ethan Drower
Somebody has to look at them and make a decision on them.
21:43 · Ethan Drower
Who's doing this?
21:44 · Ethan Drower
Humans, Machines, you know, that process lives you there.
21:48 · Ethan Drower
And then third, arguably the most important, if we are doing all of this great work, finding our claims, supporting them, linking evidence to them, we need to be able to access that information in a way that's simple, so that our teams actually use it.
22:02 · Ethan Drower
Right.
22:02 · Ethan Drower
For all of you saying we trace things through the cer, that's terrific.
22:07 · Ethan Drower
Nobody likes going through the cer.
22:09 · Ethan Drower
Nobody likes opening that thing to read it and track things down.
22:13 · Ethan Drower
Okay, this is the hardest part.
22:16 · Ethan Drower
I've seen cathedral level beautiful spreadsheets that hold and manage evidence that everybody's afraid to touch because they're so complex and they don't even let marketing look at it, which I always find funny.
22:31 · Ethan Drower
But this defeats the purpose of what we're trying to do.
22:33 · Ethan Drower
We're trying to make our assessments standardized and accessible to people.
22:40 · Ethan Drower
So we have these problems.
22:42 · Ethan Drower
We have these components that we need to build into our system, whatever that ends up looking like for you.
22:47 · Ethan Drower
And there are different tools and means available to everybody based on your structure, your budget, you know, current IT limitations.
22:56 · Ethan Drower
Point of this presentation isn't just to say you need to buy and build a system.
23:01 · Ethan Drower
You need to work within what you have access to.
23:04 · Ethan Drower
And within that, you need the foundational understanding of what you're trying to accomplish so that you can request budget, you can request tools, you can justify the purchase of, you know, people or processes.
23:20 · Ethan Drower
Okay, so for each of these components, we're going to run through them.
23:24 · Ethan Drower
I'm going to give you my color on what I think you should automate what I think is worth figuring out how to use AI for, and even where you can get away with doing things by hand, you know, if you must.
23:36 · Ethan Drower
Okay, let's see what else we have.
23:43 · Ethan Drower
You'll hear me calling these ideal, the possible, and the dangerous.
23:47 · Ethan Drower
Okay.
23:48 · Ethan Drower
Purpose built is ideal.
23:50 · Ethan Drower
Careful spreadsheet with or without an assistant is possible.
23:55 · Ethan Drower
You know, before we go through all of these parts, let's.
23:58 · Ethan Drower
Let's actually do the poll now.
23:59 · Ethan Drower
Sean, do you have number three up?
24:03 · Ethan Drower
And let's just get a.
24:04 · Ethan Drower
Let's just get a taste for what people are using.
24:06 · Ethan Drower
I think I already know, but let's throw this one up here.
24:11 · Ethan Drower
Thank you.
24:16 · Ethan Drower
So everybody has something at this point, but in our experience, there's a.
24:21 · Ethan Drower
There's a big variety of how they're implemented and who's actually using it.
24:28 · Sean Smith
See how many people we can get to answer this poll.
24:30 · Sean Smith
Come on, people, join in the poll.
24:33 · Sean Smith
It's fun.
24:35 · Carrie Britton
You don't want us to play?
24:37 · Madison Hedrick, MA
It won't let me.
24:42 · Carrie Britton
Thank you,.
24:42 · Sean Smith
Matt.
24:43 · Madison Hedrick, MA
I feel left out, too.
24:44 · Madison Hedrick, MA
Carrie,.
24:46 · Sean Smith
Memo to my team.
24:47 · Sean Smith
There's actually a checkbox in Zoom that says allow panelists to participate in poll.
24:52 · Sean Smith
We.
24:53 · Sean Smith
We need to remember to collect that.
24:54 · Sean Smith
That's item number 95 to add to the SOPs for creating poll questions.
25:02 · Sean Smith
Yeah, Zoom does not ever make it easy to do anything.
25:08 · Sean Smith
And they, they uncheck.
25:10 · Sean Smith
They uncheck the obvious thing, which is allow the panelists to participate.
25:16 · Sean Smith
And they do this, but.
25:18 · Madison Hedrick, MA
They'll let you put on business casual clothes.
25:21 · Carrie Britton
Yeah.
25:23 · Carrie Britton
Better than Microsoft right now.
25:25 · Ethan Drower
If I have, I'M.
25:26 · Sean Smith
Just glad that they get rid of the wrinkles on my 60 year old face.
25:30 · Sean Smith
So,.
25:31 · Madison Hedrick, MA
Ethan, I have a question.
25:32 · Madison Hedrick, MA
So with these questions, are these for general or is this for different markets?
25:37 · Madison Hedrick, MA
Which market is approved or just in general, what's your company approved for?
25:42 · Madison Hedrick, MA
Regulatory, clinical work?
25:44 · Ethan Drower
I think in general, I think we can keep it general.
25:46 · Ethan Drower
Let's just get some data.
25:48 · Ethan Drower
I mean, I have some ideas here, but let's see.
25:52 · Ethan Drower
Yeah, general assistance.
25:53 · Ethan Drower
Okay.
25:54 · Ethan Drower
Right, so what do we have?
25:56 · Ethan Drower
50% Are General Assistant Copilot, Enterprise type of ChatGPT.
26:03 · Ethan Drower
Some people have both, but very few have specialized system.
26:06 · Ethan Drower
Right, so that's our experience.
26:08 · Ethan Drower
Right.
26:08 · Ethan Drower
Most people are getting some version of a copilot and they are being encouraged or forced to use it as much as possible.
26:17 · Ethan Drower
Right.
26:17 · Ethan Drower
All in the name of efficiency.
26:19 · Ethan Drower
Okay, we know how that goes.
26:22 · Ethan Drower
Okay, let's keep it moving.
26:23 · Ethan Drower
All right, so let's get into each of these.
26:26 · Ethan Drower
Where do we get the claims that we need to analyze?
26:30 · Ethan Drower
Let's break it down.
26:31 · Ethan Drower
Okay.
26:32 · Ethan Drower
In our opinion, we've got existing claims and then we have potential claims, right?
26:37 · Ethan Drower
These are things based off of new data that you should consider claiming your existing claims, they're out there, right?
26:43 · Ethan Drower
They're in marketing materials, they're said by the CEO on a podcast, they're at your conferences, in your ifu, you know, your claims register.
26:52 · Ethan Drower
Potential claims are very interesting.
26:54 · Ethan Drower
These are possibilities, what we might be able to say based on new data.
26:59 · Ethan Drower
Okay.
26:59 · Ethan Drower
When it comes to our system, you know, here's our take on the methods, okay?
27:07 · Ethan Drower
Taking in ideas and requests.
27:09 · Ethan Drower
You can do this with manual tools.
27:11 · Ethan Drower
These are forms.
27:12 · Ethan Drower
There's nothing that crazy.
27:14 · Ethan Drower
You're relying on people to generate the ideas, which if you have great people, is a great bet.
27:21 · Ethan Drower
Do not try and watch all of your public materials and let marketing run crazy by hand.
27:25 · Ethan Drower
Right?
27:26 · Ethan Drower
Or expect them to upload all of their collateral and process it properly all the time.
27:31 · Ethan Drower
This is a perfect case for some type of automation.
27:35 · Ethan Drower
If you don't have access to something like that, it's a very easy push in our opinion because the risk is so great when it comes to determining what even is a claim.
27:45 · Ethan Drower
Once you have those materials, this can be done by hand.
27:50 · Ethan Drower
This is a judgment call for most people.
27:53 · Ethan Drower
You also can spin up internal tools, your co pilots, to assess things if you give them a pretty rigorous methodology.
28:00 · Ethan Drower
So it's viable.
28:02 · Ethan Drower
It's not particularly auditable if you ever were to get in trouble, but it does work, right?
28:09 · Ethan Drower
Analysis.
28:11 · Ethan Drower
So we have claims and ideas stored.
28:13 · Ethan Drower
We need to assess them against Our current body of evidence.
28:15 · Ethan Drower
And we need to make some kind of decision in grading.
28:18 · Ethan Drower
Right.
28:18 · Ethan Drower
This is where hand methods fall apart.
28:21 · Ethan Drower
Not because people can't do it, but just because everybody's too busy to really crank through these.
28:27 · Ethan Drower
Okay.
28:28 · Ethan Drower
We didn't present our framework for grading claims here, but it is available to everybody.
28:35 · Ethan Drower
We'll put a link at the end here and you can grab it and even use it with copilot to kind of run if you want to.
28:45 · Ethan Drower
So our breakdown of technologies, this is hard.
28:51 · Ethan Drower
This is hard to do by hand if this is really your only choice.
28:55 · Ethan Drower
If you're going to push anywhere for technology or improvements or even more people, this is probably the part of the system that requires it the most.
29:09 · Ethan Drower
Okay, now for the hardest part.
29:11 · Ethan Drower
If we manage to collect all of our claims and ideas, analyze them against, you know, our types of evidence, make conclusions, people need to be able to find it.
29:20 · Ethan Drower
Okay, sounds silly.
29:22 · Ethan Drower
Hand search retrieval, that's what we're trying to avoid here.
29:25 · Ethan Drower
Okay.
29:25 · Ethan Drower
If you do manage to centralize everything, there's a world in which even a copilot can traverse it and find things.
29:34 · Ethan Drower
Right?
29:35 · Ethan Drower
But the idea is if we have a central store, we can more easily add some type of mechanized search or index feature to, to find things and make it available to everybody.
29:47 · Ethan Drower
You can do it with a lock spreadsheet.
29:49 · Ethan Drower
Okay.
29:49 · Ethan Drower
The important thing is that people can get to it and search it.
29:53 · Ethan Drower
Right?
29:58 · Ethan Drower
Okay.
29:59 · Ethan Drower
So these are kind of my, my rankings again, there's a lot of possibility here.
30:04 · Ethan Drower
So you still do have some flexibility in how you actually implement this at your company.
30:09 · Ethan Drower
All right, System in action.
30:11 · Ethan Drower
You have the building blocks.
30:13 · Ethan Drower
Here's what this could look like.
30:15 · Ethan Drower
Right?
30:15 · Ethan Drower
And the idea is that each major function has a way to interact with this system without waiting on somebody.
30:24 · Ethan Drower
Right?
30:24 · Ethan Drower
Without waiting on regulatory to reply to their email in the queue of 600 other regulatory related emails that they have to do.
30:31 · Ethan Drower
That's higher priority.
30:32 · Ethan Drower
Okay, we want self serve here.
30:36 · Ethan Drower
If you look at it across the board, for each function, regulatory can pull directly what they need.
30:42 · Ethan Drower
Okay.
30:42 · Ethan Drower
No more big documents that they have to sift through.
30:45 · Ethan Drower
Clinical gets a queue of things to review.
30:48 · Ethan Drower
Right.
30:48 · Ethan Drower
Whether they're using AI or not, they're at least processing things systematically.
30:53 · Ethan Drower
Our friends at marketing, they can add their materials or have them forcefully added automatically.
31:00 · Ethan Drower
And better yet, they can search for things that they want and ideally answer some of their own questions about, yeah, you can probably say this, you can get some approval, or do not, do not say this, cannot say this.
31:14 · Ethan Drower
And then we've got Market access.
31:15 · Ethan Drower
They need to answer questions for specific markets in a timely fashion.
31:20 · Ethan Drower
They should be able to self serve.
31:21 · Ethan Drower
These are very competent people as well.
31:23 · Ethan Drower
And then of course, you've got your, your fearless leaders.
31:26 · Ethan Drower
They get to see the full picture.
31:28 · Ethan Drower
And ideally they can obsess over your competitors and their claims and stalk what they're doing.
31:34 · Ethan Drower
Okay.
31:35 · Ethan Drower
They love, love that.
31:38 · Ethan Drower
So that's our kind of, our ideal situation.
31:40 · Ethan Drower
Let me show you what this can look like in our opinion, the ideal flow.
31:45 · Ethan Drower
You don't need this interface, but this is what, in our opinion, you should be doing.
31:49 · Ethan Drower
Okay, we start with what's our question?
31:52 · Ethan Drower
Okay, what's, what's our device?
31:53 · Ethan Drower
What are we comparing?
31:54 · Ethan Drower
What's our endpoint?
31:56 · Ethan Drower
Right.
31:56 · Ethan Drower
This could be a marketing question, a competitor question.
31:59 · Ethan Drower
Doesn't matter.
32:00 · Ethan Drower
The point is we're making some type of claim and some type of comparison.
32:04 · Ethan Drower
Okay.
32:06 · Ethan Drower
If your evidence in your claims are stratified and they're indexed.
32:11 · Ethan Drower
Right.
32:11 · Ethan Drower
Impossible to do in Excel.
32:13 · Ethan Drower
In Excel, really, we can build filters across all of those endpoints and those characteristics.
32:19 · Ethan Drower
Right.
32:20 · Ethan Drower
Based on our question, not so bad, more technical usage.
32:28 · Ethan Drower
Based on what we're trying to figure out, which claims are applicable in our register?
32:32 · Ethan Drower
What's their status?
32:33 · Ethan Drower
Right.
32:33 · Ethan Drower
So based on our question, are there claims that we've already reviewed?
32:37 · Ethan Drower
Okay.
32:39 · Ethan Drower
And if there are, what's the status of them?
32:42 · Ethan Drower
Are they approved?
32:42 · Ethan Drower
Are they ideas trying to be supported?
32:44 · Ethan Drower
Where are we with this?
32:46 · Ethan Drower
Right.
32:48 · Ethan Drower
And then we want to see the actual results, right?
32:50 · Ethan Drower
What are the pieces of evidence, what's the literature?
32:53 · Ethan Drower
Especially the ones that have already been assessed.
32:55 · Ethan Drower
Okay.
32:56 · Ethan Drower
And after all of that, if we have real data, we want to be able to analyze it somehow.
33:03 · Ethan Drower
So we can build tables, we can perform meta analysis, we can summarize them, create an output.
33:13 · Ethan Drower
You got it.
33:17 · Ethan Drower
This is the type of discovery that you ideally want to facilitate for your people.
33:23 · Ethan Drower
Easier said than done.
33:24 · Ethan Drower
A lot has to go into being able to present the evidence in this way, but the presentation layer itself is not complicated.
33:33 · Ethan Drower
Anybody could use this.
33:34 · Ethan Drower
And that's really what we want to drive for.
33:36 · Ethan Drower
This is possible now.
33:38 · Ethan Drower
It wasn't possible two years ago.
33:40 · Ethan Drower
This is really possible now.
33:44 · Ethan Drower
Great.
33:44 · Ethan Drower
At this point, we know the path forward.
33:47 · Ethan Drower
Okay.
33:48 · Ethan Drower
Now it's not so easy, right?
33:50 · Ethan Drower
We don't just tell our company, cool.
33:52 · Ethan Drower
We need to implement this and make all these changes.
33:54 · Ethan Drower
Right.
33:57 · Ethan Drower
To pitch this internally, our contention and our experience is you want to play both sides of the risk reward scenario.
34:04 · Ethan Drower
Right.
34:04 · Ethan Drower
As a leader, we want to reduce regulatory risk.
34:07 · Ethan Drower
There's obvious measurable ways to do that and we want to increase marketing and sales.
34:13 · Ethan Drower
Everybody loves to grow revenue.
34:16 · Ethan Drower
And so if you can pitch a regulatory based and clinical based solution in that light of revenue and market access, you get a lot more attention.
34:25 · Ethan Drower
Okay.
34:26 · Ethan Drower
This is the leverage point to push on when you make your case.
34:30 · Ethan Drower
Regulatory people in our experience don't do this very effectively.
34:34 · Ethan Drower
And if you make that shift, you're going to get a lot more conversations, you're going to get a lot more interest in an internal initiative.
34:42 · Ethan Drower
And then on top of that, you hit them with some serious fear of missing out.
34:47 · Ethan Drower
Right.
34:48 · Ethan Drower
Competitors are going to do this, they're going to figure this out, they're going to outsell us more aggressively, and then they're even going to outbuild us in future years because their product intelligence is going to be better.
34:59 · Ethan Drower
Okay.
35:00 · Ethan Drower
So that's how I'd sell it.
35:03 · Ethan Drower
We give everybody this table at the end as well if it's helpful for you.
35:11 · Ethan Drower
The future of clinical evaluation.
35:13 · Ethan Drower
This is where it's headed in our opinion.
35:15 · Ethan Drower
It's headed to proactivity.
35:17 · Ethan Drower
It's not just a nice responsible thing that we should do.
35:20 · Ethan Drower
Right.
35:21 · Ethan Drower
It's what the most aggressive organizations are going to do to build smarter and sell more effectively and sell faster.
35:28 · Ethan Drower
Right.
35:29 · Ethan Drower
If you don't embrace the faster pace world, you're going to lose out in the long run.
35:34 · Ethan Drower
And career wise, those of us that are leading the charge to accelerate this process, you're going to be seen as an innovator of a new of the new age and you will be irreplaceable.
35:47 · Ethan Drower
It's getting easier and easier to find folks that will do literature review and appraisal.
35:51 · Ethan Drower
Right.
35:52 · Ethan Drower
It will not ever be easy to find people who can build and maintain the systems like what we just outlined.
36:00 · Ethan Drower
Okay.
36:00 · Ethan Drower
So if you're worried about being replaced by an army of low wage co pilot enabled workers, mastery of this stuff is your ticket to being essential for the next 10 years.
36:11 · Ethan Drower
You can drive this process.
36:14 · Ethan Drower
Okay.
36:16 · Ethan Drower
Quick few things to take away and to take home with you.
36:22 · Ethan Drower
If today resonated you want to lead the charge and improve your claims system, we'll prepare a free report for you.
36:28 · Ethan Drower
We call it a claims position report.
36:30 · Ethan Drower
This is just like a fun, appealing assessment of your products and then all of your competitors.
36:36 · Ethan Drower
And you can easily analyze all of what's publicly claimed for each of them and compare them.
36:42 · Ethan Drower
Okay.
36:42 · Ethan Drower
Very popular with the C suite.
36:44 · Ethan Drower
You know, they love those kind of reports.
36:46 · Ethan Drower
For the operationally inclined, we'll give you our internal claim system.
36:50 · Ethan Drower
It's just A methodology that you can copy or modify to suit your portfolio and your risk tolerance.
36:57 · Ethan Drower
This is a really good starting point if you are a co pilot warrior and you really want to start getting something done.
37:05 · Ethan Drower
And then as always, our evidence maturity model is available free.
37:09 · Ethan Drower
We'll send you that.
37:10 · Ethan Drower
That's if you want to build an internal roi.
37:13 · Ethan Drower
Kind of a budgetary case for improving things.
37:18 · Sean Smith
Yeah.
37:18 · Sean Smith
And if you just want him to contact you, just write contact in the chat and he'll contact you and you know, figure out which of these three things is right for you or send them all or, you know, I mean, you know.
37:32 · Ethan Drower
Yeah.
37:32 · Sean Smith
Not everybody does QR codes, but we.
37:36 · Ethan Drower
Got links.
37:37 · Sean Smith
Yeah.
37:38 · Sean Smith
Okay.
37:38 · Ethan Drower
Type InsideMed.com claims.
37:40 · Ethan Drower
I think, I think even you can do that, Sean.
37:43 · Sean Smith
I. I might be able to.
37:45 · Ethan Drower
I think you could.
37:47 · Madison Hedrick, MA
Ethan.
37:49 · Madison Hedrick, MA
I know we're getting some questions about guardrails in this process.
37:54 · Madison Hedrick, MA
I didn't know if you saw.
37:55 · Madison Hedrick, MA
Could see those.
37:56 · Ethan Drower
Let's, let's take some questions.
37:58 · Ethan Drower
I haven't seen any of them.
38:01 · Madison Hedrick, MA
So one was.
38:02 · Ethan Drower
What.
38:02 · Madison Hedrick, MA
Rules are behind the analysis to say a claim is substantiated.
38:10 · Ethan Drower
Okay, let me go through them.
38:13 · Ethan Drower
What rules and guardrails?
38:16 · Ethan Drower
Well, you need to establish them.
38:18 · Ethan Drower
Right.
38:18 · Ethan Drower
And what you want in the ideal world is you need a statistical way to compare whatever that claim is to what's available publicly.
38:29 · Ethan Drower
What are you comparing to?
38:30 · Ethan Drower
Your state of the art, your competitors and then what your own data shows.
38:34 · Ethan Drower
Okay, so.
38:36 · Ethan Drower
Oh, I see.
38:37 · Ethan Drower
I would love to see the guardrails implemented for their utilization of AI.
38:42 · Ethan Drower
So everybody does this differently.
38:46 · Ethan Drower
If you're asking how, how we do it, we try and you'll see in our methodology, we just publish kind of a risk based approach.
38:54 · Ethan Drower
Okay.
38:55 · Ethan Drower
And that's just.
38:56 · Ethan Drower
What are we comparing to?
38:58 · Ethan Drower
How do we systematically determine what the acceptance criteria is?
39:03 · Ethan Drower
So what's our state of the art?
39:04 · Ethan Drower
What's our benchmark?
39:05 · Ethan Drower
And then what data do we have?
39:07 · Ethan Drower
And is that data?
39:09 · Ethan Drower
How close is that to being really statistically relevant or partially.
39:14 · Ethan Drower
And we kind of go red light, yellow light, green light in terms of risk.
39:19 · Ethan Drower
We don't always boil it down to an exact percentage.
39:25 · Ethan Drower
I hope that helps.
39:28 · Ethan Drower
Love the paint.
39:29 · Ethan Drower
Love the pong game.
39:29 · Ethan Drower
Thank you, guys.
39:33 · Ethan Drower
What else do we have here?
39:36 · Madison Hedrick, MA
They're asking about where legal is in the process.
39:38 · Madison Hedrick, MA
Priya.
39:40 · Madison Hedrick, MA
The most companies have a dedicated ad promo team to review the materials for promotion materials.
39:48 · Ethan Drower
Oh, for.
39:49 · Ethan Drower
Well, from promotion materials, if we, if we go back to our.
39:53 · Ethan Drower
If we go back to our diagram.
39:58 · Ethan Drower
Okay.
40:00 · Ethan Drower
Legal can fit in.
40:03 · Ethan Drower
I would say.
40:04 · Ethan Drower
I don't even like this here.
40:05 · Ethan Drower
Let's go here.
40:06 · Ethan Drower
Legal can fit in what we consider the analysis.
40:09 · Ethan Drower
So you have some type of review and approval process.
40:13 · Ethan Drower
I don't care who the reviewer is.
40:14 · Ethan Drower
It could be, it could be clinical, it could be legal, etc.
40:19 · Ethan Drower
This needs to happen here.
40:20 · Ethan Drower
Right.
40:21 · Ethan Drower
This ideal scenario is assuming that you have a process that is producing reviewed and approved claims.
40:30 · Ethan Drower
Okay.
40:30 · Ethan Drower
We didn't diagram them out here because this is already getting a little messy.
40:34 · Ethan Drower
But if you have legal, they're part of the analysis loop.
40:38 · Ethan Drower
Right.
40:39 · Ethan Drower
Something needs to be assessed, we need to quantify it within our own risk framework.
40:44 · Ethan Drower
And then however many people need to sign off on it before it becomes a managed claim.
40:49 · Ethan Drower
Right.
40:49 · Ethan Drower
You already have this type of process, so you know it's going to vary.
40:54 · Ethan Drower
It's going to vary company by company as to how you actually operationalize that.
41:01 · Ethan Drower
Great question.
41:08 · Madison Hedrick, MA
And someone asked if there's a feedback loop for the software to show.
41:12 · Madison Hedrick, MA
So is there a feedback loop of new data coming into the existing claims?
41:16 · Madison Hedrick, MA
So if there was an initial claim of 85%, let's say improvement, but the new data shows 92%.
41:23 · Ethan Drower
Oh, I see.
41:24 · Ethan Drower
Yes, I would consider that, I would consider that part of this loop here.
41:30 · Ethan Drower
It's something, it's something you should be continuously doing.
41:33 · Ethan Drower
And again, it depends on do we have a system that helps reassess these things or do we have a process that forces people to reevaluate?
41:42 · Ethan Drower
Right.
41:44 · Ethan Drower
Yeah.
41:45 · Ethan Drower
I mean, most, the way most companies do it now, what do they do?
41:48 · Ethan Drower
They update the benefit risk every.
41:49 · Ethan Drower
Every year.
41:50 · Ethan Drower
Which means they're looking through their claims, they're looking at the new data.
41:53 · Ethan Drower
All we're saying is that you can use technology here to speed up this loop.
42:00 · Ethan Drower
Right.
42:00 · Ethan Drower
And it's not a big leap for most modern AI systems to look basically at evidence and determine if it's relevant to a claim that you already have.
42:11 · Ethan Drower
Okay, that's not a, that's not a quantum leap in, in computing or complexity.
42:16 · Ethan Drower
So the, the pace at which you do that, that's up to you.
42:21 · Ethan Drower
Technology enables it so that you could do it more or less automatically.
42:25 · Ethan Drower
Somebody's still going to read it and sign off on it, of course.
42:28 · Ethan Drower
But the idea is we don't want to wait every, you know, for before we open the file, look at new stuff.
42:34 · Ethan Drower
Right.
42:35 · Ethan Drower
We want to be able to do it quickly in case the market really is changing and we want to adapt to it, adapt to it fast.
42:47 · Ethan Drower
Okay, just scrolling through, but shout it, shout out anything else.
42:51 · Ethan Drower
Guys, if you, if you see Something.
42:53 · Sean Smith
So Jeff asks, does the claims review include website material and social media sites?
43:00 · Ethan Drower
Any.
43:00 · Ethan Drower
Anything that.
43:01 · Ethan Drower
That can be publicly accept accessible.
43:04 · Ethan Drower
So, so with social media we, we typically search for and systematically process things that are indexed by Google.
43:13 · Ethan Drower
So that's your public stuff, things people share to internal networks you don't really have good access for.
43:20 · Ethan Drower
But yes, we, when we do it for, for people like if you, if you want, if you want us to, we'll take anything that's publicly accessible and we'll crawl it all.
43:30 · Ethan Drower
Good question.
43:32 · Sean Smith
Julie asks does the software track which claims can be or are being made in which geographies?
43:41 · Ethan Drower
Yes, I think it's up to you but that's my recommendation.
43:47 · Ethan Drower
That's how we do it.
43:50 · Ethan Drower
Claims can be very geographical and very population based.
43:53 · Ethan Drower
So as long as your analysis.
43:58 · Ethan Drower
Right.
43:58 · Ethan Drower
As long as your assessment is containing geographic locations of where those studies are being run, where those populations are made up of the leap to providing support in specific geographies is pretty trivial.
44:14 · Ethan Drower
Right.
44:14 · Ethan Drower
But you have to be capturing that in the analysis and extraction stage.
44:19 · Ethan Drower
Some people move too fast and they skip over the.
44:22 · Ethan Drower
The geographies.
44:24 · Ethan Drower
Great, great question.
44:26 · Ethan Drower
Easy to, easy to say, not easy to pull off across all the articles and all the data that comes in.
44:33 · Sean Smith
And Bridget or Brigitte.
44:35 · Sean Smith
Brigitte.
44:36 · Sean Smith
Does such system have the prerequisite to establish a common repository for all purchased publications and company sponsored clinical trials?
44:52 · Ethan Drower
In our opinion it should.
44:54 · Ethan Drower
Right.
44:55 · Ethan Drower
Ours does it.
44:57 · Ethan Drower
We don't consider that part of the structure of processing and managing claims but you need to keep track of all of your articles and all of your rights.
45:08 · Ethan Drower
So that's what we do because we like to have it all.
45:13 · Ethan Drower
Everybody has some different limitations around article storage and article rights.
45:19 · Ethan Drower
It's a very hot topic now, especially with AI rights becoming a bit of a contractual war zone for a lot of companies.
45:26 · Ethan Drower
So where you keep your evidence, it's really going to matter in the coming, coming years.
45:34 · Madison Hedrick, MA
It can be costly too.
45:35 · Madison Hedrick, MA
I've seen people buy that same article six times, you know, because they don't know where they stored it.
45:40 · Madison Hedrick, MA
And so.
45:41 · Ethan Drower
Yeah, yeah Bridget, if your current method is everything gets dumped into SharePoint or it just lives in people's endnote libraries then yeah, the push for system is really obvious from a purchasing standpoint and also now from a legal and usage rights risk standpoint.
46:03 · Ethan Drower
A lot of people are putting a lot of articles into copilot that they do not have permission to use.
46:12 · Sean Smith
We have a question from Stephanie postmarket.
46:16 · Sean Smith
What happens when based on PMS data the claim can no Longer be supported.
46:23 · Sean Smith
So post market data, real world evidence, you know.
46:30 · Sean Smith
Yeah,.
46:31 · Ethan Drower
Let's, let's let our, let's let our panel weigh in.
46:33 · Ethan Drower
We've got a lot of heavy hitters on this panel.
46:37 · Ethan Drower
What do you guys think?
46:38 · Ethan Drower
I think we've heard enough of me talking.
46:42 · Sean Smith
Anyone want to try this.
46:44 · Madison Hedrick, MA
After the screaming stops from leadership?
46:47 · Madison Hedrick, MA
Yeah.
46:47 · Ethan Drower
Madison.
46:48 · Ethan Drower
Madison, you got some stories.
46:49 · Speaker 4
My question, and here's Stephanie, my question is more to do with the application.
46:54 · Speaker 4
I mean, what happens post market when based on the data, the claim has to be changed or it can no longer be substantiated.
47:04 · Speaker 4
So it has more to do with the application.
47:06 · Speaker 4
I mean, how do you.
47:07 · Ethan Drower
Oh, how we do it.
47:09 · Speaker 4
Yeah.
47:10 · Ethan Drower
Oh, I see.
47:13 · Ethan Drower
My intention in the design of our system was to be, to be agnostic and to let each manufacturer determine their own risk controls.
47:23 · Ethan Drower
Right.
47:24 · Ethan Drower
So we don't have the red flags and turn things off and call you screaming.
47:30 · Ethan Drower
What we want is we establish your risk parameters and then if something can't be supported, it should be notified.
47:38 · Ethan Drower
Right.
47:39 · Ethan Drower
Clinical needs to see that.
47:40 · Ethan Drower
And it should be very clear in the claims registry that data has drifted.
47:44 · Ethan Drower
Evidence has drifted from what this claim is.
47:47 · Ethan Drower
What you do with that internally.
47:50 · Ethan Drower
We're not going to dictate to you.
47:52 · Ethan Drower
So we want to build it to be flexible because everybody has a different definition.
47:56 · Madison Hedrick, MA
Ethan, it would flag it.
47:57 · Madison Hedrick, MA
So like Vigilance could then report it.
47:59 · Madison Hedrick, MA
But I mean, not all evidence is equal, Right?
48:01 · Ethan Drower
Yeah,.
48:02 · Madison Hedrick, MA
Is what you're saying.
48:04 · Madison Hedrick, MA
It may not be supported, it seems,.
48:08 · Speaker 4
But do you attach a record to who did what and why it had to be changed when you notice that the claim can no longer be substantiated.
48:17 · Speaker 4
I mean, what is exactly happening in your system?
48:19 · Speaker 4
I mean, can I from, from the claim being withdrawn or changed, do I see an ownership of the edits?
48:27 · Speaker 4
Do I see what is the root cause, the edit to the claim?
48:31 · Ethan Drower
Oh, sure.
48:32 · Ethan Drower
Well, if any, any status change of a claim.
48:36 · Ethan Drower
So we consider, yeah, it's, it's level of support, a status that's going to be audit trailed.
48:44 · Ethan Drower
Right.
48:44 · Ethan Drower
That's going to be tracked every time it's changed by who and by when.
48:47 · Ethan Drower
And there's an optional, you know, assign a reason to it.
48:52 · Ethan Drower
Right.
48:52 · Ethan Drower
And that's how, that's how we keep track of the history of a claim.
48:56 · Ethan Drower
Because like exactly what you're saying, this can change over time.
49:01 · Ethan Drower
Right.
49:01 · Ethan Drower
Support can accrue, levels can get updated, we can re submit for approval across all of our people and things can change.
49:11 · Ethan Drower
So we just want to track every change that's made every step that's taken.
49:15 · Ethan Drower
We're not going to tell you when to.
49:17 · Madison Hedrick, MA
Audit trail.
49:19 · Ethan Drower
Yeah,.
49:19 · Madison Hedrick, MA
Because you can't put your AI in front of an audit.
49:22 · Madison Hedrick, MA
You know, an auditor, you have to be able to see the trail.
49:26 · Madison Hedrick, MA
And so.
49:28 · Ethan Drower
I, I think everybody, I think you should be doing that no matter what tech you use.
49:32 · Ethan Drower
But we want every action of, you know, when it's coming, when it's relating to a claim.
49:38 · Ethan Drower
We want every action to be tracked.
49:41 · Ethan Drower
Who's doing it, who has permission to even do it and then why and when.
49:47 · Sean Smith
Do you have an opinion on which functions should be accountable for the overall claims process?
49:53 · Sean Smith
Anna asks.
49:54 · Ethan Drower
Oh, that's.
49:55 · Ethan Drower
You're going to get me in trouble there.
49:59 · Sean Smith
I think not going out on a limb on this one.
50:01 · Sean Smith
I don't blame you.
50:03 · Ethan Drower
No, I.
50:03 · Sean Smith
Think, I think it really depends on the organization.
50:05 · Sean Smith
I think it really depends on the structure of the organization, the resources within the organization.
50:11 · Sean Smith
How's that for a qualified answer?
50:15 · Madison Hedrick, MA
I think clinical, honestly, I think clinical should be more involved than I see a lot because clinical is looking at the data, marketing is looking at from sales and has.
50:23 · Madison Hedrick, MA
They have a bias to sell things.
50:25 · Madison Hedrick, MA
So I see a lot of times marketing is the person sometimes that is coming saying, hey, we want this claim.
50:30 · Madison Hedrick, MA
You can't, well, where's the clinical data?
50:32 · Madison Hedrick, MA
The clinical team will often be with the regulatory team in front of the auditors trying to explain what marketing did.
50:38 · Madison Hedrick, MA
You know, this is, this is what I saw most with MDD to MDR transition in Europe.
50:43 · Madison Hedrick, MA
Right.
50:44 · Madison Hedrick, MA
We had these claims that were, you know, bench tested.
50:46 · Madison Hedrick, MA
We did bench testing.
50:47 · Madison Hedrick, MA
So it lasts 1,000 years in a heart.
50:49 · Madison Hedrick, MA
Right.
50:50 · Madison Hedrick, MA
But that couldn't be, you know, that couldn't be substantiated.
50:53 · Madison Hedrick, MA
So I think it's across team functional thing.
50:56 · Madison Hedrick, MA
But I don't think it should just hit regulatory and just hit marketing.
51:00 · Madison Hedrick, MA
That's not fair, you know, to those teams.
51:03 · Madison Hedrick, MA
And, and not just in my opinion, but seeing I've been in a lot of places and I've seen, you know, marketing.
51:08 · Madison Hedrick, MA
Why didn't you notice this?
51:09 · Madison Hedrick, MA
Well, they're not doing the clinical trial, you know, like they don't see the data every day.
51:13 · Madison Hedrick, MA
And then Also regulatory has 96 other things going on in an audit, you know, on site, the clinical and also, I mean leadership has responsibility, but again, somebody has to go before an audit.
51:27 · Madison Hedrick, MA
And I see so oftentimes your clinical and then your regulatory too.
51:32 · Madison Hedrick, MA
And I think those are where you need a lot of this Legal should have some, some input of course, before it goes out but clinicals whose boots on the ground a lot of times sifting through this evidence, in my experience at all, 98 companies have consulted for not that many, but it seems.
51:51 · Ethan Drower
Like.
51:52 · Madison Hedrick, MA
It hasn't been that many.
51:53 · Madison Hedrick, MA
But there's been a lot of changes and the US market's going that way.
51:57 · Madison Hedrick, MA
But with the EU market, it's.
52:00 · Madison Hedrick, MA
You see a lot who's doing what this audit trail, you know, why is this team doing.
52:05 · Madison Hedrick, MA
And they have questions that we hadn't seen before the transition.
52:08 · Madison Hedrick, MA
And I think that US market is heading that way too, especially with AI use.
52:14 · Madison Hedrick, MA
That's why the audit trail thing is so important, in my opinion.
52:18 · Sean Smith
Thank you.
52:19 · Sean Smith
There were a couple people with hands raised.
52:22 · Sean Smith
I turned on their speaking access if they want to ask a question.
52:28 · Sean Smith
Andrea or sorry, I forgot the other person's name.
52:35 · Sean Smith
In the meantime, Elena asks is intended purpose device can do this written in an IFU marketing brochure.
52:45 · Sean Smith
Acclaim.
52:50 · Ethan Drower
Say that again.
52:51 · Ethan Drower
But my, my, my, my instinct to, to that question is yes,.
52:56 · Sean Smith
Yes it is.
52:57 · Sean Smith
Is.
52:58 · Sean Smith
Is if the intended purpose I. E. The device can do this written in.
53:04 · Sean Smith
Written in an ifu.
53:06 · Ethan Drower
Ah, yeah.
53:07 · Sean Smith
Brochure or a marketing brochure.
53:09 · Sean Smith
Acclaim.
53:11 · Sean Smith
Absolutely.
53:12 · Carrie Britton
Yes.
53:15 · Sean Smith
Even I got that one.
53:16 · Carrie Britton
Good job, Sean.
53:20 · Sean Smith
Thanks, Carrie.
53:21 · Carrie Britton
You're.
53:21 · Sean Smith
Welcome.
53:21 · Sean Smith
Appreciate it.
53:26 · Sean Smith
Jeff asks, has SiteMed been used for due diligence purposes prior to a technology acquisition?
53:34 · Ethan Drower
To an acquisition.
53:37 · Ethan Drower
The most I can, the most I can say is, is yes.
53:40 · Ethan Drower
We've, we've also been a part of a lot of very deep competitor analyses, so very R and D product planning projects in use cases.
53:58 · Ethan Drower
I think that's, I think when it comes to competitive intelligence, that's really a big shift in interest that we're seeing.
54:06 · Ethan Drower
Whereas maybe initially and previously and you know, my work before Site Med, it was very much about, okay, how do we just, how do we get these documents built and how do we update our CERs annually efficiently?
54:20 · Ethan Drower
Now I see things shifting more towards how do we keep track of what our competitors are doing, how do we plan our next trials, how do we brainstorm effective enhancements to the product, you know, that are going to get us the best return on investment for given markets.
54:35 · Ethan Drower
So I guess, yeah, that's a long answer for yes.
54:40 · Ethan Drower
And that space is moving very quickly and is something we're very focused on.
54:46 · Sean Smith
And that in part answers Ed's question.
54:48 · Sean Smith
How adaptive is the system for developing product competitive intelligence?
54:54 · Ethan Drower
Yeah, I think, I think if you go back, if you go back to our beautiful diagram, right.
55:00 · Ethan Drower
The.
55:01 · Ethan Drower
If you can sort detection and ingestion and you have a reasonable way to analyze.
55:09 · Ethan Drower
The sky's the limit in terms of what you do with those powers.
55:12 · Ethan Drower
And a very big priority is, yeah, can we use this to create competitive analysis and track how our competitors are doing?
55:22 · Ethan Drower
Right.
55:22 · Ethan Drower
Is their support increasing on the same claims that we make?
55:26 · Ethan Drower
Are they decreasing?
55:27 · Ethan Drower
And maybe we should report them?
55:29 · Ethan Drower
Right.
55:29 · Ethan Drower
Or where's the opportunity for our marketing people to differentiate?
55:34 · Ethan Drower
That is a very cool use case.
55:37 · Ethan Drower
I think that's one of the most exciting parts about being able to do this effectively is, is coming up with those insights.
55:46 · Sean Smith
That's awesome.
55:47 · Sean Smith
So we're about at the top of the hour.
55:50 · Sean Smith
I want to thank Ethan and, well, Madison, thanks for joining today and all of our panelists and everyone who attended today.
56:01 · Sean Smith
We had more than 170 people on the call at one point and by my count, which I don't even think includes the panelists.
56:10 · Sean Smith
And I thought it was an excellent presentation.
56:15 · Sean Smith
You know, where else do you get this opportunity to see things firsthand?
56:22 · Sean Smith
I'm excited about this technology and I encourage any of you that are interested in having a deeper conversation to reach out to Ethan, to connect with him on LinkedIn and, and, and, and yeah, let's see.
56:42 · Sean Smith
Join us again next week for part two of the Business Case for Quality with Michelle and Diana.
56:54 · Sean Smith
And then, yeah, you saw the upcoming events.
57:00 · Sean Smith
Please check out the new web page@medtechleadingvoice.com we got lots of fun stuff between now and the new year.
57:11 · Sean Smith
And yeah, that's it.
57:13 · Sean Smith
Thank you very much.
57:16 · Sean Smith
Want to connect with the community, watch the replay and meet people on mlvx AI.
How to cite this session
Drower, E. (2026, November 13). Architecting a Claims Support System [Webinar]. MedTech Leading Voice, Friday In-Focus. medtechleadingvoice.com/watch/2026-11-13-architecting-a-claims-support-system