EDACS vs. HEART – But Why?

The world has been obsessed over the past few years with the novelty of clinical decision rules for the early discharge of chest pain. After several years of battering the repurposed Thrombolysis in Myocardial Infarction (TIMI) score, History, Electrocardiogram, Age, Risk factors and Troponin (HEART) became ascendant, but there are several other candidates out there.

One of these is Emergency Department Assessment of Chest pain Score (EDACS), which is less well-known, but has reasonable face validity.  It does a good job identifying a “low-risk” cohort, but is more complicated than HEART. There is also a simplified version of EDACS that goes ahead and eliminates some of the complicated subtractive elements of the score. This study pits these various scores head-to-head in the context of conventional troponin testing, as well.

This is a retrospective review of 118,822 patients presenting to Kaiser Northern California Emergency Departments, narrowing the cohort to those whose initial Emergency Department evaluation was negative for acute coronary syndrome. The 60-day MACE (composite of myocardial infarction, cardiogenic shock, cardiac arrest, and all-cause mortality) in this cohort was 1.9%, most of which were acute MI. Interestingly, these authors chose to present only the negative predictive value of their test characteristics, which means – considering such low prevalence – the ultimate rate of MACE in all the low-risk cohorts defined by each decision instrument were virtually identical. Negative predictive values of all three scores depended primarily on the troponin cut-off used, and were ~99.2% for ≤0.04 ng/mL, and ~99.5% for ≤0.02 ng/mL. The largest low-risk cohort by definition was with the original EDACS rule, exceeding the HEART score classification by an absolute quantity of about 10% of the total cohort, regardless of the troponin cut-off used.

The editorial accompanying the article goes on to laud these data as supporting the use of these tools for early discharge from the Emergency Department. However, this is an outdated viewpoint, particularly considering the data showing early non-invasive evaluations are of uncertain value. In reality, virtually all patients who have been ruled-out for ACS in the ED can be discharged home, regardless of risk of MACE. The value of these scores is probably less so in determining who can be discharged, but rather in helping triage patients for closer primary care or specialist follow-up.  Then, individualized plans can be developed for optimal medical management, or for assessment of the adequacy of the coronary circulation, to prevent what MACE is feasible to be prevented.

“Performance of Coronary Risk Scores Among Patients With Chest Pain in the Emergency Department”
http://www.onlinejacc.org/content/71/6/606

“Evaluating Chest Pain in the Emergency Department: Searching for the Optimal Gatekeeper.”
http://www.onlinejacc.org/content/71/6/617

Would You Use A Syncope SDM Instrument?

Much has been made, off and on, about the chest pain shared decision-making tool rolled out over the past couple years. It turns out, when properly informed of their low risk for subsequent cardiac events, most patients look at you sideways and wonder why anyone was offering them admission in the first place.  Whether that was its intended purpose, or a happy little accident, is a subject of controversy.

Their next target: syncope.

The content of this article is not very profound, other than to show the first step in the process of developing such an SDM instrument. These authors detail their involvement of emergency physicians, cardiologists, and patient stakeholders to inform their iterative design process. In the end, their tool looks a lot like the their chest pain instrument:

Generally speaking, because the approach to low-risk syncope has some of the same issues as low-risk chest pain, I have essentially the same fundamental problems. Much like for chest pain, inpatient evaluations for syncope are generally unrevealing. We probably ought not be admitting most of these patients. Therefore, this SDM instrument is again addressing the problem of low-value resource utilization by shifting the burden of the decision onto the patient, and trying to convince them to make what we already know to be the correct one (go home). That’s not how the Force works.

Then, just like the chest pain tool, this fails to convey the benefit of hospitalization for comparison. In their pictogram, two out of 100 patients suffer an adverse event after fainting. Is admission to the hospital protective against those adverse events – even if a diagnosis is made? The patient needs to receive some simplified visualization of their expected benefit from staying in the hospital, not just simply the base rate for deterioration.

I love shared decision-making. I use it constantly in my practice in situations where the next step in evaluation or treatment has no clearly superior path. Again, I don’t think this reflects the same uncertainty.

“Development of a Patient Decision Aid for Syncope in the Emergency Department: the SynDA tool”

https://www.ncbi.nlm.nih.gov/pubmed/29288554

Yet Another Failure to Prevent Contrast-Induced Nephropathy

I’m not the first one to this party, but this is worth a short note to touch upon, regardless, in case you missed it before the holiday break. I’ve written about retrospective propensity-matched analyses and other data suggesting the impact of contrast administration on acute kidney injury is overstated. This is yet another piece of the puzzle supporting these conclusions.

This is a beautifully massive trial, the PRESERVE Trial, with 5,177 patients enrolled in a 2×2 factorial design to test the impact of sodium bicarbonate and acetylcysteine on kidney injury following coronary angiography. This study was conducted in the United States, Australia, Malaysia and New Zealand, and was planned to enroll 7,680 to detect an increase in the primary end point of 8.7% to 6.5% for each trial intervention. As you might now have gathered, they stopped the trial early after an interim analysis when their statistical analysis met criteria for futility. The incidence of the primary end point, a composite between increase in creatinine, dialysis, and death, was effectively identical between each of the various arms, as were non-renal adverse events.

The short takeaway from these data: if contrast-induced nephropathy cannot be prevented by any available treatment, is it a true clinical entity at the doses currently used in clinical practice? Or, rather, do the clinically ill simply suffer kidney injury, regardless?

“Outcomes after Angiography with Sodium Bicarbonate and Acetylcysteine”
http://www.nejm.org/doi/full/10.1056/NEJMoa1710933

The Syncope Prophecy

There has been a lot of research regarding the disposition of patients with syncope from the Emergency Department. Unfortunately, to put it bluntly, little of it is effectively usable in general practice. The most recent AHA Syncope guidelines offer loose guidance patients should have risk-stratification performed prior to disposition, but their summary of decision-instruments admits the limitations of each.

And, as it turns out, we know better, anyway.

In this prospective study, Emergency Physicians explicitly recorded the suspected etiology of syncope at the time of disposition, choosing from four broad categories: vasovagal, orthostatic hypotension, cardiac, other/unknown. Physicians were also asked to rate their level of confidence regarding their diagnosis on a scale from 0% to 100%. Research personnel then performed typical observational follow-up to determine 30-day adverse outcomes.

Over the ~4 year study period, 5,010 patients were included in the final analysis. The average age was 53 years, with a wide standard deviation of 23 years. Generally speaking, most patients were healthy, with hypertension the most prevalent known underlying medical condition at 31.6%. Over 90% of patients had ECG and blood testing in the ED, with a minority receiving any radiography. Over half (53.3%) of the cohort received a provisional diagnosis of vasovagal syncope, with 32.2% “other/unknown”, 9.1% orthostatic hypotension, and 5.4% cardiac causes.

The good news: only 1.0% of the vasovagal cohort had an adverse outcome within 30 days, none of which were death. Then, as expected, 20.9% of the cohort with suspected cardiac cause suffered a serious outcome, although, only 0.8% died – an actuarially interesting statistic, considering the average age of this cohort was 86.5 years. The other large cohort of patients, those with “unknown” etiology, suffered serious outcomes 4.8% of the time, and their outcomes were spread evenly across the various cardiac and non-cardiac outcomes.

A long story short, then – physicians do a pretty good job of identifying those who are at low risk and high risk for serious outcomes.  Considering the imprecision of decision instruments and their limitations, it turns out the best computer … is probably still the trained brain.  These data don’t have quite the granularity to decipher whether the low rates of adverse outcomes in the “other/unknown” cohort were otherwise related to specific diagnoses or underlying comorbidities, but it’s not a stretch to speculate physicians probably could also have prognosticated fairly well on gestalt even within this category.

Worth noting, as well, in comparison to the PESIT study, the prevalence of undiagnosed pulmonary embolism in this population was 0.2%.

“Syncope Prognosis Based on Emergency Department Diagnosis: A Prospective Cohort Study”

https://www.ncbi.nlm.nih.gov/pubmed/29136314

The Top “Overuse” of 2016

Another entry in JAMA Internal Medicine’s lovely “Less is More” series, this is a “systematic review” of the previous year’s literature regarding potentially unnecessary care. Living here in the asylum, it seems all our fellow inmates and I are consigned to issuing weather reports from the tempest – but, hey, baby steps.

Their “systematic review” is not particularly rigorous.  It’s basically a literature search, followed by a subjective distillation by author consensus to those considered to be the most potentially impactful – but, regardless, their list is worth reviewing. Without further ado, the highlights of their ten selections:

  • Transesophageal echocardiography is more informative than transthoracic in illuminating the etiology of a stroke, but the additive information does not have a clear downstream benefit on outcomes.
  • Patients undergoing computed tomography to rule out pulmonary embolism without algorithm-compliant use of D-dimer suffer from overuse and low-value testing.
  • CT use increased in all Emergency Department patients with respiratory symptoms, with no evidence of downstream change in prescribing, hospital admission, or mortality.
  • Supplemental oxygen does not demonstrate benefit in patients with chronic obstructive pulmonary disease and mild exertional hypoxia.
  • Small improvements in antibiotic prescribing were seen when comparisons to peers were performed.
  • A shared decision-making implementation for Emergency Department patients with chest pain increased patient engagement and demonstrated a secondary effect of diminished admission and cardiac testing.

Wizard.

“2017 Update on Medical Overuse: A Systematic Review”
https://www.ncbi.nlm.nih.gov/pubmed/28973402

Are We Killing People With 30-Day Readmission Targets?

Ever since the Center for Medicare and Medicaid Services announced their intention to penalize hospitals for early readmissions, folks have been worrying about the obvious consequences: would a focus on avoidance place patients at risk? Would patients best served in the hospital be pushed into other settings for suboptimal care?

That is the argument made in this short piece in the Journal of the American College of Cardiology. They look backwards at the last two decades of heart failure readmissions and short-term mortality, and take issue with the fundamental underlying premise of the quality measure, the inequities associated with the measure, and potential unintended harms. Their most illustrative example: when patients die outside the hospital within 30-days, paradoxically, they contribute to apparent improved performance in healthcare quality, as measured by 30-day readmission.

They back up their point by using the aggregate data analyzing readmissions between 2008 and 2014, published previously in JAMA, and focusing primarily on the heart failure component. In the original JAMA analysis, the evaluation paired individual hospital monthly readmission and risk-adjusted mortality, and were unable to identify an increased risk of death relating to reductions in 30-day readmissions. These authors say: too much tree, not enough forest. In the decade prior to announcements of 30-day readmission penalties, 30-day heart failure mortality had dropped 16.2%, but over the analysis period, 30-day heart failure mortality was back on the rise. In 2008 the 30-day mortality was 7.9% and by 2014 it was up to 9.2%, a 16.5% increase, and an even larger increase relative to the pre-study trend with decreasing mortality.

These are obviously two very different ways of looking at the same data, but the implication is fair: those charged with developing a quality measure should be able to conclusively demonstrate its effectiveness and safety. If any method of analysis raises concerns regarding the accepted balance of value and harm, the measure should be placed on a probationary status while rigorous re-evaluation proceeds.

“The Hospital Readmission Reduction Program Is Associated With Fewer Readmissions, More Deaths”
http://www.sciencedirect.com/science/article/pii/S0735109717393610

Predicting Poor Outcomes After Syncope

Syncope is a classic good news/bad news presenting complaint. It can be highly distressing to patients and family members, but rarely does it relate to an acutely serious underlying cause. That’s the good news. The bad news, however, is that for those with the worst prognosis, most of the poor prognostic features are unmodifiable.

This is a prospective, observational study of patients presenting with syncope to Emergency Departments in Canada, with the stated goal of developing a risk model for poor outcomes after syncope. The composite outcome of interest was death, arrhythmia, or interventions to treat arrhythmias within 30 days of ED disposition. Follow-up was performed by structured telephone interview, networked hospital record review, and Coroner’s Office record search.

To achieve a lower bound of the 95% confidence interval for sensitivity of 96.4%, these authors targeted a sample size of 5,000 patients, and ultimately enrolled 5,010 with complete outcome assessments. The mean age was 53.4, had a low incidence of comorbid medical conditions, and only 9.5% were admitted to the hospital. Within 30 days, 22 had died, 15 from unknown causes and the others from the pool of 91 patients diagnosed with a “serious arrhythmia” – sinus node dysfunction, atrial fibrillation, AV block, ventricular arrhythmia, supraventricular tachycardia, or requiring a pacemaker insertion.

These authors ride the standard merry-go-round of statistical analysis, bootstrapping, and logistic regression to determine a prediction rule – the Canadian Syncope Arrhythmia Risk Score – an eight element additive and subtractive scoring system to stratify patients into one of eleven expected risk categories. They report the test characteristics of their proposed clinically useful threshold, greater than 0, to be a sensitivity of 97.1% and a specificity of 53.4% – a weak positive predictive value of 4.4% considering the low incidence of the composite outcome.

This is yet another product of obviously excellent work from the risk model machines in Canada, but, again, of uncertain clinical value. The elements of the risk model are frankly those that are quite obvious: elevated troponin and conduction delays on EKG, along with an absence of classic vasovagal features. These are patients whose cardiac function is obviously impaired, but short a time machine to go back and fix those hearts before they became sick, it’s a bit difficult to see the path forward. These authors feel their prediction rule aids in safe discharge of patients with syncope, although these patients are already infrequently admitted to the hospital in Canada. The various members of their composite outcome are not equally serious, preventable, or treatable, limiting the potential management options for even those falling into their high-risk group.

As with any decision instrument, its value remains uncertain until it is demonstrated the clinical decisions supplemented by this rule lead to better patient-oriented outcomes and/or resource utilization than our current management in this cohort.

“Predicting Short-Term Risk of Arrhythmia among Patients with Syncope: The Canadian Syncope Arrhythmia Risk Score”

https://www.ncbi.nlm.nih.gov/pubmed/28791782

Neither Benefit Nor Harm Seen With Oxygen in Myocardial Infarction

We’ve been hanging on to the biological hypothesis of treating ischemia with supplemental oxygen for quite some time – despite some evidence to the contrary with regard to damage from oxygen free radical formation. What’s needed is a large, randomized trial – and so we have DETOX2-AMI, run through the SWEDEHEART trial registry.

This trial randomized individual patients with suspected or known myocardial infarction to continuous oxygen therapy or ambient air.  Patients were excluded from enrollment if they had oxygen saturation below 90% at baseline, or were not Swedish national citizens as necessary for long-term follow-up. These patients actually received fairly vigorous oxygen therapy, far exceeding the typical nasal cannula oxygen we see on patients arriving via EMS – patients randomized to the oxygen arm received 6 liters per minute via face mask for 6 to 12 hours.

Over the 1.5 year trial period, these authors enrolled 6,629 patients, generally evenly matched with regard to baseline clinical characteristics, and 75% of whom ultimately had a final diagnosis of myocardial infarction.  Detailed outcomes, owing to the underlying registry infrastructure, are scant – as compared to the AVOID trial, in which many patients underwent cardiac MRI to evaluate infarct size and ejection fraction. What you get are the hard outcomes: death and rehospitalization with myocardial infarction – and there is no difference, both in the short- or long-term, and in both the intention-to-treat and per-protocol analyses. The authors also include median highest troponin T as a surrogate for infarct severity and morbidity, and there is no difference there, either.

The underlying hypothesis here was to demonstrate a beneficial effect to oxygen in myocardial infarction – defined as a clinically relevant effect size of 20% lower relative risk of death – and that threshold was clearly not met.  There are some small differences with regard to oxygen delivery, as compared to AVOID, with the AVOID trial delivering oxygen at a much higher concentration.  But, effectively, the takeaway from these data is: oxygen just probably doesn’t matter enough to be clinically relevant. There’s no reason to be condescending and militant about taking the oxygen off a patient with myocardial infarction, and likewise it’s reasonable to consider it a wasteful intervention with regard to canistered oxygen supply.

Finally, just for fun, to recap the anachronistic acronym MONA:

Morphine – Possible small harms, as relating to inhibition of antiplatelet agents.
Oxygen – Almost certainly irrelevant with regard to clinical outcomes.
Nitroglycerin – Likely irrelevant with regard to clinical outcomes.
Aspirin – Still good!

“Oxygen Therapy in Suspected Acute Myocardial Infarction”
http://www.nejm.org/doi/full/10.1056/NEJMoa1706222

Questioning the Benefit of Non-Invasive Testing for Chest Pain

Welcome to the fascinating world of instrumental variable analysis!

This is a retrospective cohort analysis of a large insurance claims database attempting to glean insight into the value of non-invasive testing for patients presenting to the Emergency Department with chest pain. Previous version of the American Heart Association guidelines for the evaluation of so-called “low risk” chest pain have encouraged patients to undergo some sort of objective testing with 72 hours of initial evaluation. These recommendations have waned in more recent iterations of the guideline, but many settings still routinely recommend admission and observation following an episode of chest pain.

These authors used a cohort of 926,633 unique admissions for chest pain and analyzed them to evaluate any downstream effects on subsequent morbidity and resource utilization.  As part of this analysis, they also split the cohort into two groups for comparison based on the day of the week of presentation – hence the “instrumental variable” for the instrumental variable analysis performed alongside their multivariate analysis. The authors made assumptions that individual patient characteristics would be unrelated to the day of presentation, but that downstream test frequency would. The authors then use this difference in test frequency to thread the eye of the needle as a pseudo-randomization component to aid in comparison.

There were 571,988 patients presenting on a weekday, 18.1% and 26.1% of which underwent some non-invasive testing within 2 and 30 days of an ED visit, respectively. Then, there were 354,645 patients presenting on a weekend, with rates of testing 12.3% and 21.3%. There were obvious baseline differences between those undergoing testing and those who did not, and those were controlled for using multivariate techniques as well as the aforementioned instrument variable analysis.

Looking at clinical outcomes – coronary revascularization and acute MI at one year – there were mixed results: definitely more revascularization procedures associated with exposure to non-invasive testing, no increase in downstream diagnosis of AMI. The trend, if any, is actually towards increased diagnoses of AMI. The absolute numbers are quite small, on the order of a handful of extra AMIs per 1,000 patients per year, and may reflect either the complications resulting from stenting or a propensity to receive different clinical diagnoses for similar presentations after receiving a coronary stent.  Or, owing to the nature of the analysis, the trend may simply be noise.

The level of evidence here is not high, considering its retrospective nature and dependence on statistical adjustments.  It also cannot determine whether there are longer-term consequences or benefits beyond its one-year follow-up time-frame. Its primary value is in the context of the larger body of evidence.  At the least, it suggests we have equipoise to examine which, if any, patients ought to be referred for routine follow-up – or whether the role of the ED should be limited to ruling out an acute coronary syndrome, and the downstream medical ecosystem is the most appropriate venue for determining further testing when indicated.

“Cardiovascular Testing and Clinical Outcomes in Emergency Department Patients With Chest Pain”

http://jamanetwork.com/journals/jamainternalmedicine/fullarticle/2633257

The Door-to-Lasix Quality Measure

Will [door-to-furosemide] become the next quality measure in modern HF care? Though one could understand enthusiasm to do so ….

No.

No one would understand such enthusiasm, despite the hopeful soaring rhetoric of the editorial accompanying this article. That enthusiasm will never materialize.

The thrills stacked to the ceiling here are based on the data in the REALITY-AHF registry, a multi-center, prospective, observational cohort designed to collect data on treatments administered in the acute phase of heart failure treatment in the Emergency Department.  Twenty hospitals, mixed between academic and community, in Japan participated.  Time-to-furosemide, based on the authors’ review of prior evidence, was prespecified as particular data point of interest.

They split their cohort of 1,291 analyzed patients between “early” and “non-early” furosemide administration, meaning within 60 minutes of ED arrival and greater than 60 minutes. Unadjusted mortality was 2.3% in the early treatment group and 6% in the non-early – and similar, but slightly smaller, differences persisted after multivariate adjustment and propensity matching. The authors conclude, based on these observations, the association between early furosemide treatment and mortality may be clinically important.

Of course, any observational cohort is not able to make the leap from association to causation.  It is, however, infeasible to randomize patients with acute heart failure to early vs. non-early furosemide – so this is likely close to the highest level of evidence we will receive.  As always, any attempt at adjustment and propensity matching will always be limited by unmeasured confounders, despite incorporating nearly 40 different variables. Finally, patients with pre-hospital diuretic administration were excluded, which is a bit odd, as it would make for an interesting comparison group on its own.

All that said, I do believe their results are objectively valid – if clinically uninterpretable. The non-early furosemide cohort includes both patients who received medication in the first couple hours of their ED stay, as well as those whose first furosemide dose was not given until up to 48 hours after arrival.  This probably turns the heart of the comparison into “appropriately recognized” and “possibly mismanaged”, rather than a narrow comparison of simply furosemide, early vs. not.  Time may indeed matter – but the heterogeneity of and clinical trajectory of patients treated between 60 minutes and 48 hours after ED arrival defies collapse into a dichotomous “early vs. non-early” comparison.

And this certainly ought not give rise to another nonsensical time-based quality metric imposed upon the Emergency Department.

“Time-to-Furosemide Treatment and Mortality in Patients Hospitalized With Acute Heart Failure”

http://www.onlinejacc.org/content/69/25/3042