Studying Anti-Gun Studies: Confusion, Obfuscation & Irrelevance

Gun Research
Studying Anti-Gun Studies: Confusion, Obfuscation & Irrelevance
Doctors for Responsible Gun Ownership
Doctors for Responsible Gun Ownership

USA –  -( They’re at it again, so we are too.

They” are the ‘gun violence is a public health issue’ crowd, who keep propounding theories about how guns should be treated as autonomous risk factors for injury and death.

DRGO will keep setting them straight.  If we weren’t volunteers, we’d thank them for keeping us so busy.

The big news from the front this week was an article appearing May 16 2016 in the Annals of Internal Medicine, Yes, You Can: Physicians, Patients, and Firearms by Garen Wintemute and two other MD/MPH’s. 

Accompanying it is a laudatory editorial that makes just one point accurately, though from a different point-of-view than ours: physicians are “ill-equipped to address firearm safety with patients”.   The article gives the impression that it offers objective advice to physicians about when and how they may inquire about their patients’ gun ownership.   Its Table 2 summarizes the conditions in which they recommend such questioning.

As Dr. Young explained the same day in a Medscape article, Gun Laws May Allow Docs to Counsel Patients, Report Ownership, it is always necessary when there are indicators of immediate danger (Wintemute’s first category).  This applies only in some of his second category (“Individual-level risk factors”), and is unethical profiling in others of those and in all of his third category labelling demographic groups at higher statistical risk of violence.

This is the same Garen Wintemute who has made it his life’s work to justify restricting and minimizing civil gun ownership, the same one whose work, the California state legislature is considering funding from state tax receipts.  (See DRGO Goes to Sacramento to Stop California Junk Science.)

A section of his May 16 paper, “How to Ask and Counsel”, concludes with Wintemute’s characteristic refrain:

“The advisability of having firearms at home may come up for discussion. Clinicians can point to a large body of evidence establishing that, on balance, firearms in the home (81) and purchasing a handgun (82) are associated with a substantial and long-lasting increase in the risk for violent death.”

Perhaps now that patients are becoming aware that clinicians should not force organized medicine’s anti-gun politics on them, the new tactic is for anti-gun doctors to help the subject “come up for discussion”.

The two studies cited in that paragraph should be the justification for assuming the danger “of having firearms at home.”  Number 82 is from a 1999 paper by Wintemute, Mortality Among Recent Purchasers of Handguns, which trumpets the unremarkable finding that the risk of homicide and suicide “by firearm” is higher among people who own guns than among those who do not.

Likewise, we suppose that the risk of dying in bathtubs is more likely in households with full bathrooms.

The other, number 81, refers to a 2014 study, also in Annals of Internal Medicine, The Accessibility of Firearms and Risk for Suicide and Homicide Victimization Among Household Members, by Andrew Anglemyer and two co-authors.  As a more recent look at the question by authors other than Wintemute that assesses many studies together (a ‘meta-analysis’), we thought this one worth examining in some detail.

Any meta-analysis claiming to draw reliable conclusions from many other studies faces special obstacles.  Besides the usual potential for many kinds of bias (see DRGO’s Reading ‘Gun Violence’ Research Critically), a study of studies has to demonstrate that it is examining consistent and comparable enough work for a synthesis to be valid.  Dr. Margulies examined these questions, and found that this study comes up lacking.

First of all, their data base it is so incomplete and disparate as to be meaningless. They note that out of about 31,000 firearms deaths in 2009, there were 10,000 suicides, 52% of which were by firearm, and 4,057 homicides, 66% by firearm. They don’t discriminate between criminal and justified homicides.

They reference over 90 sources, but discuss just 16 of them. They state that they reviewed over 6000 articles and excluded half, but gave reasons for only 58 of those exclusions. They say they included an article by expert criminologist and generally pro-gun researcher Gary Kleck, but never mention it again. They include the long and rightly ridiculed seminal 1993 Arthur Kellerman anti-gun article, highlighting it in Table 1, but did not discuss it specifically either.  They don’t even mention premiere criminologists and economists who have studied firearms safety issues, like Don Kates and Gary Mauser, James Wright and Peter Rossi, and John Lott.

The authors do acknowledge that their selection of control comparisons had potential bias, and report that part of the control group in one study included hospital inpatients. Few hospital inpatients have access to firearms.

Their Figure 3 compares two time periods, pre-1997 verses 1997 to 2003. They note that during that time frame suicides increased and homicides decreased. They certainly had access to data after 2003, because they also discuss suicides and homicides in 2009. There’s no explanation for their timeline choices. They also note that 37% of studies were performed pre-1997 and 63% were performed from 1997 to 2013 (while using an ‘N’, or total, of 10, which can’t result in a 37:63 split).

The authors point out that men and women commit suicide at about the same rate, but men are more likely to use firearms and women are more likely to use poisons. How is that relevant?

They make a major point that women are more likely than men to become victims of homicide. From law enforcement statistics, we know that domestic violence produces many more injuries and does occur in populations with significant access to firearms.  Yet only a small percentage of those domestic violence injuries involved firearms (perhaps a function of their relatively lethal impact). But nowhere do they address the question of whether women (or anyone) could gain the advantage by arming to protect themselves.

They falsely describe the ‘chilling’ effect of the 1996 federal law supposedly prohibiting use of federal funds for firearms research.  The amendment actually merely prohibited federal funds to be used to proselytize for gun control, which the Centers for Disease Control, along with organized medicine, had been doing.

Finally, in a long section of the paper the authors describe their study’s limitations, demonstrating how their work has no consistent framework by which to draw objective conclusions:

  1.    It was not a new study itself, but a review of prior studies, having to note that many of them had biases that could not be controlled for.  For example,

“. . .other sources of bias are an ever present threat, among them using purchase date or military duty as a proxy for firearm access or ownership may not accurately represent ownership…”

  1. The authors ignored well known statistical methods of analysis and chose to use inappropriate analytic approaches that only make it seem like they are doing serious science:

“We synthesized heterogeneous populations of varying risks to estimate pooled odds ratios of death. We analyzed our pool of data by using fixed and random effects models.”

But “heterogeneous populations” don’t “pool” well to determine anything accurately, and the “fixed and random effects models” are different approaches to understanding varying outcomes.  The point here is that neither their data (many vastly differing studies) nor their varying analytic approaches could possibly produce cogent findings.

  1. They also comment on potential misclassification of firearm exposure and cause of death in the selected studies:

“We considered studies of suicide and homicide victims by any means and firearm specific outcomes may differ. . .”

Yes, the presence or absence of firearms may or may not have anything to do with outcomes of death by other means.  And, by ignoring potential means substitution, they overlook that firearms may have less to do with ultimate mortality even when they are used.

  1. The authors choose papers, locations for study, and sub-populations that do not reflect the population at large:

“[I]n studies with homicide outcomes, whether the presence of a firearm among case patients is the result of environmental characteristics of living conditions is unclear. . . Some persons may purchase a firearm for protection because of neighborhood crime. . . [This behavior t]ransfers the risk from [individual] ownership of a firearm to the neighborhood. . .”

Right.  Guns may be more popular in areas because criminals want to use them violently, or they may be more popular because it is a violent area and people want to protect themselves.  If the authors had commented that homicide rates are excruciatingly high in many inner-city African-American populations and are largely caused by black on black crime, a meaningful discussion might have begun. They also ignore the paradox that those same urban areas with the highest crime and violent death rates are generally where firearms have been most severely restricted.

Anglemyer et al simply can’t explain anything about the general risk of firearm possession on suicide and homicide, beyond the obvious fact that firearms are more likely to be used if they are present.

This is not a scientific study. It’s at best a polemic, and a confusing one at that.  Recognizing this undercuts every aspect of its conclusions.

That’s what we find almost any time we dissect “studies” that purport to show that the mere presence of guns causes more harm than good.  The harm is always a matter of correlation and conjecture, not causation.  The good is never acknowledged.


—Robert A. Margulies, MD, MPH is an emergency medicine specialist, retired Navy Medical Corps captain, and firearm trainer with multiple certifications from the NRA and Massad Ayoob Group.

— Robert B. Young, MD is a psychiatrist practicing in Pittsford, NY, an associate clinical professor at the University of Rochester School of Medicine, and a Distinguished Fellow of the American Psychiatric Association.

Doctors for Responsible Gun Ownership, a project of the Second Amendment Foundation.

  • 8 thoughts on “Studying Anti-Gun Studies: Confusion, Obfuscation & Irrelevance

    1. Because nobody wishes to alienate a doctor, the only answer is to lie. “Don’t own any” followed by either “never had any” or “got rid of ’em.” My doctors (I only have two) are active hunters and one is a certified instructor. Both have children who are being carefully trained in the use of them for self defense as well as hunting and competition.

    2. Most gun control arguments are post hoc propter hoc fallacies (‘what came before caused what came after”).

      A person obtains a weapon which is later used in a homicide. The post hoc fallacy concludes the weapon caused the death. The fallacious gun-control reasoning ignores the fact that any non-accidental homicide is the result of motivation and intent on the part of the murderer. The death would have happened anyway by some other means if the gun was not available.

      The post hoc fallacy usually does not apply when speaking of self-defense since the gun is frequently the only means the person had to effectively defend themselves. In many if not most cases, the defender without a gun would have been a helpless victim.

      Additionally, while there is a moral difference between murder and justifiable homicide, most gun control arguments amorally (that is, “without moral distinction”) lump them together as homicide. The moral vacuum of the gun control position is also revealed when they include gun suicides in gun fatality statistics. The same post hoc fallacy applies because the gun control argument fails to account for the motivation of the person and the other means available to cause their own death.

      1. Well said Richard, and I loved the use of Post hoc ergo propter hoc. You get four gold stars for the day. Now your next tasking is the explanation of thought in a society where the obviously wrong (e.g. men accessing the ladies room under cover of a dubious “gender identification” argument) is protected by the most coercive means that society’s governments can employ, and the obviously right is vilified by that same government’s propaganda.

      2. a very interesting review of readiy available statistics I read a while back compared Canada and the US on these points. Both nations have similar demographic and economic bases. Thus, many cultural/social phenomenon should be similar….. and when examined, are.

        The suicide rates in both are almost identical. The differences year on year are statistically insignficant.
        But means by which someone ends their life differ racisally. In Canada, handguns are almost nonexistant, per government coercion. Hardly anyone have them. In the US, probably half of the 100 million plus gun owners have one or more. In Canada, guns are almost never used in suicides. In the US, somewhere near half of suicides are by firearm.

        this lends heavy weight to the position that the desire to end one’s life is the driving factor, NOT the ready availability of the firearm. One might easily and accurately posit that if Canadians had ready access to handguns, the number of suicides would change little, but the means employed would quickly switch to the handy dandy point it at your head and squeeze method. Conversely, were handguns as rare south of 54.40 as they are northward, our suicide rate would change little, but the use of the handgun to accomplish the self-assigned task would quicky drop to nearly that of Canada.

        One more glitch in the US statistics…. one might legitimately question whether ALL “suicides by gun” are indeed suicides. How many were actually murders staged to APPEAR to be suicides?

    3. There are more than 310 million guns in the United States, and about 30, 000 gun related deaths, including suicides.

      There are 970,000 doctors in the United States, and the medical profession is responsible for 440,00 deaths, the third highest cause of death in the United States.

      It’s easy to say “doctor, heal thyself” but that is potentially dangerous for them.

    4. This statement :

      “They note that out of about 31,000 firearms deaths in 2009, there were 10,000 suicides, 52% of which were by firearm, and 4,057 homicides, 66% by firearm. ”

      So out of 10,000 firearms suicides, 52% were by firearm? And 66% of the firearms homicides, were by firearm? That doesn’t even make sense.

      1. part of the point of the article…. that their data are questionable at base, thus their conclusions are delusions at best. Who said issue advocates and lobbyists have to make sense? If you can’t win them with trith, baffle them with meadow muffins. A very old trick. Sad thing is, it works all too often. I had to go back and reread your response twice before I caught it.

    Comments are closed.