The violent death rate estimate published by Observatorio Venezolano de Violencia (OVV) must be one of the two or three most cited figures about Venezuela. OVV’s contention that 27,875 Venezuelans died violently in 2015 has been cited by virtually everyone, from Time magazine and Associated Press to Venezuelanalysis, Wikipedia, Vice News and The Miami Herald: everyone.

The OVV estimate is a totem, a touchstone of the way sophisticated analysts understand Venezuela.

Later today, Caracas Chronicles will publish the result of a detailed analysis by Professor Dorothy Kronick of the University of Pennsylvania that demonstrates that figure is very likely wrong. And not by a little, by a lot. As best as we can tell, OVV overestimates the violent death rate in Venezuela by a staggering 6,000 victims or so. That makes their 2015 estimate a whopping 29% higher than ours (90 per 100,000 versus 70 per 100,000).

Over the last four months, I’ve had front row seats to Professor Kronick’s investigation into what exactly went wrong with the OVV estimate (and yes, calling a close friend like Dorothy “Professor Kronick” sure feels weird, but in this context, she is very much Professor Kronick.)

Her deep dive into how this happened had all the hallmarks of a good detective story: the careful sifting through clues, the false starts, the doubts, the hunt for corroborating details, the vital push-along by a well-placed source, and finally the break in the case, that a-ha moment when it all falls into place.

The culprit in the OVV case, we’ve come to see, was not so much malice as carelessness. It’s clear, of course, that if CICPC simply did its job and published the statistics it already collects, none of this need have happened. But official opacity doesn’t excuse sloppiness: just the opposite. In a data poor environment, researchers need to be more scrupulous, not less.

You can read Dr. Kronick’s report for a detailed explanation of what went wrong, and how. Scrambling for data that was getting harder and harder to obtain, OVV researchers made a major blunder. They built their estimate on the basis of data whose definition was unclear, whose provenance is still unclear, and from a source even they now admit they didn’t entirely trust. As a result, they double-counted a substantial number of violent deaths in 2013, showing a big upswing in homicides at a time when the murder rate was actually falling somewhat.

It was the kind of mistake that would be perfectly understandable and not a big deal in the hands of anyone else. For an academic research body whose whole purpose is to quantify violence in Venezuela, though, it amounts to serious malpractice.

But it didn’t end with the blunder over the 2013 data, because OVV’s subsequent use of projections ensured that the 2013 mistake was amplified over time, making the in 2014 estimate more wrong than that of 2013, and the and 2015 even wronger.

Each January OVV puts out a new murder-rate estimate for the previous year, to a flurry of domestic and international media attention. The fast-growing trend contributed to a sense of an out-of-control society. It fueled political tension, as opposition political leaders brandished it as more evidence of government lies. In reality, lost in the hyperpolarized melodrama, the violent death rate has actually leveled off somewhat since 2012.

Professor Kronick was adamant that OVV needed to be given multiple chances to review and comment on her findings.

“Maybe it’s all just a misunderstanding,” she kept telling me, “maybe I made some mistake.” She checked and rechecked, going far, very far, to give OVV the benefit of the doubt, to allow it to put forward a defense, or failing that, a correction.

Their response, when it came, was hard to figure out.

OVV lead statistician Alberto Camardiel reviewed Professor Kronick’s work, agreed she had accurately portrayed OVV’s methodology…and left it at that.

I find that response unacceptable.

If OVV understands and accepts that its murder-rate estimate is profoundly flawed, surely it follows they must issue a public retraction along with a correction.

Millions of people in Venezuela and around the world have been misinformed by OVV’s blunder. The dozens of well intentioned journalists who have propagated a mistake in repeating OVV’s deeply flawed estimate are entitled to an explanation about what happened, a retraction and a correction.

None of this is to suggest that the violence epidemic in Venezuela is anything less than catastrophic. It is. But we can’t begin to face up to that catastrophe without a careful understanding of its scale, and in that quest, OVV has done our country a real disservice.

12 COMMENTS

  1. Wow. This matters enormously. Who would’ve thought the next major scoop would be about not something the government did, but how one of the good guys was so irresponsibly sloppy?

    Do we have any working theories about why the government didn’t open fire on OVV’s numbers if they knew they were wrong? Maybe this is just another proof that chavismo loves and thrives in polarization.

  2. Without knowing anything about the statistics, two people I know personally have lost close family members to violence in the last two months. What is worse is that their reactions have been to attempt to shrug it off. The Venezuelans have become numb to the violence. In other places in the world, we hear people say on the news reports, “I always thought that this sort of thing happened to other people. I never imagined it could happen to my family.” In Venezuela, no one says that. We know better, because even if our own family has not been affected we all know people who have been.

  3. I bet there are people inside the OVV that know this and probably mentioned to their bosses and they decided not to change the estimate.

    “When the legend becomes fact, print the legend.”

  4. Si a la gente no le importaba que maten por año 15.000 personas, igual les va a importar un pito que maten 5.000 ó 500.000.

    • Missing the point here. Good stats are a prerequisite for understanding problems and designing public policies. This isn’t about the average Venezuelan caring about the problem, it’s about how our future leaders will keep track of this number and will act to bring it down.

      • You’re right there, the people that should care about this is the one that’s making the policies, yet, if the “average Pedro Pérez” doesn’t care at all, much I fear the politician in turn won’t care either, because if the population doesn’t give a rat’s ass about crime rates, then it doesn’t affect the result of the next election.

        That level of inhuman numbness is one of the reasons chavismo has managed to avoid ALL the political cost of letting people to be killed as if this country was a war zone.

        If the average people cares about crime, they’ll vote for someone that cares too, neither Chávez, Maduro nor ANY high-ranking chavista ever cared about crime rates, and let’s not talk about how they deliberately let the criminals do whatever they want to keep the population controlled. And yet still they never paid ANY cost for it because the chavista base (And a LOT of venezuelan people) can’t care less about how many thousands are murdered.

      • Ulamog makes a valid point. To argue in detail about the exact numbers is a distraction from the fundamental outrage that any civilized person should feel when confronted by such wholesale carnage. It really doesn’t matter if it is 70 or 90 homicides per 100,000. What matters, and no one disputes, is that the homicide rate is an entire order of magnitude higher than the global average!

Leave a Reply