Apr 23 2013
Forget Excel: This Was Reinhart and Rogoff’s Biggest Mistake | The Atlantic
See on Scoop.it – lean manufacturing
“For an economist, the five most terrifying words in the English language are: I can’t replicate your results. But for economists Carmen Reinhart and Ken Rogoff of Harvard, there are seven even more terrifying ones: I think you made an Excel error.”
While not a story about manufacturing, it is a cautionary tale that manufacturing professionals who use Excel should ponder.
It is about two economists from a prestigious institution whose sweeping conclusions have been leading foreign governments to adopt disastrous policies and fueled the argument in favor of the same policies in the US.
Reviewing the Harvard paper, researchers Thomas Herndon, Michael Ash and Robert Pollin have discovered that Reinhart and Rogoff had selectively excluded data, calculated averages in “unusual ways,” and made a mistake in an Excel calculation.
On the face of it, the general sloppiness of the work would be forgivable in a summer intern, but the Excel error should give us pause. When inputting the range of a sum, they didn’t drag the cursor down far enough and left five rows out.
With Excel, this kind of error is easy to make and difficult to detect. In spreadsheets generated by others, I have found products with no sales showing positive revenues, and formulas with exponents applied to the wrong parameters. And I suspect others may have found errors in my own.
Following are a few recommendations that may protect you from egg on your face:
- Use meaningful names for cells and ranges. Refer to cells as “GDP” or “Viscosity” rather than “A3” or “RR1.” It will be easier to validate formulas, as they will more closely resemble their mathematical forms and errors will stand out.
- Break down complex formulas into simple ones, with additional cells or columns for intermediate results.
- Include comments explaining your calculations.
- Whenever possible, use built-in functions or pre-existing templates from a trusted source.
- Explain the innards of your spreadsheet to a colleague for validation, and return the favor for his or her spreadsheets.
- Use Excel for calculations and graphic displays, but NOT as a database management system (DBMS). Use a real DBMS for data storage and retrieval.
See on www.theatlantic.com
David Armstrong
April 23, 2013 @ 9:06 am
“The widespread availability of statistical computer packages has put mathematical bazookas in the hands of some people who would be dangerous with an abacus.” – Arnold Barnett, 1982
I have lived with the book, The Elements of Spreadsheet Style, by John Nevison, 1987 for excellent guidance on spreadsheet design. Modeled after Strunk and White’s, The Elements of Style, it has great concepts to clarify, communicate and eliminate errors of the types referenced.
http://john.raffensperger.org/ArtOfTheSpreadsheet/ also appears to have good guidelines.
One-piece Flow for Information Products? | Michel Baudin's Blog
February 7, 2015 @ 6:07 pm
[…] instead of using descriptive names. And they won't know any better than using "simple" tools like Excel as data stores, or distributing documents as email attachments. Not to mention the countless hours that will be […]
Is Vendor Selection Really The First Step in ERP Implementation? | Michel Baudin's Blog
January 26, 2016 @ 11:19 am
[…] Transaction processing only. The systems don't support analytics. All analytical work is done on extracts to Excel, which is initially easy but deteriorates as the number of people involved and the complexity of the analyses increase, errors creep in, data quality and security are lost. Sometimes this leads to disastrous consequences. […]
Introduction to R for Excel Users | Thomas Hopper | R-bloggers | Michel Baudin's Blog
May 8, 2016 @ 12:11 pm
[…] over two decades, I limited the analyses offered to my consulting clients to what I could do with Excel, because it was the only tool they had, and I wanted to reproduce my […]