Technical Debt is a Social Problem - Gordon Shotwell

February 5, 2020 Gordon Shotwell

Technical debt is a big problem for the R community. Even though R has excellent support for testing, documentation and packaging code it has the reputation that it is not suitable for production applications because data scientists don’t pay enough attention to technical debt within their codebases. Most people think of technical debt as an engineering problem. We choose to make our current work cheaper at the expense of needing to do more work down the road. But when you look closely at the root causes of technical debt they are almost always about interpersonal relationships. Developers have trouble empathizing with other users of their code and so don’t spend the time to make that code easy for future developers to use and understand. In this talk I argue that we should think about technical debt as a social problem because it gives us insight into why it’s so hard to pay back. I then provide a practical roadmap of how to introduce best practices into your data science team.


View Slides.

About the Author

Gordon Shotwell

Gordon is a lawyer by training, and has worked with survey companies, correctional facilities, and web properties to improve their data analysis processes to allow more people to make better decisions. He is currently a Senior Data Scientist at Socure where he develops data products to help protect people against financial fraud.

Follow on Twitter Follow on Linkedin More Content by Gordon Shotwell
Previous Video
RMarkdown Driven Development - Emily Riederer
RMarkdown Driven Development - Emily Riederer

RMarkdown enables analysts to engage with code interactively, embrace literate programming, and rapidly pro...

Next Video
One R Markdown Document, Fourteen Demos - Yihui Xie
One R Markdown Document, Fourteen Demos - Yihui Xie

R Markdown is a document format based on the R language and Markdown to intermingle computing with narrativ...