Is Big Data a Big Deal?

Not Without Correct Software!

Gregory M. Kapfhammer

creative commons licensed ( BY-NC-ND ) flickr photo shared by sunface13

What is Big Data?

Electronic music group from New York City?

Yes, but not in this context!

Create models, make predictions, and take action!

"V" Times Three?




flickr photo shared by Elad R under a Creative Commons ( BY-NC ) license

Wait, have we missed a "V"?

We Need Veracity!

Confidence in the correctness of the data and software

Achieved through verification and validation

flickr photo shared by Brandon Giesbrecht under a Creative Commons ( BY ) license

Software Testing

Execute the test cases against the system under test

Check to see if the system's output is as expected

Status Report

Testing data mining and database systems

Research is preliminary and transfer is not common! photo shared by Olu Eletu under a Public Domain license


Testing: scale to the level of big data systems

Big Data: Holistically consider all of the four "V"s

Next Steps?

Let's Talk!

Collaboration between research communities

Demonstrate the correctness of big data systems photo shared by Alejandro Escamilla under a Public Domain license

Is Big Data a Big Deal?

Of course it is!

A Bigger Deal

Greater impact with high-quality big data systems

Important societal benefits with correct predictions

Enhance and sustain our influence — together! photo shared by Aundre Larrow under a Public Domain license