Today’s hardest problems require a new approach to crunching huge quantities of data. And a Waltham, Mass.-based startup, Paradigm4, has figured out a better way to solve them. Big organizations — including life sciences companies, the NIH, medical care providers,and insurance companies — are taking advantage of its solution.
That’s what Paradigm4′s CEO Marilyn Matz — and my teaching assistant in a course I took at MIT — explained in a February 7 interview.
As I have learned from interviewing executives at Cloudera, one of the most popular ways to solve big data problems is to break complex problems into smaller pieces, send each piece to a different computer, solve the smaller pieces in parallel, and then pull the results together for analysis. This is the approach used by an open source program called Hadoop and its application programming model, MapReduce.