Skip to content

Wisdom of Crowds: The Guiding Light

Share on twitter
Share on facebook
Share on linkedin

Wisdom of Crowds

Have you ever felt like a unicorn? Well, I certainly have. I felt that way when I got my first computer, then again when I filled in my first Excel spreadsheet, and even when I built my first RapidMiner process. I felt like the only person on the planet with a problem and no knowledge on where to begin solving the problem. But this feeling never lasted very long. Why?  Because there’s always been friends, colleagues, tech support and simply people I knew who had gone through similar situations, and provided me with useful tips to get me started. All of us have experienced this numerous times – as a child learning, in our professional careers, even in sports.

With advanced analytics, it can be very similar experience if you have the right tool. The core decisions to be made when building an analytical workflow in its simplest form, is selecting a next step, and then selecting options for the next step.

This process of selecting and defining the parameters necessary for a complete workflow looks easy when a tool has limited functionality and very few options. But you don’t build a house with just a hammer. Don’t be fooled by vendors who’ll sell you an “x” to use as a “y” [now fighting back the urge here to name names.]  What you really need is a wide breadth of functionality combined with intuitive guidance to ensure with the highest degree – that the path you’re on – is the right one. RapidMiner provides both.

The Guiding Lightrapidminer wisdom of crowds

RapidMiner gives you that community experience. There are more than 250,000 RapidMiner users worldwide, brilliant minds who have had tasks similar to yours – building some analytical process to come up with a predictive model to support business, just as an example. You don’t know any of them? No worries, that’s where technology innovation comes in: just like Amazon shows recommendations for products based on what other people have bought, RapidMiner delivers recommendations to you on what to do next based on what other RapidMiner users have done in similar situations.

Since version 6.1, RapidMiner Studio has shown recommendations on what operator to add to your process as a next step. This was only the beginning as we have committed to adding more and more features that leverage the Wisdom of Crowds, i.e. the knowledge, experiences and best practices of RapidMiner users. We continue on that path in the next release of RapidMiner Studio which will feature an improvement of the operator recommender introduced in 6.1. By focusing on the particular part of the process a user is working on, we have drastically improved the recommendations. The recommendations are not only extremely helpful for beginners but for advanced users allowing them to build their processes much faster. In addition, we have also compiled a completely new feature that guides users in setting the parameters for an operator by recommending what others have specified.

Crowd Control

Nothing attracts a crowd, like a crowd.  Several years in the making, RapidMiner’s Wisdom of Crowds has grown from a powerful idea embraced by an enthusiastic open source community to highly differentiating recommendations engine on a commercial scale.  Our early innovation in this arena is now being echoed by other industry thought leaders, with a special shout out to GoodData, who just introduced Insights As A Service, a Wisdom of Crowds-like capability now a part of their BI platform.  Stay tuned this year as our Wisdom of Crowds recommendation engine continues to expand its intelligence quotient, helping business analysts with easier and faster guidance on building powerful advanced analytics. 

On a final note, I find RapidMiner’s Wisdom of Crowds features particularly thrilling as it uses our own analytics and machine learning to help our RapidMiner community to come up with analytics for their very own domains. How does that work? I recommend you hear it for yourself from our CEO, Ingo Mierswa, in this latest installment of Five Minutes with Ingo.

Ingo Mierswa

Ingo Mierswa

Ingo Mierswa is the founder and president of RapidMiner and an industry-veteran data scientist since starting to develop RapidMiner at the Artificial Intelligence Division of the TU Dortmund University in Germany. Mierswa, the scientist, has authored numerous award-winning publications about predictive analytics and big data. Mierswa, the entrepreneur, is the founder of RapidMiner. Under his leadership RapidMiner has grown up to 300% per year over the first seven years. In 2012, he spearheaded the go-international strategy with the opening of offices in the US as well as the UK and Hungary. After two rounds of fundraising, the acquisition of Radoop, and supporting the positioning of RapidMiner with leading analyst firms like Gartner and Forrester, Ingo takes a lot of pride in bringing the world’s best team to RapidMiner.