Customer Story

How NCP is Reinventing Customer Analytics: Increasing Engagement During COVID-19 with RapidMiner

Reducing Churn and Re-Engaging Customers with Data Science

Overcoming Common Data Challenges Requires Data Science 

Video with Thomas Schleicher, Ph.D., VP of Measurement and Data Science at NCP

Data is at the core of what National Consumer Panel (NCP), a joint venture between NielsenIQ and IRI, does. As a market research company, their retail and manufacturing clients rely on the data they provide to determine what products to sell and to understand how their consumers’ shopping habits change over time. But, to get that data, they need a large volume of committed panelists to report their shopping behaviors. As their panelists are similar to a group of subscribing customers, NCP does sometimes experience churn and periods of lower engagement. 

In this video, NCP’s VP of Measurement and Data Science, Thomas Schleicher, talks about how NCP uses data science to bolster panelist engagement and provide high-quality consumer data to their clients.

Considering working with RapidMiner? Watch the full video below to see what challenges our platform has helped the data science team at NCP overcome, and how working with RapidMiner has improved their team’s data science knowledge and skills. 

00:04 Hi, I’m Tom Schleicher, the VP of Measurement and Data Science at National Consumer Panel. I’d like to share with you my experience working with RapidMiner during my time at NCP. Before doing so, it will be helpful to share some background about NCP. NCP is a joint venture of IRI and NielsenIQ, two leading companies in consumer panel market research. Our longitudinal consumer panel data serves a multitude of clients, including retailers and manufacturers across numerous industries. NCP runs the operations needed to maintain this longitudinal consumer panel. It is geographically representative of the United States, and it is balanced on several census-based demographic characteristics. Our panelists, actual consumers across the US, send us detailed data regarding their shopping habits. They also respond to a variety of surveys regarding their purchase behavior. By continuing to meet KPI targets, NCP ensures high-quality data for our JV partners and their many clients. The measurement and data science team that I lead at NCP is responsible for a number of analytical tasks that help to ensure we meet or exceed our KPIs.

01:22 To give a little bit of an overview of the analytics environment at NCP, it’s worth sharing that there’s quite a range from visualization to predictive models. Very important to our clients is our KPI reporting. That includes dashboard visualizations as well as benchmark indexing. And then there’s a host of separate but interrelated analytics that we perform on a regular basis, which includes panelist churn modeling, forecasting the need for new panelist recruitment, test and control comparisons that we might evaluate different promotions, sample selection that could be used to make sure we have balanced comparisons for surveys that our clients may be wanting, and text analytics. While my team’s focus is on the data analytics, NCP is fundamentally about data operations and client service. Data operations include the collection and cleansing of data and preparing it for distribution. It also includes multiple sources and multiple storage systems to house all of that data and, eventually, reporting that data back to our partners. Not only is that data feeding the deliverables to our clients, but it’s also important in terms of the updates that we provide to our partners. They want to make sure that we are adhering to certain KPIs and standards of data quality.

02:54 The relevance of NCP’s panel operations to common business problems, I think, will be familiar for many of you. Our panelists are sort of like subscribing customers as such. As mentioned already, we do experience churn and have goals for retention of our best subscribers. We also go through CRM and lifecycle management topics. Panelists are also our data providers. As such, they are the source of our raw material. And we have issues of supply and demand for those panelists, and that also relates to issues of quality control as well as cost management. Finally, our raw data is processed into deliverables, our product. And that’s what provides value to our client partners and to their clients. It underscores the importance of the KPIs that we manage, too. And the variety of analytics that are in our toolkit helps to ensure smooth operations and the best quality data. With that as background, I’d like to answer a few questions to share with you some of my experience with working with RapidMiner in the time I have been at NCP.


04:11 First, assess your current and future client needs. Understanding, especially, external client needs are of the highest importance, at least for us. But I think it’s also important to consider internal experts and clients. Subject matter experts that are a cross function can help you to understand how each department contributes to the success of your business. And if you’re not aware of that, you may benefit from having that kind of contact. It helps you to ensure that you have the right kind of data, and it also allows you to capitalize on synergies that may not be obvious if operating in silos. You may discover allies who may also help you advocate for any needed investment. Second, I would say focus your attention on solving a small but meaningful problem, and this will help you to keep your initiative manageable as well as to deliver the results quickly. It’ll help you to demonstrate value to senior management on a smaller investment first in order to make it easier later on when you want to get buying for a larger investment. You’ve demonstrated that you’ve added value on the smaller version. Third, I would assess your analytic bench strength. As needed, invest in training. It’s probably more important the more junior your team is. But even at more senior levels, it is still important to keep people fresh and up to date in this evolving field. And lastly, you could even consider consulting as needed.


05:44 Well, I would first say evaluate not only the software, but the support. For me and NCP, RapidMiner was one of a number of possible options that we evaluated, and their support really was what set them apart from a number of other tools that had pretty good functionality as well. Especially early on when we were first investing in them, they invested time and expertise with us to help us achieve our analytic goals out of the gates. They were less concerned with upselling than providing hands-on consulting and shared expertise. And over the years, although some personnel have changed, the organization’s emphasis on customer satisfaction has remained. Another piece of advice I would extend is to take inventory of what your future analytical needs may be and not just your current needs. With the proliferation of data and analytical tools and solutions that are available, it is increasingly important to anticipate those future needs. Consider how well they may work with your current and planned IT infrastructure, and also consider how well it may work with any ETL and visualization tools that you may have.


06:58 Within NCP, I think many organizations bringing together several well-maintained but disparate data sources has been a significant challenge. My team has worked closely with our ETL team to build the right data warehousing business intelligence system and to pull all the data together. With the right data in the right place, NCP has leveraged RapidMiner’s analytics capabilities to address a number of common business questions, including predictive modeling, targeting and segmentation, churn reduction, and text analytics. Finally, beyond NCP, marketplace changes and data technology expansion continue to present challenges that actually present opportunities. And at NCP, we will leverage RapidMiner as an important tool to mine those opportunities for value.


07:51 Well, RapidMiner allows us to handle large amounts of data and efficiently leverage a wide range of machine learning algorithms. For example, predictive modeling identifies characteristics of panelists most likely to perform well. That, in turn, has helped us to recruit panels that are much more likely to succeed and save a lot of investment in the process. Text analytics have helped us to turn panelist feedback into insights and actionable decisions. Specifically, combining what our panelists told us with some of our quantitative data has led to more effective targeted engagement efforts with our panelists, our customers. Data science knowledge then helps to translate into value for our business and coming up with a number of solutions including improved marketing effectiveness, reduced churn, improved cost efficiencies, discovered or uncovered new insights through cross functional synergies. And also it can help you to confirm what you know or, more importantly, disprove what you thought you knew as in the case when you might have been knowing something in the past, but it’s no longer true.


09:04 Include predictive analytics as a reflexive part of your business process. Tap into stakeholders’ business acumen to inform your data inputs as well as to ensure that you have meaningful outputs that are generated. This also fosters cross functional buy-in and cultivates shared ownership. It helps to focus attention beyond any one department’s needs as well as driving better business decisions for the whole organization. Recognize that having a robust, advanced analytics platform is critical to efficiently address evolving business needs particularly during uncertain times. The marketplace and industries relying on data is increasingly competitive, and data analytics solutions continue to evolve as well as offer cutting edge solutions. If I were to sum it up, I would say having a tool like RapidMiner with the support they provide can help your organization not only keep up with the ongoing proliferation of data but, with the right focus, help to stay ahead of the curve. That’s all for now. I hope that you found my shared experiences partnering with RapidMiner at NCP informative. Thank you and have a great day.

Related Resources