AI & ML

Product research gets new life with AI

By
Joel Passen
February 22, 2023
5 min read

Product research is a crucial component of successful software product development. By understanding customer needs, preferences, and behaviors, technology companies can create products that create value for their customers and differentiate in the marketplace. Research helps businesses learn more about their target audience and users’ desired outcomes to develop features and functionality that increase customer engagement and dependency. Let’s face it, the name of the game is getting your customers addicted to your tool or platform. In addition, software product research provides valuable data that businesses can use to optimize customer acquisition and retention motions. 

Traditional product research 

To date, product research has been conducted through surveys, focus groups, and customer interviews. Traditionally, surveys have been emailed to customers immediately to gather qualitative and qualitative feedback. More recently, product experience platforms have given product researchers access to more dynamic in-app surveys, product usage analytics, and the ability to launch traditional surveys with fewer resources.

Customer interviews allow one to ask specific questions and dig deeper into customer motivations, pain points, and specific use cases. Interviews can be extremely useful when businesses try to develop new products or determine how to enhance existing ones. Customer interviews can also provide valuable insights into desired integrations, services, and more. 

Focus groups allow companies to observe how customers interact with products and better understand the user experience. Observing customers using the product can provide valuable insights that are unavailable through surveys or customer interviews. Additionally, observational research, such as shadowing customers in their own environment, can help uncover valuable insights that would otherwise remain hidden.

Here are a few other common ways teams conduct product research:

  • Examine competitors: Analyzing competitors' products and marketing strategies can give you valuable insights into customer preferences and behavior trends in the market.

  • Track sales data: Tracking sales data such as purchase histories, customer feedback, and website analytics can help you pinpoint which products are selling well and which are not so you can adjust your product design accordingly.

  • Monitor social media: Utilizing social media channels like Facebook, Twitter, LinkedIn, and Instagram can help you monitor customer conversations about your product or service and see what users are saying about it.

At the end of the day, what do all of the traditional product research methods have in common? They are labor-intensive, expensive, and time-consuming, requiring intricate expertise and specialization to operate. Another drawback to traditional product research methods is that the data and insights generated are typically used by a small group and not leveraged across the enterprise. 

AI is Changing How Teams Conduct Product Research

ChatGPT, the AI-powered natural language understanding (NLU) platform that helps automate conversations has catapulted AI into the business mainstream. Aside from being all the rage, business leaders are adopting AI now more than ever because of technological advancements that have made it more accurate and faster to deploy. Additionally, AI is becoming increasingly affordable, allowing businesses of all sizes to benefit from the latest advances in artificial intelligence. Furthermore, the increased availability of data has allowed for more sophisticated algorithms and models to be used, enabling better decision-making and providing a competitive edge for businesses that use AI. 

Product leaders recognize that customer expectations are changing rapidly, and AI can help them stay ahead of the curve. While AI and its practical applications are evolving quickly, here are a few ways that advanced data sciences are already impacting product research.

  1. Automating the data capture and cleaning processes

AI automation can take over mundane tasks such as data collection and normalization (cleaning or standardizing data for reuse and analysis), freeing up teams’ time to focus on more strategic initiatives. AI also facilitates the data cleaning and preprocessing (data joining and integration) activities required to glean knowledge from the raw data. 

  1. Eliminating privacy concerns

Privacy issues are often a roadblock for product researchers. Teams must be careful how they use personal data (PII) to discover product insights. Privacy restrictions and personal data limitations challenge legacy experimentation and research methods. AI is paving the way to alleviate these concerns so teams can move quickly. New advances in  PII Identification, de-Identification, synthetic PII generation, and pseudonymization provide teams with tools to iterate and innovate faster than ever without jeopardizing privacy regulations. 

  1. Making sense of previously untapped data sets

AI-powered platforms are making it possible to sift through data using natural language processing (NLP) and machine learning algorithms to quickly analyze large amounts of customer-generated information like email, tickets, call transcripts, and more. These data sets have, for the most part, been hard to access given, among other things, their unstructured nature. AI-based tools can search for patterns and recognize key signals that might be difficult and even impossible for humans to spot, especially at scale. 

AI is already accelerating product research by enabling teams to quickly and accurately collect, clean, and identify trends in customer behaviors related to product usage and specific future use cases. AI-based platforms can analyze vast amounts of data in real time, helping companies make decisions faster while reducing costs associated with human labor. Additionally, using natural language processing (NLP), companies can automate text-based research tasks, such as discovering specific product-related insights, which would otherwise take an immense amount of time and resources. With the help of AI, teams can gain valuable insights into their products more efficiently and more effectively than ever before.

Similar articles

View all
Customer Churn

The Four Horsemen of Customer Churn

Joel Passen
December 4, 2024
5 min read

Our data scientists have combed through mountains of unstructured customer usage data to crack the code on proactively identifying accounts that are a churn risk. After analyzing thousands of signal combinations, we found that four key indicators—Budget Issues, Unhappiness, Value Issues, and Urgency—are the ultimate predictors of revenue risk.

Nearly every B2B tech and services company sees the same pattern: when these signals align, it’s time for action.

Hold on, what is unstructured usage data? It’s the raw, untamed data that tells you what customers are *really* doing and saying—not just what they’re willing to admit in a survey or conveyed by numbers of daily average logins (also critical but lacking context). Here are the harbingers of risk; when combined, they are what the team needs to act on right now. 🧯

1️⃣ Budget Issue: This signals a customer struggling to justify the cost, possibly due to tighter budgets or a perceived lack of value.

2️⃣ Unhappy: Customer dissatisfaction can stem from unmet expectations, unresolved issues, or lack of engagement.

3️⃣ Value Issue: If a customer doesn’t see the ROI, they’ll start questioning the worth of your service.

4️⃣ Urgent: An urgent flag indicates an immediate problem that requires rapid action. They are expressing a need to engage with a teammate now.

Customer Retention

Improving Revenue Retention in 2025

Joel Passen
November 15, 2024
5 min read

If improving revenue retention is a key priority in FY25, here is some food for thought. If you believe data is the essential foundation for improving retention, imagine the possibilities with 50-100x more data about your customers. Here’s the thing: Every business has this customer data, but 99% of businesses are sleeping on a data set that could change their business. It’s the unstructured data that’s sitting in ticketing systems, CRMs, chat systems, surveys, and the biggest silo by volume - corporate email systems. Most of us still rely on structured data like usage, click rates, and engagement logs to gauge our customers' health. However, structured data provides only a partial view of customer behavior and revenue drivers. Unstructured data—like customer emails, chats, tickets, and calls —holds the most valuable insights that, when leveraged, will significantly improve revenue outcomes.

Why Unstructured Data is Essential for Revenue GrowthImproving Customer Retention: Unstructured data helps businesses identify early warning signs of dissatisfaction, allowing them to create proactive interventions before customers churn. Repeated mentions of poor experiences, response lags, product-related frustration, and more in call transcripts, cases, and emails indicate potential churn risks. By identifying these trends while they are trending, businesses will improve retention.

Fueling Product Innovation: Let’s face it: Our customers bought a product or service. Post-sales teams don’t develop products and are limited in what they can directly impact. Product teams need more unbiased, unfiltered contextual customer data, and they need it consistently. Unstructured data provides real-time feedback on how customers use products and services. Businesses can analyze customer feedback from multiple channels to identify recurring requests and pain points. This data fuels product innovation and informs customer-led roadmaps that lead to higher engagement rates and more profound value. Developing products that directly respond to customer feedback leads to faster adoption, better advocacy, and a competitive advantage.

Identifying Expansion Opportunities: Unstructured data reveals customer needs and preferences that structured data often overlooks. Businesses can uncover untapped expansion opportunities by analyzing email, chats, and case feedback. These insights help identify additional products or services that interest customers, leading to new upsell or cross-sell possibilities. To drive immediate improvements in revenue retention, the key isn't pouring resources into complex churn algorithms, chatbots, or traditional customer success platforms—it's being more creative with the data you're already collecting. Start listening more closely to your customers, identify the patterns in their pain points, and share this knowledge with your peers who can improve your offerings. This is the year to start thinking outside of the box.

Customer Retention

Burton's Broken Zippers

Steve Hazelton
November 15, 2024
5 min read

Last year, I bought a pair of ski pants and the zipper fell out on the first chair lift. I called Burton, and they offered an exchange. New pants, first chair, same problem. Support informed me that I was required to return the pants for repair. The repairs would be completed after ski season. For the inconvenience, Burton offered me a 20% discount on my next purchase of skiwear. The next time I am in the market for skiwear that I can't wear during ski season, I will use that coupon.

I started my first business over 25 years ago. Since that day, I have lived in an almost constant state of fear that somehow, somewhere, things would get so broken that we'd treat a customer like this.

Let's be clear, no one who runs a business wants stuff like this to happen. Yet, it happens all the time.

If you run a software company, your engineering team will have usage tools and server logs to tell you when your product is "down" or running slowly. They can report which features are being used and which ones aren't. You'll learn that certain features in your product cost more to run than others, maybe because of a bad query, code, or something else. And you'll know what needs to be upgraded.

However, every time a customer contacts a business, they are "using" (or "testing") your product. If you sell ski pants, your product is ski pants, and your customer service team. If you sell software, your product is your tech and your customer service.

Yet, your customer-facing teams have very poor usage data, if any at all. Which feature of our service gets used the most (billing, success, support)? What are the common themes? Is one group working more effectively than the others? Does a team need an upgrade? 

(BTW, what costs more, your AWS bill or your payroll?)

The reason your customer-facing teams don't have usage data is because this data is "unstructured," and it is everywhere. Imagine if your engineering team needed to check 50 email inboxes, 1,000 phone recordings, a CRM, and a ticket system to get your product usage statistics. 

That's where your customer-facing teams are today. Until you can get answers from these systems as easily as an engineer can, you’ll continue to churn, annoy customers, and try to hire your way out of a retention problem. It won’t work.

How many customers will you have to lose before you try Sturdy?

Schedule Demo
A blue and gray logo with a black background
A number of different types of labels on a white backgroundA white background with a red line and a white background with a red line andA sign that says executive change and contact request
A white background with a red line and a blue lineA number of different types of logos on a white backgroundA pie chart with the percentage of customer confusion and unhappy
A number of graphs on a white background