Section I: Problem Statement CVS Health is continuously exploring ways to improve its e-commerce platform, cvs.com. One potential enhancement is the implementation of a complementary product bundle recommendation feature on its product description pages (PDPs). For instance, when a customer browses for a toothbrush, they could also see recommendations for related products like toothpaste, dental floss, mouthwash, or teeth whitening kits. A basic version of this is already available on the site through the “Frequently Bought Together” (FBT) section. Traditionally, techniques such as association rule mining or market basket analysis have been used to identify frequently purchased products. While effective, CVS aims to go further by leveraging advanced recommendation system techniques, including Graph Neural Networks (GNN) and generative AI, to create more meaningful and synergistic product bundles. This exploration focuses on expanding the existing FBT feature into FBT Bundles. Unlike the regular FBT, FBT Bundles would offer smaller, highly complementary recommendations (a bundle includes the source product plus two other items). This system would algorithmically create high-quality bundles, such as: This strategy has the potential to enhance both sales and customer satisfaction, fostering greater loyalty. While CVS does not yet have the FBT Bundles feature in production, it is developing a Minimum Viable Product (MVP) to explore this concept. Section II: High-Level Approach The core of this solution is a Graph Neural Network (GNN) architecture. Based on the work of Yan et al. (2022), CVS adapted this GNN framework to its specific needs, incorporating several modifications. The implementation consists of three main components: Section III: In-Depth Methodology Part 1: Product Embeddings Module A: Discovering Product Segment Complementarity Relations Using GPT-4 Embedding plays a critical role in this approach, converting text (like product names) into numerical vectors to help machine learning models understand relationships. CVS uses a GNN to generate embeddings for each product, ensuring that relevant and complementary products are grouped closely in the embedding space. To train this GNN, a product-relation graph is needed. While some methods rely on user interaction data, CVS found that transaction data alone was not sufficient, as customers often purchase unrelated products in the same session. For example: Instead, CVS utilized GPT-4 to identify complementary products at a higher level in the product hierarchy, specifically at the segment level. With approximately 600 distinct product segments, GPT-4 was used to identify the top 10 most complementary segments, streamlining the process. Module B: Evaluating GPT-4 Output To ensure accuracy, CVS implemented a rigorous evaluation process: These results confirmed strong performance in identifying complementary relationships. Module C: Learning Product Embeddings With complementary relationships identified at the segment level, a product-relation graph was built at the SKU level. The GNN was trained to prioritize pairs of products with high co-purchase counts, sales volume, and low price, producing an embedding space where relevant products are closer together. This allowed for initial, non-personalized product recommendations. Part 2: User Embeddings To personalize recommendations, CVS developed user embeddings. The process involves: This framework is currently based on recent purchases, but future enhancements will include demographic and other factors. Part 3: Re-Ranking Scheme To personalize recommendations, CVS introduced a re-ranking step: Section IV: Evaluation of Recommender Output Given that CVS trained the model using unlabeled data, traditional metrics like accuracy were not feasible. Instead, GPT-4 was used to evaluate recommendation bundles, scoring them on: The results showed that the model effectively generated high-quality, complementary product bundles. Section V: Use Cases Section VI: Future Work Future plans include: Like Related Posts Salesforce OEM AppExchange Expanding its reach beyond CRM, Salesforce.com has launched a new service called AppExchange OEM Edition, aimed at non-CRM service providers. Read more Salesforce Jigsaw Salesforce.com, a prominent figure in cloud computing, has finalized a deal to acquire Jigsaw, a wiki-style business contact database, for Read more Health Cloud Brings Healthcare Transformation Following swiftly after last week’s successful launch of Financial Services Cloud, Salesforce has announced the second installment in its series Read more Top Ten Reasons Why Tectonic Loves the Cloud The Cloud is Good for Everyone – Why Tectonic loves the cloud You don’t need to worry about tracking licenses. Read more