Sustained Impact of Agentic Personalisation in Marketing: A Longitudinal Case Study
Summary: arXiv:2604.08621v1 Announce Type: new
Abstract
In consumer applications, Customer Relationship Management (CRM) has traditionally relied on the manual optimisation of static, rule-based messaging strategies. While adaptive and autonomous learning systems offer the promise of scalable personalisation, it remains unclear to what extent “human-in-the-loop” oversight is required to sustain performance uplift over time. This paper presents a longitudinal case study analysing a real-world consumer application that leverages agentic infrastructure to personalise marketing messaging for a large-scale user base over an 11-month period.
Introduction
The evolution of marketing strategies has been significantly influenced by technology, particularly through the integration of artificial intelligence (AI) and machine learning. This study focuses on the role of agentic personalisation in marketing, which involves using AI-driven systems to tailor marketing messages to individual consumers. The primary objective is to understand how human oversight impacts the effectiveness of these autonomous systems over time.
Methodology
Our research comprises a longitudinal analysis comparing two distinct operational phases:
- Active Phase: During this period, marketing professionals directly curated content, audiences, and strategies, using a hands-on approach to engage users.
- Passive Phase: In this subsequent phase, autonomous agents operated independently, relying on a predetermined library of messaging components.
Findings
The findings from the study reveal several key insights into the dynamics of agentic personalisation:
- Active human management generated the highest relative lift in engagement metrics, indicating that direct involvement is critical during the initial phase of strategy implementation.
- Despite the absence of human oversight in the passive phase, autonomous agents maintained a positive lift in engagement metrics, suggesting that these systems can effectively preserve performance gains over time.
- The combination of human intervention for strategic initialization and discovery, paired with the scalability of autonomous agents, creates a symbiotic relationship that enhances overall marketing performance.
Conclusion
The study highlights the importance of a dual approach to marketing personalisation, where initial human oversight is crucial for setting up effective strategies, while autonomous systems can sustain these gains in the long term. As the marketing landscape continues to evolve with advancements in AI, businesses must consider integrating both human and machine intelligence to optimise their CRM efforts.
Implications for Future Research
Future research should explore the balance between human and AI-driven strategies in various marketing contexts. Additionally, understanding the limitations and potential biases of autonomous systems will be essential for developing more effective marketing frameworks. The ongoing evolution of agentic personalisation promises to reshape how businesses engage with consumers, making it a critical area for continued exploration.