Every marketer aims to achieve better click rates, easy conversions, reduce the churn rate, and create a memorable experience for their customers. To accomplish it, the decisions they take while sending out emails, designing CTAs, landing pages, and even sending out offers should be inline with the customer they are targeting. To avoid the assumptions of what shall work and what won’t, A/B testing, also known as split testing, is the marketing technique that utilizes two versions of the webpage, application, offers, email, or any other marketing asset to analyze and understand which one performs better.

A/B testing is essential as different customers may react differently to varied situations. For example, some might want the ‘Buy Now’ button in the center of the page, and others might like on the bottom right corner. But which one of them leads to the most conversions? Is the answer that A/B testing can provide.

How A/B Testing works in Interact?

In Interact, an A/B Testing is a test done for a treatment rule with all its properties fixed, but only one parameter varies. In 12.1, this parameter is a combination of offer and its offer attributes. In an A/B testing of a rule, each varying-parameter represents one branch with audience distribution percentage. Depending on the response of the Audience for an Offer in a set Test Period, you can choose the best suitable offer for that treatment rule.

Set up A/B Testing for Treatment Rule

  • A new option A/B, is added to the Rule menu; you can directly land to A/B Testing pane by using it.

A/B testing with Unica Interact- Adding new rule

A/B testing with Unica Interact- Advance configuration

  • On A/B Testing tab, you can enable A/B Test for a Rule by selecting Enabled Check Box.
  • After enabling the A/B Test for a Rule, a Default branch will be added by copying details from the base Rule.

  • You can even add more branches by clicking ‘Add Branch.’

  • You can change the Branch name, which should be unique within A/B Testing.
  • A branch can be enabled and disabled. Only enabled branches will participate in A/B Testing at runtime.
  • Sampling % is the distribution of the Audience between branches.
  • Also, you can add Expression to Offer Attributes. After adding an expression to offer attributes, its count will be displayed in the ‘Offer Attributes’ column, and a dropdown will appear to check more details.

  • You can also set the ‘Test Period’ for which A/B Test can be enabled.
  • A Default branch is a branch out of A/B testing branches, which is executed once the testing completes, i.e., after its expiration date. It can be completely independent of base rule for cell code, offer, or parametrized offer attributes. For the Unica 12.1 release, you need to designate a default branch, and it must always be enabled. In the upcoming release, the selection of the Default branch will automatically depend on Branch performance.
  • After saving A/B Testing details on the rule list page, an Orange ‘A/B Testing’ icon will appear for a Rule.

  • You can filter out only A/B test Rule by Selecting the‘ Show A/B testing rules only’ check box on Rule list Edit or View mode.

  • After enabling ‘Show A/B testing rules only,’ filter you will get a limited set of Columns and can see Branches details like Sampling% and number of Offer Attributes with expression by expanding section.

  • Also, with the ‘Show A/B testing rules only’ filter, you can further filter on rules by using a search by Segment or Zone.
  • Once Interactive Channel with A/B Testing is deployed, A/B Testing details are also displayed for rules on deploymentInfo.jsp.

  • To save A/B Test data in Systems tables, two new tables were added in Design Time(Campaign) Schema UACI_ABTest and UACI_ABTestBranch.

Analyzing A/B Testing Results

You can analyze branch performance and set that branch’s offer as the default offer for treatment rule in the following ways.

1. To check Branch performance, the Customer needs to add a column “ABTestBranch” of string data type into the target CHStaging and DTLContactHist tables, and then the customer can run a query or create Custom reports to determine branch performance and then set the default branch for the rule, in the upcoming release we are going to add new reports to show the performance of all A/B testing, organized by interactive channel and then strategy.

2. Customer can configure Cognos, or Birt reports and check ‘Interactive Offer Performance Over Time’ report for Offer performance summary and decide which branch offer is doing well.

The ability to conduct A/B Testing with Unica Interact will help customers identify the best offer for their Treatment Rules using Comparative Analysis of Offers. This will help them in making more customer-focused decisions and ultimately increasing the conversion rate of the offer. You can reach out to us for any more queries, and we will be happy to help.

Comment wrap
Further Reading
Marketing & Commerce | November 17, 2020
Unica Named a November 2020 Gartner Peer Insights Customers’ Choice for Multichannel Marketing Hub.
HCL Software is excited to announce that Unica, a leading enterprise marketing solution, has been recognized as a November 2020 Gartner Peer Insights Customers’ Choice for Multichannel Marketing Hub (MMH). Our team at Unica takes great pride in this distinction, as customer feedback continues to shape our products and services. In its announcement, Gartner explains, “The Gartner Peer Insights Customers’ Choice is a recognition of vendors in this market by verified end-user professionals, taking into account both the number of reviews and the overall user ratings.” To ensure fair evaluation, Gartner maintains rigorous criteria for recognizing vendors with a high customer satisfaction rate. Here are some excerpts from customers that contributed to the distinction: “A solid product with deep user community and good integrator expertise in region.”- Head Of Marketing Data & Analytics in the Finance Industry “HCL Unica is a great Campaign Management tool which generate good revenue for organisation.”- Senior Manager in the Services Industry "HCL Unica is a great ROI Marketing Automation tool.”- Associate Director in the Manufacturing Industry Read more reviews for Unica here. Everyone at Unica is deeply proud to be honored as a November 2020 Customers’ Choice for Multichannel Marketing Hub. To learn more about this distinction, or to read the reviews written about our products by the IT professionals who use them, please visit the Customers’ Choice announcement. To all of our customers who submitted reviews, thank you! These reviews mold our products and our customer journey, and we look forward to building on the experience that earned us this distinction! If you have a Unica story to share, we encourage you to join the Gartner Peer Insights crowd and weigh in. The GARTNER PEER INSIGHTS CUSTOMERS’ CHOICE badge is a trademark and service mark of Gartner, Inc., and/or its affiliates, and is used...
Marketing & Commerce | November 12, 2020
Manage TVC-Grid Validation in Unica Plan – A Systematic Way
Marketers are always looking for tools and processes to manage their marketing operations, streamline workflows, optimize the budget spend, resources, and manage other marketing assets. MRM is a single solution that can take care of all your needs, from strategic planning to executing a certain marketing activity and ensuring that consistency binds the team together. Unica Plan is the solution that Unica Suite offers to manage all your marketing needs and activities. HCL Unica Plan (Formerly known as Marketing Operations) supports the feature called Tabular View Control (TVC) Grid, where the marketer can choose and arrange the different attributes like Text, Numeric, Date, etc. which they want to use for tracking their business activities. Grids are mainly used for collecting data, in the user interface, it appears like a table or a list. You can enter data into the cells of the grid according to the selected attributes and their data type. Apart from this, the product supports the customization of grid attribute(s) with validation; for example, the attribute should start with a specific character/word OR attribute should not allow entering beyond a certain limit OR attribute should only allow data between a certain range, etc. “com.unicacorp.uap.grid.validation.plugin.GridValidatorPluginImpl” validator is delivered with HCL Unica Plan which can help you to define the validations on-grid attribute(s). This validation plug-in supports two types of rules. ROW: row-level rules are executed first. GRID: grid-level rules are executed after row-level rules. HCL Unica Plan ships with the following sample rules. BeginsWithRule DateCheckRule RangeCheckRule UniqueCheckRule This article will help you to understand the grid validation, data validation rules, and how to implement the ROW level validation using the "BeginsWithRule" rule with the Text Single Line Type attribute. Let’s follow the step by step approach to learning the validation. Create the new grid frame using the Form...
Marketing & Commerce | October 14, 2020
Case Study- Preparing for Success with Unica Deliver
In my fourteen plus years with Unica, I’ve been lucky enough to be involved with some incredible projects that delivered outstanding achievements using our software. My personal favorite example was when one of our customers consolidated over two hundred newsletter campaigns for individual newspaper publications into a single lights-out campaign. Let me repeat that- from two hundred individual campaigns to one. That is a serious amount of time and money saved every week, week-on-week. Another favorite example of mine is when a major UK retailer invested a couple of million dollars in building a completely new data warehouse and implementing Unica. The uplift attributed to coupon redemption in the very first campaign paid for the entire project. When these tools are implemented right, the rewards aren’t just observable and tangible; they’re staggering. And my experience in the vast number of cases is overwhelmingly positive. But what I want to talk about in this article are some of the obstacles to achieving these results. There was one occasion where I encountered a situation where, despite doing our best, adoption of the suite was only partially successful, and some modules were ultimately replaced. Why? Because in being aware of these situations, we can watch out for the markers in the future and hopefully intervene in time. Those that don’t learn history are doomed to repeat it. Failure is only absolute when we learn nothing from it. So what was different in this particular case? The Unica delivery team was the same. The software was the same. The customer’s senior management team's appetite to make the implementation success was there, and they were active and present. The appetite from the users to make the project a success was there too. The main representative from the user team was skilled, intelligent, and inventive. The...
a/icon/common/search Created with Sketch.