[ 26.03.09 ] Template response comparison is open

Summary

Send two message templates side by side with the new template response comparison feature and see which message draws the stronger response.

Real send data shows you how customer response changes with your message copy and button layout.

What changed?

Template response comparison

You can now send two message templates under identical conditions
and see which one draws the stronger response.

Recipients are split randomly into two groups automatically,
so you see the difference between the templates under the same send conditions.

Results based on performance metrics

Depending on the message type, the higher-response template is judged on:

• Alimtalk: valid read count
• Brand Message: CTR (click-through rate)

Test results are aggregated hourly, and you can review the statistics while the test is still running.

Why it matters

It is often hard to judge which template works better when you send a message.

With template response comparison you can use real send data to compare how customer response changes with

• message copy
• button copy
• message layout

That lets you pick the message that draws the stronger response and improve message performance.

How to use it

1. Turn template response comparison ON on the message send screen.
2. Set the two templates (A/B) you want to compare.
3. Register your recipient list and send the message.
   Recipients are split into the A/B groups automatically.
4. Once the test has run,
   review the results in Template Lab → Template response comparison → detail screen.

Eligibility and policy

• One test consists of two templates (A/B).
• Tests only run between the same message type. (Alimtalk vs Alimtalk / Brand Message vs Brand Message)
• The test runs when you send to 20 or more recipients.
• The test ends automatically about 4 hours after the send.
• Test result data is aggregated hourly.