When you’re planning a creator campaign, there’s usually more than one promising way to tell the product story. You might emphasize the time it saves, show a particular use case, or explain how it fits into someone’s routine. You also need to decide who should tell that story. The first message and creator group you choose may be a good starting point, but you won’t know what works best until you try different approaches.
That’s why we recommend building experimentation into the campaign from the start. Work with enough relevant smaller creators to try different briefs and audiences, then use the results to decide what to develop. You’ll learn more from seeing an approach work across several posts than from one unusually strong or disappointing result.
This guide shows how to plan those comparisons, measure the results, and use what you learn to improve the next campaign. We’ll walk through examples of testing different messages and creator groups, including what to do when one standout post makes the result harder to interpret.
Compare different messages and creator audiences
A campaign can explore several messages and creator audiences at once. Organize the posts around clear comparisons so you can learn from those differences. You might compare two briefs among similar creators, or try the same product story with different creator groups. If both the brief and targeting change, keep that combination identifiable so you can develop it further when it performs well.
For a fictional scheduling app, you could compare creators who speak to freelancers with creators who speak to parents, keeping the central product task and offer similar. Look at what those creators actually made when reviewing the results. A difference could come from the explanation or the creator’s expertise as well as the audience they usually reach.
To compare messages instead, recruit similar creators and try a “plan the week” brief with one group and a “handle a last-minute change” brief with the other. Keep the offer and intended customer action the same, and note which brief each creator used. You can then look at whether one explanation worked across several posts.
The distinction between audience and creative questions also shaped our work with Gamma and SnapCalorie. Gamma wanted to compare creator audiences and refine its targeting as it learned. We organized those creator groups and briefs separately, ran the partnerships, and tracked their performance. SnapCalorie also wanted to explore different creative strategies, so we helped it compare approaches and adapted reporting around its return goals, including attributed subscriptions. The Gamma and SnapCalorie case studies show the work behind those comparisons. For your own campaign, define both what differs between the groups and which event will help you assess the result.
Decide how you’ll choose the comparison groups
Decide how you’ll assign creators to each group before the campaign begins. Random assignment can help where it’s practical, but you may need to choose groups based on expertise, availability, or existing content. Record those differences so you can consider them when reviewing whether a stronger result came from the message, the creators, or both.
Once you know how the groups will differ, explain which parts of the brief need to stay consistent for the comparison to be useful. If you’re comparing two product messages, creators can bring their own examples and style to each one, but a reviewer should not rewrite both into the same message. Make that clear in the brief so creators can try different ways of telling each story while you still get to compare the two messages.
Also account for access and availability. If one group receives working accounts later or has a shorter production window, consider whether that affected the results when you compare the groups.
Decide what to measure and for how long
Before the campaign begins, choose the result that would change what you run next. Views can help you compare how widely the content was seen. If the goal is activations or qualified inquiries, you’ll need to track those events and give interested people time to complete them.
Once you’ve chosen that outcome, agree on where it will be recorded, how long you’ll wait, and which costs you’ll include. Test the tracking for both groups before publication. You may need product or revenue records alongside campaign reporting, especially when the question goes beyond what people did on the social platform.
Keep that plan when reviewing the results. Other observations may suggest useful ideas for the next campaign, but choosing a new success measure after seeing the numbers makes it harder to judge the comparison you originally set out to run.
1stCollab helps you decide what to test as well as run the comparisons. Our AI uses detailed creator understanding and proprietary partnership outcomes to suggest messages and audiences worth exploring. We run the partnerships so you can try those ideas across enough relevant creators, then use performance to recommend the next brief or targeting change. You can work through those recommendations with our team and stay as involved in the creative as you want.
Check which posts drove the result
Once the results come in, one message or creator group may look like the clear winner. Before putting more budget behind it, look at the individual posts. Did several creators do well, or did one exceptional post account for most of the difference?
This matters because performance can vary substantially even for the same creator. In our repeat-post analysis, 39.4% of TikTok creators had at least a twofold difference in views between posts within the same campaign and format. One disappointing post doesn’t necessarily mean the idea was wrong, just as one breakout post doesn’t mean you’ve found something you can reliably repeat. You need enough posts to give each approach a fair chance.
If several creators did well with the same message, look for what their content had in common. Perhaps they made the benefit easier to understand or showed the product in a situation their audiences recognized. Those details give you something to build on in the next campaign.
If most of the result came from one post, that’s still worth exploring. Look at what made it work, then try that approach with more relevant creators. You may have found a promising message, a particularly good creator fit, or both. The next campaign can help you understand which parts you can repeat.
Throughout that review, give posts similar time to collect results and check that tracking worked consistently. Otherwise, you could end up favoring an approach simply because its posts went live earlier or more of its customer activity was recorded.
What to do with a promising but unclear result
Consider a fictional software campaign where a tutorial brief generates more activations than a routine-based brief, but most of those activations come from one creator with unusually relevant expertise. There’s something worth pursuing, but the result doesn’t yet tell you whether to buy more tutorials or find more creators like that person.
For the next campaign, recruit more people with similar expertise and try both explanations. Keep the offer, activation tracking, and review period consistent. Check whether the tutorial approach works across those creators or whether they can make either story effective.
Plan your next comparison
Before booking the next creators, put the comparison into your campaign plan. Describe the briefs and audiences, what you’ll measure, and what a promising result would lead you to try next. A short note is enough to keep the team working toward the same question.
For the fictional software campaign, that could read: “We’ll try tutorial and routine-based briefs with creators who have similar expertise, then compare how many interested users complete the task in the app. We’ll give both groups the same time to collect results. If several tutorials do well, we’ll develop that approach with more creators. If people reach the app but get stuck, we’ll improve that experience before sending more people through it.”
Use the results to choose what to test next, then put that comparison into the campaign plan. If the results are hard to compare, check the reporting setup before running another campaign. Once you find a promising message or creative approach, you can also explore it beyond the original posts. We can help arrange usage rights to test selected content in paid ads, or have creators make new content for your own channels using what you’ve learned. Give the paid test its own budget and review the results before expanding it.
1stCollab can help you turn the ideas you want to test into a campaign and run the partnerships for you. Our AI can develop the entire plan with you in minutes, whether you’re testing for the first time or building on previous results. As posts go live, we’ll help you decide which approaches to develop and what to change. Planning is free, and you only pay when you launch. Sign up for free to get started, or schedule a free consultation with our team to talk through what you’d like to learn and how to test it.