It’s the dirty little secret that scientists, web psychology gurus and digital media pros rarely acknowledge, let alone discuss. It’s the topic that emerges the minute you stop “selling” persuasive technology as a magic formula, and take an honest look at it.
The elephant I’m talking about is the “backfire”, when we accidentally misapply psychology so severely that we accidentally trigger the opposite behavior of what we intended.
Here are some backfires I’m sure you know well. How about when someone tries so hard to win your trust, that they trigger your distrust. Or how about a social media guru with such a small Twitter following that people believe they are incompetent at using social media.
What follows is a plain language description of a scientific paper on how psychology can easily backfire in behavior change technologies. Dr. Agnis Stibe (MIT Media Lab) and I co-authored the paper, which you can download here: Stibe, A., & Cugelman, B. (2016, April). Persuasive backfiring: when behavior change interventions trigger unintended negative outcomes. In International Conference on Persuasive Technology (pp. 65–77). Springer, Cham.
However, for most people, this article will give you a high-level overview of the concepts. I’ll also discuss how you can take a realistic risk management approach to deal with backfires, in a way that is more realistic and cost-effective.
Common misperceptions around behavioral science
While teaching digital psychology, I often deal with misconceptions and unrealistic expectations when applying behavioral sciences principles to interactive media.
From my experience, people often believe that they can design addictive technologies by simply gamifying their app, or layering on some social pressure. Without doubt, these principles can work in the right context, but the problem is that without practical or scholarly experience, professionals risk misunderstanding the conditions that can influence the effectiveness of these principles, how different principles combine, or how things can go dreadfully wrong.
How to discredit yourself (easier done than said)
Perhaps the biggest misperception about behavioral sciences is that psychology always produces the desired outcome, and that interventions always work. Speak to anybody who works as an impact evaluator, and you’ll hear a radically different story.
There’s some truth behind each of these, but in practice, the outcomes are far smaller than most organizations are willing to admit, and there’s a lot that can go wrong.
Perhaps the biggest risk is trying to win user trust while accidentally losing it; a backfire that we call “Self-discrediting”, when someone accidentally trashes their own reputation.
Say a developer learns that customers don’t feel safe when purchasing on their e-commerce site. They respond with a “hold no bars” approach to boosting user trust and roll-out the next iteration of their e-commerce checkout page with six safety certificates, anti-virus badges, a gold seal with their return policy, guarantees, testimonials, big brand logos, customer helplines, and so many pictures of locks and shields, that you’ll feel like you’re in Fort Knox. And of course, they tell users that their site is 100% safe and secure.
Is there any guarantee that all these trust-building design elements will increase user trust and sales? Is it possible to overdo it, by trying so hard that we trigger distrust?
Trust is a sensitive principle that can easily backfire due to the risks and rewards involved with trust judgments. Think about it in your daily life. How often do you trust anyone who explicitly asks “trust me”?
I can’t speak about others, and I have no scientific paper to quote on this exact case, but from my personal experience, anyone who’s aggressively pressured me to grant them my trust has eventually betrayed me. I’m sure that throughout your life you have learned to recognize the red flags of dishonesty. Chances are that you can name a few.
Trust evaluations can lead to dire outcomes, and fortunately, our brain is constantly scanning for threats, so although you can consciously describe the red flags that signal a liar, when you distrust a person, you may not know why. Similarly, you may not understand why you trust one person over another.
What’s ironic about trust psychology is that people trust abstract things like brands, companies, and interactive technology. Just as it goes with humans, so it goes with websites and apps. People decide if they can trust a website in under a fraction of a second, often based on superficial design features, and some users may also seek out third-party reviews or feedback.
For our fictional e-commerce example, there is a point where the developers employ so many trust mechanics that they risk triggering the opposite effect. Instead of boosting trust, a tasteless overuse of confidence-winning measures triggers a threat response. The company is perceived as untrustworthy. Instead of increasing sales, overdoing it has reduced sales. At this point, instead of boosting credibility, our developers have practiced self-discrediting by accidentally undermining their credibility.
Four types of outcomes
When it comes to behavior change, we generally want to see a shift in someone’s beliefs, attitudes, and intentions, and ultimately, their behaviors. However, there is another way we can look at these outcomes, which Dr. Stibe and myself classified under four categories, listed in the Intention-Outcome matrix below.
Axis 1 shows whether an outcome is intended or unintended, whether we’re achieving our target behavior or some behavior that we didn’t expect. Axis 2 shows whether the outcome was negative or positive, whether it was a good outcome for us and our target audience, or whether some bad outcome that is contrary to our goals.
Within the Intention-Outcome matrix, we defined the four outcomes as follows:
- Target Behavior: The intended positive behavioral outcome being sought, and typically reported, such as increasing user trust and sales in an e-commerce sale funnel.
- Unexpected Benefits: An unintended positive behavioral outcome that was not intentionally sought but was positive nonetheless and may be reported as an additional benefit. This might include attempts to boost trust in the buying process, which rubs off onto a more trustworthy brand.
- Dark Patterns: An intended negative outcome, such as deception or fraud, when persuasion is used (and potentially abused) for the benefit of the evil developer. This could include attempts to boost trust in phishing scams.
- Backfiring: Unintended negative outcomes where the opposite outcome happens, such as triggering distrust instead of trust. This quadrant is further subdivided into a risk management matrix that contrasts the likelihood of backfiring with its potential severity.
A risk management approach to psychological backfires
We believe that backfires are present in all persuasive media to some degree, so it’s unlikely that you will ever build any interactive technology or campaign that is 100% backfire free. Instead of advocating a total war on psychological backfires, we thought it would be more practical to take a risk management approach which means learning to live with backfires, and learning to manage them.
Below is our Likelihood-Severity matrix, a risk management framework. During our study, we used a consensus-based approach to arrange the different types and categories of backfires into a simple framework that you can use to not just learn about the backfires, but also get a sense of how likely they are to occur, and if so, get a sense of how severe the backfire could become.
Within this matrix, we identified six broad categories with twelve types of backfires. However, to the best of my knowledge, this was the first attempted systematic study on backfiring risks in persuasive technology, so in the future, we hope other scholars will build on our research, and help extend this taxonomy. But for now, you can take this as a list of common and obvious psychological offenders.
Below is a description of each backfire category and type:
- Superficializing: The superficial application of theory, such as copying surface tactics without understanding the underlying strategies, principles, or reasoning.
- Overemphasizing: Motivating people to take action for one strongly emphasized benefit, while omitting (or hiding) harmful factors that are hidden in the fine print, ingredients, details, etc…
- Defiance Arousing: Triggering resistance to messages that are incompatible with a person’s self-identity, that can induce unpleasant cognitive dissonance, leading the audience to reject the message, or oppose it.
- Self-Licensing: When someone does something good in one area, they sometimes feel like they have a license to misbehave in other.
- Self-Discrediting: When the source disseminates discrediting information, causing a misalignment of source and message credibility.
- Message Hijacking: When a third-party actor re-contextualize the source’s message, bringing a new meaning, which in many cases undermines the intervention by turning it into a public joke.
- Mistailoring: When a tailored messaging system provides information that produces negative outcomes in some users, that could have been avoided with an appropriate message.
- Mistargeting: When a message that was intended for one audience segment is misinterpreted by another group of people.
- Misdiagnosing: When a behavior change intervention does not properly diagnose user behavior or psychological processes.
- Misanticipating: Changes in policies or directives that lead to unanticipated shifts in beliefs, attitudes or behaviors.
- Anti-Modeling: Demonstrating negative behavior (often to demonize it showing the bad behavior), which raises people’s awareness and may trigger them to do the bad behavior, especially during moments of susceptibility.
- Reverse Norming: Interventions that use examples of popular bad behaviors can establish bad behavior as a social norm.
Practical steps to reduce backfires
It’s impractical to try and remove every single potential backfire from your communications, landing pages, interfaces, etc… So instead of advocating that digital media pros aim to remove all possible backfires, instead, we’re recommending that you learn to live with them and manage them.
What follows are some principles I put together, to help you better manage backfire risks.
- Know the limits of removing backfires: The first thing you need to do is adopt the right mindset, where you accept your limits, by acknowledging that no matter what you do, there is always a chance that some aspect of your design will cause negative impacts in some populations. As long as you’ve taken steps to hunt and remove the highest risk backfires, there is a point where you need to take the attitude that it’s not possible to predict how all people will respond, which will keep you on your toes, scanning for potential backfires.
- Take a risk management approach: Instead of trying to remove every single backfire, what you need to do is to prioritize those backfires with the highest likelihood of occurring, so that you can focus on eliminating the highest risk backfires. For instance, superficializing is a lower risk backfire that’s more likely to lead to something that doesn’t work (wasting your time and money), rather than the social psychology backfires, which is more likely to backfire. To get going, use the Likelihood-Severity matrix to scan for the highest risk backfires in quadrant D, where you’ll want to see if any of your materials may trigger anti-modeling and reverse norming outcomes. If you’re clean on those, move to quadrant C, then B, and finally A.
- Nip backfires in the bud while it’s cost effective to address them: It’ll probably cost you less time and money to remove backfires from a new product/campaign that’s under development, rather than try to fix a problem after you’ve rolled it out. As one of my Krav Maga instructors told me, the best ways to get out of a bad situation, is to avoid being in it, in the first place. Look before you leap.
- Systematically scan for emergent backfires: Given that you’ll never fully remove all backfires, you’ll need to be vigilant and on the lookout for backfires that may creep into your projects; either because you, others, or the changing world has caused them to emerge. You may need to scan for backfires like in a risk management approach where you ask yourself, “What can go wrong?”, and “How can we stop it before it emerges?”. Plan ahead by asking yourself, “If it did occur, what would we do?”
- Become an obsessive tester: Even with years of scientific and practical experience, behavior change pros can rarely predict which messages and design patterns will be most effective when rolled-out to new populations. However, these pros can generally tell you how to run a simple experiment to test which messages work best. So if you want to improve your ability to apply behavioral psychology, you’ll also have to develop a basic understanding of the psychological principles and architectures that drive behavior, and then learn which of them work best with your target audiences. Think of it this way: Science will tell you what psychological principles should work in theory, with very robust models. But then you’ll have to build messages, interfaces, and real-world materials that you’ll need to test and optimize. I believe that conversion rate optimization research helps professionals to identify the core psychological ingredients that boost a technology’s persuasiveness, while also reducing their worst backfires.
We could not stop laughing while co-authoring this paper. And the reason is simple. When you finally see the psychological principle that triggered a backfire, it hits you like the punchline of a great joke. You realize how absurd it was to do X to achieve Y.
As long as the joke isn’t about your digital marketing campaign or app, you’ll probably appreciate the humor. But you may have a different perspective if your backfired app that has become the laughing stock of your industry.
The stigma associated with rolling out a backfiring campaign or technology is perhaps too much to bear for most individuals and organizational leadership. Maybe this is why we suspect there is probably a significant publication bias in the scientific community around unreported psychological backfiring, and why it’s so difficult to find much research on this subject.
The point of talking about taboo subjects is to broaden one’s perspective by not denying reality, but instead, developing a bigger understanding of what’s going on. I hope this discussion on how psychology can go dreadfully wrong has helped to broaden your perspective on using digital psychology and inspired new ideas on how to make sure you’re hitting more of those intended positive outcomes.
This summary was authored by myself (Brian Cugelman), and I’d like to thank my co-author, Dr. Stibe, all those who contributed examples and feedback, the Persuasive 2016 conference who accepted our paper, and Jesse Ship who’s brought the editorial scalpel to this article.
Share your backfires
If you happen to identify any new types of backfires, or new examples of the ones we identified, please share them below. It would be great to get references with full names, URLs, and citations if possible. This would be an awesome help for our follow-up research. THANKS!!!