JRE #1263 – Renée DiResta

12-Mar-19

This podcast is a captivating journey into the world of online manipulation, exposing the intricate tactics used by Russian trolls and bots to sow discord and influence public opinion. Renée DiResta, a leading expert in the field, shares her insights based on years of research, revealing the sophisticated strategies employed by the Internet Research Agency (IRA) and the profound impact they can have on online communities and even real-world events. From the genesis of her research to the intricacies of IRA operations, the conversation explores provocative themes of free speech, misinformation, and the challenges of navigating a rapidly evolving information ecosystem.

1. The Birth of Renée DiResta’s Research:

• DiResta’s initial research focused on anti-vaccine activity in California, leading to her observations about the disproportionate amplification of messages on social media.
• Her investigation then shifted to ISIS’s use of social media to spread propaganda and build an online presence, highlighting the potential for small groups to manipulate platforms and narratives.
• The revelations about the Internet Research Agency (IRA) in 2015 sparked her interest in exploring the vulnerability of the internet to manipulation by anyone, leading to her deep dive into Russian troll activity.
• DiResta’s research, initially focused on understanding the tactics, evolved into examining their impact on online communities and the potential to influence political discourse.

2. The IRA’s Tribal Strategy:

• The IRA created fake social media profiles targeting specific American communities, building up “tribes” with targeted content and memes.
• These profiles cultivated a sense of in-group identity, subtly influencing opinions by appealing to shared values, experiences, and concerns.
• By reinforcing in-group dynamics and creating a sense of collective identity, the IRA subtly swayed opinions without resorting to blatant political messaging.
• This “tribal” approach was a long-term strategy, with pages established years before they were used for explicit political purposes, showcasing the IRA’s methodical approach to manipulation.

3. The IRA’s Political Leanings and Targets:

• DiResta’s research revealed the IRA’s unwavering support for Donald Trump’s candidacy, along with a distinct disdain for Hillary Clinton.
• The IRA actively worked to erode support for traditional Republicans, promoting the idea of a “new” conservatism aligned with Trump’s brand of populism.
• While the IRA targeted both sides of the political spectrum, their efforts to undermine Clinton and support Trump were particularly noteworthy, demonstrating a clear political agenda.
• DiResta’s findings highlight the potential for manipulation to exacerbate polarization by pushing people towards opposite ends of the political spectrum, creating a more hostile and divisive online environment.

4. The IRA’s Use of Repurposed Content:

• The IRA often repurposed existing content, stealing memes and repurposing them for their own agendas.
• This allowed them to blend seamlessly into existing online conversations, leveraging the organic content of real Americans for their own purposes.
• The IRA’s ability to repurpose content effectively demonstrated their deep understanding of American culture and the ability to adapt to changing trends and narratives.
• DiResta’s analysis highlights the challenges of identifying manipulative content, as it can often appear indistinguishable from authentic American content, adding to the difficulty of discerning truth from fabrication.

5. The IRA’s Real-World Impact:

• The IRA didn’t just stop at online manipulation; they took their influence into the physical world, organizing rallies and events.
• By using Facebook events, they orchestrated protests on both sides of divisive issues, creating real-world conflict and division.
• This demonstrated the IRA’s ability to translate their online influence into offline actions, blurring the lines between virtual and real-world manipulation.
• DiResta’s research raises profound questions about the responsibility of social media platforms to mitigate the potential for such real-world consequences resulting from their manipulation.

6. The Challenge of Detection and Moderation:

• DiResta’s research highlights the difficulty of identifying and moderating manipulative content on social media, especially as technology continues to evolve.
• The IRA’s sophistication, combined with the speed at which online narratives can change, makes it challenging for platforms to stay ahead of the game.
• DiResta emphasizes the importance of focusing on account authenticity and dissemination patterns rather than solely relying on content moderation to combat manipulation.
• This conversation raises concerns about the potential for overreach and censorship in attempts to moderate online content, highlighting the need for a delicate balance between free speech and protection against manipulation.

7. The Future of Online Communication and Manipulation:

• DiResta expresses concern about the future of online communication, given the increasing sophistication of AI-generated content and deepfake technology.
• The potential for creating realistic, believable fake images and videos poses a significant challenge to trust and the ability to discern truth.
• DiResta envisions a future where online communities may self-segregate, with some embracing identity verification to enhance trust, while others embrace the chaos and uncertainty.
• The conversation raises profound questions about the future of free speech, privacy, and the evolving role of social media platforms in navigating a complex information landscape.

5 Memorable Quotes:

• “People, though. They really are. It’s just fucking hard business, especially when you didn’t see it coming.” – DiResta highlights the human element in the IRA’s operation, acknowledging the genuine individuals who may have been unwittingly manipulated.
• “They’re not just, you know, the money is not just going for the salaries and the ad buys. The money is also going for they were talking about using kind of consultants. And this is where you get at, this thing that comes out during the standup where they’re like black people who are LGBT you don’t want to see white LGBT memes.” – DiResta reveals the meticulous attention to detail and cultural understanding employed by the IRA, demonstrating their sophisticated approach to manipulation.
• “It’s gonna target you with the thing that you’re most likely to be receptive to just because of psychological bias and and tribal affiliation and you’re not sitting there thinking, how is this person who is purportedly just like me screwing with me?” – DiResta explains the effectiveness of the IRA’s tactics, highlighting the psychological vulnerabilities they exploit.
• “We have no real evidence of, you know, we’ve we’ve no information on either. This is the kind of thing that lives in some, you know, Facebook has it. The rest of us haven’t seen it.” – DiResta acknowledges the limitations of external research, emphasizing the need for platforms to share data for a more comprehensive understanding of the impact of manipulation.
• “It’s a really amazing time in that we’re getting to see this kind of stuff happen in real time. We’re getting to see these sort of weird attempts at manipulating things. And I think in a lot of ways successful, especially with less sophisticated people that don’t really understand that they’re being trolled and that someone is fucking with them.” – DiResta reflects on the unprecedented nature of the current information war, highlighting the ease with which manipulation can occur, particularly for those unaware of its presence.