Data & Society put out a report on Source Hacking, a set of techniques for spreading information. The whole report is fantastic and available as a free PDF but here are some pertinent quotes:
Source hacking is a versatile set of techniques for feeding false information to journalists, investigators, and the general public during breaking news events or across highly polarized wedge issues. Specifically, source hacking exploits situations and technologies to obscure the authorship of false claims. Across eight case studies, we identify the underlying techniques of source hacking to provide journalists, news organizations, platform companies, and others with a new vocabulary for describing these tactics, so that terms such as “trolling” and “trending” do not stand in for concerted efforts to pollute the information environment. (p. 6)
Media manipulators create campaign materials with knowledge of techno-logical and cultural vulnerabilities, taking advantage of platform design to amplify persuasive content. Careful attention to data craft is the foundation of a successful manipulation campaign, as manipulators create images, videos, and documents, carefully working around systems like spam detection, circumventing platform companies’ terms of service and trust and safety teams. Individual actors use sockpuppet accounts, botnets, and social media influencers to create trending opportunities and saturate hashtags with original content. (p. 7)
Evidence collages often contain a mix of verified and unverified information and can be created with simple image-editing software. By compiling a mix of verified and unverified information in a single, shareable image, conspiracy theorists can decide which sources to highlight or obscure, bypassing critical search results a user would experience if they were to seek this information on their own. (p. 26)
[Note – evidence collages in this exact format are not common on tumblr but this resembles the strategy of screenshotting a tweet thread and reblogging that post with updated misinformation; because of tumblr’s reblog functionality a screenshotted-thread can serve the same purpose as an evidence collage, largely spreading misinformation through decontextualizing the initial tweets or accepting outrageous claims as a given – the Statue of Liberty Post acts as a version of an Evidence collage]
Do not repost collaged materials without vetting and confirming the source. To spot this kind of campaign, journalists and platform companies should seek out signs of cross-platform coordination, especially for image files that circulate without clear authorship. Because manipulators will use different methods to hide the origins of these images, use reverse image software to look for other possible sites. (p. 36)
[Note - Screenshots from twitter are very common in spreading misinformation on tumblr but it’s also important to search the text from suspected misinformation blogs; frequently it’s take whole cloth from news articles, reddit posts, and other unlisted sources to divorce the information from its context. For instance this post by i-hate-chick-fil-a/whyyoustabbedme is copied nearly word-for-word from a comment on r/blackpeopletwitter but neglects to include the link for people to watch the trial for themselves]
Yet the efforts manipulators will go to in order to hide their coordination can vary from no protections to laundered banking information. Especially in instances where hoaxes involve numerous platforms, assessing the source materials circulated for coherency with other movement organizations is paramount. However, this is not fool-proof, as skilled manipulators will share a mix of content from other easy-to-verify sources. (p. 45, pp.42-45 discuss the IRA specifically)
Best practices for the proper identification of bad actors and artificial amplification tactics on social media are needed to prevent small groups from polarizing public conversation through wedge issues. Authorship and attribution of disinformation are often impossible to ascertain, and public figures actively participating in manipulation campaigns use all media attention, positive or negative, as an opportunity for audience building. For those individuals who participate in manipulation campaigns, we cannot measure intent— we can only measure harm. And so, gauging the true intentions of manipulators is not the most critical issue facing those fighting against manipulation campaigns—gauging their impact is. (p.47)
When coupled with keyword squatting and sockpuppet accounts, amplifying wedge issues to exploit cultural vulnerabilities disproportionately harms historically marginalized groups. Across each of these campaigns, we described how white supremacists, “trolls,” and partisan pundits used the materials crafted by manipulators to sow dissent and, sometimes, target groups that are unable to refute accusations against them. Most significantly when keyword squatting, manipulators steal the voice and tools of representation afforded to minoritized groups through social media. This particular tactic will be the most difficult to detect and debunk. (p. 48)
The report is 50 (short) pages and I’d recommend that you give it a read. Thanks again to the user who shared the link with me (who didn’t want to be named). If any of you reading are interested in more information on this subject Data & Society’s reports are a solid place to start.