Shadowbanning

Risius, Marten; Blasiak, Kevin Marc Article — Published Version Shadowbanning Business & Information Systems Engineering Provided in Cooperation with: Springer Nature Suggested Citation: Risius, Marten; Blasiak, Kevin Marc (2024) : Shadowbanning, Business & Information Systems Engineering, ISSN 1867-0202, Springer Fachmedien Wiesbaden GmbH, Wiesbaden, Vol. 66, Iss. 6, pp. 817-829, https://doi.org/10.1007/s12599-024-00905-3 This Version is available at: https://hdl.handle.net/10419/315771 Standard-Nutzungsbedingungen: Die Dokumente auf EconStor dürfen zu eigenen wissenschaftlichen Zwecken und zum Privatgebrauch gespeichert und kopiert werden. Sie dürfen die Dokumente nicht für öffentliche oder kommerzielle Zwecke vervielfältigen, öffentlich ausstellen, öffentlich zugänglich machen, vertreiben oder anderweitig nutzen. Sofern die Verfasser die Dokumente unter Open-Content-Lizenzen (insbesondere CC-Lizenzen) zur Verfügung gestellt haben sollten, gelten abweichend von diesen Nutzungsbedingungen die in der dort genannten Lizenz gewährten Nutzungsrechte. Terms of use: Documents in EconStor may be saved and copied for your personal and scholarly purposes. You are not to copy documents for public or commercial purposes, to exhibit the documents publicly, to make them publicly available on the internet, or to distribute or otherwise use the documents in public. If the documents have been made available under an Open Content Licence (especially Creative Commons Licences), you may exercise further usage rights as specified in the indicated licence. http://creativecommons.org/licenses/by/4.0/ CATCHWORD Shadowbanning An Opaque Form of Content Moderation Marten Risius •Kevin Marc Blasiak Received: 21 February 2024 / Accepted: 26 September 2024 / Published online: 28 October 2024 ÓCrown 2024 Keywords Shadowbanning Visibility reduction Trust and Safety Content moderation Algorithmic content moderation Social media 1 Introduction Social media platforms face numerous societal, ethical, and political issues. Online extremism (Spiekermann et al. 2022), disinformation campaigns (Starbird et al. 2019), hate speech (Oksanen et al. 2020), and cyberbullying (Chan et al. 2019) are just a few examples of the social media related problems. Social media platforms have responded by implementing various content moderation mechanisms to govern communication on social media platforms (Grimmelmann 2015). Content moderation is a rapidly growing US$ 9.8 Bn market (Bloomberg 2022; Wankhede 2022). Particularly algorithmic content moderation is an increasingly popular approach (Katzenbach 2021). Algorithmic content moderation encompasses platform design decisions that dictate how community members interact with one another and determine who gets to see which content (Duffy and Meisner 2022; Zeng and Kaye 2022). Algorithmic content moderation offers scalable, automated systems that classify user-generated content to inform governance decisions (e.g., removal, geoblocking, account takedown) (Gorwa et al. 2020; Grimmelmann 2015). The current discussion on content moderation pays little attention to shadowbanning (Gillespie 2022a; Gillespie et al. 2020). Shadowbanning secretly demotes or suppresses visibility of users, content, or groups without alerting the affected entity (Gillespie 2022a). A recent survey of 1,000 U.S. social media users found that about 10% of respondents – typically non-cisgendered, Hispanic, or Republican users report being shadowbanned across all major social media platforms like Facebook, Twitter, Instagram, Reddit, and TikTok (Nicholas 2022). Shadowbanning is the conceptual counterpart to platform’s amplification of problematic content for the sake of boosting engagement through recommender algorithms (Gillespie 2022a). Social media platforms generally avoid using the term shadowbanning as part of their content moderation mechanisms. Instead, they refer to it as visibility reduction techniques (Gillespie 2022b). Social media platforms have good reasons to use shadowbanning as it allows them to contain unwanted content without releasing information that would help malicious actors adjust their tactics and avoid detection (e.g., spam bots), to mitigate access to undesirable content (e.g., suicide, pro-eating disorder) (Nicholas 2022), or to avoid polarization and public outcry resulting from certain content moderation decisions (Gillespie 2022a). Accepted after two revisions by Susanne Strahringer. M. Risius (&) Information Management, University of Applied Sciences NeuUlm, Wileystraße 1, 89231 Neu-Ulm, Germany e-mail: [email protected] M. Risius Adjunct Senior Fellow, School of Psychology, University of Queensland, St. Lucia, Brisbane, QLD 4072, Australia K. M. Blasiak Center for Technology & Society, TU Wien, Gußhausstraße 27-29, 1040 Vienna, Austria K. M. Blasiak Informatics, TU Wien, Favoritenstraße 9-11, 1040 Vienna, Austria 123 Bus Inf Syst Eng 66(6):817–829 (2024) https://doi.org/10.1007/s12599-024-00905-3 Shadowbanning is also heavily scrutinized, predominantly for its opacity. Shadowbanning prevents users from correcting or disputing content moderation decisions (Nicholas 2022), leaving users left to speculate about whether they have been shadowbanned (Delmonaco et al. 2024) and unclear about the criteria that trigger shadowbanning (Elmimouni et al. 2024). Shadowbanning is accused of systematic bias against minorities (Duffy and Meisner 2022). In a recent content moderation survey that oversampled marginalized identities (i.e., racial and ethnic minorities, LGBTQ ?people, trans and/or nonbinary people), 21.78% of respondents reported experiencing shadowbans (Delmonaco et al. 2024). Subjects of shadowbanning report mental and emotional harm (Nicholas 2022) ranging from feelings of frustration, sadness (Delmonaco et al. 2024), marginalization, anxiety, and helplessness (Elmimouni et al. 2024), leading to selfcensorship, withdrawal from social media, and financial damages (Delmonaco et al. 2024). The potential ramifications of shadowbanning are expected to extend far beyond the silenced individuals or minority groups directly affected. This mechanism is believed to erode trust and confidence in social media platforms, fostering an environment conducive to conspiracy theories (Chen and Zaman 2024). For instance, shadowbanning fuels beliefs that platforms hold biased agendas, such as aligning with specific governments (e.g., ‘‘platforms align with the state of Israel’’). Similarly, shadowbanning can exacerbate societal polarization by filtering certain opinions or individuals from public discourse. This can bias the process of forming public opinion, for example, when restricting pro-Palestinian voices on Facebook during the Israel-Hamas war (Elmimouni et al. 2024) or TikTok’s suppression of #BlackLivesMatter and LGBTQ ?content (Delmonaco et al. 2024). Finally, shadowbanning can be weaponized by malicious actors to silence dissenting voices (Nicholas 2022), undermining open dialogue and empowering those who seek to manipulate online discourse. A balanced and informed discussion of shadowbanning is urgently needed. Related research is still nascent and – to the best of our knowledge – absent in the field of Information Systems (IS). The objective of this article is to introduce IS practitioners and researchers to shadowbanning. By introducing shadowbanning, we aim to make three key contributions. First, we contribute to the emergent literature that raises awareness for this opaque content moderation mechanism (Gillespie 2022a). Shadowbanning complements existing IS research on content moderation beyond the more commonly discussed forms of annotating (He et al. 2024; Kim and Dennis 2019; Kim et al. 2019), banning (Russo et al. 2023), blocking (McDonald 2022), and deplatforming (Keller 2019). But also other related IS research on platform governance (Halckenhaeusser et al. 2020), algorithmic audiencing (Riemer and Peter 2021), and algorithmic control (Benlian et al. 2022) ought to consider the role of algorithms in secretly demoting content – in addition to their augmenting, amplifying, and serendipitous effects (Milli et al. 2023). Second, we offer conceptual clarity into what constitutes shadowbanning. Building a common understanding of shadowbanning ought to help bridge the gap between social media platforms who avoid the term shadowbanning (Gillespie 2022b), users who speculate whether they have been subjected to this practice (Elmimouni et al. 2024), researchers who try investigate this phenomenon (Jaidka et al. 2023), and lawmakers who need to understand this mechanism to devise meaningful regulation (Nicholas 2023). Third, we outline ways in which information systems research with its focus on sociotechnical systems can help address and inform the related conversation around content moderation, censorship, freedom of expression to contribute to society and make the online environment safer for everyone (Sarker et al. 2019; Spiekermann et al. 2022). 2 Background 2.1 Definition and Origins of Shadowbanning The term shadowbanning first appeared in 2001, where it referred to the mechanism of removing posts for everyone else except for the poster in an online forum (Savolainen 2022). It reached broader public awareness in 2018 when US conservatives began accusing Twitter (now X) of shadow-banning ‘prominent Republicans’ by not suggesting them on the platform’s autofill drop-down search bar (Savolainen 2022; Stack 2018). Shadowbanning trades under many different names such as stealth banning, ghost banning, hell banning, comment ghosting, visibility moderation, (visibility) reduction, suppression, borderline content policies, and uninformed or undisclosed content moderation (Gillespie 2022a,2022b; Jaidka et al. 2021; Nicholas 2023). Shadowbanning suppresses the visibility or reach of content, users, or groups without alerting the affected party (Gillespie 2022a). Platforms limit the conditions under which the content circulates, for example, whether it appears as a recommendation, a search result, in a news feed and users’ queries, or in a stream of comments (Gillespie 2022b). It is an opaque mechanism where content remains theoretically accessible and visible to (some) users (e.g., the poster themselves) (Savolainen 2022). It is important to emphasize that today’s understanding of shadowbanning by demoting people, groups, or content with algorithmic support is much more nuanced than the original 2001 mechanism of simply withholding content from anyone (Gillespie 2022b). 123 818 M. Risius, K. M. Blasiak: Shadowbanning, Bus Inf Syst Eng 66(6):817–829 (2024) Four main types of shadowbans (see Table 1) can be identified (Jaidka et al. 2023): (1) Ghost bans are the most restrictive type of shadowbans that obfuscate content by allowing only the accountholders themselves to see their own content (Jaidka et al. 2023). (2) Search bans prohibit the intended encounter with users or content by removing them from the platforms’ internal search index (e.g., quarantined subreddits from Reddit’s internal search, false posts from Instagram’s hashtag search) (Goldman 2021). (3) Search suggestion bans remove content from the platform’s internal search engine’s ‘‘auto-suggest’’ feature (Goldman 2021) so that the account does not appear when others look it up in the search interface (Jaidka et al. 2023). (4) Downtiering deprioritizes content to limit the unintentional exposure and to make it unlikely for other users to find it by hiding replies under an interstitial and only loading when prompted (Jaidka et al. 2021,2023; Nicholas 2022; Ryan et al. 2020), downgrading the internal search visibility, reducing internal promotion (e.g., recommendations), and reducing or removing navigation links (e.g., explore pages) (Goldman 2021). Shadowbanning differs from the standard content curation mechanisms employed by social media platforms through recommender algorithms. Content recommendation follows a different set of concerns and priorities (Gillespie 2022a). Recommender systems and newsfeeds select for what is deemed most appealing to optimize for engagement measured by the time spent on the platform, the types of actions taken, and satisfaction proxies (Bucher 2018; McKelvey and Hunt 2019). They collect and analyze user data together with the corpus of all available content to personalize user feeds and maximize user engagement. Content that is more positive – e.g., in terms of recency, serendipity, close tie popularity – has greater likelihood to be selected by recommender algorithms. Shadowbans are not simply an outcome or byproduct of recommender algorithms because shadowbanned content is actively suppressed or obscured, even in search results (Jaidka et al. 2023). Shadowbanning aims to select out - what is deemed least appealing based on negative signals that indicate an item ought not to be recommended (Gillespie 2022a). The gold standard for Trust & Safety performance is ‘prevalence’ and shadowbanning aims to minimize the function of how often users view certain content (Fishman and Harris 2023). We broadly understand shadowbanning as social media platforms’ use of algorithms to align user behavior, accounts, and content with organizational objectives. This conceptualization closely resembles the prevalent definition of algorithmic control (Wiener et al. 2023), being embedded into a broader organizational context (Alizadeh et al. 2023) with human controllers (Cram and Wiener 2020) and organizational intentions (Kellogg et al. 2020; Sullivan et al. 2024), fulfilling sanctioning functions – among others – (Hirsch et al. 2023), complementing and relieving but not entirely replacing human actors (Wiener et al. 2023). Current research on algorithmic control functions (Alizadeh et al. 2023; Hirsch et al. 2023; Kellogg et al. 2020; Sullivan et al. 2024) is yet to consider visibility reduction techniques from platforms like Uber (Uber 2023). Shadowbanning’s implicit form of algorithmic control delivery by avoiding to alert users also appears to be an extreme form of the previously investigated algorithmic opacity and limited transparency of algorithms (Mo ¨hlmannn et al. 2023). Given that algorithmic management researchers recognize the relation of algorithmic control to broader organizational contexts beyond work settings (Cameron et al. 2023), we draw on the related algorithmic management and control literature (Benlian et al. 2022) to guide our conceptualization of shadowbanning in the following (Fig. 1). In the context of shadowbanning, the human controllers are Trust & Safety teams who define and communicate organizational intentions in the form of platform policies or policy violations, help implement policies into content moderation algorithms, manage or conduct content Table 1 Summative overview of different types of shadowbans Shadowban type Description Outcome Examples from literature Ghost bans Content is hidden from everyone except the account holder Complete invisibility to others Jaidka et al. (2023) Search bans Content is removed from the platform’s internal search index Reduced discoverability, contained visibility Goldman (2021) Search suggestion bans Content is removed from the platform’s search ‘‘auto-suggest’’ feature Decreased visibility, potential loss of organic reach Goldman (2021) Downtiering Content’s visibility is reduced or limited Decreased visibility, reduced engagement Jaidka et al. (2021); Jaidka et al. (2023); Nicholas (2022); Ryan et al. (2020) 123 M. Risius, K. M. Blasiak: Shadowbanning, Bus Inf Syst Eng 66(6):817–829 (2024) 819 moderation themselves, and deal with content moderation appeals (Fishman 2023). Shadowbans are typically automated (e.g., to reduce visibility for spam bot posts) but still allow human moderators to enforce shadowbans directly (e.g., to occult certain types of users) (Biddle et al. 2020; Duffy and Meisner 2022). Algorithmic content moderation automates the human Trust & Safety teams moderation tasks (He et al. 2024) in order to gain scalability and consistency in content moderation (Jiang et al. 2023). For shadowbanning this involves the algorithmic detection of unwanted content or users based on Trust & Safety policies and enactment of respective ghost-, search-, search suggestion ban, or downtiering. Shadowbanning solutions can be developed by platforms themselves or sourced from external entities (e.g., Reddit’s AutoModerator) (Wright 2022). 2.2 The Role of Shadowbanning as a Form of Content Moderation Shadowbanning is part of social media platforms broader content moderation efforts to contain the prevalent online issues which means ‘governance mechanisms that structure participation in a community to facilitate cooperation and prevent abuse’ (Grimmelmann 2015, p. 47). While content moderation mechanisms are hypothetically unlimited from a technological standpoint, research has identified a range of common mechanisms (Goldman 2021) (Table 2). These content moderation mechanisms vary (1) in their degree of severity and (2) regarding their underlying philosophy. The degree of severity is commonly broken up into either ‘‘hard’’ or ‘‘soft’’ types of content moderation (Zannettou 2021). Hard moderation means to suspend, block or remove content or entities from social media platforms (Gorwa et al. 2020). Soft forms of content moderation warn about content or contain its impact without suspension or take-downs (Jaidka et al. 2023). Content moderation mechanisms’ underlying philosophies differ in the degree to which they rely on nurturing or punishing to create a positive online environment (Jiang et al. 2023). Punishing is a reactive approach that primarily focuses on applying consequences for rule-violating behaviors. Nurturing predominantly intends to educate, improve or reform online (mis)behavior. In the following, we apply these dimensions to integrate the different forms of shadowbans into the broader context of other content moderation mechanisms as identified and described by Goldman (2021) (Table 2). From a philosophical standpoint, shadowbanning is particularly opaque compared to nurturing mechanisms. Users are usually not informed that (or for how long) they are shadowbanned or need to retrieve the information themselves when possible (Silva 2022). Indeed, a major reason for using shadowbans is to disallow malicious actors (e.g., spam bots) to learn from and adjust to content moderation algorithms (Biddle et al. 2020). This prevents users from learning from the shadowbanning decisions and is thus a more punitive measure rather than one that nurtures user behavior in line with community standards. The different forms of shadowbans vary in their degree of severity (Jaidka et al. 2023). Shadowbans can include both hard and soft types of content moderation depending Content Moderation, Rules Enforcement, and Appeals Defining Policies Community Management Configuration (Product Support, Engineering) Content Moderation Algorithm (Detection, Enactment) Controller (Social Media Platforms, Trust & Safety Teams) User Community Informate Automate figure inspired by Benlian et al. (2022) Shadowban (Ghost, Search, Search Suggestion, Downtiering) Fig. 1 Conceptualizing shadowbanning as a form of algorithmic control 123 820 M. Risius, K. M. Blasiak: Shadowbanning, Bus Inf Syst Eng 66(6):817–829 (2024) on the degree to which they enforce visibility restrictions (i.e., do not recommend at all/ as much/ to some) (Gillespie 2022a). A ghost ban matches an account suspension without notifying the user (Goldman 2021). Similarly, shadowbans that severely restrict visibility in situations with a short ‘‘lifespan’’ of engagement equate to a suspension (Jaidka et al. 2023) (e.g., removal from the internal search index). Instead of making content inaccessible, shadowbans can also greatly conceal items to make it less likely that users may find them (Jaidka et al. 2021; Nicholas 2022; Ryan et al. 2020) (e.g., downgrade internal search visibility, no auto-suggest in the search function, no or reduced internal promotion, no or reduced exposure in navigation links such as ‘‘most popular’’ or ‘‘newly available’’). Overall, we consider shadowbanning to be a predominantly punitive mechanism with its specific forms differing in their degree of severity between hard and soft forms of content moderation. 2.3 Unpacking the Controversy Surrounding Shadowbanning The debate around the prevalence and impact of shadowbanning is highly politicized. On one side, social media platforms are reluctant to admit to shadowbanning (Gillespie 2022a), often framing it as a specific kind of behavior (e.g., ‘‘it doesn’t hide people’s content for posting too many hashtags’’) (Cotter 2021, p. 1234) or referencing its aforementioned original meaning in internet forums (Gillespie 2022b; Savolainen 2022). The absence of a unified, industry-accepted definition for shadowbanning (Gillespie 2022a) complicates discussions and fuels misunderstandings (Elmimouni et al. 2024). Platforms are understandably wary of being scrutinized for their policies (either for being interventionist and biased, or opaque and unaccountable) and aim to avoid the politicization of their content moderation practices (Gillespie 2022a). Table 2 Conceptualization of shadowbanning among other content moderation mechanisms Philosophy Nurturing Punishing Degree of Severity Hard Assign strikes/warnings Fine author/impose liquidated damages Outing/unmasking Community service Put user/content on industry-wide blocklist Educate users Remove content Redirect method  Report to law enforcement Restorative justice/apology Suspend account Suspend content Terminate account Ghost ban  Remove from internal search index* Soft Age-gate Disable comments Counterspeech Edit/redact content Display content only to logged-in readers Forfeit accrued earnings Interstitial warning Nofollow authors’ links Shaming Outing/unmasking Suspend future earnings Reduce service levels Terminate future earnings Reduced virality Warning legend Relocate content Remove credibility badges Remove from external search index Suspend posting rights Downgrade internal search visibility*** No auto-suggest** No/reduced internal promotion*** No/reduced navigation links*** Types of shadowbans: * search ban, ** search suggestion ban, *** downtiering; adaptations from Goldman (2021):  originally referred to as ‘‘shadowban’’,  adopted from Scrivens and Gaudette (2024); in non-remedial contexts (e.g., remove from external search index, nofollow authors’ links) (Goldman 2021) the classification of the punishing philosophy occurs based on the mechanisms’ reactive nature 123 M. Risius, K. M. Blasiak: Shadowbanning, Bus Inf Syst Eng 66(6):817–829 (2024) 821 From the platforms’ perspective, shadowbanning serves as an effective tool to manage problematic content. First, it helps mitigate ‘‘lawful but awful’’ content. This content that trades under different names across platforms (e.g., borderline, sensitive, harmful, undesirable, or objectionable content) (Cotter 2021) is considered detrimental to the user experience, threatens the health of the community, is misleading or salacious. It fails to violate platform policies (Gillespie 2022b) and therefore evades other forms of content removal. Examples include pro-eating disorder), sexually suggestive, firearm, and implicitly drug-related content (Gillespie 2022a) or misinformation (Gillespie 2022a). Second, shadowbanning allows platforms to hide moderation tactics from malicious actors, such as spammers (e.g., clickbait, links to malicious or deceptive sites) (Cotter 2021), bots (e.g., astroturfing, sockpuppeting), or orchestrated disinformation campaigns, preventing them from adjusting their strategies (Llewellyn et al. 2019; Nicholas 2022). Third, it provides a means to avoid public outcries over ‘‘censorship’’ while maintaining flexible moderation, particularly in response to evolving threats like increasing radicalization (Gillespie 2022a). On the other side, the lack of transparency around shadowbanning has fueled folk theories and speculation among users, policymakers, and watchdogs (Jaidka et al. 2023) (e.g., Elon Musk uses shadowbanning on X to suppress Tesla’s employee union account (Masnick 2023)). Reports, especially from marginalized communities, suggest shadowbanning is used to suppress certain voices (Elmimouni et al. 2024). User surveys and interviews on shadowbanning are often discarded through ‘‘black box gaslighting’’ by asserting that users do not have sufficient understanding of content curation algorithms to determine whether they were shadowbanned (Cotter 2021). Platforms explain media reports on shadowbanning as technical glitches, the users’ failure to create engaging content, or as a matter of chance through the platform’s black-box algorithms (Cotter 2021). This back-and-forth erodes public trust in social media platforms and contributes to societal polarization (Chen and Zaman 2024; Jaidka et al. 2023). The scrutiny surrounding shadowbanning also stems from its potential for misuse. Cases have emerged where shadowbanning was allegedly used to meet government demands (e.g., silence dissent in China, contain Covid-19 messages in the USA) (AP 2024; Hern 2019), marginalize minority voices (e.g., handicapped, black, or LGBTQ ? users) (Delmonaco et al. 2024; Duffy and Meisner 2022), or manipulate public opinion (e.g., mute pro-Palestinian posts) (Chen and Zaman 2024; Elmimouni et al. 2024; Luu 2023). This form of exclusion can result in emotional distress (Lutz and Schneider 2021), financial harm for content creators (Duffy and Meisner 2022), and increased vulnerability to online attacks (for an overview, see Delmonaco et al. 2024; Nicholas 2022). For marginalized groups, shadowbanning can lead to their exclusion from public discourse or bans by association (Delmonaco et al. 2024; Elmimouni et al. 2024). On a broader societal level, the secrecy and lack of recourse foster distrust and conspiracy theories, while entrenching societal divides (Chen and Zaman 2024; Nicholas 2022). 2.4 Establishing the Prevalence of Shadowbanning The opaque nature of shadowbanning has inspired considerable work on establishing the prevalence of shadowbanning. A major source of evidence are social media platforms themselves when reporting content moderation mechanisms that impose a form of visibility reduction while avoiding the term ‘‘shadowbanning’’ (Merrer et al. 2021). Reddit is the only platform that openly confirms the traditional form of shadowbans (Nicholas 2022). Elon Musk promised to provide more transparency on shadowbanning after taking over Twitter (now X), which is yet to be delivered (Perez 2023) and instead faces scrutiny himself over shadowbans on posts with links to other social media platforms (Newton 2023). Meta’s Facebook and Instagram were the first major social media platforms that declared pursuing ways to algorithmically reduce user engagement with borderline content in May 2018 (Gillespie 2022a; Zuckerberg 2021). YouTube, X, LinkedIn, and TikTok have since disclosed applying similar strategies to dealing with sensitive content (Duffy and Meisner 2022) and Uber reports visibility reductions for restaurants in response to unfavorable customer reviews (Uber 2023) (for more details on platform statements on shadowbanning, see Delmonaco et al. 2024; Gillespie 2022a). Beyond official social media platform statements concerning visibility reduction mechanisms, additional evidence suggests the existence and prevalence of shadowbanning. Anecdotal evidence comes from trace ethnography, surveys or interviews (Nicholas 2022; Wright 2022), analyses of platforms’ content moderation patents (Nicholas 2023), and users who closely monitor their engagement statistics (e.g., content creators) (Duffy and Meisner 2022; Zeng and Kaye 2022). Other evidence comes from sources that are difficult to verify such as internal whistle-blowers (Chen 2019), information leaks (Gillespie 2022a), or investigative journalism (Colve 2018; Merlan 2020). To determine the extent of shadowbanning, a recent survey of 1,006 social media users found that 9.2% report having been shadowbanned. Of these 8.1% were on Facebook, 4.1% on Twitter (now X), 3.8% on Instagram, 3.2% on TikTok, 1.3% on Discord, 1% on Tumblr, and less than 1% on YouTube, Twitch, Reddit, NextDoor, Pinterest, Snapchat and LinkedIn (Nicholas 2022). A content 123 822 M. Risius, K. M. Blasiak: Shadowbanning, Bus Inf Syst Eng 66(6):817–829 (2024) moderation survey that oversampled marginalized identities (i.e., racial and ethnic minorities, LGBTQ ?people, trans and/or nonbinary people) even found that 21.78% of respondents reported shadowbanning (Delmonaco et al. 2024). Recently, researchers have begun collecting statistical evidence for the presence and extent of different forms of shadowbanning. Analyses of 41 k to over 2.5 million Twitter (now X) accounts found that between 3–6.2% of accounts had been shadowbanned at least once (Jaidka et al. 2021; Merrer et al. 2021). These studies identify characteristics that increase the likelihood of shadowbans. Some of these predictors are particularly new accounts (less than two weeks old) with low follower numbers (below 200), using incivility (negative or offensive terms) or posting pictures without text messages, and displaying bot-like behavior (high botometer score) (Jaidka et al. 2023; Merrer et al. 2021). A verified account (e.g., the blue checkmark on X) helps to drastically reduce the chance of a shadowban (Jaidka et al. 2023; Jorgenson 2022). Based on these findings, computer scientists were then able to develop tools or workarounds that identify whether accounts are shadowbanned for different platforms like X (hisubway, 1 yuzurisa 2 ) or Reddit (r/CommentRemovalChecker, r/ShadowBan) (Nicholas 2022). 3 Challenges and Opportunities for IS Research Research on shadowbanning mechanisms and their implications remains in its early stages. While legal scholars, communication researchers, and computer scientists have contributed to this nascent field, existing studies primarily rely on qualitative methods. These methods often involve interviews with affected content creators or utilize anonymous sources within social media companies mechanism (Cotter 2021; Savolainen 2022; Zeng and Kaye 2022)or the analysis of content moderation patents (Nicholas 2023). Information systems scholars can address shadowbanning to help resolve these apparent issues and bridge the conversation between social media platforms, users, and regulators. Applying a sociotechnical perspective, information systems research can help mitigate the human and societal implications of this form of algorithmic content moderation and facilitate productive discourse on this challenge between the stakeholders (i.e., businesses, governments, NGO’s) (Gorwa 2022). Building upon the conceptualization of shadowbanning as an algorithmic control process involving various entities (user community, social media platforms’ Trust & Safety Teams, content moderation algorithms; Fig. 1), the following sections will explore a non-exhaustive list of illustrative research questions (Table 3). 3.1 User Community While there is currently little anyone can do if their account or content is shadowbanned, researchers identified common strategies that creators use to prevent and cope with shadowbans: Suppression, experimentation, circumvention, and resignation (Duffy and Meisner 2022). Similarly, creators’ experiences helped to develop techniques for individual users to detect whether they were shadowbanned (Columbres 2023). However, user reports of shadowbanning frequently encounter ‘‘black box gaslighting,’’ a phenomenon where platforms dismiss these concerns by claiming users misunderstand the complexities of content moderation algorithms (Cotter 2021). IS research can explore methods for users to safely communicate potential shadowbanning experiences (1.1)? Similarly, shadowbanning has significant implications for the targets (Myers West 2018; Nicholas 2022). Core Self-Evaluation theory (Bono and Judge 2003; Judge et al. 2003), for example, can help us understand (and mitigate) the shadowbanning effects on users’ self-esteem, self-efficacy, locus of control, and emotional stability (1.2). Lastly, shadowbanning has considerable monetization ramifications for creators (Duffy and Meisner 2022; Myers West 2018). Self-determination theory (Ryan and Deci 2000) allows to examine the complexities of the algorithmically driven workplace at the individual level (Benlian et al. 2022). Here it can help us understand how shadowbanning affects content creators or regular users’ (e.g., job candidate) perceived competence, autonomy, and relatedness after being shadowbanned (1.3). Shadowbanning also poses a major challenge for marginalized groups that appear to be disproportionally targeted (e.g., ‘‘ugly, poor, or disabled’’ users, ‘‘Black Lives Matter’’ filter, LGBTQ ?keywords) (Duffy and Meisner 2022; Ryan et al. 2020; Walsh 2022). The DIME model (Louis et al. 2020) allows IS scholars to explore the responses by these movements to shadowbanning (1.4). 3.2 Social Media Platforms (Trust&Safety Teams) Shadowbanning helps platforms fulfil important societal tasks by moderating various forms of harmful content. While its secrecy is strongly contested (e.g., promote conspiracies, reduce trust) (Nicholas 2022), shadowbanning’s opaque nature helps to avoid politicizing content moderation (Gillespie 2022a). The broader implications of content moderation mechanisms are controversially discussed among law and policy scholars (e.g., Douek (2022; Goldman (2021); Gorwa et al. (2020)), in communications 1 https://hisubway.online/shadowban/. 2 https://shadowban.yuzurisa.com. 123 M. Risius, K. M. Blasiak: Shadowbanning, Bus Inf Syst Eng 66(6):817–829 (2024) 823 research (e.g., Suzor et al. (2019)), and computer scientists [e.g., Seering (2020), Jhaver et al. (2019a), Jhaver et al. (2019b)]. IS research should join the debate and explore shadowbanning’s ability to mitigate societal or group polarization (Sunstein 2018) or protect free speech (Riemer and Peter 2021) compared to other forms of content moderation (2.1, 2.2). Alternatively, research demonstrates that a verified account and blue checkmarks are protective factors against shadowbanning (Jaidka et al. 2023; Jorgenson 2022), which are now partly offered for sale (Klar 2023). IS researchers could address this issue, for example, by applying the critical theory of power and ethics by Foucault (2007) to explore whether shadowbanning is an ethical, political, or primarily a technical problem (Siapera and Viejo-Otero 2021). Researchers could also aim to delineate the intended versus unintended consequences of systematic biases within shadowbanning (2.3). Moderating problematic social media content is a major concern for advertisers that want to avoid having their ads displayed next to hateful content (Cooban 2023). While shadowbanning confines the visibility of problematic content, it remains potentially accessible online. IS scholars can apply, for example, brand safety (Bishop 2021)or situational crisis communication theory concepts (Coombs 2007) to assess advertisers’ concerns regarding platforms shadowbanning (2.4). We highlighted the heated politicized debate around the term shadowbanning (Cotter 2021; Gillespie 2022a). The good reasons for performing shadowbans are often met with harsh criticism of censorship and marginalization. Researchers could follow other examples of IS research on contested online behaviors (e.g., doxing) (Franz and Thatcher 2023) to determine boundary conditions for ethically acceptable shadowbanning (2.5) and whether some platforms’ efforts that allow users to trace their account status means meaningful improvements (2.6) (Silva 2022; Zakharchenko 2024). In this regard, while we have summarized the evidence on the prevalence of shadowbanning on social media platforms, other platforms (e.g., Gig-economy) also report forms of visibility reduction (Uber 2023). Shadowbanning offers research the opportunity to expand their conceptualization of algorithmic control functions (Alizadeh et al. 2023; Hirsch et al. 2023; Kellogg et al. 2020; Sullivan et al. 2024), refine algorithmic management to benefit society at large (Mo ¨hlmannn et al. 2023), and explore the prevalence Table 3 Suggested areas of research to advance knowledge on shadowbanning Topic Proposed research questions User community 1.1 How can people safely communicate that they were shadowbanned? 1.2 How does shadowbanning affect users’ self-esteem, self-efficacy, locus of control and emotional stability? 1.3 What effects has shadowbanning on users’ perceived competence, autonomy, and relatedness? 1.4 How do marginalized groups respond to being shadowbanned? 1.5 How does shadowbanning influence users’ online behavior, such as self-censorship or avoidance of certain platforms? Social media platforms (Trust & Safety Teams) 2.1 How do shadowbanning’s trade-offs compare to other forms of content moderation? 2.2 How effective is shadowbanning in reducing polarization and protecting free speech compared to other forms of content moderation? 2.3 What factors drive platform’s exercise of shadowbanning? 2.4 What are the brand safety implications of shadowbanning for advertisers? 2.5 What characterizes ethically acceptable shadowbanning cases? 2.6 How to design shadowbanning reporting structures that offer reasonable amounts of transparency? 2.7 What other types of platforms use shadowbanning to moderate content? Content moderation algorithm 3.1 How can shadowbanning be detected across platforms? 3.2 How can advancements in artificial intelligence and machine learning improve the accuracy and fairness of shadowbanning algorithms? 3.3 How can we implement algorithmic sensemaking into shadowbanning decisions to reduce algorithm aversion? 3.4 What are the implications of shadowbanning’s reductionist effects for free speech and algorithmic audiencing? 3.5 What situations prompt manual vs automated shadowbanning? 3.6 What are the trade-offs regarding efficacy and ramifications between different types of shadowbans? 123 824 M. Risius, K. M. Blasiak: Shadowbanning, Bus Inf Syst Eng 66(6):817–829 (2024)