The rise of cybernetic citizenship

Reijers, Wessel; Orgad, Liav; de Filippi, Primavera Article — Published Version The rise of cybernetic citizenship Citizenship Studies Provided in Cooperation with: WZB Berlin Social Science Center Suggested Citation: Reijers, Wessel; Orgad, Liav; de Filippi, Primavera (2022) : The rise of cybernetic citizenship, Citizenship Studies, ISSN 1469-3593, Taylor & Francis, London, Iss. Latest Articles, pp. --, https://doi.org/10.1080/13621025.2022.2077567 This Version is available at: https://hdl.handle.net/10419/261201 Standard-Nutzungsbedingungen: Die Dokumente auf EconStor dürfen zu eigenen wissenschaftlichen Zwecken und zum Privatgebrauch gespeichert und kopiert werden. Sie dürfen die Dokumente nicht für öffentliche oder kommerzielle Zwecke vervielfältigen, öffentlich ausstellen, öffentlich zugänglich machen, vertreiben oder anderweitig nutzen. Sofern die Verfasser die Dokumente unter Open-Content-Lizenzen (insbesondere CC-Lizenzen) zur Verfügung gestellt haben sollten, gelten abweichend von diesen Nutzungsbedingungen die in der dort genannten Lizenz gewährten Nutzungsrechte. Terms of use: Documents in EconStor may be saved and copied for your personal and scholarly purposes. You are not to copy documents for public or commercial purposes, to exhibit the documents publicly, to make them publicly available on the internet, or to distribute or otherwise use the documents in public. If the documents have been made available under an Open Content Licence (especially Creative Commons Licences), you may exercise further usage rights as specified in the indicated licence. http://creativecommons.org/licenses/by/4.0/ The rise of cybernetic citizenship Wessel Reijers a,b,c , Liav Orgad a,d,e,f and Primavera de Filippi a,g a University of Vienna, Department of Philosophy, Vienna, Austria; b European University Institute, Robert Schuman Centre, Florence, Italy; c Department of Humanities and Arts, Technion – Israel Institute of Technology, Haifa, Israel; d WZB Berlin Social Science Center, Berlin, Germany; e Reichman University, Lauder School of Government, Diplomacy & Strategy, Herzliya, Israel; f Peking University, School of Transnational Law, Shenzhen, China; g CNRS, Paris, France ABSTRACT The global COVID-19 pandemic demonstrates how states and companies mobilise new sociotechnical systems to track, trace, evaluate, and modulate the behaviour of citizens. This development illustrates an already-existing transformation of citizenship governance, which this article captures as the move to ‘cybernetic citizenship’. First, the article explores the concept of cybernetic citizenship, providing an overview of the concepts of ‘cybernetic’ and ‘citizenship’ and synthesising these in a discussion of the cybernetic modulation of citizenship. Second, it presents the rise of cybernetic citizenship in the urban realm, zooming in on the case of the Chinese social credit system and the way it affects civic life in the urban realm. Third, it turns into the normative implications of cybernetic citizenship, arguing that it confronts the idea of citizens as equal, free, and vigilant. It challenges equality by turning rights into ends, freedom by turning status into process, and civic virtue by turning excellence into effectiveness. ARTICLE HISTORY Received Accepted 4 May 2022 KEYWORDS Citizenship; cybernetic citizenship; COVID-19; social credit system; China 1. Introduction Systemic crises like wars and natural disasters tend to propel new waves of technological innovation. This is demonstrated by the global COVID-19 pandemic, which has led to massive data collection on citizens, track- and trace applications, and automated means of intervention. A fascinating example comes from China, where the pandemic initially started, which has deployed its emerging social credit system (SCS) to fight the pandemic (Knight and Creemers 2021). The SCS uses technological innovations to rate (and often score) citizens to improve public order and trust. For instance, it has made it more socially costly to engage in behaviours that might lead to spreading the disease, such as hiding virus symptoms or evading medical treatment. At the same time, the SCS has been used to relax some restrictions on behaviours that would otherwise be more costly, for example, enforcing financial obligations that are harder to meet due to the economic downfall. The costs and benefits imposed by the SCS are not only monetary, but rather attached to one’s status, rights, and duties as a citizen. CONTACT Liav Orgad [email protected] CITIZENSHIP STUDIES https://doi.org/10.1080/13621025.2022.2077567 © 2022 The Author(s). Published by Informa UK Limited, trading as Taylor & Francis Group. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/ licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. This article investigates the emerging form of cybernetic citizenship as illustrated by the SCS. It builds on a growing body of literature that addresses the transformation brought about by technology to the concept of citizenship (digital citizenship, Mossberger, Tolbert, and McNeal 2008; e-citizenship, Dumbrava 2015; algorithmic citizenship, Cheney-Lippold 2016). At first, literature focused on the way technologies shaped existing, stable aspects of citizenship, for instance, by looking at the digitalisation of state services and online civic education. More recently, there has been a turn toward questioning the foundations of liberal citizenship, as conceptualised in the tradition that follows Marshall (1950). Most notably, Marion Fourcade has coined the term ‘ordinal citizenship’, which implies a transformation of citizenship due to the emergence of large sociotechnical systems that measure, quantify, and evaluate citizens (2021). Some utopian and dystopian scenarios related to the shift in the essence of citizenship due to cybernetic systems were already discussed decades ago by philosophers of technology like Mumford (1965) and Winner (1969, 1978). This article continues this strain of thought and draws from recent work in the humanities (Pickering 2010; Hui 2019) that signals the revival of cybernetic thinking. The article’s central claim is that, empirically, we are witnessing the rise of cybernetic citizenship as demonstrated by the Chinese SCS and similar sociotechnical systems around the globe; normatively, this development has urgent ethical, legal, and political implications. First, cybernetics professes to be a general epistemology that takes the networked computer as its model (Winner 1969). While citizenship in the current international order of states is still primarily based on the mechanised worldview of enlightenment philosophy, cybernetics challenges this worldview and thereby the sense of citizenship based on it. Second, cybernetics accounts for how sociotechnical systems learn and adapt their behaviour according to contingent inputs (Krivý 2018). Hence, it explains how citizens’ seemingly accidental and contingent behaviours are connected and harnessed for citizenship governance. And third, initially emerging in the wake of computerised systems, cybernetics speaks to a much longer history of philosophical thinking that mobilises the notion of a living machine to understand the institution of citizenship (Mumford 1965). The article proceeds as follows. Section 2 develops the concept of cybernetic citizenship, synthesising the outlines of ‘cybernetics’ and establishing perspectives on ‘citizenship’. Section 3 describes the rise of cybernetic citizenship through the lens of the application of the SCS in the urban realm in China. Section 4 develops a normative analysis of cybernetic citizenship, arguing that it erodes core distinctions that inform modern citizenship: between rights and ends, status and process, and excellence and effectiveness. 2. Concept This section develops the concept of cybernetic citizenship. First, it provides an overview of the cybernetic perspective and how it is used to understand different phenomena. Second, it outlines different established perspectives on citizenship. Third, it shows how cybernetic citizenship modulates the relation between citizens and institutions in terms of space, time, and social interaction. 2W. REIJERS ET AL. 2.1. Cybernetics Cybernetics can be understood in two ways: a scientific discipline and a general worldview. As a scientific discipline, cybernetics emerged at the end of World War II. A varied, interdisciplinary group of scholars, including the mathematician Norbert Wiener, psychiatrist Ross Ashby, and anthropologists Margaret Mead and Gregory Bateson, convened around a shared scientific view of the world that encompassed human and nonhuman elements in a communication network. This view arose in the wake of the development of early computer systems, mainly for military purposes, which gathered information from the environment and translated the data into behavioural outputs by means of feedback mechanisms. Due to the deterministic qualities of technologies at its inception, the initial focus of cybernetics was on (relatively) closed systems with negative feedback loops. This view does not fit current cybernetic systems, which are open, constitute positive feedback loops, and can control but also adapt to environmental changes (Krivý 2018). As a general worldview, early cyberneticians successfully identified and conceptualised a way of thinking that is found in today’s biology, computer science, statistics, and political science. Cybernetics is a general understanding of the world that emerges from studying three seemingly distinct phenomena: life processes, machines, and political communities. It combines these perspectives through the single metaphor of the kybernetes, the ancient Greek word for a pilot. The kybernetes had a practical understanding of navigating the ship and adapting to unknown circumstances, like the weather. The influence of cybernetic thinking on modern technoscience can be demonstrated by the increasing use of core cybernetic concepts – such as systems, networks, feedback, and information (Françios 1999) – and their application to the world. As a scientific discipline or a way of thinking, cybernetics is too complex to be comprehensively captured in this article. Yet, a brief explanation through three core concepts – networked system, recursive feedback, and informatisation – will suffice to make a relevant connection with citizenship. At first, cybernetics is about the networked system. This notion refers to the way cybernetics understands space, which has horizontal and vertical dimensions. The horizontal dimension is captured by the idea of a network – a spatial arrangement of interconnected nodes connecting and exchanging information (Castells 2004, 3). Networks are relatively flat and distributed: they have no centre of command. A prime example is the Internet, the main driver of the ‘network society’. The vertical dimension is captured by the idea of a system. This idea adds control or regulation to the communication network. A system is a goal-directed assemblage of functional components. It is not simply a machine that repeats a mechanical movement, like a clock. Instead, it has a direction and can pursue an often indeterminate number of ends. For this reason, systems are ‘quasi-living’ entities (Wiener 1989); they respond to their environment in light of certain ends. Systems are open, and they interact with their environments. The system dimension introduces a hierarchy to communication networks, which have layers or components of networks that hierarchically relate to one another. An example is DNS (Domain Name System), which is nested within the Internet architecture (Galloway 2004). The hierarchy inherent to DNS is not necessarily top-down, based on a command- CITIZENSHIP STUDIES 3 and-control structure. On the contrary, most systems that operate on the Internet today produce bottom-up, emergent hierarchies, such as the hierarchy of websites displayed after a Google Search query. Next, cybernetics is about recursive feedback. This relates to the way cybernetics understands time, how networked systems operate and give rise to a particular temporality (Hui 2019). Recursive feedback allows systems to have a ‘memory’ of the past and to ‘predict’ a future. This process is often likened to forms of reflective learning, similar to how a child learns a language. The notion of recursive feedback refers to a movement between a system and its environment, whereby inputs received from the environment are processed and fed back into the system as new inputs. This is not a mechanical process of mere repetition, like the mechanical movement of a clock, but a movement of adaptation. This means that contingent inputs do not lead to noise or disruption of the system but are reflexively interpreted to anticipate future events. From a cybernetic perspective, recursive feedback can be found everywhere in our world. Animals use it to process information from their environment and adapt their behaviour to new circumstances. The human brain uses it to learn new skills. And digital systems use it to engage in processes of machine learning, in which new information is analysed based on a vast corpus of existing data. In other words, recursive feedback relies on sensing the environment, processing information, and generating behavioural change. Finally, cybernetics relates to informatisation. It captures how systems interact. Interaction is premised on intelligibility, i.e. systems must understand each other, and they do so through information. Cybernetic systems can only understand reality once it is accessible as ‘information’. The practical notion of informatisation explains how phenomena are modulated to become informative in a cybernetic sense. This modulation shows a kinship with the much-discussed idea of datafication (Lycett 2013), which broadly means (i) eliciting the informational aspect from physical objects and events and their context, (ii) processing data in such a way that it can easily be manipulated and transferred, and (iii) recombining informational resources for particular contexts and problems. According to De Mul (1999), informatisation presupposes phenomena to be programmable (subject to calculation), synthesisable (subject to self-organisation), and manipulable (subject to artificial change of limits that govern the natural world). In short, cybernetics modulates entities so that they can be quantified, organised, and manipulated. Consider the technology of genetic modification. It captures genes as a form of code that can be programmed; it synthesises this code with a certain purpose in mind, for instance, eradicating a genetic disease; and, by doing so, artificially overcomes the limits of the natural world. 2.2. Citizenship Like cybernetics, citizenship is a complex concept with various meanings. In the most basic sense, citizenship denotes (equal) membership in a self-governing political community (Joppke 2010, 160). This definition spells out citizenship as a basic aspect of the human condition, which considers humans as ‘political animals’ (Depew 1995) capable of co-governing communities. Considering this basic notion of citizenship, even stateless refugees could potentially be ‘citizens’ of virtual/cloud-based political refugee 4W. REIJERS ET AL. communities (Orgad 2018). Yet, since the world is still dominated by territorial-based nation-states, citizenship has been chiefly conceptualised by this spatial reality (Hirschl and Shachar 2019) and can be seen by using two perspectives. The first is a human rights perspective. It focuses on the internal function of citizenship – the relation between the state and the citizens. T.H. Marshall (1950) was one of the leading proponents of the view that citizenship denotes a gradual increase in citizens’ rights, starting from civil rights, via political rights, to social rights. This historical thesis accounts for the way citizens have gained, amongst others, rights to private property, voting rights, and social rights to education and healthcare. After World War II, this idea of citizenship as giving access to rights internal to states has been extended to the idea that it could also give access to the more general category of human rights. As a citizen of France, for example, one could appeal to international or European human rights while residing in Germany. This view is paradoxical since the enjoyment of universal human rights depends on having the legal status attached to the membership of a particular nation-state. For this reason, Hannah Arendt (while not ascribing to the Marshallian view of citizenship) proclaimed that citizenship is essentially a ‘right to have rights’ (1973, 298). The second is a sociological and anthropological perspective. Citizenship consists of different, interrelated elements, such as rights, obligations, and identities (Joppke 2010), to which might be added civic virtue and political participation. This view is more attentive to how the relationship between states and people, both as citizens and as migrants, is constituted. It considers citizenship not only as a legal status but also as a sociocultural reality of belonging. Being a German citizen does not only mean having a German passport or rights associated with it but also sharing a historical and cultural sense of being German and acting according to some German way of doing things. It is about ‘citizenship in practice’ (Barnes, Auburn, and Lea 2004), everyday social life, how people do things in a political community. This view is often used to distinguish ‘real’ or ‘true’ citizens from the ‘other’ citizens. Citizenship, thus, can be understood both as a formal legal status and de facto membership in a political community (citizenship as everyday practice). 2.3. Cybernetic citizenship A cybernetic understanding of citizenship is not new. It originates from what might have been the most sophisticated ‘living’ technology in ancient Greece, the trireme – a mighty warship that played a decisive role in the Peloponnesian Wars. Plato is frequently cited as the Western thinker who considered citizenship governance in the ancient polis in analogy with (or as a metaphor for) the steering of a ship (Winner 1980, 129). In The Republic (Plato [1997] 488a-489e), Plato argued that unlike the owner of a trireme, the trierarch, who lacks expertise in navigation, the kybernetes, an experienced crew member, should be in charge of the ship. This is because the kybernetes would have practical skills and technical knowledge of navigating the ship. Using this analogy, Plato advocated for governance by experts, who would use techno scientific knowledge and practical skills to govern the citizenry. While Plato initiated the debate, it was Aristotle who used the cybernetic analogy more decidedly to theorise the governance of the ancient Greek city, CITIZENSHIP STUDIES 5 the polis (Mumford 1965, 275). In The Politics (Aristotle 1998] 1276b19-30), Aristotle spelt out what may be considered the first comprehensive concept of citizenship governance in cybernetic terms: Just as a sailor is one of a number of members of a community, so, we say, is a citizen. And though sailors differ in their capacities (for one is an oarsman, another a captain, another a lookout, and others have other sorts of titles), it is clear both that the most exact account of the virtue of each sort of sailor will be peculiar to him, and similarly that there will also be some common account that fits them all. For the safety of the voyage is a task of all of them, since this is what each of the sailors strives for. In the same way, then, the citizens too, even though they are dissimilar, have the safety of the community as their task. But the community is the constitution. Hence the virtue of a citizen must be suited to his constitution. Cybernetic thinking has migrated from the philosophical discussion of citizenship in Ancient Greece, via the Enlightenment philosophy of life and the organic (Kant, Schelling), through biology (Mendel, Darwin) and mathematical physics (Schrödinger, Gödel), to computer science (Turing, Wiener), dissipating into a variety of disciplines (cf. Hui 2019), including politics. And yet, despite its influence on political philosophy, cybernetic thinking has had limited practical impact on citizenship governance for most of history. The reason is that, as a technical notion of governance, it requires sophisticated conditions of human organisation, techniques, and technologies to be effectively applied. Early forms of cybernetic governance were applied to relatively smallscale units. A paradigmatic example is Jeremy Bentham’s Panopticon (August 2021, 16), which establishes a form of recursive feedback (the prisoners regulate their own behaviour because they might be observed) within a system that governs the network of communication (the prison architecture). Other examples applied during the Industrial Revolution, both in education through the grading system and in factory management through Frederick Taylor’s scientific management theory. But while institutions like schools and factories have relatively stable boundaries and are easy to regulate, the scale and complexity of political communities have prevented, thus far, cybernetic governance from being extended to society as a whole. The proliferation of sociotechnical systems in every aspect of life makes the cybernetic governance of citizenship a practical possibility today. Three transformations are contributing to that. First, cybernetic systems transform the space of citizenship, promoting both connectivity (horizontal) and systematisation (vertical). Paradoxically, the more connectivity is achieved, the more room for control and regulation is made. In terms of a network, as Varnelis and Friedberg (2013, 32) argue, the space of citizenship is shaped by the merging of the ‘geospatial Web’ and ‘ubiquitous computing’. It relies on the expansion of cyberspace – the digital space through which citizens connect and their institutions, and simultaneously on a vast physical network of connected devices and sensors: phones, cameras, radio-frequency identification chips. These two aspects allow for the placing of citizens and institutions as connecting nodes in a network that functions like a geometric overlay on the physical space. In this context, citizens have to digitally check-in when they enter physical spaces so that health authorities can trace their behaviour in case a COVID-19 outbreak happens at a location they visited. Interconnectivity under such a citizenship regime is less of a free choice and more of a public imperative: being a node means being able to send and receive information. In terms of a system, cybernetic governance generates a built environment that connects 6W. REIJERS ET AL. people and institutions to a certain hierarchy of ends (Zandbergen and Uitermark 2019); citizens are placed into a hierarchical relation vis-à-vis the ends of political institutions, which in turn relate to a higher-order end that justifies the overall system. To be sure, citizenship has always been organised around an overarching end, at least in spirit. Yet, with the advent of cybernetic sociotechnical systems, individual behaviours can systematically be brought into a manageable relationship with the ends of the political community, similar to how the behaviours of the worker can be brought into a relationship with the ends of a company. Consider how political institutions are now able to set quantifiable metrics for individual behaviours to align with institutional aims. Such systematisation sets citizenship into a concrete rather than imagined relation to an overarching end of the political community, for the sake of which citizenship is governed. Second, cybernetic systems transform the time of citizenship, turning it into a historicised process that draws from recorded traces and calculated predictions. Practically, this happens through the introduction of recursive feedback into the relations between citizens and institutions; more information is processed between citizens and officials through government institutions. A tax officer might scan a citizen’s tax record and send it back for corrections. This helps the tax officer ‘learn’ about faulty behaviour and the citizen to ‘learn’ about the correct way to file taxes; it is a process of mutual adaptation. Today, such recursive feedback is increasingly automated by means of algorithmic processes. An algorithm might interpret the behaviour of citizens based on historical patterns and assign them a risk score, which indicates the probability that taxes will be filed correctly (Alm and Torgler 2011). Automated processes of recursive feedback rely on vast collections of historical data to deal with scale and complexity (Fourcade and Johns 2020). They can use statistical methods to learn from the populations’ behaviour and use this data to predict and modulate individual behaviours. In this way, cybernetic systems mediate the temporality of human activities (Hui 2019). To be sure, the impact of technological change on time has been a theme of reflection since the rise of mechanisms of time and, in particular, the use of the clock in industrial operations. Yet, earlier time machines differ from contemporary time machines because they did not adapt to contingencies. The clock keeps ticking at a regular pace, regardless of whether the worker goes on strike. Cybernetic systems, in contrast, might anticipate the strike and, as a response, allocate more free time to workers to modulate their sentiments. This temporal logic penetrates now into the realm of citizenship. Third, cybernetic systems transform the interaction between citizens and institutions by informatising it. This interaction becomes subject to calculation, which means that standards for being a ‘good’ citizen or institution are determined through quantifiable metrics. Primary instruments for this are techniques for ranking, rating, and scoring. Public officials like politicians are rated and ranked, as are public institutions like universities and hospitals. Government agencies are regularly subjected to impact assessment exercises by which they are scored on performance indicators. Similarly, citizens get scores for increasingly many activities: not only do they get grades for their educational accomplishments, but they are scored as consumers, as social media users, and even as citizens qua citizens (in the case of the SCS). Such metrics rely on standardisation and interoperability. It means that standards of measurement are CITIZENSHIP STUDIES 7 brought from a local to a global understanding, like the way different standards of time have been replaced by the global Greenwich Mean Time measurement. This shows itself through global standards for qualification and certification, like ECTS (European Credit Transfer and Accumulation System) points in European education (Backer and McQuilla 2020). Interoperability, in turn, ensures that different metrics can ‘speak’ to one another. To illustrate, the metric of one’s social media activity might interact with one’s credit score. Finally, these forms of quantified assessment rely on citizens and institutions to be liable to modulation by means of incentives. Thus, metrics can only have effects when they are linked up with incentive structures that modulate behaviour. Citizens can be rewarded when they engage in public service and sanctioned when they commit traffic infractions, with the goal that they regulate themselves. To sum up, cybernetic citizenship means that citizenship is increasingly shaped by the cybernetic understanding of space, time, and interaction. In terms of space, citizens are turned into communicating nodes that are put into a systemic relation with defined ends of their political community. In terms of time, citizenship becomes a process that draws from recorded history, leading to a prediction of future behaviour. In terms of interaction, citizens and institutions are informatised: subjected to quantifiable assessment, which is standardised and made interoperable, and premised on the practical notion that behaviour can be modulated through incentive mechanisms. This challenges the normative basis of citizenship in terms of status, rights, and identity, as discussed in Section 4. Before we turn to the normative assessment of cybernetic citizenship, we present how it already exists in the urban realm. 3. Case study This section provides empirical evidence for the rise of cybernetic citizenship, with a focus on the urban realm. First, it gives a high-level description of how cybernetic systems are integrated into the fabric of citizenship at the urban, national, and transnational levels. Second, it discusses the case of the social credit system, emphasising how it affects citizenship in Chinese cities. 3.1. Citizenship in the digital age With the proliferation of personal computers and the Internet, the transformation of political institutions has been mainly linked to increases in data collection and networked exchanges of digital documents. Certain rights and duties have become embedded in digital communication systems. Thus, with the advent of cloud services, large internet platforms, artificial intelligence, and advances in cryptography, new sociotechnical systems have emerged; they can collect different types of information and process them through statistical methods that enable these systems to learn from contingent inputs and execute outputs accordingly. Some social rights, for instance, are now conditioned on having a digital identity, navigating an online platform, and digitally signing or verifying information. This is particularly true in the wake of the COVID-19 pandemic, as governments around the world have implemented new digital passes (e.g. proofs of 8W. REIJERS ET AL. The concept of citizenship is one of the mechanisms for securing a stable legal system (alongside others, such as the ability to amend laws and political compromises that enable peaceful co-existence). It means that, once a person is a citizen, it is a lifelong status that guarantees civil rights, including, at least in a rule-of-law system, the ability to take critical political initiatives. The lifelong status of citizenship creates stability through time, which Arendt (1958) refers to as duration. Political freedom exists through the absence of law (everything which is not forbidden is allowed) and is protected (from arbitrary domination) through its presence (Pettit 2011). Citizens can count on this legal basis unconditionally: they neither have to earn nor deserve it. Cybernetic citizenship transforms citizenship as a legal status, whose essence derives from the law and stands despite the passing of time, into a conditioned concept, the way citizenship is implemented in practice. First, citizenship becomes contingent. The enjoyment of a complete set of human and civil rights depends on the evaluation of data about past events. Cybernetic systems learn from the behavioural histories of citizens to decide which rights and sanctions to grant or impose, when, and where. This is evident in the COVID-19 context, where some behaviours are drawn within the historicised reputation of people, like violating quarantine rules. Cybernetic citizenship is a dynamic, adjustable process that turns citizenship from an unconditional legal status to a historically lasting process, subject to fault and correction. Second, because it does not explicitly rely on laws and regulations, cybernetic citizenship, as illustrated partly by the Chinese SCS and Covid-19 policies, is not subject to the same constraints as the rule of law system. If it exists at all, the legal ground for citizenship restrictions is not always publicly formulated, clear, coherent, and retroactive; in some cases, there is no due process of law and full respect of property and liberty. Cybernetic citizenship, thus, turns citizenship from a status to a process whose entitled rights must be constantly earned, and moves the legal status outside the sphere of legality to the societal reality, the way people do things in a political community (for the sociological view of citizenship, see Section 2). We are witnessing a transition from a system governed by the rule of law (‘nomocracy’) to a system governed by numbers (‘numerocracy’). Unlike citizenship as a status, a governance by numbers (or reputation, Dai 2018) system is constantly subject to change and must be earned. It requires citizens to be constantly aware of good behaviour standards and change their behaviour accordingly. It thereby normalizes the notion of ‘citizenization’, citizenship as a process, and indirectly reinforces the idea of ‘good citizenship’ (Orgad and Reijers 2022). Third, cybernetic citizenship urges citizens to ‘labour’ for their citizenship to get access to certain rights. This ties in with Scheuerman’s (2005) argument that the ‘busyness’ generated by contemporary life makes that people have ‘no time for citizenship’ and that free political actions are relegated to laborious activities. As such, being a citizen has increasingly less to do with taking free initiatives and more to do with engaging in activities that fit the historicised expectation of the political community, as aligned with cybernetic incentives. As a result, citizens have less time to exercise their freedom since the labour to maintain rights is tied to a cyclical, never-ending process. CITIZENSHIP STUDIES 15 4.3. From excellence to effectiveness Citizenship implies interaction, which means that citizens must be responsive to institutions and vice-versa. This idea is captured by the term civic virtue, which can be a virtue ascribed to a citizen (e.g. vigilance) and an institution (e.g. justice). These virtues are twosided: they appeal to excellence and effectiveness. This distinction lies at the heart of Aristotle’s conception of citizenship. For free citizens, the effectiveness of being ruled coincides with the excellence of ruling; citizenship is enacted through skills (effectiveness) and virtues (excellence). Effectiveness denotes activities needed for a citizen to function according to institutional ends, like paying taxes. It requires extrinsic motivation, safeguarded by external goods such as reputational or material gains. Excellence denotes activities of democratic political life; most notably, activities in which political agents disclose themselves by acting and speaking in concert. It requires a sense of intrinsic motivation, captured by MacIntyre (2007) as the requirement to aim at goods internal to a practice. Cybernetic citizenship challenges civic virtue as excellence by informatising the qualities of citizens and institutions. These qualities are rendered calculable, programmable, and manipulable to make interaction possible. Institutions increasingly use calculated metrics: risk scores, credit scores, and other measurements. To get to these measurements, civic virtue is not assessed directly but indirectly: it matters whether one pays one’s bills in time, not whether one has the proper disposition to do so. Cybernetic citizenship is thus premised on an implicit form of behaviourism: qualities are derived from behaviours that can be made discrete, measured, and calculated. This comes to the fore with implementing the SCS in the urban realm through a translation of atomic behaviours (e.g. paying a bill, jaywalking) into calculated measurements following a catalogue of good or bad deeds. By this process, citizens become responsive to institutions but only in an instrumental way – they engage in behaviours not primarily because these bring them internal goods but because they are extrinsically motivated. Turning civic virtue from excellence into effectiveness limits the interaction between citizens and institutions in three senses. First, it makes civic virtue past-oriented rather than future-oriented. The metrics that establish civic virtue are derived from existing norms and standards. Citizens and institutions will strive to comply with existing norms and standards, but this, in turn, limits their ability to act innovatively and creatively, for instance, by developing new political projects. Second, it introduces the ‘tyranny of metrics’ (Muller 2018), which means that measurements become more important than what they are supposed to measure. This risks generating a false sense of ‘good citizens’ on the side of institutions, because conformist, rule-abiding citizens are valued higher than active, vigilant citizens who challenge existing structures. On the side of citizens, this same dynamic creates incentives to game the system. For, as de Filippi rightly observed, under the SCS the motto is no longer ‘I have a good credit score because I am a good citizen’, but rather becomes ‘I’m a good citizen because I have a good credit score’ (De Filippi 2019). Third, this transformation eventually instrumentalises the citizen, for civic virtue is no longer a function of the citizen’s happiness but only relates to the external well-being of the community. Cybernetic citizenship thereby falls prey to what Heidegger (1977) called the enframing of modern technology: it confers everything, including 16 W. REIJERS ET AL. citizens themselves, into standing reserve, a resource to be used. To be clear, liberals often consider civic virtue as instrumental to the sustenance of the liberal state (McTernan 2014). Yet, liberal thinkers have generally refrained from cultivating virtue, leaving the cultivation of character almost exclusively to the private sphere, augmented with civic education. Cybernetic citizenship, on the contrary, explicitly reimagines civic virtue by subjecting it to a logic of metrified interaction. It is, therefore, ‘republican’ in reviving civic virtue in the public sphere but subverts it in turn by instrumentalising it fully. 5. Concluding remarks Cybernetic sociotechnical systems reshape the lives of citizens in the urban realm. This article presents the first philosophical discussion of the concept of cybernetic citizenship, its implementation through the proliferation of sociotechnical systems like the SCS, and the normative challenges it raises. The article contributes to the ongoing debate on the impacts of ‘dataism’ on citizenship. It foremost responds to the work of Fourcade (2021) on ordinal citizenship, adding to her work in three ways: by linking the discussion on citizenship and technology to the philosophy of technology, embedding the debate within the frame of cybernetics, and considering ‘ordinality’ in algorithmic governance as an enabler of a conception of citizenship that can be traced back to the birth of political philosophy. The article goes beyond ordinal citizenship and its valuable criticism (Joppke 2021) by arguing that cybernetic citizenship is not tied to any particular citizenship ideology such as neoliberalism, although it has allied itself with that in recent times. Just as cybernetics was embraced by liberal and communist states (Csizmas 1971), it can emerge in different ideological contexts. The article returns to the perplexity of philosophers of technology who consider that cybernetics is on its way to replace metaphysics and explores what this means for citizenship. The rise of cybernetic citizenship, as discussed in the article, is limited in scope. First, emphasising the urban realm, the article is inclined toward the ‘internal’ perspective on citizenship, focusing on the relationship between citizens and political institutions rather than on between states. It would be valuable to inquire into how cybernetic systems like distributed blockchain technologies would impact the inequality between citizenships (Gstrein and Kochenov 2020). Second, it accounts for a new model of citizenship that is not yet fully applicable but exists as a loose conglomeration of sociotechnical projects. Still, we might follow John Torpey (2001) in his discussion of the invention of the passport, arguing that a technical tendency, as fractured, ineffective, and disorganised as it was at the start, tends toward effectiveness and consolidation. Hence, cybernetic citizenship represents a potent new force in our world that might transform citizenship and what it means to enact it. Notes 1. The episode Nosedive of Black Mirror (Netflix) is often compared to the Chinese social credit system in the popular media. In this episode, citizens use digital devices to rate eachother, which leads to a social ranking with vital benefits and sanctions attached to it. 2. For the differences between the ‘rule of law’ and the ‘rule by law,’ see Tamanaha (2004). CITIZENSHIP STUDIES 17 Acknowledgments We would like to acknowledge the thoughtful comments of Federico Tomasello and two persistent anonymous reviewers. Disclosure statement No potential conflict of interest was reported by the author(s). Funding This research is funded by the European Research Council (ERC) under the European Union’s Horizon 2020 Research and Innovation Programme (Grant Agreements No. 716350 and No. 865856). References Alm, J., and B. Torgler. 2011. “Do Ethics Matter? Tax Compliance and Morality.” Journal of Business Ethics 101 (4): 635–651. doi:10.1007/s10551-011-0761-9. Arendt, H. 1958. The Human Condition. Vol. 24. Chicago: University of Chicago Press. Arendt, H. 1973. The Origins of Totalitarianism. New York: Harvest Book. Aristotle. 1998. Politics. C. D. C. Reeve edited by. Indianapolis: Hackett Publishing Company. August, V. 2021. “Network Concepts in Social Theory: Foucault and Cybernetics.” European Journal of Social Theory 25 (2): 1–21. Backer, L. C., and M. McQuilla. 2020. “The Algorithmic Law of Business and Human Rights: Constructing a Private Transnational Law of Ratings, Social Credit, and Accountability Measures.” SSRN Electronic Journal 2 (Aguirre 2004): 1–51. Barnes, R., T. Auburn, and S. Lea. 2004. “Citizenship in Practice.” British Journal of Social Psychology 43 (2): 187–206. doi:10.1348/0144666041501705. Castells, M. 2004. “Informationalism, Networks, and the Network Society: A Theoretical Blueprint. In The Network Society: A Cross-Cultural Perspective, edited byM. Castells, 3–48. Cheltenham: Edward Elgar Publishing Limited. Chen, W. 2019. “The Practice and Thoughts of Hangzhou City Brain.” CPC News, September 8 Cheney-Lippold, J. 2016. “Jus Algoritmi: How the National Security Agency Remade Citizenship.” International Journal of Communication 10: 22. Csizmas, M. 1971. “Cybernetics - Marxism - Jurisprudence.” Studies in Soviet Thought 11 (2): 90–108. doi:10.1007/BF01045036. Dai, X. 2018. “Toward a Reputation State: The Social Credit System Project of China.” SSRN. De Filippi, P. 2019. “The Social Credit System as a New Regulatory Approach: From Code-Based to Market-Based Regulation.” In A Dystopian Future? the Rise of Social Credit Systems (:), edited by L. Orgad and W. Reijers, 27–28. Florence, Italy: Robert Schuman Centre, Europea University Institute. De Mul, J. 1999. “The Informatization of the Worldview.” Information, Communication & Society 2 (1): 69–94. doi:10.1080/136911899359763. Depew, D. J. 1995. “Humans and Other Political Animals in Aristotle’s ‘History of Animals’.” Phronesis 40 (2): 156–181. doi:10.1163/156852895321051937. Dumbrava, C. 2015. “Welcome to E-Stonia! E-Residence and Citizenship in an Electronic Republic.” EUDO Citizenship, January. Fourcade, M., and F. Johns. 2020. “Loops, Ladders and Links: The Recursivity of Social and Machine Learning.” Theory and Society 49 (5–6): 803–832. doi:10.1007/s11186-020-09409-x. Fourcade, M. 2021. “Ordinal Citizenship.” British Journal of Sociology 72 (2): 1–20. 18 W. REIJERS ET AL. Françios, C. 1999. “Systemics and Cybernetics in a Historical Perspective.” Systems Research and Behavioral Science 16 (3): 203–219. doi:10.1002/(SICI)1099-1743(199905/06)16:3<203::AIDSRES210>3.0.CO;2-1. Fuller, L. L. 1969. The Morality of Law. New Haven: Yale University Press. Galloway, A. R. 2004. Protocol: How Control Exists After Decentralization. Cambridge, Massachusetts: MIT Press. Gstrein, O. J., and D. Kochenov. 2020. “Digital Identity and Distributed Ledger Technology: Paving the Way to a Neo-Feudal Brave New World?” Frontiers in Blockchain 3 (March): 1–8. doi:10.3389/fbloc.2020.00010. Hart, H. L. A. . 1965. “Book Review: Lon Fuller. The Morality of Law.” Harvard Law Review 78 (6): 1281–1296. doi:10.2307/1338941. Heidegger, M. 1977. The Question Concerning Technology and Other Essays. New York: Garland Publishing, . Hirschl, R., and A. Shachar. 2019. “Spatial Statism.” International Journal of Constitutional Law 17 (2): 387–438. doi:10.1093/icon/moz052. Hoffman, S. 2017. Programming China: The Communist Party’s Autonomic Approach to Managing State Security. Berlin: MERICS. Hui, Y. 2019. Recursivity and Contingency. London: Rowman & Littlefield Publishers. Joppke, C. 2010. Citizenship and Immigration. Cambridge: Polity Press. Joppke, C. 2021. “From Liberal to Neoliberal Citizenship: A Commentary on Marion Fourcade.” British Journal of Sociology 72 (2): 1–9. Kaufmannn, M., S. Egbert, and M. Leese. 2019. “Predictive Policing and the Politics of Patterns.” The British Journal of Criminology 59 (3): 674–692. doi:10.1093/bjc/azy060. Knight, A., and R. Creemers. 2021. “Going Viral: The Social Credit System and COVID-19.“ SSRN : 1–23. Krivý, M. 2018. “Towards a Critique of Cybernetic Urbanism: The Smart City and the Society of Control.” Planning Theory 17 (1): 8–30. doi:10.1177/1473095216645631. Lessig, L. 2006. CODE Version 2.0. New York: Basic Books. CODE Version 2.0. Liu, W. 2020. “Hangzhou ‘City Brain’ Creates Good Lives/杭州“城市大脑”创造美好生活.” Economic Daily, April 11. Lycett, M. 2013. “‘Datafication’: Making Sense of (Big) Data in a Complex World.” European Journal of Information Systems 22 (4): 381–386. doi:10.1057/ejis.2013.10. MacIntyre, A. 2007. After Virtue: A Study in Moral Theory. Third ed. Notre Dame, Indiana: University of Notre Dame Press. Marshall, T. H. 1950. “Citizenship and Social Class.” The Welfare State Reader 2: 30–39. Maschewski, F., and A.-V. Nosthoff. 2017. “Order from Noise: On Cambridge Analytica, Cybernetic Governance and the Technopolitical Imaginary.” PS. McTernan, E. 2014. “How to Make Citizens Behave: Social Psychology, Liberal Virtues, and Social Norms.” Journal of Political Philosophy 22 (1): 84–104. doi:10.1111/jopp.12015. Meuwese, A. 2020. “Regulating Algorithmic Decision-Making One Case at the Time.” European Review of Digital Administration & Law 1 (1–2): 209–211. Mossberger, K., C. J. Tolbert, and R. S. McNeal. 2008. Digital Citizenship: The Internet, Society, and Participation. Cambridge, Massachusetts: MIT Press. Muller, J. Z. 2018. The Tyranny of Metrics. Princeton: Princeton University Press. Mumford, L. 1965. “Utopia, the City and the Machine.” Daedalus 94 (2): 271–292. Orgad, L. 2018. “Cloud Communities: The Dawn of Global Citizenship?” In Cloud Communities: The Dawn of Global Citizenship? (:), edited by L. Orgad and R. Bauböck, 1–6. Florence, Italy: European University Institute, Robert Schuman Centre. Orgad, L., and W. Reijers. 2019. “A Dystopian Future? the Rise of Social Credit Systems.” RSCAS 2019/94. Florence. Orgad, L., and W. Reijers. 2022. “Making the Perfect Citizen: Lessons from China’s Social Credit System.” Vanderbilt Journal of Transnational Law 53 (4). Pasquale, F. 2018. “Digital Capitalism: How to Tame the Platform Juggernauts.” Friedrich-Ebert- Stiftung - Division for Economic and Social Policy 1–4. CITIZENSHIP STUDIES 19 Pettit, P. 2011. “The Instability of Freedom as Noninterference: The Case of Isaiah Berlin.” Ethics 121 (4): 693–716. doi:10.1086/660694. Pickering, A. 2010. The Cybernetic Brain: Sketches of Another Future. Chicago: University of Chicago Press. Plato. 1997. “Plato Complete Works”. In Plato Complete Works, edited by J. M. Cooper, 971–1224. Indianapolis: Hackett Publishing Company. Qiu, X., et al. 2019. “One Step Faster; Hangzhou Smart Police Reform Runs Accelerated/快人一步, 杭州智慧警务改革跑出“加速度”,” China Police/ 中国警察网 , December 29. Scheuerman, W. E. 2005. “Busyness and Citizenship.” Social Research 72 (2): 447–470. doi:10.1353/sor.2005.0031. State Council. 2014. Notice of the State Council on the Planning Outline of the Construction of a Social Credit System (2014-2020). Beijing: Chinese Communist Party. Sunstein, C. R. 2015. “The Ethics of Nudging.” Yale Journal on Regulation 32 (2): 413–450. Supiot, A. 2019. Governance by Numbers: The Making of a Legal Model of Allegiance. London: Bloomsbury. Tamanaha, B. 2004. On the Rule of Law: History, Politics, Theory. Cambridge: Cambridge University Press. Torpey, J. 2001. The Invention of the Passport. Surveillance, Citizenship and the State. Vol. 5. Cambridge: Cambridge University Press. Varnelis, K., and A. Friedberg. 2013. “Place: The Networking of Public Space. In Networked Publics, edited by K. Varnelis, 15–39. Cambridge: MIT Press. Wiener, N. 1989. The Human Use of Human Beings. London: Free Association Books. Winner, L. 1969. “Cybernetics and Political Language.” Berkeley Journal of Sociology 14 (1969): 1–17. Winner, L. 1978. Autonomous Technology: Technics-out-of-Control as a Theme in Political Thought. Cambridge, Massachusetts: MIT Press. Winner, L. 1980. “Do Artifacts Have Politics?” Daedalus 109 (1): 121–136. Zandbergen, D., and J. Uitermark. 2019. “In Search of the Smart Citizen: Republican and Cybernetic Citizenship in the Smart City”. Urban Studies 57 (8): 004209801984741. Zhao, J., et al. 2020. “When a City can ‘think’: An Observation that Hangzhou Pays Attention to Establishing ‘the First City of Digital Administration’/当城市 会“思考”——杭州聚力打造“数 字治理第一城”观察.” Xinhua Net, October 23. 20 W. REIJERS ET AL.