Ethical Aspects of Algorithms and Scoring in Pedagogical and Social Work Contexts

Super-Scoring? Data-driven societal technologies in China and Western-style democracies as a new challenge for education

von: Nadia Kutscher (University of Cologne)

Algorithms and scoring play an increasing role in social work as well as in pedagogical contexts. In her talk Nadia Kutscher discusses what it means that social work is being part of practices producing sensitive and score-related data about clients.

Inhalt

1. Ethical Aspects of Algorithms and Scoring in Social Work Contexts
2. ‘Objectivity’ of Technology - Disguise of and Implicit Normativity and Normalism
3.Subjectivation and Moral Delegitimation of ‘Underclass
4. The actuarial logic of risk assessment systems raises the question what cases but especially what subjects are being constructed by using scoring criteria differentiating people into reliable or non-reliable resp. deserving and undeserving ones.
5. What Works Logic, Recognition of the Individual Situation and Stigmatization
6. The Dilemma of Low-Threshold and Reaching Target Groups of Services vs. Client Data Protection Empirical findings on "algorithmic bias" show that the discrimination of certain social groups in the population is reproduced again within the framework of algorithmic calculations, since either the algorithms are designed in this way or the data they process carry this bias within them (Angwin et al. 2016). Against this background, the risk of structural and potentially non-transparent reproduction of social inequalities - also in access to social services - is a problem to which Virginia Eubanks points (Eubanks 2018).

Autonomy or Subjectivation
In the context of "Liquid Surveillance" inscribed in digital media (Bauman/Lyon 2013), these include the possibility that a subjectively perceived gain in autonomy does not exclude or even conceal subjection to a future - or even current - powerful lack of freedom on the basis of digital data. In the sense of a "governmediality" (Traue 2009), the users of digital media experience themselves as autonomous actors, but at the same time submit to the structures and forms of representation of the media structures.

Weitere Informationen

  • Produktion: 11.10.2019

  • Spieldauer: 00:25:51

  • hrsg. von: Bundeszentrale für politische Bildung/bpb

 
Creative Commons License

Dieser Text und Medieninhalt sind unter der Creative Commons Lizenz "CC BY-NC-ND 4.0 - Namensnennung - Nicht kommerziell - Keine Bearbeitungen 4.0 International" veröffentlicht. Autor/-in: Nadia Kutscher (University of Cologne) für bpb.de

Sie dürfen den Text unter Nennung der Lizenz CC BY-NC-ND 4.0 und des/der Autors/-in teilen.


Weitere Medien zum Thema

Beyond

Beyond "Digital Big Brother": Five things to understand about China's Social Scoring System

Super-Scoring? Data-driven societal technologies in China and Western-style democracies as a new challenge for education

In her talk Ohlberg analyses the current state of China's social credit system by neither trivializing nor dramatizing it. In her opinion, the social credit system is "a highly effective tool helping to enforce the Chinese code of law" but...

Jetzt ansehen

Blacklists and Social Credit Regimes in China

Blacklists and Social Credit Regimes in China

Super-Scoring? Data-driven societal technologies in China and Western-style democracies as a new challenge for education

The Chinese social credit system CSC represents a new regulatory methodology. Catá Backer´s object in this essay is to encourage fresh thinking among Westerners. In his opinion, China is not only a harbinger of transformations in technology, but...

Jetzt ansehen

Scoring is not a new phenomena: we can learn from experience how to deal with scoring

Scoring is not a new phenomena: we can learn from experience how to deal with scoring

Super-Scoring? Data-driven societal technologies in China and Western-style democracies as a new challenge for education

Scores are numerical ratings used to predict or steer people’s behavior. These numerical ratings are usually calculated via algorithmic processes based on a broad range of data (see, e. g., AlgorithmWatch 2019). Wagner gives a brief historical...

Jetzt ansehen

Personal Scoring in the EU: Not quite Black Mirror yet, at least if you‘re rich

Personal Scoring in the EU: Not quite Black Mirror yet, at least if you‘re rich

Super-Scoring? Data-driven societal technologies in China and Western-style democracies as a new challenge for education

The TV show "Black Mirror" has widely been used to illustrate what a centralized, permanent and public personal scoring system would look like. How likely is the application of such a system in the countries of the European Union?

Jetzt ansehen

Data Scores as Governance: Mapping and Analysing Changing Practices in the UK

Data Scores as Governance: Mapping and Analysing Changing Practices in the UK

Super-Scoring? Data-driven societal technologies in China and Western-style democracies as a new challenge for education

Governments at all levels use more and more predictive technologies. The Data Justice Lab at Cardiff University investigates where and how local authorities across the UK use data systems. The results of this project are presented by Joanna Redden.

Jetzt ansehen

Shared responsibilities? The future of scoring in the context of shifting baselines and public science

Shared responsibilities? The future of scoring in the context of shifting baselines and public science

Super-Scoring? Data-driven societal technologies in China and Western-style democracies as a new challenge for education

Digitalization intensifies the correlation between organization and control. A seemingly harmless example of this is self-tracking. People measure themselves in an increasing number of life spheres, supposedly voluntarily, while carrying...

Jetzt ansehen

On the function and legitimation of scoring

On the function and legitimation of scoring

Super-Scoring? Data-driven societal technologies in China and Western-style democracies as a new challenge for education

Scoring relies on data or methods of classification. With this in mind, does scoring lead to automation of discrimination? Are its creators still capable of keeping track with their decision making processes? Lorena Jaume-Palasí presents her...

Jetzt ansehen

Identity and Integrity: The Ethical Relevance of Super-Scores

Identity and Integrity: The Ethical Relevance of Super-Scores

Super-Scoring? Data-driven societal technologies in China and Western-style democracies as a new challenge for education

Digital decision making relies on data and predefined criteria, but lacks when being implemented non-technical parameters like a social environment or basic human values. Christine Woopen, however, disagrees and explains in her talk why these values...

Jetzt ansehen

Being scored but informed – how to boost people´s risk literacy for public discourse

Being scored but informed – how to boost people´s risk literacy for public discourse

Super-Scoring? Data-driven societal technologies in China and Western-style democracies as a new challenge for education

I do not need to know how a bus works, for taking the bus!? – Wrong! Algorithm sovereignty actually is about being the object of others’ analyses, or better, about putting control on that. Felix G. Rebitscheck focuses in his talk on the...

Jetzt ansehen

Scoring practices - consequences for education in democratic societies

Scoring practices - consequences for education in democratic societies

Super-Scoring? Data-driven societal technologies in China and Western-style democracies as a new challenge for education

Data storage and processing have become a politically relevant topic. Media literacy and media education play an important role. Technological education is thus political education. Political education thus requires basic technical knowledge or at...

Jetzt ansehen