On the function and legitimation of scoring

Super-Scoring? Data-driven societal technologies in China and Western-style democracies as a new challenge for education

von: Lorena Jaume-Palasí (The Ethical Tech Society)

Scoring relies on data or methods of classification. With this in mind, does scoring lead to automation of discrimination? Are its creators still capable of keeping track with their decision making processes? Lorena Jaume-Palasí presents her approach on the function and legitimation of scoring.

Inhalt

Je komplexer das Scoring-System ist, desto schwerer ist es zu verstehen. Können die Initiatoren ihre Vorgehensweisen und Entscheidungen selbst noch überblicken? Es ist nicht notwendig, die einzelnen Algorithmen verstehen und nachvollziehen zu können; eine Bewertung eines Systems ist auch anhand seiner Funktion und Ergebnisse möglich. Diese müssen kontinuierlich überprüft und transparent gemacht werden (ggf. gesetzlich geregelt). Provokativ wurde angemerkt, dass die Undurchsichtigkeit des Systems durchaus von interessierten Kreisen erwünscht und herbeigeführt sein könne. Diskriminierung einzelner Bevölkerungsgruppen im Rahmen des SCS ist eine Gefahr, die sich aus den durch das System gemachten Vorgaben ergibt: Nutzt man diskriminierende Kategorisierungen, erhält man diskriminierende Ergebnisse. Auch die Verwendung alter Daten kann zu Diskriminierung führen. Problematisch ist auch eine politische Haltung, die die technologische Analyse von potentiellen Risiken und das Profiling über eine fundierte Ursachen- und Motivforschung zur Kriminalprävention stellt.

Weitere Informationen

  • Produktion: 11.10.2019

  • Spieldauer: 00:10:50

  • hrsg. von: Bundeszentrale für politische Bildung/bpb

 
Creative Commons License

Dieser Text und Medieninhalt sind unter der Creative Commons Lizenz "CC BY-NC-ND 4.0 - Namensnennung - Nicht kommerziell - Keine Bearbeitungen 4.0 International" veröffentlicht. Autor/-in: Lorena Jaume-Palasí (The Ethical Tech Society) für bpb.de

Sie dürfen den Text unter Nennung der Lizenz CC BY-NC-ND 4.0 und des/der Autors/-in teilen.


Weitere Medien zum Thema

Beyond

Beyond "Digital Big Brother": Five things to understand about China's Social Scoring System

Super-Scoring? Data-driven societal technologies in China and Western-style democracies as a new challenge for education

In her talk Ohlberg analyses the current state of China's social credit system by neither trivializing nor dramatizing it. In her opinion, the social credit system is "a highly effective tool helping to enforce the Chinese code of law" but...

Jetzt ansehen

Blacklists and Social Credit Regimes in China

Blacklists and Social Credit Regimes in China

Super-Scoring? Data-driven societal technologies in China and Western-style democracies as a new challenge for education

The Chinese social credit system CSC represents a new regulatory methodology. Catá Backer´s object in this essay is to encourage fresh thinking among Westerners. In his opinion, China is not only a harbinger of transformations in technology, but...

Jetzt ansehen

Scoring is not a new phenomena: we can learn from experience how to deal with scoring

Scoring is not a new phenomena: we can learn from experience how to deal with scoring

Super-Scoring? Data-driven societal technologies in China and Western-style democracies as a new challenge for education

Scores are numerical ratings used to predict or steer people’s behavior. These numerical ratings are usually calculated via algorithmic processes based on a broad range of data (see, e. g., AlgorithmWatch 2019). Wagner gives a brief historical...

Jetzt ansehen

Personal Scoring in the EU: Not quite Black Mirror yet, at least if you‘re rich

Personal Scoring in the EU: Not quite Black Mirror yet, at least if you‘re rich

Super-Scoring? Data-driven societal technologies in China and Western-style democracies as a new challenge for education

The TV show "Black Mirror" has widely been used to illustrate what a centralized, permanent and public personal scoring system would look like. How likely is the application of such a system in the countries of the European Union?

Jetzt ansehen

Data Scores as Governance: Mapping and Analysing Changing Practices in the UK

Data Scores as Governance: Mapping and Analysing Changing Practices in the UK

Super-Scoring? Data-driven societal technologies in China and Western-style democracies as a new challenge for education

Governments at all levels use more and more predictive technologies. The Data Justice Lab at Cardiff University investigates where and how local authorities across the UK use data systems. The results of this project are presented by Joanna Redden.

Jetzt ansehen

Shared responsibilities? The future of scoring in the context of shifting baselines and public science

Shared responsibilities? The future of scoring in the context of shifting baselines and public science

Super-Scoring? Data-driven societal technologies in China and Western-style democracies as a new challenge for education

Digitalization intensifies the correlation between organization and control. A seemingly harmless example of this is self-tracking. People measure themselves in an increasing number of life spheres, supposedly voluntarily, while carrying...

Jetzt ansehen

Identity and Integrity: The Ethical Relevance of Super-Scores

Identity and Integrity: The Ethical Relevance of Super-Scores

Super-Scoring? Data-driven societal technologies in China and Western-style democracies as a new challenge for education

Digital decision making relies on data and predefined criteria, but lacks when being implemented non-technical parameters like a social environment or basic human values. Christine Woopen, however, disagrees and explains in her talk why these values...

Jetzt ansehen

Ethical Aspects of Algorithms and Scoring in Pedagogical and Social Work Contexts

Ethical Aspects of Algorithms and Scoring in Pedagogical and Social Work Contexts

Super-Scoring? Data-driven societal technologies in China and Western-style democracies as a new challenge for education

Algorithms and scoring play an increasing role in social work as well as in pedagogical contexts. In her talk Nadia Kutscher discusses what it means that social work is being part of practices producing sensitive and score-related data about clients....

Jetzt ansehen

Being scored but informed – how to boost people´s risk literacy for public discourse

Being scored but informed – how to boost people´s risk literacy for public discourse

Super-Scoring? Data-driven societal technologies in China and Western-style democracies as a new challenge for education

I do not need to know how a bus works, for taking the bus!? – Wrong! Algorithm sovereignty actually is about being the object of others’ analyses, or better, about putting control on that. Felix G. Rebitscheck focuses in his talk on the...

Jetzt ansehen

Scoring practices - consequences for education in democratic societies

Scoring practices - consequences for education in democratic societies

Super-Scoring? Data-driven societal technologies in China and Western-style democracies as a new challenge for education

Data storage and processing have become a politically relevant topic. Media literacy and media education play an important role. Technological education is thus political education. Political education thus requires basic technical knowledge or at...

Jetzt ansehen