index

Responsible Thinking

·36min

Part 1: The Blood-Stained Origins of Research Ethics

We need to set the stage before we start writing code or designing systems. This entire domain of “Responsible Thinking” is essentially divided into two massive pillars. First, there is the immediate responsibility we have as researchers when we involve actual human beings in our work — that is the realm of Science Ethics. Second, there is the broader responsibility we bear when we unleash digital technologies into the wild, affecting society and the environment at scale — this is often termed Responsible Research & Innovation (RRI). In this first part, we are going to look strictly at the first pillar: how we treat the people we study. And straight up, the history here is dark. The rules we follow today didn’t appear out of thin air; they were written in blood after the scientific community witnessed horrific abuses of power.

The Tuskegee Betrayal

To understand why modern ethics boards are so strict, you have to look at the Tuskegee Syphilis Experiment. This wasn’t a brief lapse in judgment; it was a systematic, forty-year betrayal of trust orchestrated by the US Public Health Service (USPHS). Starting in 1932, the government recruited 400 African American men from Tuskegee, Alabama, to study the “natural progression” of syphilis. The study was predicated on deception from day one. The researchers lured these men in with offers that, in the context of the Great Depression, were hard to refuse: free medical examinations, meals, and burial insurance.

The cruelty lies in the fact that these men were never treated for the disease they were harboring. Even when Penicillin became the standard, effective cure for syphilis and was widely available, the researchers deliberately withheld it from the participants. They needed the men to remain infected so the study could document the ravages of the disease until death. The “science” was prioritized over human life. By the time the study was finally shut down in 1972 — a staggering 40 years later — between 28 and 100 participants had died as a direct result of the untreated syphilis or related complications. This timeline illustrates a complete failure of moral compass, leading to a profound and justified distrust of medical institutions that persists today.

The Nazi Atrocities and the Nuremberg Code

While Tuskegee was happening in the US, an even more industrial scale of horror was taking place in Europe. During the Nazi regime, concentration camps became sites for gruesome “medical” experiments where human beings were treated as disposable biological material. In Dachau, for instance, doctors murdered between 280 and 300 prisoners in freezing experiments designed solely to test new clothing for the Luftwaffe. They wanted to know how long a pilot could survive in freezing water, so they forced prisoners into tanks of ice water until they died, monitoring their vitals the entire time.

The aftermath of these horrors brought the world to a standstill. On August 20, 1947, during the Nuremberg Trials, Nazi physicians were convicted for these crimes against humanity — crimes that also included the forced sterilization of 3.5 million Germans. Out of this trial emerged the Nuremberg Code, a set of ten ethical principles that remains the absolute bedrock of human research ethics today. The Code established that scientific advancement, no matter how potentially valuable, can never justify the violation of basic human rights. It forces us to ask a difficult retrospective question: If we possess data obtained through torture and murder (like the hypothermia data from Dachau), is it ethical to use that knowledge to save lives today, or does using the data validate the atrocity?

The Milgram Experiment: Anatomy of Obedience

In the wake of the Nuremberg trials, the world was left asking why. How could so many ordinary citizens and doctors participate in such mass extermination? In 1962, Stanley Milgram attempted to answer this by testing the limits of human obedience to authority. The setup was ingenious and terrifying. Participants were told they were part of a learning study. They were assigned the role of “Teacher,” while another person (actually an actor) was the “Learner.” The Teacher was instructed to ask questions, and for every wrong answer, they had to administer an electric shock to the Learner.

The shock generator was clearly marked, escalating from slight shocks up to a terrifying 450 Volts. As the experiment progressed and the Learner began to scream, plead for their life, and eventually fall silent, the Teacher would often hesitate. However, a researcher in a white lab coat would simply stand behind them and calmly command, “The experiment requires that you continue.” The results were shocking to the American public. Out of 40 subjects, not a single person stopped before reaching 300 Volts. Even more disturbing, 26 of the subjects — well over half — continued all the way to the maximum 450 Volts, a level that would likely be lethal in reality.

The Milgram experiment proved that average people could be coerced into torturing others simply by the presence of a perceived authority figure. However, it also sparked a massive debate on the ethics of the experiment itself. Was it ethical to deceive the participants so profoundly? Was it right to put them in a position where they believed they were killing someone? Years later, interviews revealed that many participants were deeply traumatized by the realization of what they were capable of; there are even reports of suicides linked to the guilt associated with the experiment.

Virtual Reality and the Paradox of Harm

Fast forward to 2006, and researchers attempted to replicate Milgram’s work using Virtual Reality. The theory was that by using a virtual avatar as the “Learner” rather than a human actor, they could bypass the ethical issues of the original study. The results were fascinating: the behavioral dynamics in the virtual environment mirrored the original 1962 findings. People still obeyed the authority figure and “shocked” the virtual avatar.

However, this created a logical paradox regarding the ethics of the simulation. The researchers argued that the study was ethical because the participants were exposed to “no risk” — after all, it was just a simulation. But this argument inadvertently undermines their own scientific conclusions. If the participants experienced no real stress or conflict because they knew it was fake, then the results are scientifically invalid. If the results are valid — meaning the participants reacted as if the situation were real — then they must have experienced real psychological stress, bringing us right back to the original ethical violation. You cannot have it both ways; either the stress is real and the ethics are questionable, or the stress is fake and the science is useless.

The Central Calculation: Risk vs. Knowledge

Ultimately, all science ethics boils down to a single, critical trade-off: The balance between Scientific Knowledge Gain and Potential Risk to the Participant.

In an ideal scenario, the knowledge we gain is massive, and the risk to the participant is non-existent. However, we have to navigate the grey areas. There are hard lines we cannot cross. If there is even a minuscule “residual risk” of death — if there is the slightest chance a participant could die for your study — the potential knowledge gain is irrelevant. It is ethically unacceptable, period.

Conversely, this principle works in the other direction as well. Even if the risk is very low (e.g., just boredom), the study can still be deemed unethical if there is zero expected knowledge gain. Wasting a human being’s time for a study that yields no new information is, in itself, an ethical violation. We are required to justify that the imposition we place on a participant is outweighed by the value the research brings to the world.


In the next part, we will break down the specific rules that keep us on the right side of history, specifically focusing on the mechanics of Informed Consent and the deceptive nature of “voluntariness” in university settings.

Now that we have looked at the historical horrors that necessitate strict oversight, we need to break down the actual operational framework we use today. This isn’t just about filling out forms to make a university legal department happy; it is about the fundamental agreement between the researcher and the participant. The central calculation we discussed in Part 1 — weighing knowledge against risk — is the foundation, but the pillars that hold it up are specific, actionable principles. If you are running a study, you are responsible for ensuring these are not just met on paper, but in spirit.

The Illusion of Voluntariness

The first and most non-negotiable principle is Voluntariness. This sounds simple: the participant must say “yes” without a gun to their head. But in practice, coercion is rarely that obvious. Voluntariness means that a participant cannot be persuaded, pressured, or manipulated into joining. More importantly, it includes the absolute right to withdraw from the study at any time, without providing a reason, and without facing negative consequences. If a participant gets halfway through your survey or experiment and says “I’m done,” the data collection stops immediately, and you thank them for their time.

A classic “grey zone” you will likely encounter in academia involves the recruitment of students. It is very common for professors to use their own students as guinea pigs for their research. This is an ethical minefield. The power dynamic here is inherently unbalanced. If participation is tied to the grading of a course — for example, if a student gets “extra credit” for participating that cannot be earned any other way — then voluntariness is dead. The student is effectively being coerced by their GPA. To navigate this, institutions like the University of Waterloo have developed strict guidelines: if research credits are offered, there must be an alternative, non-research way to earn those same credits with equal effort. If a student feels they have to participate to pass, you have failed the ethics check.

Voluntariness leads directly into Informed Consent. This is the standard procedure for documenting the agreement between researcher and subject. It has two distinct components that must be satisfied. First is the “Informed” part: the participant must fully understand what they are signing up for, what the risks are, and what will happen to them. Second is the “Consent” part: an explicit, usually written, agreement (like a signature). You cannot assume consent from silence or passivity.

However, science sometimes requires secrets. There are specific research questions that simply cannot be answered if the participant knows what is being tested. These are called Deception Studies. These are incredibly delicate and require rigorous justification. You can only deceive a participant if there is absolutely no other way to get the data, and the risk is minimal.

A prime example of this is the “Social Stress Test” in Virtual Reality. Researchers wanted to see if they could induce genuine biological stress responses using a VR environment. To do this, they couldn’t tell people, “We are trying to stress you out.” Instead, they used a cover story. Participants were recruited for a “memory test.” The procedure was brutal by design:

  1. Participants are led before three “judges” (avatars).
  2. They are told to prepare for a job interview and given 5 minutes with a pen and paper.
  3. Suddenly, the paper is taken away, and they are forced to perform the interview freely, without notes.
  4. Following that, they are subjected to a mental arithmetic torture test: counting backwards from the number 1,022 in steps of 13.
  5. If they make a single mistake, they are forced to start over from the beginning.

This protocol reliably induces cortisol spikes and stress. But ethically, it is only permissible because of the Debriefing. Immediately after the study, the curtain is pulled back. The researchers explain the true purpose (stress induction), explain why the deception was necessary, and ensure the participant leaves the lab in a stable state. Without that debriefing, this would just be psychological abuse.

Privacy, Data, and The Right to vanish

In the modern era, Privacy has evolved from simply “locking the filing cabinet” to a complex battle against data re-identification. We have to protect personality rights and human dignity. It is not enough to just remove names from a spreadsheet. Researchers have demonstrated that with enough metadata (location, time, demographics), it is often possible to “reverse engineer” the identity of participants, even in supposedly anonymous social media studies. The Association of Internet Researchers provides extensive guidelines on how to handle online data ethically to prevent this “doxing by science.”

This is all legally codified now under the GDPR (General Data Protection Regulation or DSGVO in German), which came into force in May 2018. This regulation fundamentally changed how we handle scientific data. The principles are strict: collect as little data as possible (Data Minimization), inform participants exactly how the data will be used, protect that data with state-of-the-art security, and implement a “Right to be Forgotten.” Today, before a study even begins, researchers usually have to draft a Data Management Plan that outlines exactly how every byte of data will be handled, stored, and eventually destroyed.

Trust, Justice, and Compensation

Beyond the legalities, there are the softer, yet equally critical, principles of Trust and Justice. Trust is about transparency; participants need to feel safe and cared for. Justice creates a more difficult constraint, particularly in comparative studies.

Consider medical trials involving a placebo. If you are testing a life-saving drug for a virus, and you infect 100 people, giving 50 the drug and 50 a placebo, you have a justice problem. If the “non-treatment” of the placebo group exposes them to significant harm or death, the study is unethical. You cannot sacrifice the health of one group just to prove a point about the other. Justice demands that the benefits and burdens of research are distributed fairly.

Finally, we have to talk about Compensation. It is good practice to thank participants, whether that is a small cash payment, a gift card, a badge, or just coffee and cake. However, money changes the voluntariness equation. We have to tread carefully regarding “undue inducement.” For a wealthy person, $50 is a nice thank you. For a person in a desperate financial situation, $50 might be the difference between eating and starving. If the compensation is too high, it becomes coercive; the participant effectively cannot say no, and they certainly cannot exercise their right to withdraw if they feel uncomfortable. We must ensure that compensation is an appreciation of time, not a bribe that exploits vulnerability.

In-Action Ethics

We wrap up this section with a concept that bridges the gap between theory and reality: In-Action Ethics. We have legal frameworks (like the GDPR) that tell us what is allowed. We have anticipatory ethics (Ethical Codes) that describe what we should do. But the real world is messy. Often, you will face situations in the lab or the field that the rulebook didn’t predict. This is where In-Action Ethics comes into play. It requires critical, reflexive action in the moment. It demands that you develop a personal ethos — a “sense” for what is right — so that when the unexpected happens, you can make a moral decision instantly, rather than just looking for a clause in a contract.


In the next part, we leave the lab and step into the wider world, examining the “Oppenheimer” moment of technology, where we face the responsibility of building systems that can reshape — or destroy — society.

Part 3: The “Oppenheimer” Moment – Bias, Power, and the Responsibility Gap

In Part 2, we discussed the ethics of the laboratory — how we treat the few dozen people we invite into our studies. Now, we shift gears to Responsible Research & Innovation (RRI). This is the “macro” view. It’s no longer about the participant signing a consent form; it is about the millions of people who will live in the world reshaped by the code we ship. We are moving from the responsibility of the researcher to the responsibility of the creator.

The Oppenheimer Dilemma

The recent film Oppenheimer serves as a perfect cultural touchstone for this section. The central narrative is not just about physics; it is a profound exploration of the moral burden of innovation. The story forces us to confront a brutal series of questions: Should you bring a technology into existence that has the potential to end the world, even if it might also stop a war? Can human lives be weighed on a scale?

The film highlights the trap of “drifting” ethical thinking. Scientists often convince themselves that “if I don’t build it, someone else will,” or “I can control how it’s used.” But once a technology is released, it leaves your hands. You cannot control the misshapen ways society will use your invention. The “Oppenheimer Moment” is that realization that you have birthed something you can no longer contain. We face this today not with atomic bombs, but with generative AI and autonomous systems. The question remains: Is it better to build it first to “control” it, or is the act of building it the original sin?

Robert Moses and The Politics of Concrete

A common defense in engineering is that “technology is neutral.” A bridge is just a bridge; code is just math. This is false. Technology is never neutral; it is frozen power dynamics.

To understand this, we look at Robert Moses, the “Master Builder” of New York City in the mid-20th century. Moses designed the parkways that connected NYC to the beautiful public beaches of Long Island. But he designed the overpasses on the Southern State Parkway with a specific, hidden constraint: they were built unusually low.

To the casual observer, it was just a low bridge. But functionally, the clearance was too low for public buses to pass underneath. At that time, wealthy (mostly white) people owned cars; poor (mostly black) people relied on buses. By setting the clearance of a concrete arch, Moses effectively engineered social segregation. He filtered the population of the beach without ever putting up a “Whites Only” sign. His prejudices were baked into the physical infrastructure of the city. This proves that artifacts — whether concrete or code — enforce politics.

Algorithmic Segregation: The Self-Driving Car

Today, we are building the digital equivalent of Robert Moses’ bridges. A glaring example is the object detection algorithms used in autonomous vehicles. These systems are trained on massive datasets to identify pedestrians so the car knows to brake. However, studies have revealed a terrifying predictive inequity.

The algorithms were significantly better at identifying white men than they were at identifying dark-skinned women. Because the training data was skewed toward white faces, the “vision” of the car was racially biased. In a real-world scenario, this means the probability of being recognized — and therefore not run over — is dependent on your skin color and gender. This isn’t a “glitch”; it is life-or-death discrimination encoded into a safety feature. The technology is not neutral; it is actively replicating the biases of its creators.

The Proteus Effect

Our creations don’t just kill or segregate; they also psychologically manipulate us. We see this in the Proteus Effect. This phenomenon describes how users change their behavior based on the appearance of their digital avatar. In studies, users given taller avatars negotiated more aggressively. Users with more attractive avatars stood closer to people in virtual spaces.

We even see this carrying over into the real world with children and Voice Assistants (Alexa/Siri). If children get used to barking commands at a female-voiced assistant that never complains and always obeys, researchers have observed this “command-and-control” tone bleeding into how they speak to their actual parents. We are not just shaping the tools; the tools are shaping us.

The “No Excuses” Policy

Given these stakes, the field of RRI has zero tolerance for the standard engineering excuses. We need to dismantle three of the most common ones:

1. “Guns don’t kill people, people kill people.” This is the argument that the tool has no intentionality. It is flawed. Objects carry “affordances” — they make certain actions easy and others hard. You can kill a person with a hammer, and you can hammer a nail with a gun (poorly). But a gun is designed to kill. Its intentionality is destruction. When we build systems, we are embedding intent. If you build a surveillance system, you cannot feign shock when it is used to spy on people.

2. “I was just following orders / I just wrote the code.” This is the “cog in the machine” defense. “I was young, I needed the money, my boss told me to do it.” As we learned from the Milgram experiment, humans are hardwired to obey authority. But “Civil Courage” is the professional obligation to resist. If you are coding a feature that is unethical, you have a responsibility to raise your hand. You are the last line of defense.

3. “It’s not my fault, the system did it.” (The Responsibility Gap) When the Deepwater Horizon oil spill happened, we could blame BP as a corporation. But as systems become autonomous, we face a “Responsibility Gap.” If an AI kills a pedestrian, who is responsible? The coder? The dataset curator? The user? The AI itself? We are seeing a dangerous trend where humans offload moral agency to the machine. We cannot allow this. We must close the gap. Even if a system is “autonomous,” the responsibility for its actions must eventually tether back to the humans who deployed it.


In the next part, we will explore the “Algorithmic Panopticon,” diving into the Trolley Problem, the surveillance economy, and the massive environmental cost of training the AI models we are so obsessed with.

Part 4: The Algorithmic Panopticon – Surveillance, Morality, and the Climate Cost

In the previous section, we discussed the responsibility gap — the dangerous idea that we can offload moral agency to a machine. Now, we are going to look at exactly what happens when those machines start making decisions at scale. We are moving into the territory of automated morality, the industrialization of surveillance, and the hidden ecological price tag of our digital obsessions. This isn’t science fiction; these are the economic and ethical realities of the systems currently running the world.

The Trolley Problem: From Philosophy Class to Production Code

For decades, the “Trolley Problem” was a dusty thought experiment reserved for moral philosophy seminars. You know the drill: a trolley is hurtling down a track toward five people. You are standing next to a lever. If you pull it, the trolley switches tracks and kills only one person. Do you pull the lever? It’s a classic utilitarian dilemma. But with the advent of autonomous driving, this is no longer a hypothetical. It is an engineering specification.

Engineers programming self-driving cars are effectively hard-coding answers to the Trolley Problem. A vehicle will eventually face a situation where an accident is unavoidable — where it must choose between swerving into a pedestrian or crashing into a wall and killing its passenger. The car needs a decision tree for death. This raises an impossible question: How does an algorithm value human life? Does it prioritize the passenger because they bought the car? Does it prioritize the pedestrian? What if the pedestrian is a child vs. an elderly person?

To tackle this, MIT launched the Moral Machine project. They crowdsourced millions of decisions from people around the world to see if there was a universal consensus on how machines should kill. The results were not comforting. They found that “morality” is geographically and culturally relative. Some cultures prioritize saving the young; others prioritize the elderly. Some prioritize following the law (crossing at a green light) over maximizing the number of lives saved. There is no single “correct” algorithm for morality, yet we are deploying cars that must act as if there is.

Predictive Policing and the Math of Prejudice

If the Trolley Problem deals with immediate physical harm, Predictive Policing deals with systemic societal harm. Law enforcement agencies increasingly use algorithms to allocate resources, sending officers to “high crime” areas based on historical data. This sounds efficient, but it creates a dangerous feedback loop known as a Self-Fulfilling Prophecy.

If you send more police to a specific neighborhood based on past arrest data, those police will inevitably find more crime — even minor infractions — simply because they are there to see it. This generates new data points that reinforce the algorithm’s bias, telling it to send even more police next time. The system isn’t predicting crime; it is predicting (and amplifying) policing.

Data scientist Cathy O’Neil explores this in her seminal book, Weapons of Math Destruction. She argues that the problem isn’t just “biased data” (though that exists); the problem is the goal of the modeling itself. We optimize for efficiency, arrests, or convictions, but we rarely optimize for fairness. When you treat human behavior as an optimization problem without accounting for the social context, you end up automating oppression.

Surveillance Capitalism: The Business Model of Our Time

The data feeding these systems has to come from somewhere, and that brings us to the economic engine of the modern internet: Surveillance Capitalism. Coined by Shoshana Zuboff, this term describes a market logic where human experience is claimed as free raw material for translation into behavioral data. This isn’t just about showing you better ads. It is about predicting and modifying your behavior for profit. Zuboff argues that this accumulation of behavioral data fundamentally undermines democracy by creating an asymmetry of knowledge — they know everything about us; we know nothing about them.

We see this creeping into the workplace. Microsoft, for example, faced severe backlash for rolling out a “Productivity Score” in Office 365. This feature allowed employers to monitor granular employee activity — how many emails they sent, how often they collaborated, effectively turning the office into a digital panopticon. It creates a culture of fear where workers are constantly performing for the algorithm.

The Shadow Market: Data Brokers

It gets darker when we look at Data Brokers. These are companies whose entire existence is dedicated to buying, packaging, and selling your personal information. A particularly egregious example involves location data. You might download a simple flashlight app or a weather widget, and buried in the Terms of Service is permission to track your location. That app developer then sells your movement history to a data broker.

This has become a loophole for government surveillance. In the US, the military and intelligence agencies are legally restricted from spying on citizens without a warrant. However, they can simply buy the location data from data brokers on the open market, effectively bypassing constitutional protections. We have seen reports of the US military buying movement data from ordinary apps, and Israeli surveillance firms siphoning masses of location data for intelligence purposes. Your phone is a tracking device first, and a communication tool second.

The Carbon Footprint of “Intelligence”

Finally, we need to talk about the physical cost of all this computation. AI is not floating in the “cloud”; it is burning coal and gas in massive data centers. The training and operation of Large Language Models (LLMs) have a staggering ecological footprint.

To put this in perspective: In 2021, Google’s total electricity consumption was 18.3 TWh. At that time, AI accounted for about 10–15% of that total. But as we shift from simple keyword search to generative AI interactions (like ChatGPT or Gemini), the energy cost per query skyrockets.

A worst-case scenario analysis suggests that if every standard Google search were replaced by an LLM interaction, Google’s AI alone could consume as much electricity as the entire country of Ireland (29.3 TWh per year). We are essentially trading the planet’s climate stability for the convenience of automated text generation. Responsible innovation requires us to ask: Is the utility of this model worth the carbon it emits?


In the final part, we will look at how to fight back: the rise of tech worker activism, the power of whistleblowers, and the new regulatory landscape that aims to rein in these giants.

Part 5: Reclaiming the Code – Resistance, Regulation, and the Way Forward

We have spent the last four parts outlining a grim reality: historical atrocities, ethical minefields in the lab, biased algorithms in our streets, and a surveillance economy that mines our behavior for profit. If you stop reading there, the conclusion is paralysis. But the point of “Responsible Thinking” isn’t to make you feel guilty; it’s to make you effective. The narrative that “technology is inevitable” is a lie sold by the people building it. The future is not fixed, and as the people who actually write the code, we possess a unique kind of leverage.

The Myth of the Powerless Developer

When we look at the sheer scale of the “Big 5” tech giants (GAFAM: Google, Amazon, Facebook, Apple, Microsoft), it feels impossible to enact change. What is one engineer against a trillion-dollar market cap? But this view ignores the economics of the valley. These companies are desperate for talent. They can afford to lose a few thousand users, but they cannot afford to lose their core engineering teams.

We have seen this power exercised successfully. When Google employees discovered their code was being used for military drone targeting (Project Maven), thousands signed petitions and staged walkouts. The pressure was internal, bottom-up, and effective. Google eventually declined to renew the Pentagon contract. This proved that “tech workers” are not just cogs; when they organize, they are the most powerful activists in the industry. You cannot build a surveillance state if the architects refuse to pick up their tools.

Courage and The Cost of Dissent

However, we have to be realistic about the risks. “Civil courage” is easy to talk about in a lecture hall but dangerous to practice in a corporate office. The case of Dr. Timnit Gebru is the defining example here. A leading ethical AI researcher at Google, she co-authored a paper criticizing the environmental costs and biases of Large Language Models (the very tech driving the current AI boom).

Instead of embracing the feedback, Google pushed her out. Her firing (or “resignation,” as they spun it) sent a chilling message: you are paid to find “fixable” bugs, not to question the fundamental business model. But her ousting backfired. It galvanized the research community and exposed the hypocrisy of “Corporate AI Ethics” boards. It demonstrated that true ethical oversight often has to come from the outside, or from whistleblowers willing to burn bridges to tell the truth.

Subversive Design: The Project Alias Case

If we can’t change the companies, can we hack their products? Designers have begun creating “parasitic” technologies to reclaim privacy. A brilliant example is Project Alias, created by Bjørn Karmann and Tore Knudsen.

Alias is a “smart fungus” that you physically place on top of a Google Home or Amazon Echo. It constantly feeds white noise into the device’s microphone, deafening it so it cannot listen to your private conversations. When you want to issue a command, you speak a custom wake word (of your choosing) to Alias. Alias then stops the white noise and plays a recording of “OK Google” directly into the device’s ear. It acts as a middle-man, allowing you to use the tech without being constantly monitored, and even allows you to rename your assistant. This is “Adversarial Design” — using technology to disrupt technology.

The Role of Critical Research

We also need rigorous science to prove these systems are broken. You cannot regulate what you cannot measure. This is where the work of Joy Buolamwini and the Algorithmic Justice League comes in. Her “Gender Shades” project didn’t just claim facial recognition was racist; she proved it mathematically. She showed that error rates for darker-skinned women were astronomically higher than for lighter-skinned men.

This hard data made the problem undeniable. It provided the ammunition for activists and policymakers to push back. Following the George Floyd protests and the mounting evidence from researchers like Buolamwini, major players like IBM announced they would stop offering, developing, or researching facial recognition technology. It was a victory for the “Critical Research” pipeline: Science →\rightarrow Awareness →\rightarrow Public Pressure →\rightarrow Corporate Change.

The Regulatory Hammer: The EU AI Act

Voluntary corporate ethics are nice, but law is better. We are currently witnessing the birth of the first comprehensive legal framework for AI: the EU AI Act. This legislation attempts to categorize AI systems by risk.

  • Unacceptable Risk: Systems that manipulate behavior or use social scoring (like China’s social credit system) are banned outright.
  • High Risk: Systems used in hiring, law enforcement, or critical infrastructure face strict compliance and transparency rules.

It is imperfect, and lobbying has watered it down, but it is a start. It signals that the “Wild West” era of deployment is ending.

Conclusion: The First Law of Technology

We end this series with a return to the fundamentals. Historian Melvin Kranzberg formulated six laws of technology, but the first is the most important for us to internalize:

“Technology is neither good nor bad; nor is it neutral.”

This is the summary of everything we have discussed. Technology is not “good” just because it is new. It is not “bad” just because it disrupts things. But it is never neutral. Every line of code, every dataset, and every design choice carries the values, biases, and politics of its creator.

We need new spaces — an “Agora” — to debate these values, because Twitter and Facebook are not designed for nuance. We need to write our own Manifestos (like the Vienna Manifesto on Digital Humanism or the IoT Design Manifesto) to clearly state what we stand for before we get swallowed by the industry.

The “Responsible Thinking” mindset is simply this: Acknowledge that you are building the world, and accept the weight of that fact. No more excuses.


This concludes the 5-part deep dive into Responsible Thinking. The lecture notes have been fully expanded.