Questions

When an AI system causes harm, does responsibility disappear or move?

Short answer

Responsibility for harm done by an AI system moves; it does not disappear. The ‘responsibility gap’ worry is that no one controlled a learning system closely enough to be blamed, and the system cannot be. I think responsibility in these cases is redistributed to the people who design, deploy and oversee such systems, in the way we already hold the makers of instruments answerable, and the philosophical work is to draw that distribution accurately.

The responsibility gap is one of the founding worries of AI ethics. A system that learns behaves in ways its designers did not specify and could not foresee in detail. When it causes harm, the designers lacked the control that blame usually requires, the users lacked the knowledge, and the system is not a moral agent. So, the worry runs, responsibility falls into a gap between them.

Why I think it moves rather than vanishes

The worry is sometimes framed as if responsibility were a quantity that must be found in one place. Our ordinary practice is less tidy and more accurate. Nissenbaum showed how accountability is spread across the ‘many hands’ that build and run complex systems. We already hold the makers of certified instruments answerable, regulate how instruments are deployed, and expect users to rely on them competently. None of those parties controls every outcome, and none is excused for that reason.

The same structure applies here. Designers answer for the systems they build and the claims they make about them; deployers, for where and how they put them to use; overseers, for the checks they do or do not run. The system itself can be criticised for failing at its function, but that criticism describes a failure; it does not create a new bearer of blame.

What is genuinely hard

It does not follow from responsibility’s moving that its new distribution is easy to draw. Learning systems redistribute control and knowledge in ways that our practices of blame were not designed to track, and some harms arise from interactions no single party could have foreseen. The task is to describe the distribution accurately enough that it can be acted on, by law, by design and by the people who rely on these systems. Read in this way, the gap is a map of where control and knowledge actually sit rather than a hole into which responsibility falls.

Questions people also ask

Can AI be held accountable for its decisions?

An AI system cannot be held accountable in the way a person can: it cannot answer for what it did, be blamed in a way that means anything to it, or make amends. Accountability for an AI system’s decisions therefore falls on the people and organisations who design, deploy and oversee it, and the practical task is to map who controlled what, so that each answers for their part.

What is the responsibility gap?

The term comes from Andreas Matthias (2004). The worry is that learning systems act in ways their makers could not predict or control, so that no human is responsible for the outcome in the traditional sense, while the system itself is not the kind of thing that can be.

Can an AI system itself be responsible?

It can be criticised for failing at the function it was built for, and some philosophers attribute responsibility to systems functionally. That vocabulary is useful for describing failure, but it does not make the system answerable in the way a person is.

Read next

In the library

Sources and further reading

  1. Matthias, A. (2004). The responsibility gap: Ascribing responsibility for the actions of learning automata. Ethics and Information Technology 6(3): 175–183.doi.org/10.1007/s10676-004-3422-1
  2. Nissenbaum, H. (1996). Accountability in a computerized society. Science and Engineering Ethics 2(1): 25–42.doi.org/10.1007/bf02639315
  3. Sparrow, R. (2007). Killer robots. Journal of Applied Philosophy 24(1): 62–77.doi.org/10.1111/j.1468-5930.2007.00346.x
  4. Saxena, A. (2026). Assertion without a speaker: Testimony, tracking, and large language models. Episteme, 1–22.doi.org/10.1017/epi.2026.10160

Cite this page

Saxena, A. (2026). When an AI system causes harm, does responsibility disappear or move? abhinavsaxena.in. https://abhinavsaxena.in/questions/responsibility-gap/