Consequence-aware LLMs
The first line of research trains or programs an LLM so that its knowledge includes causal chains: the effects an answer or an action can have on people, and on the real world when the model acts autonomously or controls systems. Before acting, the model learns to reflect on the possible options and their consequences.
- An AI agent tasked with administering an IT system should anticipate that a seemingly harmless command can shut down a critical service or erase backups.
- In control of an industrial robot, it should take into account the risk to people nearby, even if no instruction mentions it.
This is not a filter based on a blacklist: the behaviour is part of what the model has learned.
A rule says what to avoid; a chain of consequences says why.
Even when safer, the model is still an LLM. What it has learned still cannot be read directly, and its safety remains a statistical measurement. This is what the second line of research addresses.