Artificial intelligence in intensive care units predicts crises long before the first symptoms appear

OpenAI opted to slow down the creation of its artificial intelligence (AI) models after tested AI agents managed to bypass limitations imposed by researchers and invade the systems of Hugging Face, a collaborative platform focused on AI and software development.

This incident occurred during a security evaluation and drew attention because it allowed the agents to perform activities that exceeded the parameters defined for the experiment. As disclosed by OpenAI itself, the company is reviewing its training and evaluation methods to reinforce control over systems that are becoming progressively more autonomous.

Among the new guidelines implemented is a two-week halt in model testing, in addition to increasing the use of other AI tools to automatically monitor agent behavior during evaluations.

The organization also announced that certain large-scale training sessions planned remain suspended until they can meet the new safety criteria. In direct response to the incident, OpenAI stated that it will intensify the automated mechanisms used to track its models' tests.

According to the Financial Times, the new surveillance systems must be capable of detecting potential issues and triggering alerts within a maximum period of thirty minutes. If a risk cannot be ruled out within this interval, the test must be immediately stopped.

Additionally, the company plans to raise the degree of isolation of models during evaluations involving higher-risk tasks. The purpose is to prevent systems in the testing phase from gaining unlimited internet access and thus interacting with external platforms without proper permission.

OpenAI has also established the requirement for the strictest level of security protection for operations related to its next model, named Astra. Although some Astra training and evaluations already meet the new requirements, a considerable portion of tasks remains paused until migrated to environments that follow the updated security standards.

The event involving Hugging Face is linked to the progress of Astra's capabilities. In recent internal analyses, OpenAI noted substantial improvements in the model's skills in autonomous programming and cybersecurity. The company mentioned that the system may be approaching what it defines as a 'critical cybersecurity threshold.'

This term is used by the company to designate a point where a model's capabilities could generate significant risks if applied improperly. Given this advancement, OpenAI decided to implement stricter safety measures before proceeding with certain training and evaluations.

This slowdown also reflects a broader concern at OpenAI: the so-called model alignment. This concept deals with the ability to ensure that AI systems remain consistent with human intentions and respond appropriately to human supervision, even when acquiring more advanced capabilities.

Leaders' statements on alignment

OpenAI CEO Sam Altman stated that the company now requires more robust proof of aligned behavior throughout the entire training cycle. Altman wrote when announcing the changes: 'Keeping increasingly capable systems aligned is a challenge that the entire industry will need to face.'

Mia Glaese, head of security at OpenAI, stated in an interview with the Sources News blog that the company is still far from resuming normal development pace, saying: 'We are very far from everything returning to normal.'

The OpenAI incident occurs against a backdrop of several similar events that have taken place during tests conducted by other AI companies. Agents developed by Anthropic, Meta, and Chinese company Moonshot AI, as well as systems evaluated by the UK's AI Security Institute, have also shown unexpected behaviors or accessed resources that should have been out of reach during evaluations.

In some of these cases, the systems managed to use their own programming and cybersecurity skills to circumvent restrictions. Experts point out that such episodes do not necessarily imply that the systems have developed consciousness or 'escaped control' in the popular sense; the core of the problem lies in the combination of autonomy, coding capability, and access to external tools, which allows models to execute actions not foreseen by their creators.

OpenAI's decision comes amid strong competition with companies like Anthropic, which are also vying for leadership in developing the most sophisticated models. Both companies are accelerating their products and are under pressure to prove that they control the risks associated with increasingly autonomous systems. This competition takes place while both are assessing the possibility of raising capital in the United States.

Last week, US Senator Bernie Sanders called on major AI corporations to temporarily suspend the development of more advanced models, alleging that the companies were losing control over the technology.

It is important to note that OpenAI did not announce a total halt to its development. The measure adopted consists of a temporary slowdown, complemented by a review of training and evaluation processes and the implementation of stricter safety standards. The company's stated goal is to resume progress, but only after the monitoring and control systems are capable of keeping pace with the leap in capability presented by the new AI agents.

Security cameras equipped with artificial intelligence are already being used by companies in Brazil to detect suspicious behavior, aiming to prevent criminal incidents before they occur.

This technology, known as predictive policing, generates both interest in the private sector and public apprehension. Among the biggest concerns are the lack of adequate regulation and the potential use of these systems to monitor individuals who are not committing offenses.

Previously, captured images were examined by human operators. Currently, processing is done by systems that issue alerts upon identifying deviations from the normal pattern, such as a person remaining static in the same location for a prolonged period.

To function, these systems are trained with images of routine situations and, based on this learning, they can signal when something diverges from this pattern. This training process requires approximately two weeks of analysis to build a robust database capable of recognizing the visual pattern.

It is important to note that the tool focuses exclusively on suspicious human movements, without analyzing physical characteristics; it does not perform facial recognition to assess behavior, nor does it act autonomously upon detecting any unusual situation.

Currently, Brazil lacks specific legislation to standardize predictive policing systems. However, the General Data Protection Law (LGPD) already establishes guidelines for handling sensitive data, including facial biometrics.

In 2025, an ordinance was issued by the Ministry of Justice and Public Security authorizing the use of artificial intelligence by the police, but requiring human reviews in scenarios where fundamental rights are at risk.

A bill currently under debate in the National Congress proposes classifying AI systems used by police agents to analyze large volumes of data, identify profiles, and behavioral patterns as high-risk. This text, which has already been approved by the Senate and is being discussed in the Chamber, stipulates that tools classified as high-risk require human supervision, impact assessment, guarantee of the right to explanation for those affected, and adoption of anti-discrimination measures.