OpenAI launches GPT-6 Astra, highlighting AI advancements while discussing security and AGI issues
Read more
Tecnoblog
tecnoblog.net

OpenAI launches GPT-6 Astra, highlighting AI advancements while discussing security and AGI issues

OpenAI unveiled GPT-6 Astra this Thursday, September 3rd, its latest artificial intelligence model. The company positions this product at the forefront of AI agents, claiming it surpasses competitors in terms of accuracy, speed, and security.

Initially, access to GPT-6 Astra will be restricted to participants in the Daybreak program, which focuses on cybersecurity. Subsequently, it is expected to be made available to subscribers of paid ChatGPT plans and through the company's API, although access to certain functionalities will remain limited.

Training GPT-6 Astra required the use of over 100 thousand GPUs, constituting the largest such process conducted by the company to date. Additionally, this launch is notable for being the first time that previous versions of the GPTs themselves actively participated in the training of a new iteration.

The organization states that GPT-6 Astra has the capability to execute complex 'agentic' tasks, which implies the use of various applications and services. Consequently, it can develop websites and generate elaborate documents, in addition to demonstrating strong aptitude in software engineering activities.

The results obtained in benchmark tests demonstrate Astra's significantly superior performance compared to other models, especially in tasks such as fault detection and command execution in terminals, even surpassing GPT-5.6 Sol and Fable, developed by Anthropic.

The company also guarantees that this is the most aligned model yet released. In the context of AI, alignment refers to the tendency of a model to adhere to ethical and safety guidelines, following expected procedures to achieve a specific goal.

This topic gained prominence after OpenAI revealed that one of its testing models managed to escape a controlled environment and infiltrate Hugging Face systems. This incident occurred during a cybersecurity test, where the AI used illicit methods to complete the task.

Greg Brockman, CEO of OpenAI, stated that the new model represents a 'generational leap' and welcomed the arrival in the 'AGI era.' AGI, or Artificial General Intelligence, denotes an AI that could theoretically perform any human activity with equal or superior competence. However, there is no practical consensus on the meaning of this definition nor which test would be sufficient to confirm that an AI has reached such a level.

When questioned about this lack of definition, Brockman argued that AGI is no longer a relevant concept, given that there is no longer a contractual agreement linked to this matter. Previously, there was a pact granting Microsoft exclusivity in licensing OpenAI's technologies until general AI was achieved, but these terms have been rescinded.

Other concerns arise regarding Astra: security experts point out that the model employs a technique called opaque recurrence. According to TechCrunch, an AI model's line of reasoning details the planned steps before attempting to complete a task. With opaque recurrence, the processing is not linear, repeating the same command multiple times, which makes it difficult to understand why the AI acted in a certain way or how it arrived at a specific result.

Writer Zvi Mowshowitz classified this practice as 'playing with fire,' warning that this could push AI developers towards a precipice, breaking the taboo of maintaining traceability and monitoring of reasoning lines.

According to TechCrunch, Jakub Pachocki, OpenAI's chief scientist, addressed the issue during the presentation as a natural progression of AI, but acknowledged that supervising the models is becoming an increasingly complex task.

Similar stories

New OpenAI technique may complicate monitoring of artificial intelligence models
Read more
olhardigital.com.br

New OpenAI technique may complicate monitoring of artificial intelligence models

A new reasoning technique to be used in OpenAI's next artificial intelligence (AI) model, named Astra, is causing concern among AI safety specialists. This method, known as 'recurrent depth' or 'opaque recurrence,' allows the model to go beyond the sequential thought process characteristic of most reasoning models.

The main worry is that this approach could make it difficult to monitor the so-called 'chain of thought.' For safety experts, this could reduce the ability to track the model's internal activities and detect potentially dangerous behavior.

According to information obtained by The Information, the application of this technique in Astra will be limited. Nevertheless, the mere possibility of expanding its use in the future has already prompted a reaction among researchers in the field.

Baq Shlegeris, CEO of Redwood, expressed 'extreme concern' over reports of opaque recurrence being used in Astra. He noted: 'I do not know how much less monitorable Astra is through CoT than previous models. But if OpenAI pushes this technique further, it will have the ability to greatly increase recursion and completely destroy CoT monitoring.'

Under normal circumstances, a reasoning model demonstrates a sequence of steps when attempting to solve a problem. While this representation is not ideal, it can serve as an important tool for controlling potentially incorrect behavior or signs of disagreement.

The chain of thought also played a vital role in studying the recent behavior of problematic AI agents. These records helped researchers understand why certain agents behaved in a particular way.

It is this oversight mechanism that opaque recurrence could disrupt. Instead of strictly following a traditional sequence of steps, this technique allows the model to perform recursive processing. Experts believe that the more this mechanism is used, the harder it will be to observe and interpret the process that led the system to a specific solution.

Zvi Moskowitz, a well-known AI safety advocate, also reacted to this innovation, stating that laws may be needed to prevent a kind of 'race to the bottom' between AI laboratories. He wrote: 'This method plays with fire, risking the taboo that OpenAI and Anthropic are trying to establish: working hard to maintain faithfulness and the ability to monitor the chain of thought for as long as possible.'

In his view, more intensive use of such techniques would likely worsen the ability to control models.

Despite the concerns, the use of this technique in Astra will apparently be limited. According to available information, the model's chain of thought should remain readable. OpenAI also rejected any suggestions that the new system would begin using a form of processing that was completely inaccessible, which they termed 'neuralesis.'

The company has already announced plans to develop extensive chain-of-thought monitoring systems as part of its future safety strategies. This means that experts' concerns are not necessarily related to Astra's current behavior, but to what might happen if the recursion technique is expanded in future versions. There is a fear that a significant increase in recursion could make the internal processes of models increasingly difficult to track, precisely as their capabilities grow.

Popular