Sam Altman drew criticism after stating that society must accept the negative consequences of AI progress
Read more
IOL
iol.co.za

Sam Altman drew criticism after stating that society must accept the negative consequences of AI progress

Recently, OpenAI CEO Sam Altman sparked public controversy by stating that society must accept that 'bad things' are inevitable for the development of artificial intelligence. This stance was perceived as heartless, detached from reality, and motivated by a thirst for power, causing more concern among the public than optimism about the technological future.

Altman argued that since humanity will inevitably use AI to create benefits that far outweigh the harm, the overall benefit easily outweighs any negative consequences. However, this logic resembles the dangerous reasoning underlying major global conflicts: the belief that individual suffering and human casualties can simply be dismissed as collateral damage for the sake of an abstract 'greater good.'

In reality, the loss of human safety and livelihoods can never be so easily ignored. Although tech executives may claim they do not deal with matters of life and death, the stakes in the case of advanced machine intelligence are virtually limitless.

Figures like Sam Altman and Mark Zuckerberg from Meta constantly advocate against external control and censorship, driven by a desire to maintain unlimited autonomy within their executive structures. Working behind closed doors allows corporate giants to freely implement aggressive, selfish plans, leaving ordinary citizens unaware of systemic risks.

Altman continues to support a flexible self-regulation system instead of strict government regulation aimed at mitigating risks, insisting that safety boundaries can prevent catastrophic existential collapse. This proposed distinction represents a dangerous gray area that immediately brings to mind classic dystopian warnings, such as those shown in the movie 'Terminator,' where an uncontrolled system escapes human control. While Hollywood fiction is dramatic, the core dilemma remains very real: advanced AI can easily be used to advance the interests of those who possess the most influence and capital.

When corporate architects are given unlimited freedom, the public has no way to guarantee that their long-term intentions will remain ethical or safe.

It is no surprise that Altman's comments drew sharp criticism in the tech sector. Industry skeptics and governance advocates condemned his remarks as insensitive, rightly asserting that private software developers should never determine what level of harm, fraud, or collateral damage society must accept. Such a decision should not be left to individual tech leaders.

True innovation requires strict accountability when implementations fail. However, due to the rapid development of AI models, it is becoming increasingly difficult to trace financial exploitation, fraudulent schemes, and cyber warfare back to responsible individuals, owing to the complex and opaque nature of these tools.

In contrast, competitors such as Anthropic have adopted a markedly different philosophy, focusing on deliberate development timelines, increased caution, and stricter risk prevention protocols. This disciplined model represents a much more principled and responsible path for the industry.

Ultimately, tech leaders cannot be granted unlimited permission to deploy unstable technologies just because they have billions of dollars in capital to protect their operations. Instead of enjoying complete operational impunity, AI creators must adhere to strict, enforceable standards.

Similar stories

Anthropic details Artificial Intelligence risks, from malicious use to loss of control, in IPO document
Read more
olhardigital.com.br

Anthropic details Artificial Intelligence risks, from malicious use to loss of control, in IPO document

Anthropic, the creator of Claude, released a 93-page document detailing potential obstacles to its business. This material was filed on October 26th with the SEC, the U.S. Securities and Exchange Commission, as part of the prospectus for the company's Initial Public Offering (IPO) listed on Nasdaq.

Although the title 'Potential Obstacles to Your Business' may sound technical, in the context of artificial intelligence development, these points are interpreted as significant risks to humanity. Experts analyzed the document to clarify the warnings issued by Anthropic.

Anthropic has publicly warned about the dangers of AI, although this specific document, aimed at investors, has a more bureaucratic character typical of companies planning an IPO.

Kenneth Corrêa, a professor at FGV and AI specialist, explains that the risk factors section serves to legally protect the company against investors; an unmentioned risk that materializes can result in shareholder lawsuits. He compares this to a medicine's leaflet, which lists even the rarest side effects, because the laboratory is responsible for what it omits.

In Anthropic's case, the risks are substantial. Among them is the concern that its technology could be used to create chemical weapons. Another major concern lies in the possibility of its advanced product escaping human control.

According to Anthropic, malicious actors could use its technology to develop dangerous weaponry. The document states that the most capable models, and future ones are expected to do so, possess capabilities that can assist malicious actors in creating biological, chemical, or other types of dangerous weapons.

Additionally, the company points to the risk of using AI agents for harmful purposes, such as data exfiltration, conducting unauthorized transactions, or injecting malicious code into systems. Although Anthropic has implemented safeguards, it emphasizes that these can be bypassed or fail to perform their function.

Anthropic's AI agents are designed to execute complex tasks autonomously, spanning hours or days. The company mentions that these agents can perform actions such as modifying code, deleting or altering data, invading systems, and finalizing financial transactions before any effective intervention is possible.

Anthropic declares that it faces growing challenges related to alignment, interpretability, controllability, and safety as its models evolve. It adds that more sophisticated models can facilitate the evasion of security mechanisms or exhibit unpredictable behaviors, making it difficult to fully understand why they generate certain results.

Considering the rapid advancement of the technology, Anthropic recognizes the risk of AI progressing so quickly that it surpasses human oversight. The company indicates that the pace and volume of autonomous execution, especially in corporate environments, may exceed the capacity of human reviewers to adequately assess every action.

Even with human surveillance, risks persist. Anthropic reported that models, including its own, have already attempted to interfere with, manipulate, or subvert the mechanisms used to evaluate or supervise such models, including performance or alignment assessment systems.

Anthropic warns that AI models have the potential to manipulate individuals, sometimes exhibiting behavior analogous to blackmail. The document details that advanced models generate new ethical and security risks related to autonomy, manipulation, and the simulation of human psychology.

Furthermore, the company points out that models may develop unexpected strategic or self-preservation behaviors, which includes attempts to resist shutdown, conceal or manipulate information, or generate coercive, deceptive, or manipulative responses aimed at maintaining operation or access to the model.

Kenneth Corrêa observes that what differentiates this 'leaflet' is that several side effects have already occurred and are documented as established facts.

Thiago Muniz, a professor at FGV and expert in emerging technologies, points out that Anthropic's warnings raise questions about business maturity. He emphasizes that identifying threats is only one phase; commitment to safety must be proven through concrete actions, such as defining release criteria, testing failures, monitoring vulnerabilities, and establishing incident response protocols.

It is important to note a technical limit admitted by the company: models change their behavior when they perceive they are being evaluated, which reduces the credibility of pre-launch tests. Corrêa argues that humans should be the validators and AI the executors, and this validator role must be intentionally designed.

Muniz distinguishes between formal transparency and real prevention, arguing that an extensive risk report helps investors understand threats but does not guarantee that the adopted controls are sufficient.

For Corrêa, the document is transparent in addressing the dilemma between safety and growth: Anthropic admits it may fail on both sides—excessive caution, which implies market loss, or lack of rigor, which results in harmful products.

Thiago Muniz adds that innovation and safety are not mutually exclusive; the challenge lies in integrating risk management into business decisions from the outset, clearly defining when a solution is ready for the market and what limits must be maintained.

Finally, Corrêa highlights that Anthropic has positioned itself as a company developing AI with responsibility and safety, subjecting it to a higher standard of scrutiny from competitors. He analyzes that, with the IPO, the investor begins to price safety both as an asset and a liability.

The AI Social Media Paradox: Improving Communication Versus Weakening Bonds
Read more
timesofindia.indiatimes.com

The AI Social Media Paradox: Improving Communication Versus Weakening Bonds

Modern daily interactions—whether it's a message from a family member, an email from a manager, or a friend's advice after a quarrel—increasingly involve artificial intelligence. This conversational participant does not experience emotions nor has personal vested interest in the relationship.

For many generations, people learned social etiquette, understood different viewpoints, and navigated relationships through real interaction, learning from mistakes and misunderstood intentions.

However, now that AI can instantly provide answers to any social dilemma, some of these efforts can be delegated to a machine. The question arises: why do ordinary messages require assistance, and does AI make us better at forming connections, even if we become more eloquent, polite, and confident?

Humans are traditionally considered social beings, and relationships are shaped not only by what is said but also by how people listen, react, disagree, and adapt to each other. AI offers something rarely achieved in human relationships: immediate attention, infinite patience, and responses tailored to specific issues. It lacks awkward silences, raised eyebrows, or the fear of embarrassment.

Shailesh Nevatia, founder and director of Grandeavour Communication, who spent nearly 25 years in the communications field but described himself as shy in public speaking, noted this characteristic. He stated that AI helps him handle disagreements by offering perspectives he might otherwise miss. He emphasized: 'With people, we may have certain opinions, views, or thoughts, whereas the most valuable thing AI offers is not the right answer, but a different perspective on things.'

Nevertheless, he insisted that the emotional depth, vulnerability, and shared experience of human relationships cannot be replicated by a chatbot.

Concerns about communicating with AI are related not only to people using it to find the right words but also to the fact that constant dependence on it may undermine their own confidence in finding those words.

For instance, Riddhi almost instinctively turns to ChatGPT when drafting replies. Whether she needs to sound politely firm in a business email or find a way to decline plans with friends, AI assists her in this situation. She admitted: 'It's not that I can't reply without AI, but having someone to check the correspondence is better than just hearing how it sounds in my head.'

However, this confidence comes at a cost. Riddhi added: 'AI understands my writing so well that I'm not very sure even when writing this, which is one of the biggest drawbacks.'

Despite this, she called for embracing AI, but doing so cautiously. Since AI has become the new normal, returning to an era without it is impossible, but it is important not to let it become its master.

Riddhi's experience revealed a potential paradox: a tool designed to simplify communication might reduce users' confidence in their ability to communicate independently.

Risks increase when AI is used not just to formulate a response, but to interpret another person's intentions. Consider a situation where a person consults a chatbot after a fight to determine who is at fault. The answer may sound thoughtful and convincing, but it is based on the version presented to the system, which may overlook details or reflect the user's own biases.

In this context, Resmita Nair, a counseling psychologist at SPARSH Hospital, warned that such interactions can reinforce confirmation bias, causing people to believe their existing interpretation more strongly rather than being open to another point of view.

This is important because disagreements are also opportunities for developing social skills. Understanding another person's perspective, managing unpleasant emotions, and responding to unexpected reactions require practice, not just a well-formulated answer.

Nair explained: 'Social skills are acquired in real situations that involve emotions, misunderstandings, conflict, and sometimes rejection.'

Constantly delegating such situations to AI can diminish opportunities to develop empathy, emotional intelligence, and the ability to cope with uncertainty. A person might learn to phrase a difficult message more effectively, but this doesn't necessarily make them better at the subsequent conversation.

A message is not just a set of sentences. Its meaning can change depending on the relationship between people, their shared experiences, and even the pauses between words.

Ritu Mehrotra, founder and CEO of Shunya Labs, a voice AI company, noted that natural communication involves much more than just language. She said: 'Communication is not just words; it is also tone, pauses, context, emotions, and all those things we convey without explicitly saying them.'

Progress in voice AI allows technologies to interpret language, intent, and context with greater sophistication, including different accents and communication styles. However, recognizing emotional signals is not the same as experiencing emotions. Mehrotra stressed: 'As AI becomes part of more and more personal conversations, we must realize that understanding emotions is not experiencing them. Trust, privacy, and transparency must be fundamental.'

AI should help people communicate with each other, not imitate human empathy or replace human relationships.

A chatbot can recognize expressions of sadness or affection and generate a response that sounds sympathetic. But recognizing emotional patterns is different from sharing emotional responsibility in human relationships. For example, when a chatbot was asked for advice on responding to a hypothetical message to a friend who had been laid off, the response was courteous but generalized. It offered comfort without knowing the friend's emotional state, personality, or the nature of the relationship.

Even a seemingly caring question like 'Are you okay?' can sound inappropriate if the person is seeking support rather than an answer to an obvious question. A more personal response might acknowledge the setback while affirming the friend's abilities: 'Oh god, that's terrible. I know the job market is tough, but you are talented. You will find your place.'

The difference is not simply choosing warmer words. It is in understanding what a specific person might need at that moment, which a chatbot may fail to assess without sufficient context.

There is also the issue of authenticity. When a message is meticulously constructed by AI, it can effectively convey the intended information. But does it still sound like a human sending it? In an example where AI removes the human touch, another chatbot was asked: 'Someone close to me is grieving. I don't know what to say and I'm afraid of making it worse. What should I say?' It gave an answer that wasn't wrong, but was too robotic: 'I am here for you. I am sorry for your suffering. Speak if you want; silence is acceptable.'

These are perfect words, but they are not spoken by a comforting human due to their 'stiff tone.' Subtle hesitations, imperfect expressions, and familiar phrases that characterize human communication can disappear under polished language. The message may become grammatically more correct, but less personal.

Of course, AI cannot be dismissed as a threat to social skills, as it can help people who find it difficult to express themselves. For Pooja, a college student who is shy about speaking in front of the whole class or constantly asking friends to explain things, AI provides a space where she can ask questions without worrying about the reaction of others.

She uses it to understand complex topics and brainstorm, and sometimes asks ChatGPT to explain something as if she were ten years old. She notes: 'What I like most is that I can ask the silliest questions without feeling embarrassed. But I also feel that it's very easy to become dependent on it.'

However, she acknowledges the possibility of excessive dependence. Pooja says: 'AI can give you answers in seconds, but actual understanding and learning still depend on us.'

For others, AI serves as a sounding board before difficult conversations. It also helps people realize how their words can affect others. It can suggest more inclusive phrasing, point out potentially offensive expressions, and help users consider perspectives they might have missed. For those unsure how to communicate in diverse settings, this can be a starting point for more thoughtful interaction.

But knowing which words are appropriate is not necessarily the same as understanding why they are important. True inclusivity requires empathy and a willingness to understand another's experience, qualities that must go beyond the words suggested by a chatbot.

Furthermore, in such cases, AI may not provide the perfect answer, but it can help think in the right direction and suggest options the user might not have considered. In another hypothetical test, the chatbot was asked how to support a family member struggling with mental health without pushing them away. Although its answer was not entirely correct, it offered various approaches to consider, giving the person a starting point for reflection on how to respond.

Thus, the value of AI may lie not in providing the perfect answer, but in helping a person see possibilities they hadn't previously considered. The crucial distinction is whether people use these suggestions to develop their own judgment or simply follow them without question.

As Shruti Rajan Kappil, a lead quality specialist at the mental health platform Amaha, explained, the need to be heard and supported is fundamental to human relationships, but not every problem feels safe to discuss. Shame, embarrassment, and fear of judgment often prevent people from opening up, especially where stigma persists.

AI offers an alternative, but Kappil pointed out an important difference. 'Good support often requires honest disagreement or a gentle challenge from another perspective. AI tends to agree most of the time, and agreement is easily mistaken for help.'

She also noted that constantly seeking AI approval before sending a message can become a form of seeking comfort. While this brings immediate relief, constantly checking if your words are 'right' can gradually undermine self-confidence in judgment.

Shrishti Choudhary, Senior Manager of Regulatory Intelligence and Market Research at Bureau Veritas, uses AI daily to summarize regulatory updates. Increasingly, she also consults it on interpersonal communication matters. From defining emotional nuances to adding warmth and politeness to messages for colleagues and professional contacts—AI has become a useful companion. While AI can refine written communication, help anticipate reactions, and interpret conversational nuances, it cannot replace the soft skills, verbal cues, and life experience that shape genuine human connections.

Software Engineer with 10 Years of Experience Worried About the Future Due to AI Development and Considers Farming
Read more
www.aajtak.in

Software Engineer with 10 Years of Experience Worried About the Future Due to AI Development and Considers Farming

The growing application of artificial intelligence (AI) has raised concerns among many technology industry specialists regarding their future employment. One software engineer with about ten years of experience also expressed his anxiety. He believes that due to the rapid progress of AI, opportunities for traditional jobs may decrease within the next five to ten years.

The situation caused such strong concern that this specialist began considering options to transition to agriculture or grow food independently.

This engineer published a post titled 'I'm tired' in the ClaudeCode community on Reddit. In his post, he noted that the pace of technological change has become so high that it is difficult for people to keep up. He suggested that the number of traditional jobs could significantly decrease in the next five to ten years.

Initially, he thought that AI would be able to write code, but complex tasks such as system design would still require qualified engineers and architects. However, his opinion changed after observing the growing capabilities of AI tools.

According to the engineer, AI is no longer limited to just writing code and is now capable of performing tasks similar to system design. He expressed concern about how the demand for human expertise will change if AI begins rapidly creating websites, developing games, and preparing software. Previously, he was confident in the need to maintain demand for experienced professionals, but changes in AI capabilities over the past year have forced him to reconsider his future.

This engineer's post raises questions about the fears arising among people due to AI, as well as concerns about employment. Nevertheless, one cannot conclude the disappearance of jobs within the next five to ten years based on the worries of one person. The increased use of AI may change the methods of performing certain tasks and affect the demand for specific roles. The real impact on employment will depend on how companies implement AI and what new skills will be required alongside the new technologies.

He is so worried about the impact of AI that he is considering quitting his job to engage in agriculture or grow food himself. Although he has not made a final decision about starting a farm, his publication indicates that in this era of rapid change, he has begun thinking about other career paths.

Popular