Core introduces new AI-enabled Microsoft Surface devices in South Africa

South African organizations have moved past questioning the potential of AI; the focus has shifted to operational tasks: how to implement AI, where it should operate, how much computing power will be required, and how this will affect data, budgets, and overall technological strategy.

Previously, AI implementation was viewed primarily as a software issue—selecting a platform, a training model, and priority use cases. However, hardware components have become the bottleneck: GPUs, memory, storage, networking equipment, power and cooling systems, security, and data management. Access to the necessary computing power has become as critical as access to a suitable model.

Infrastructure Situation in South Africa

Local companies face several specific limitations. High-performance computing is expensive, and access to advanced GPU infrastructure is limited. The performance of cloud AI suffers due to bandwidth and latency issues. Large-scale planning is complicated by energy supply and data center capacity concerns: less than half a gigawatt of active data center capacity exists in Africa per billion people. Furthermore, data sovereignty issues add complexity for those working with regulated information, and skilled specialists in specialized AI infrastructure are scarce.

South Africa cannot simply copy hyperscale models created in other regions. The assumption that every organization must have a large data center or significant commitments to cloud services is no longer viable or necessary.

A Huge Data Centre Is Not Always Needed

As AI adoption matures, workloads are becoming more distributed. Developers require computational resources for testing and training models, while business units need local inference for analytics, automation, and computer vision. Operational environments, whether factories or retail stores, increasingly rely on edge AI for real-time data processing.

This opens up opportunities for compact, distributed infrastructure. Instead of centralizing computation in one data center or cloud environment, organizations can deploy small, AI-capable systems at various business points. This provides significant computing power without the costs and timelines associated with building a traditional AI data center.

The Rise of Accessible AI Compute

To meet this need, a new generation of compact systems is emerging, designed to bring AI computing power closer to users, developers, and operational environments. This allows organizations to start small, conduct local experiments, and scale as real demand grows.

An example is the ASUS Ascent GX10. It is built on Nvidia's GB10 Grace Blackwell superchip—the same silicon used in Nvidia's DGX Spark. This system delivers AI performance of petaflop FP4 and 128GB of unified memory in a 150x150x51mm chassis, sufficient for fine-tuning models up to 200 billion parameters right on a desk. Two such units can be connected via the ConnectX-7 network to double performance. At the same time, the power consumption reaches 180W, which is important in a market where power supply is a limiting factor in planning, not just an expense item.

The ASUS ExpertCenter Pro ET900N G3 provides workstation performance for business and professional needs, supporting AI workloads that need to be closer to the user in fields like engineering, analytics, design, research, or operations. For many organizations, this is a practical compromise: the system is powerful enough for complex AI tasks yet accessible for deployment across different teams and departments.

The practical effect of such systems is local development and testing, accelerated experimentation cycles, bringing data closer to the point of use, tighter control over sensitive tasks, reduced reliance on cloud connectivity, and creating a realistic starting point for an organization building its own AI capability.

It Is No Longer Cloud Versus On-Premises

For years, infrastructure decisions boiled down to a binary choice: cloud or on-premises. Artificial intelligence is disrupting this paradigm because different workloads have different requirements, and these requirements determine where they should run.

Some AI tasks benefit from the elasticity and scale of cloud services. Others require low latency, local processing, data sovereignty compliance, predictable costs, or autonomous operation capabilities, pointing to the need for local or edge infrastructure.

Thus, the future is hybrid. Organizations will combine cloud, on-premises, and edge computing based on the nature of each workload, and compact systems like the GX10 and ET900N will become part of this model, allowing computation to be placed exactly where it is needed. The question is which location suits which workload.

From Proof of Concept to Production

Many technically successful concepts fail at the operational level because infrastructure planning was treated as a secondary concern. Overcoming this gap requires assessing current and future workloads, separating training from inference, considering GPU and memory requirements, data location, applicable sovereignty rules, security concerns, power consumption, cooling, network latency, total cost of ownership, and environmental scalability.

This assessment must be integrated into the organization's AI strategy, not kept alongside it. Infrastructure defines the limits of possibility, the speed of AI deployment, and the economic sustainability of its operation.

The Role of the Technology Ecosystem

Making AI accessible is more than just selling hardware. It requires building an entire ecosystem that includes computing power, infrastructure, software, cybersecurity, distribution, technical expertise, and channel partners.

Altron Arrow, which distributes ASUS AI systems in South Africa, is part of this ecosystem, helping organizations and partners gain access to what is needed for modern AI deployments. The goal is to provide computing power that is realistic, scalable, and economically viable for local organizations, rather than just a scaled-down copy of a hyperscale solution.

Accessibility will define the next phase of AI adoption. The greatest benefit will go to organizations that understand their workloads and build their infrastructure strategy around them, not necessarily those with the largest budgets. For South African businesses, the barrier of accessibility is no longer an obstacle; the current focus is on how quickly AI moves from experiment to operational advantage.