Australian firms must close AI data readiness gap, IDC warns

AI data readiness is the critical factor separating Australian businesses that can capitalise on artificial intelligence from those that cannot, according to new IDC research.

The International Data Corporation (IDC) surveyed more than 2,000 senior executives across a range of industries and found that 71% of Australian organisations consider data quality and accessibility to be a bigger barrier to AI adoption than the availability of sophisticated models. While the hype around large language models and generative AI dominates headlines, the study argues that without clean, well‑governed data, even the most advanced algorithms will deliver limited value.

What the IDC study uncovered

IDC’s Global AI Adoption Survey, released in August, highlighted three key findings for the Australian market:

  • Data silos persist. Over half of respondents said their data remains trapped in departmental islands, making it difficult to train enterprise‑wide AI solutions.
  • Governance gaps. Only 28% of firms have a formal data‑governance framework, compared with 45% in the United States and 52% in the United Kingdom.
  • Skill shortages focus on data engineering. While 63% of CEOs cite a lack of AI talent, 79% specifically mention a shortage of data engineers and data‑quality specialists.

By contrast, 84% of Australian executives believe their existing AI models are sufficiently powerful, reinforcing the notion that the bottleneck lies elsewhere.

Why data matters more than models

Models are often treated as a plug‑and‑play solution, but they are only as good as the data they ingest. In the Australian context, legacy systems, inconsistent data standards and a fragmented regulatory environment exacerbate the problem. For example, the finance sector still struggles with the transition from legacy mainframes to cloud‑based data lakes, while the health industry wrestles with privacy‑by‑design requirements that limit data sharing.

“You can spend millions on the latest transformer architecture, but if your training set contains duplicate records, bias or missing fields, the output will be unreliable,” said Dr Sofia Nguyen, IDC senior analyst for AI. “Australian firms need to prioritise data hygiene, lineage and stewardship before they chase the next model hype.”

Implications for Australian industry

The gap in AI data readiness could widen the productivity divide between Australia and its trading partners. The Australian Bureau of Statistics estimates that AI could add up to AUD 315 billion to the national economy by 2030, but only if data foundations are solid.

Key sectors such as mining, agribusiness and retail stand to lose competitive advantage if they cannot harness real‑time sensor data, satellite imagery or consumer insights. Conversely, organisations that invest in data‑centric AI strategies are likely to see faster time‑to‑value, higher ROI and stronger compliance with the Australian Privacy Principles.

Steps to improve AI data readiness

IDC recommends a four‑stage roadmap tailored for Australian enterprises:

  1. Audit and map data assets. Conduct a comprehensive inventory of data sources, noting ownership, quality metrics and regulatory constraints.
  2. Establish a data‑governance office. Appoint a chief data officer (CDO) or equivalent role to enforce standards, oversee metadata management and coordinate cross‑departmental data sharing.
  3. Invest in data‑engineering talent. Upskill existing staff through partnerships with universities such as the University of Melbourne and the Australian National University, and consider hiring specialised data‑quality analysts.
  4. Adopt a modular AI platform. Choose solutions that separate data ingestion, preparation and model training, allowing teams to iterate on data improvements without redeploying models.

These actions align with the Australian Government’s “Digital Economy Strategy” and the “AI Ethics Framework”, both of which stress responsible data handling and transparency.

Government and policy response

Prime Minister Anthony Albanese’s recent budget allocated AUD 1.2 billion to the “Data for Good” initiative, aimed at creating secure data trusts for health, climate and infrastructure projects. The initiative could provide a template for industry‑wide data collaboration, reducing duplication and fostering a shared ecosystem.

Additionally, the Australian Competition and Consumer Commission (ACCC) is reviewing data‑sharing guidelines to ensure that competition law does not inadvertently hinder the formation of data consortia. A clear regulatory pathway will be essential for SMEs that lack the resources to build proprietary data lakes.

In summary, the IDC research flips the narrative: the AI race in Australia is less about who has the flashiest model and more about who can master data readiness. Companies that act now to break down silos, formalise governance and upskill their data workforce will be better positioned to reap the promised economic benefits and maintain a competitive edge on the global stage.