New research from Xero, the global small business platform, has revealed that 78% of New Zealand small business owners are concerned AI development and adoption is outpacing regulation, as generative AI tools permeate various industries and the workforce.

Xero’s Future Focus AI research surveyed over 3,000 small business owners from Australia, Canada, New Zealand, Singapore, the United Kingdom and the United States on what they are thinking, feeling and doing about AI.

It revealed that New Zealand small businesses believe sensitive information disclosure (51%) and data privacy violations (50%) are the biggest ethical challenges relating to AI use in their business. This is closely followed by worker displacement, with 44% citing this as the biggest ethical challenge.

The findings were unveiled at Xerocon Sydney, Xero’s event for cloud accounting leaders from across Asia Pacific, where Xero shared more on its approach to building AI products and introduced two new AI-powered predictions features, generative AI pilots and an AI guide for accountants and bookkeepers.

Mark Rees, Chief Technology Officer at Xero, says, “While AI brings lots of benefits, the survey results highlight the need to provide more knowledge, tools, and policies to ensure small businesses are not left behind and can continue to thrive."

"Xero’s always looking at how we can bring new technology safely into the hands of customers, in a way that will make a positive difference in their lives. It’s about putting the customer first; not shipping lots of AI features for the sake of it.”

Data privacy concerns don’t reflect actions

The survey showed as AI tools become more widely accessible, many small businesses globally proactively looking for ways to stay ahead of the curve. The most common steps are experimenting (32%) or investing (21%) in new AI tools, dedicating more resources to AI use (20%) and working with third party AI vendors or experts (18%). However, 32% of small businesses aren’t taking any proactive steps.

When exploring the benefits that AI can bring, small businesses are also paying attention to the risks. The top actions taken by small businesses to manage the risks of generative AI tools include creating policies and guidelines for employees (26%), providing training to employees on identifying biases or inaccuracies (25%) and seeking written consent from clients / customers before using AI tools (23%).

However, the survey shows many small businesses are trusting AI tools with sensitive data, highlighting a need to support them in assessing security and privacy risks. For example, more than half (51%) of small businesses said they trust AI with identifiable customer information, while 45% trust AI with their sensitive commercial information. By being too comfortable with sharing personal identifiable information with AI tools, many small businesses are putting their data at risk. Xero is guided by its responsible data use commitments and strives to support customers navigating data use.

Overall, 23% of small businesses have seen increased security or privacy issues since using generative AI tools. In fact, 69% of small businesses said they have seen drawbacks when using generative AI in their business.

Other drawbacks small businesses have seen are increased biases or inaccuracies in content (18%), decreased employee morale (18%) and decreased efficiency due to time overseeing the quality control of AI content (16%). Additionally, 14% of businesses who are using generative AI have seen a reduced headcount.

Both excited and anxious about the impact of AI

Small businesses are decidedly ambivalent but lean, ever slightly, towards optimism when it comes to the impact of AI on their business. Almost a third (32%) are intrigued about AI, while others are feeling anxious (31%) and excited (30%). Half of small businesses believe AI will be more helpful and have a positive impact on their people, processes and workflows, compared to 20% who said more harmful.

Three quarters of small businesses believe AI will have an impact on their business in the next five years, with 34% saying it will have a “significant impact”. However, 24% of small businesses say they are not sure what impact AI will have on their business. Of the other respondents, 26% said AI will help them create more efficient business models and workflow and 20% said new products and services.

Most small businesses want AI to play a big role - but not the majority role - in their business, with only 28% saying they want more than half of their business systems supported by AI in the next three years. While over half (59%) said AI will have no impact on their hiring plans in the next three years, 31% of small businesses said they plan to hire fewer people than they would have otherwise due to AI.

Amid all the hype and buzz, AI is not a priority in the near term for the majority of small businesses. When asked about their concerns over the next 12 months, growing business revenue (65%), attracting new customers (61%) and managing rising costs (56%) were the top three concerns. Only 8% of respondents ranked adopting or investing in AI as their number one priority over the next 12 months.