Showing posts with label intelligent automation. Show all posts
Showing posts with label intelligent automation. Show all posts

Friday, 2 October 2026

We Taught AI to Say “I Don’t Know” And That Made the Automation Better

 



There is a strange expectation surrounding artificial intelligence. We expect it to have an answer. Ask AI a question and we expect a response. Give it a problem and we expect a solution. Put it inside a business automation and there can be an even stronger temptation to expect it to handle every situation that reaches it. But what happens when it genuinely doesn't know? At Byron AI, we think that's one of the most important questions to consider when building AI into a real business process. An impressive demonstration might show AI completing a task perfectly once, but a useful business system also needs to consider what happens on the hundredth or thousandth attempt when something inevitably arrives that doesn't fit the normal rules.

Sometimes the best answer AI can give isn't an answer at all. Sometimes it needs to recognise that it doesn't have enough information, isn't confident enough to make a decision or has encountered something outside the job it was designed to perform. Designing an automation that can reach that conclusion might sound like deliberately limiting the AI, but in practice it can make the entire system much more useful and reliable.

Imagine an employee who answered every question they were given regardless of whether they actually knew the answer. They never asked a colleague for help, never checked anything and never admitted uncertainty. You probably wouldn't describe that employee as reliable. Yet businesses can accidentally expect exactly that behaviour from AI. If an automated system is instructed to always produce an answer, it may attempt to make a decision even when the information available isn't sufficient to make a good one.

Consider an ecommerce business using AI to categorise products. Most products might be straightforward, with the system able to identify an appropriate existing category from the product information provided. Eventually, however, something unusual will appear. Perhaps the supplier information is incomplete, several categories appear equally suitable or the correct category simply doesn't exist on the website. An AI system designed only to produce an answer may still choose something. That sounds helpful until the answer is wrong. A better system has another option available: don't guess.

This changes the way we think about AI automation. Instead of only asking, “How do we get AI to complete this task?”, we can also ask, “How does the system recognise when it shouldn't complete this task?” The first question concentrates on automation, while the second concentrates on reliability. A workflow can be designed so normal and predictable situations continue automatically while unusual cases take a different route. If essential information is missing, the process can stop. If no suitable match can be found, the item can be flagged. If a request falls outside the system's intended purpose, it can be passed to a person.

This becomes particularly important as automation scales. If AI makes one decision and gets it wrong, someone can probably correct it fairly easily. If the same system is making hundreds or thousands of decisions, confidently guessing every time becomes a much bigger problem. Imagine 1,000 tasks entering an automated workflow and 950 of them being straightforward. Rather than forcing the system to make decisions on all 1,000, it could process the 950 predictable cases automatically and send the remaining 50 for review. Technically, that system is less automated than one attempting to process everything, but it could be considerably more valuable to the business.

Instead of an employee manually completing 1,000 repetitive tasks, they only need to investigate the small number where human judgement genuinely adds something. The objective therefore doesn't have to be achieving 100% automation. It can be about automating the predictable work while making sure the exceptions reach the right person.

The same principle becomes even more important when AI communicates directly with customers. Many conversations follow predictable patterns. A customer asks a common question, provides some information or wants to arrange something. But customers don't behave like database records. They change subjects, provide incomplete information, ask unexpected questions, complain or make requests that the automation wasn't designed to handle. Trying to force every conversation through the same automated path can quickly create a poor customer experience.

A better system can have a clearly defined point at which it stops trying to handle the conversation itself. If a request falls outside its intended purpose, important information cannot be established or the situation requires judgement, the conversation can be handed to a person. In that situation, the AI hasn't necessarily failed. It has recognised the boundary of its job and responded appropriately.

This can also change the role of employees within an automated process. Without automation, a person might process every task from beginning to end. With sensible automation, the system handles the predictable majority while the employee concentrates on the exceptions. Instead of categorising hundreds of obvious products, someone investigates the handful that don't fit anywhere. Instead of manually processing every straightforward enquiry, somebody deals with the unusual customer request. Instead of preparing every quotation from scratch, an employee reviews the ones that require special attention.

There is another important reason why AI needs the ability to stop: sometimes the information simply isn't there. Businesses naturally accumulate messy data. Supplier descriptions can be incomplete, customers forget to provide details, spreadsheets contain blank fields and different systems use different terminology. AI may be extremely capable at interpreting information, but it shouldn't automatically be expected to invent information that hasn't been supplied.

A well-designed automation therefore needs to distinguish between understanding information and filling gaps with assumptions. If a customer hasn't supplied something required to prepare a quotation, the system might need to ask for it. If a product cannot be matched confidently with an existing category, somebody may need to review it. If important information is missing from a spreadsheet, the workflow may need to stop until that information has been provided. Sometimes a blank field isn't something AI should solve. It's something the business needs to know about.

This is also where traditional automation and AI can work particularly well together. AI is useful for interpreting information that doesn't always arrive in exactly the same format, while automation can enforce precise business rules around what happens next. AI might identify what a customer wants, while predefined rules determine whether that request can continue automatically. AI might suggest where a product belongs, while the workflow checks that the category actually exists. AI might prepare information for a quotation, while sending the final quotation still requires approval.

That combination gives businesses something extremely important: control. Rather than asking AI to run an entire business process without supervision, you're giving it a clearly defined job within that process. The system knows what it is supposed to handle, what rules it needs to follow and what should happen when it encounters something outside those boundaries.

It's tempting to judge an automation purely by how much human involvement it removes, but that isn't always the best measurement. Imagine one system that automates 100% of a process but occasionally makes decisions it shouldn't, and another that automates 90% while reliably sending the remaining 10% to someone who knows what to do. For many real business processes, the second system could be considerably more useful.

This is why one of the most valuable questions to ask when designing any AI workflow is surprisingly simple: “What should happen when the AI doesn't know?” The answer might be to request more information, place something into a review queue, alert an employee, hand a conversation over to a person or simply stop the process. Whatever the answer is, deciding it before the automation goes live is far better than discovering the problem after AI has confidently made the wrong decision hundreds of times.

At Byron AI, we're interested in practical AI automation built around the way businesses actually work. That means thinking not only about what AI can automate, but also where its boundaries should be, when people should remain involved and what should happen when something unexpected occurs. The aim isn't to create AI that tries to do everything. It's to create systems that reliably handle the work they're actually designed to do.

Because the smartest AI in your business might not be the one that always has an answer.

It might be the one that knows when to say “I don't know.”


Contact Us:

Call 07905 967307 for details

Email: Byronai.uk@gmail.com