The confident nonsense problem
Ask an AI assistant about a competitor, a regulation or a market, and you will get a fluent, well organised, immediately useful briefing. Most of it will be right. Some of it may be entirely invented: a statistic that was never published, a company that merged with someone it never merged with, a rule that was repealed years ago.
This is usually called hallucination, and the important thing to understand is that the invented parts do not look different from the true parts. There is no wobble in the voice. A made up figure arrives with exactly the same confidence as a real one. That is the whole difficulty, and everything in this lesson is built around it.
Heads up: this lesson links to GenSpark through an affiliate link, so LearnAI earns a commission if you subscribe. It costs you nothing extra, and it is what keeps these courses free. We tell you where these tools fall short too, including who should not use them.
In plain English
- Hallucination:
- When an AI states something that sounds right and is not true. It is not lying, it is filling a gap with a plausible pattern.
- Source:
- Where a fact came from. A named report, article or website you can go and look at yourself.
- Primary source:
- The original document a fact came from, rather than an article describing it. The annual report, not the news story about it.
Ask for the briefing, then ask for the receipts
The single change that improves AI research most is making sources part of the request rather than an afterthought.
โ Weak prompt
Prompt
Tell me about the state of the UK coffee shop market.
Output
The UK coffee market is worth around 6 billion pounds and grew 12 percent last year, driven by independent operators taking share from the major chains.
Two precise figures with nothing behind them. They might be right. You have no way to know, and you are about to put them in a slide.
โ Good prompt
Prompt
Give me a short briefing on the UK coffee shop market. For every figure, name the source and the year it was published. Mark anything you are not confident about as UNVERIFIED. If you do not know, say so rather than estimating.
Output
Market size: estimates vary by source and definition. UNVERIFIED, my figures here may be out of date. Trend most widely reported: independents growing faster than chains. Suggested checks: the trade association's annual report and recent industry press.
Less impressive and far more useful. It tells you what to go and check instead of handing you a number to be wrong about.
Give me a briefing on [topic] for someone who knows nothing about it.
Structure it as: what it is, why it matters, the three things most people get wrong,
and what has changed recently.
Rules:
- Name a source for every factual claim, with the year.
- Mark anything you are not confident about as UNVERIFIED.
- If you do not know something, say you do not know. Do not estimate.
- Separate established facts from opinion and disagreement.
Keep it under 500 words.
Checkpoint
Invented facts arrive with exactly the same confidence as true ones. Asking for named sources and an explicit UNVERIFIED label is what makes the difference visible.
Cross-checking without spending an hour
You do not need to verify everything. You need to verify the things that carry weight, which is a much shorter list.
Check anything you will repeat in public, anything with a number in it, anything with a date, any name of a person or organisation, and anything that would embarrass you if it were wrong. Skip the general background. Nobody has ever been fired for a slightly imprecise sentence about industry trends.
Two techniques take about a minute each.
Here is a claim from your previous answer:
[paste the claim]
Now argue against it. What evidence contradicts it?
What would someone who disagrees with this say, and what is their strongest point?
Then tell me honestly how confident you are in the original claim, and why.
The second technique needs no AI at all. Take the most important single fact, put it into a search engine, and see whether an organisation you have heard of says the same thing. If the number appears nowhere, it probably came from nowhere.
Be especially careful with legal, medical, tax and safety questions. In these areas being 90 percent right is not a pass mark, and a confident wrong answer can cost real money or real harm. Use AI to understand the shape of the question, then ask a qualified human the actual question.
Comparing options without losing a morning
The other everyday research job is not learning about a topic, it is choosing between things: three suppliers, two software packages, four venues. The trap is asking which is best, because you will get an opinion dressed as an answer.
I am choosing between [option A], [option B] and [option C] for [purpose].
What matters most to me, in order: [cost], [reliability], [how quickly we can start].
Build a comparison table with one row per option and one column per criterion.
Rules:
- Where you do not have solid information, write UNKNOWN. Do not fill the gap.
- Add a final column: the strongest argument against each option.
- Then tell me the three questions I should ask each of them myself.
Do not tell me which to pick.
The last two lines are what make it useful. The strongest argument against each option cuts through the sales copy the AI has absorbed, and the questions to ask yourself put the decision back where it belongs.
Spotting confident nonsense before it bites you
Some things should make you slow down and check.
A suspiciously round number. A statistic with no year attached. A source you cannot find when you search for its exact title. Anything about the last few months, since AI tools are often working from older information than you assume. And the classic warning sign: a fact that fits your argument perfectly and that you were very pleased to receive.
Tools that research and then do the next bit
A plain chat assistant answers your question. A newer category of tool goes further: it searches, reads across many pages, and then completes the multi-step job around the research, such as assembling a comparison table or drafting the summary document. GenSpark is one of these. You describe the outcome you want rather than the individual steps, and it goes off and works through them.
Who it suits. People doing genuine legwork research: comparing a dozen suppliers, pulling together a market overview, checking what competitors publicly say. Anyone who currently opens thirty browser tabs and loses track of which one had the useful bit.
Who it does not suit, and this might well be you. If your research is a single quick question, this is a heavier tool than you need, and a normal assistant or a plain search will be faster. If you work with confidential internal material, an autonomous tool browsing the web is the wrong shape of tool entirely. If you need a legally or financially defensible answer, you need a professional, not automation. And if you dislike not seeing each step as it happens, the hands-off approach will make you uneasy rather than productive.
The verification habit does not relax here. A tool that reads fifty pages instead of one is still capable of confidently summarising the wrong page, and now it has produced a polished document around the mistake. Check the load-bearing facts exactly as you would otherwise. Pricing and free allowances change, so look at the current terms yourself.
Try GenSparkThe habit worth keeping
Treat every AI briefing as a well informed colleague talking from memory in a corridor. Enormously useful for getting oriented in five minutes. Not something you quote in a board paper without looking it up first.
๐ Quiz
Question 1 of 4Why are AI hallucinations particularly dangerous in research?