fintols

How to Verify ChatGPT's Financial Numbers

How to fact-check the numbers ChatGPT gives you: the 10-K and 10-Q on SEC EDGAR, the earnings release, four checks and a worked example.

To verify a figure from ChatGPT, find it in the primary source: the 10-K or 10-Q on SEC EDGAR for a US company, the official annual report elsewhere, or the earnings release. Check the figure, the unit, the period and the date. If you cannot find it, discard it.

Short answer: to check a number from ChatGPT, find it in the primary source. For a US company that is the 10-K or 10-Q on SEC EDGAR; for others, the official annual report; and the company's own earnings release for recent results. Check four things (the figure, the unit, the period and the date) and, if you cannot find it, discard it.

Key takeaways

See the Apple analysis in 10 seconds

What you just read, applied to Apple. A preview with real data:

See the full Apple analysis free → Already done: nothing to type.

1. Why you have to verify

A language model does not query a database by default; it generates probable text. CNMV Working Paper No. 96, Large Language Models and Stock Investing: Is the Human Factor Required?, notes that these models can use old or invented data and only improve with human supervision and official sources. Verifying is not excess distrust; it is the step that turns a draft into usable information. This is how to answer "is ChatGPT reliable for investing?": reliable as a reader of text you provide, not as a source of numbers you did not.

2. Where each fact lives

What you needUS companyCompany outside the US
Revenue, profit, debt10-K (annual) and 10-Q (quarterly) on SEC EDGARAnnual report and audited accounts on the investor relations site
Disclosed risks"Risk Factors" section of the 10-KRisk section of the annual report
Latest resultsEarnings release (usually filed in an 8-K)Results presentation and press release
Dividend10-K and company announcementsAnnual report and company announcements

3. The process, step by step

  1. Write down the figure exactly as ChatGPT gave it, with the unit and period it mentioned (or the lack of them).
  2. Open the official document and search for the exact term in the income statement, balance sheet or notes.
  3. Compare the figure. Does it match? Is it consolidated or from a subsidiary?
  4. Compare the unit. Thousands versus millions is the most common error. A difference of a thousand times is rarely a coincidence.
  5. Compare the period. Is it the full year, a quarter or a year to date? Some companies have a fiscal year that does not match the calendar year.
  6. Note the publication date of the document. If a newer one exists, use that.
  7. If you cannot find it, discard it and do not carry it into your analysis.

4. Verifying ratios

Ratios (P/E, margin, net debt to EBITDA) are computed from figures and a price. Check separately:

If the model gives a P/E without saying which earnings and which price it used, it cannot be verified.

You are halfway through

Keep reading free.

Create your free account to continue reading “How to Verify ChatGPT's Financial Numbers”.

No card required

That easy

Three steps. Zero spreadsheets.

  1. 1Search a companyBy the name you know it: Apple, Inditex, Santander… ETFs too.
  2. 2Fintols does the homeworkIt reads the official filings, runs the numbers and writes the analysis for you.
  3. 3You analyze and decideWith the five answers clear, you decide. And you save the analysis to review it when the price moves.
Analyze any stock free
Analyze AAPL free