How to Use Public Databases First

Exhaust open portals and bulk datasets before FOIA or interviews — free records beat slow asks when the data is already online.

How to Use Public Databases First
Key Takeaways
The methodExhaust open portals and bulk datasets before spending weeks on requests and calls.
Why it mattersYou avoid asking agencies for records already online and you arrive at interviews with receipts.
On GnosisLog each database hit as a dated pin with a primary label when you opened the record.

FOIA and interviews are tools. They are expensive in time. Public databases — courts, procurement, inspections, campaign finance, corporate registries — often answer half the claim before you write a letter. Indie investigators who skip portals burn months.

Build a portal checklist for your beat

For each beat, list the five databases that reliably emit records. Save search URLs, not just homepage links. If a portal needs an account, create it once and store credentials securely.

Examples: PACER or state court search, SAM.gov or state procurement, OSHA or local inspection boards, FEC or state campaign finance, secretary of state business search. Your list will differ — the method is the checklist.

Search with the claim’s nouns

Use exact entity names, contract numbers, docket numbers, and date ranges from documents you already have. Broad keyword fishing returns noise. When you find a hit, download or print-to-PDF immediately — portals change.

Record the query you ran and the date. That note becomes part of your methods trail if someone later asks how you found the exhibit.

Know when databases are not enough

Missing fields, sealed cases, and non-digitized archives still require FOIA, clerks, or interviews. Use database gaps as precise asks: “the inspection report number cited in this portal entry for March 2025.”

Never treat a database summary line as a substitute for the underlying PDF when the claim is load-bearing. Climb to primary.

Feed the Evidence Board, not a bookmark graveyard

Each useful hit should become a pin with URL, date, and credibility label. Bookmarks without pins are how evidence disappears before publish week.

On Gnosis, start from the free Starter Kit claim box, then attach database exhibits as you work.

Do this next on Gnosis

Use the free Investigator Starter Kit to put this method on one page, then open Gnosis and start the investigation. Premium unlocks the full Evidence Board on Pricing.

More Methods: Investigation Methods hub.

Make database work weekly

Put portal checks on your beat calendar the same way you would put a FOIA follow-up. Thirty focused minutes with saved queries beats a monthly panic search. Capture candidates in a log with URLs and one-line relevance to a claim.

When a portal is down or rate-limited, note the outage time. Retry later rather than inventing the contents from memory or a secondary tweet. Teach your future self which portals flake and which are stable.

Share sanitized query tips in your Methods notes so a collaborator can reproduce the hit. Reproducibility is part of checkable journalism even before you publish.

Keep a short private checklist for this method and revisit it on every story until it is automatic. Indie investigators do not have a newsroom hallway to catch slips, so the checklist is the hallway. When something feels inconvenient — downloading the portal PDF, writing the correction note, killing a tip — that inconvenience is usually the signal that the method is working. Readers will not see your discipline directly; they will feel it as fewer walk-backs and clearer exhibits.

Link back to the Investigation Methods hub when you publish so the next guide in the catalog is one click away. Practice on Gnosis with pins that match what you wrote here, and use the free Investigator Starter Kit when you need the one-page version of claim, sources, and first publish.

Sources

Comments