How to test a multi-state legislative tracker for accuracy and timeliness

Short answer: test it against the legislatures. Pick bills that moved this week, open each on the legislature’s own site, and check the tracker’s status, last action and date against it. Then look for the bills it should have found and did not. Five tests, below, take about a week and tell you more than any demo.

Why the claims do not help

Every multi-state service says it covers all 50 states and updates in real time. Both claims can be true in some states and false in others, because each legislature publishes on its own schedule and in its own format. Some post committee actions within hours; some post them days later; some publish bill text long after the bill is filed. A tracker inherits all of that. The useful question is how accurate it is, in which states, for which signals.

You can answer that yourself. The legislature’s own website is the record, and every test below compares a tracker against it.

1. The status test

Pick 20 bills that moved in the last week across five states you care about. Open each on the legislature’s site. For each, check three things in the tracker:

• Status. Does it show the same stage (in committee, passed one chamber, enrolled, signed)?
• Last action. Is the latest action there, in the legislature’s words or a faithful version of them?
• Date. Is the action dated when it happened, not when the tracker found it?

The third one is the easiest to miss. A tracker that dates actions by when it noticed them will show a hearing as “this week” that happened last month.

2. The lag test

For the same 20 bills, note when the legislature posted the latest action and when the tracker showed it. Do it on three days in one week. You are looking for the pattern by state: a service can be same-day in one legislature and a week behind in another, and the average hides that.

Run this during session. Most legislatures adjourn by early summer, and in July every tracker looks current because nothing is moving. The session calendar guide shows which legislatures are sitting when.

3. The missed-bill test

This is the one that matters. A wrong status is visible; a missing bill is not.

Write down the bills you already know about in your practice area this session, from client work, bar alerts, trade press or a colleague. Then count how many the tracker found on its own, without you searching for them by number. Every bill on your list that it missed is one it would have missed when you did not know to look.

Then reverse it: count the relevant bills the tracker found that were not on your list. That number is most of what you are paying for.

4. The completeness test

Pick one state and one session. The legislature’s site will tell you how many bills were introduced. Ask the tracker how many it holds for that session. The counts will rarely match exactly, since some services skip resolutions or memorials, but a large gap means bills that never entered the system and can never match anything.

Do the same for bill text. Open ten bills in the tracker and check that the full text is there, not only the title. A tool that matches on titles alone is matching on the least informative thing about a bill.

5. The source test

For any bill the tracker shows, can you click through to the legislature’s own page for it in one step? A service that links every bill to its source is inviting you to check it. One that does not is asking you to trust it, and a lawyer who forwards a status to a client needs to be able to check it in seconds.

What to ask the vendor

Before the trial, ask for:

• The expected lag by state, in days, during session.
• Which signals it covers in each state: bills, actions, text, hearings, votes.
• How it dates an action.
• What happens when a legislature’s site changes format, and how long recovery takes.

A vendor that can answer by state has measured it. One that answers “real time, all 50 states” has not.

How LawSignals handles it

This is our product, so read this section with that in mind. LawSignals covers all 50 states, DC and Congress, updated daily, with federal rules from the Federal Register. Every bill links to the legislature’s own page for it, so every status in the feed and in the report can be checked at the source. Each action is dated when it happened, and the monthly report says what moved in that month. Tracker scopes are model-drafted and not attorney-reviewed.

Run the five tests on us as well. The published reports are open, so you can check a month of statuses against the legislatures before you sign up, and the coverage page lists what is covered. Then start the 14-day trial during session and run the missed-bill test on your own practice area.

---

Related reading: Government legislation tracker tools compared, how to track bills across all 50 states, and state legislative data sources.