[delexagon]

Summary

Added a pipeline to fetch roll call votes.

Description

• Creates a votes Firestore collection to store rollcall votes. The individual votes for rollcalls are collected into votes/${branch}-${court}-${number}/vote.
• House rollcall votes are collected via PDF, by iterating through the endpoints at https://malegislature.gov/RollCall/${court}/HouseRollCall${number}.pdf.

Next steps

• Currently, senate roll calls are fetched from the API. Unlike house roll calls, the API/pdfs do not have enough information to relate these roll calls back to the bills they affect. Committee votes would be useful to have in a searchable format, but these are also only present in bills. Therefore, although the house roll call scraping cannot be altered, both senate roll calls and committee votes should probably be fetched through the bill scraper instead.
• Amendments are present in the Question field in the API, and are also listed in the Question field with my scraping procedure. When a roll call is based on an amendment, we may want to retrieve this amendment text as well and add some sort of flag.

Steps to test/reproduce

1. Check that the created yarn firebase-admin run-script backfillRollCalls --env local --branch House --court 193 --number 3 works
2. Check that the curl 'http://localhost:5001/demo-dtp/us-central1/triggerPubsubFunction?scheduled=scrapeHouseRollCalls' does not run into problems
3. Can run yarn test for scrapeRollCall - small text extraction test

[vercel]

The latest updates on your projects. Learn more about Vercel for GitHub.

Project	Deployment	Actions	Updated
maple-dev	Ready	Preview	Oct 21, 2026 3:19am UTC

[Mephistic]

Love this! Super annoying that there's not a great way to get a list of House Roll Calls, but given that roll calls monotonically increment from 1 by 1, I think your solution should work fine here.

I know we still have some changes outstanding per our discussion at the last hack night re: the Senate Roll Call scraper that we can discuss when they're ready.

[delexagon]

Doing more testing rn

[delexagon]

I can't seem to get the pubsubs to fire through curl, my own or previous ones. Is that a known problem with the v2 migration, or just something happening locally?