Building an NFL data ingestion pipeline (open source & feedback welcome)

[u/Sensitive-Soup6474]

Hey all, I got tired of one-off notebooks and scripts, so I’ve been working on a small Python pipeline to go from NFL data sources → normalized tables → rolling features you can actually use for analysis or modeling.

Right now it supports automated data ingestion from:

• Pro Football Reference (stats + box scores)
• PFF (weekly game-level grades for all advanced team stats)

The pipeline then:

• normalizes team IDs
• merges across sources
• creates rolling averages & rankings
• exports analysis-ready datasets (CSV today, easy to extend to parquet / DBs)

The goal is to give people a repeatable starting point instead of single-use notebooks.

I also have a few predictive models built on top of this data that I haven’t open-sourced yet, but I’m happy to share those too if there’s interest.

Repo is here if anyone wants to take a look or poke holes in it:
https://github.com/thadhutch/nfl-data-pipeline