Skip to content

Add dedicated EPSS score model and related pipeline - #2487

Draft
Samk1710 wants to merge 7 commits into
aboutcode-org:mainfrom
Samk1710:enhance-epss-model
Draft

Samk1710 wants to merge 7 commits into
aboutcode-org:mainfrom
Samk1710:enhance-epss-model

Conversation

@Samk1710

Copy link
Copy Markdown
Contributor

Resolves: #2472

  • Add a new EPSSScore model and migration
  • Add EPSSPipeline pipeline (ingests daily and prunes scores older than 90 days) and its tests
  • Update advisory detail view & template to use EPSSScore
  • Update rRelateSeveritiesPipeline
  • Remove deprecated EPSS importer code
image URL: http://127.0.0.1:8001/advisories/pysec/PYSEC-2006-1

Pipeline logs:

python manage.py improve epss_pipeline
Improving data using epss_pipeline
INFO 2026-10-28 14:34:11.034266 UTC Pipeline [EPSSPipeline] starting
INFO 2026-10-28 14:34:11.034443 UTC Step [fetch_and_bulk_load_scores] starting
INFO 2026-10-28 14:34:11.034520 UTC Fetching EPSS data from https://epss.cyentia.com/epss_scores-current.csv.gz
INFO 2026-10-28 14:34:18.670760 UTC Parsed 396,966 EPSS scores for 2026-10-28.
INFO 2026-10-28 14:34:46.795641 UTC Successfully inserted 396,966 EPSS scores for 2026-10-28
INFO 2026-10-28 14:34:46.943299 UTC Step [fetch_and_bulk_load_scores] completed in 36 seconds
INFO 2026-10-28 14:34:46.943478 UTC Step [prune_old_scores] starting
INFO 2026-10-28 14:34:46.999132 UTC Pruned 0 EPSS records older than 2026-07-30 (retention: 90 days)
INFO 2026-10-28 14:34:46.999325 UTC Step [prune_old_scores] completed in 0 seconds
INFO 2026-10-28 14:34:46.999398 UTC Pipeline completed in 36 seconds

Signed-off-by: Sampurna Pyne <sampurnapyne1710@gmail.com>
Signed-off-by: Sampurna Pyne <sampurnapyne1710@gmail.com>
Signed-off-by: Sampurna Pyne <sampurnapyne1710@gmail.com>
Signed-off-by: Sampurna Pyne <sampurnapyne1710@gmail.com>
Signed-off-by: Sampurna Pyne <sampurnapyne1710@gmail.com>
Signed-off-by: Sampurna Pyne <sampurnapyne1710@gmail.com>
Signed-off-by: Sampurna Pyne <sampurnapyne1710@gmail.com>

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Do not treat EPSS score as advisory

1 participant