Skip to content

Update EIA 757A column mapping to correctly rename columns#5107

Merged
e-belfer merged 4 commits intomainfrom
fix_ng_column_maps
Mar 20, 2026
Merged

Update EIA 757A column mapping to correctly rename columns#5107
e-belfer merged 4 commits intomainfrom
fix_ng_column_maps

Conversation

@e-belfer
Copy link
Copy Markdown
Member

@e-belfer e-belfer commented Mar 18, 2026

Overview

Closes #4722

What problem does this address?

EIA 191 and 757A extraction was not renaming columns as expected. The problem is partially addressed in #5058, but this extends the solution to EIA 757A.

What did you change?

Correctly call the any_year partition in the extractor. Rename the columns to match our naming protocols rather than the exported names from EIA, and test that the raw columns are correctly renamed.

Testing

How did you make sure this worked? How can a reviewer verify this?
Test the extraction and verify that column names are not what they were in the original source files.

To-do list

  • Run pixi run pre-commit-run to run linters and static code analysis checks.
  • Run pixi run pytest-ci locally to ensure that the merge queue will accept your PR.
  • Review the PR yourself and call out any questions or issues you have.

@e-belfer e-belfer self-assigned this Mar 18, 2026
@e-belfer e-belfer added bug Things that are just plain broken. eia757a Issues related to EIA Form 757a: Natural Gas Processing Plant Survey csv Issues related to working with / extracting data from CSV files labels Mar 18, 2026
@e-belfer e-belfer moved this from New to In progress in Catalyst Megaproject Mar 18, 2026
@e-belfer e-belfer marked this pull request as ready for review March 20, 2026 14:25
@e-belfer e-belfer moved this from In progress to In review in Catalyst Megaproject Mar 20, 2026
@e-belfer e-belfer requested a review from zaneselvans March 20, 2026 14:26
@e-belfer e-belfer added this pull request to the merge queue Mar 20, 2026
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to failed status checks Mar 20, 2026
@e-belfer e-belfer added this pull request to the merge queue Mar 20, 2026
Merged via the queue into main with commit 9b8dc97 Mar 20, 2026
15 checks passed
@e-belfer e-belfer deleted the fix_ng_column_maps branch March 20, 2026 16:06
@github-project-automation github-project-automation bot moved this from In review to Done in Catalyst Megaproject Mar 20, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bug Things that are just plain broken. csv Issues related to working with / extracting data from CSV files eia757a Issues related to EIA Form 757a: Natural Gas Processing Plant Survey

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

Correctly rename columns for EIA 176/191/757A data

2 participants