Skip to content

Add selected loss.py targets to unified calibration #946

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
anth-volk wants to merge 2 commits into
base: main
Choose a base branch
from
Open

Add selected loss.py targets to unified calibration #946

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
1a7ad39
Add selected loss.py targets to unified calibration
anth-volk May 11, 2026
63feccf
Fix SOI domain target uprating
MaxGhenis May 14, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions changelog.d/945.added
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
Added selected legacy `loss.py` target families to unified calibration target ETL and selection.
68 changes: 68 additions & 0 deletions policyengine_us_data/calibration/target_config.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -48,15 +48,23 @@ include:
# REMOVED: is_pregnant — 100% unachievable across all 51 state geos
- variable: snap
geo_level: state
- variable: household_count
geo_level: state
domain_variable: snap
- variable: tanf
geo_level: state
- variable: adjusted_gross_income
geo_level: state
- variable: rent
geo_level: state
- variable: spm_unit_count
geo_level: state
domain_variable: tanf
- variable: eitc
geo_level: state
- variable: tax_unit_count
geo_level: state
domain_variable: eitc
- variable: refundable_ctc
geo_level: state
- variable: non_refundable_ctc
Expand Down Expand Up @@ -107,6 +115,42 @@ include:
- variable: adjusted_gross_income
geo_level: national
domain_variable: adjusted_gross_income,filing_status,income_tax_before_credits
- variable: tax_unit_count
geo_level: national
domain_variable: adjusted_gross_income,income_tax_before_credits,irs_employment_income
- variable: irs_employment_income
geo_level: national
domain_variable: adjusted_gross_income,income_tax_before_credits,irs_employment_income
- variable: tax_unit_count
geo_level: national
domain_variable: adjusted_gross_income,filing_status,income_tax_before_credits,irs_employment_income
- variable: irs_employment_income
geo_level: national
domain_variable: adjusted_gross_income,filing_status,income_tax_before_credits,irs_employment_income
- variable: tax_unit_count
geo_level: national
domain_variable: adjusted_gross_income,income_tax_before_credits,pension_income
- variable: pension_income
geo_level: national
domain_variable: adjusted_gross_income,income_tax_before_credits,pension_income
- variable: tax_unit_count
geo_level: national
domain_variable: adjusted_gross_income,filing_status,income_tax_before_credits,pension_income
- variable: pension_income
geo_level: national
domain_variable: adjusted_gross_income,filing_status,income_tax_before_credits,pension_income
- variable: tax_unit_count
geo_level: national
domain_variable: adjusted_gross_income,income_tax_before_credits,social_security
- variable: social_security
geo_level: national
domain_variable: adjusted_gross_income,income_tax_before_credits,social_security
- variable: tax_unit_count
geo_level: national
domain_variable: adjusted_gross_income,filing_status,income_tax_before_credits,social_security
- variable: social_security
geo_level: national
domain_variable: adjusted_gross_income,filing_status,income_tax_before_credits,social_security

# === NATIONAL — wealth target (Federal Reserve SCF, no filer filter) ===
- variable: net_worth
Expand All @@ -126,6 +170,9 @@ include:
domain_variable: medicare_enrolled
- variable: medicare_part_b_premium
geo_level: national
- variable: medicare_part_b_premium
geo_level: national
domain_variable: age
- variable: real_estate_taxes
geo_level: national
- variable: rent
Expand All @@ -149,6 +196,9 @@ include:
- variable: spm_unit_count
geo_level: national
domain_variable: tanf
- variable: household_count
geo_level: national
domain_variable: spm_unit_energy_subsidy_reported
- variable: tip_income
geo_level: national
- variable: unemployment_compensation
Expand Down Expand Up @@ -280,6 +330,12 @@ include:
- variable: unemployment_compensation
geo_level: national
domain_variable: unemployment_compensation
- variable: refundable_american_opportunity_credit
geo_level: national
domain_variable: refundable_american_opportunity_credit
- variable: education_tax_credits
geo_level: national
domain_variable: education_tax_credits

# === NATIONAL — IRS SOI filer count targets (restored: |rel_err| < 10%) ===
- variable: tax_unit_count
Expand Down Expand Up @@ -311,6 +367,18 @@ include:
- variable: tax_unit_count
geo_level: national
domain_variable: total_self_employment_income
- variable: tax_unit_count
geo_level: national
domain_variable: refundable_american_opportunity_credit
- variable: tax_unit_count
geo_level: national
domain_variable: education_tax_credits
- variable: tax_unit_count
geo_level: national
domain_variable: real_estate_taxes,tax_unit_itemizes
- variable: tax_unit_count
geo_level: state
domain_variable: real_estate_taxes,tax_unit_itemizes

# === NATIONAL — identity / population count targets from old loss.py ===
- variable: person_count
Expand Down
1 change: 1 addition & 0 deletions policyengine_us_data/db/create_field_valid_values.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -70,6 +70,7 @@ def populate_field_valid_values(session: Session) -> None:
source_values = [
("source", "Census ACS S0101", "survey"),
("source", "IRS SOI", "administrative"),
("source", "IRS EITC Central", "administrative"),
("source", "CMS Marketplace", "administrative"),
("source", "CMS 2024 OEP state metal status PUF", "administrative"),
("source", "CMS Medicaid", "administrative"),
Expand Down
Loading