Status Page
Changelog
Back to All

Agnitio Changelog

about 2 months ago by ReadMe API

All notable changes to this project will be documented in this file. To read
more about data methodology changes, see
the data changelog.

If you have questions, please contact us by emailing our engineering team at
[email protected].

November 2024

Added a /status endpoint

A /status endpoint was added to help us track and maintain the status of our systems.

January 2022

Deprecation of annual UK Economic Activity data

We will be transitioning from annual updates to quarterly updates for the UK economic activity data from the APS. This will provide users more up-to-date economic activity data. The quarterly data represents a complete year (four quarters) of data ending in the given quarter. Users can replicate the results of the original endpoint by querying Q4 of each year.

Fall 2021

Breaking change in UK further education dataset

We will be adding another year of data to the EMSI.UK.FurtherEducation dataset which will mean that API users will no longer be able to query metrics without specifying a year. For example, you will need to request "Achievements.2020" instead of simply requesting "Achievements".

November 2021

Removal of deprecated US dataset

Due to data errors and lack of use, the EMSI.US.EducationalAttainment.ACS will not be included in the 2021.4 and later US data versions.

October 2021

Removal of "percent" metrics in staffing patterns datasets

We will be removing the percent metrics from our staffing patterns datasets in the US, Canada, and the UK. This metric will be removed in the next datarun for each country.

Metric changes in Emsi US Unemployment datasets

September 15, 2021

Metric changes in EMSI.US.LaborForce

  • New: WorkingAgePopulation. Civilian non-institutionalized population aged 16-64.
  • New: LaborForcePopulation. Civilian non-institutionalized population aged 16+.
  • New: WorkingAgeLFPR. (Employment+Unemployment)/WorkingAgePopulation.
  • New: LFPR. (Employment+Unemployment)/LaborForcePopulation.
  • Deprecated: EmployablePopulation. Renamed to WorkingAgePopulation.
  • Deprecated: LaborForceParticipationRate. Renamed to WorkingAgeLFPR.

August 9, 2021

New endpoints:

CIP 2020

With the 2021.3 US data version, Emsi is updating from CIP 2010 to CIP 2020 for IPEDS completions data. For more information about CIP codes, see the CIP user site. This update affects the following datasets:

Removal of deprecated US datasets

The 2021.3 US data version will not include the following deprecated datasets:

Breaking changes to US labor force dataset

In our US EMSI.US.LaborForce dataset, we deprecated our Population metric in favor of a new EmployablePopulation metric. This new metric represents total civilian noninstitutionalized population between the ages of 15 and 64. The prior Population metric represented total population over the age of 15, so it included people who should not be included when calculating labor force participation rate, including retirees, inmates, and residents of care facilities.

July 30, 2021

Removal of deprecated UK datasets

The 2021.2 UK data version will not include the following deprecated datasets, because they have been combined into the single endpoint EMSI.UK.HigherEducation. We also switched the metric name to the British spelling: "enrolments".

Addition of UK historical occupation earnings percentiles

The 2021.2 UK data version will include UK historical occupation earnings percentiles for 2011 to current earnings year in the EMSI.UK.Occupation endpoint.

June 4, 2021

New endpoint:
EMSI.US.Commuting

April 16, 2021

Breaking changes with the 2021.2 US data version

With the 2021.2 US data version, we added single-age detail to the AgeGroup dimension in the EMSI.US.Demographics dataset. The current AgeGroup dimension has a total (code 0) and eighteen age groups (codes 1-18). The new AgeGroup dimension has an additional third level that represents single ages, using codes 0-85, (code 85 represents anyone 85 or older). Unfortunately, the new codes conflict with the existing codes, so the old codes will be modified as defined by this mapping. We will not be retroactively changing previous data versions.

  • Level 1 (existing): 0 -> T
  • level 2 (existing): 1-18 -> G1-G18
  • Level 3 (new): 0-85

For consistency with other endpoints, the following constraints have been renamed:

The following experimental endpoints do not exist in the 2021.2 US data version, as the data has been combined into Emsi.US.Occupation and Emsi.US.Industry, respectively. The format has been backported to the 2021.1 US data version; the experimental endpoints have not been removed.

April 15, 2021

New endpoint:
EMSI.US.Enrollments.Distance

April 6, 2021

New endpoints:

February 26, 2021

Removal of deprecated dataset

The 2021.1 US data version does not include the JSA Claimant Counts dataset because it is no longer considered reliable. The dataset is replaced by Emsi.UK.Unemp.

January 25, 2021

New endpoint:
Emsi.US.QCEW.Quarter

New occupation classification for Emsi.US.Nioem.Raw

The BLS updated the occupation classification for the National Employment Matrix to match that of the Occupational Employment Statistics (OES).

However, we did find one discrepancy between the two occupation classifications that we believe to be a mistake made by the BLS when creating the 2019 NIOEM data. We have contacted them to see if they will resolve it. In the meantime, here are the details: OES classifies 17-3098 as a child of 17-3020, but NIOEM classifies 17-3098 as a direct child of 17-3000. We have inserted a midlevel code to keep consistency with the rest of the classification, so 17-3098 is the only child of 17-3090 which is a direct child of 17-3000.

December 17, 2020

New endpoint:
Emsi.CA.Commuting

November 6, 2020

New endpoints:

October 27, 2020

Updated Canada release notes

The Canada data release notes can be found here.

October 12, 2020

New endpoint:
Emsi.CA.WorkforceDemographics

Improved Detail for Canada Completions

PSIS data granularity has been significantly improved. CIP detail has been expanded from the 4- to the 6-digit CIP level. In addition, PSIS data now also includes a Credential dimension, which is the level of education previously achieved by the student. For more information about the Credential dimension and a description of the codes in it, see Statcan's descriptions.

Note that the Credential dimension should not be confused with the Award Level dimension, which is the context in which a program is offered (i.e. the level of the studies and whether the student is seeking the degree as preparation for a career or for further studies). For more information about the Award Level dimension and a description of the codes in it, see Statcan's descriptions.

October 7, 2020

New endpoints:

Removal of deprecated datasets

The 2020.4 US data version will not include the following deprecated datasets:

  • Emsi.US.Occupation.ZIP
  • Emsi.US.Occupation.Residence
  • Emsi.US.Occupation.Residence.ZIP
  • Emsi.US.Industry.ZIP
  • Emsi.US.Industry.Month.ZIP
  • Emsi.US.Staffing.ZIP
  • Emsi.US.Demographics.ZIP

September 5, 2020

New experimental endpoint:
Emsi.US.Occupation.Tract

August 6, 2020

New endpoint:
Emsi.UK.Unemp

Added MSA geography detail to Emsi.US.CES.Industry.Month

Emsi.US.CES.Industry.Month now has MSA data in addition to the previously
available nation and state data. To request MSA level data, prepend the MSA
code with "MSA" (e.g. to request Albuquerque, NM use "MSA10740").

July 27th, 2020

Change in Occupation Classification (Emsi SOC 2019)

With the 2020.3 US data version, Emsi is now using a SOC2018-based transitional
occupation classification called Emsi SOC 2019. See the data
changelog for
more information.

July 21, 2020

New endpoint:
Emsi.US.EducationalAttainment.Age

June 26, 2020

New experimental endpoint:
Emsi.US.Industry.Tract

May 22, 2020

New endpoint:
Emsi.US.CES.Industry.Month

April 28, 2020

Format changes and corresponding deprecations

With the release of the 2020.2 US data version, we are making an effort to simplify
the user experience for many of our core datasets. Essentially, we are adopting
the experimental format released in January. Nation, state, MSA, county, and
ZIP code data are now available from a single unified endpoint for these
datasets:

  • Emsi.US.Occupation
  • Emsi.US.Industry
  • Emsi.US.Industry.Month
  • Emsi.US.Staffing
  • Emsi.US.Demographics (also includes Census Tracts)

The ZIP version of these datasets is now deprecated in the 2020.2 US data version
and will no longer updated beginning with the 2020.4 US data version. Additionally,
occupation data by place of residence has been combined into Emsi.US.Occupation
as a separate metric, and Emsi.US.Occupation.Residence will no longer be updated
beginning with the 2020.4 US data version. Lastly, demographics data currently has
a third endpoint for Census Tract data that is now deprecated and rolled into
the unified Emsi.US.Demographics endpoint.

Complete list of deprecations that will not be updated after 2020.1:

  • Emsi.US.Demographics.Tract

Complete list of deprecations that will not be updated after 2020.3:

  • Emsi.US.Occupation.ZIP
  • Emsi.US.Occupation.Residence
  • Emsi.US.Occupation.Residence.ZIP
  • Emsi.US.Industry.ZIP
  • Emsi.US.Industry.Month.ZIP
  • Emsi.US.Staffing.ZIP
  • Emsi.US.Demographics.ZIP

March 20, 2020

Made internal updates to memory utilization strategies to improve performance and scalability.

January 17, 2020

Experimental endpoint for occupation data

In preparation for upcoming changes, we've published an experimental occupation
dataset (Emsi.US.Occupation.Experimental) that combines all types of geography
into a single endpoint. Currently, Emsi.US.Occupation returns data for the
nation, states, and counties and Emsi.US.Occupation.ZIP returns data for ZIP
codes. The experimental format combines these two dataset and also adds MSA.
State and MSA areas are mutually exclusive because frequently MSAs cross state
lines and therefore cannot be queried together in the same aggregate mapping.
You are free to query nation, state, and county data as before, but ZIP and MSA
data need to have "ZIP" or "MSA" prepended to the area. So "83843" would become
"ZIP83843".

August 12, 2019

Agnitio 5 release

  • Utilizes new parallelization architecture to improve query speeds by up to 1000x
  • Complete rewrite of the API