Over the next two months, Burning Glass Technologies will be rolling out data improvements boosting the comprehensiveness of the data and creating a more detailed and representative picture of the job market.
The job market is a moving target in several ways:
- · Changes in the jobs themselves
- · Changes in how many jobs are posted online
- · Changes in the specific sources (websites and job feeds)
We are continually reviewing our aggregation, deduplication, and processing to give the best possible picture of the market. Periodic adjustments are going to be necessary (even the BLS has to adjust the monthly jobs report after the fact). In this case, we are making major improvements to our aggregation—the technology that collects and deduplicates job postings. These changes will enable us to gather and process significantly more jobs with greater accuracy.
The overall aggregation improvements are an ongoing process continuing through the end of the year, with the first set of enhancements being implemented on Nov. 11, 2019. That first set of improvements will increase job counts by 17% for the U.S., providing a more comprehensive view of the market. We expect that later updates will also increase job counts. All changes will also be made retroactively for continuity and consistency. We will provide more details as the process proceeds.
An important consideration to us in evaluating these changes was that our data remain representative of the overall job market. Our analysis shows that Burning Glass data correlate closely with federal JOLTS jobs data, both before and, even more so after our revisions. Detailed analyses find minimal changes in results involving top employers, occupations, skills, and geographies.
As part of this process, we are also correcting a problem in our data. As the result of a change in data sources earlier this year, roughly 1,500 employers representing 4% of all 2019 postings were erroneously left out of Labor Insight. The postings were collected but not processed or displayed in the Labor Insight dashboard. At the time, we believed that these postings, although valid, would impact the continuity of our data products. However, further analysis shows that restoring these postings results in only minor shifts for results involving top employers, occupations, skills, and geographies.
We understand, however, that this is a more serious problem for clients who rely on us for a detailed look at employers in their region. Please contact your Customer Success representative for assistance in reviewing any reports you would like to revisit.
Burning Glass deeply regrets the error involving the omission of postings from these 1,500 employers. We know how much our customers rely on our data and that, in this case, we did not meet our high standards for accuracy and reliability. Our Customer Success team is ready to work with clients to correct any problems you may have or to help you in validating previous analyses.
The total effect of these changes will be to provide a more comprehensive, detailed view of the job market. Many thanks for your patience as we implement these changes, and again, please accept our apologies.