What Job Boards Need to Ask Before Buying AI-Scraped Jobs Data
A new wave of jobs data vendors is making the same pitch: legacy providers are slow and expensive,…
Insights
Thought Leadership & Industry Deep-Dives
From custom job scraping to real-time labor market updates, news, research, product updates, and data stories from the Aspen Tech Labs team
Insights
JobsIndex Hits 11 Million Jobs: What Our Global Expansion Means for You
JobsIndex, the largest database of active jobs, crossed 11 million live job listings earlier this year. That number…
The Best Job Scraping Delivery Method for You: XML vs. API
One question we frequently hear from job boards is: “Which delivery method is better, XML or API?” Before…
Aspen’s Jobs Data: What’s Live, Where to Find It, and What It Means for Buyers
Our job posting data is now available in more places than ever, via direct API, on developer marketplaces,…
Salary Information in Job Listings: Why Include it if it’s Not Mandatory?
Traditional wisdom holds that employers shouldn’t include a salary in job listings. The thinking: not disclosing salary gives…
Is Web Scraping Legal? Yes. Here’s Why Courts Keep Agreeing
In 2022, a US Circuit Court of Appeals answered the “is web scraping legal” question once and for…
Harness the Power of the Past: 4 Use Cases for Historical Job Market Data
We love expired job listings. And you should, too. Don’t get us wrong: expired job listings are no…
The Ethics of Web Scraping: Why We Don’t Scrape Job Boards
We help our customers power their job boards by scraping jobs from around the internet. But we don’t…
Job Scraping vs. Organic Job Feeds: Which Is the Right Jobs Data Solution for You?
One question we hear a lot from current and potential customers is: “What’s the difference between JobsIndex (organic…
How to Keep Your Web Scrapes Out of the Courtroom
Web scraping is, once again, in the news and under attack. In the past few months, both Meta…
How College Recruiter Expanded its Reach with Aspen Tech Labs
The online job advertising space has grown much more saturated and competitive since Indeed was founded back in…
Why Our Customers Use JobsIndex vs. Taking Paid Job Feeds from Aggregators
There are two main ways to significantly increase the content on your job board as you build out…
The Value of Job Scraping Today: A Q&A with Aspen Tech Labs Founder Michael Woodrow
Our CEO and founder, Michael Woodrow, recently had the pleasure of speaking on the podcast Job Board Secrets,…
Why Now Is the Time to Increase Organic Listings on Your Job Board
According to the most recent data from the Bureau of Labor Statistics (BLS), open positions now outnumber unemployed…
4 Best Practices for Keeping Your Job Listing Web Scrapes Up and Running
Online job boards make life easier for businesses and employment candidates. But for job boards to provide the…
How (and Why) to Optimize Your Job Listings for Google for Jobs
In the last decade, Google has tried its hand at everything from selling insurance to social media to…
4 Ways to Improve the User Experience of Your Job Board
The job market is facing nearly unprecedented levels of turnover. In fact, more than 4.5 million workers in…
How to Stop Sending Job Applicants to 404 Pages
In recent posts, we’ve addressed common reasons web scrapes stop working and best practices for ensuring the scrapes…
3 Common Problems with Web Scrapes for Job Listings
A correctly configured web scrape consistently drives value for a job board. But ensuring that a scrape – never…
When to Outsource Web Scraping for Your Job Board
Eighty-two percent of employers use job boards to attract talent, and at least 60 percent of job seekers…
Niche Job Boards Are Gaining Ground, but Generalist Platforms Still Lead on Google for Jobs
Google for Jobs (GFJ) has become one of the most influential job search platforms in the United States.…
How Job Boards Are Using AI Tools and Why Adoption Is Uneven Across Industries
AI has become embedded in hiring technology far faster than many job seekers realize. While headlines often focus…
How Recruitment Tech Companies Can Use Labor Market Data as Sales Intelligence
Whether your sales team is five people or 500, one of the most important factors in its success…
3 Ways to Grow Your Business with Real-Time Wage Data
Since Colorado’s pay transparency law took effect in 2021, nine other states and Washington, DC, have passed and…
How Hedge Funds Use Job Posting Data to Make Smarter Investment Decisions
Why Timing Matters in Hedge Fund Strategy For hedge funds, an edge often comes from seeing what others…
Hiring Signals and Competitive Intelligence for Job Boards
Across the hiring landscape, job postings serve as early indicators of employer activity and strategy. Using data from…
The Global Push for Wage Transparency: How Employers Are Responding in 2025
Salary transparency has moved from a patchwork of local rules to one of the most significant global labor…
The Jobs Number You Read Is Already Wrong
The economy added 172,000 jobs in May. Here is what actually drove it. 70,000 of those jobs came…