TL;DR
- There are two ways of measuring performance – in the lab and the field.
- Lab data is artificial and collected from a single, predefined device, location, and internet connection.
- Field data is gathered from many users, and you can filter it to focus on a specific user and their experience.
- If you want to verify the real performance experienced by users, you should use field data.
- If you’re working in a testing or debugging environment, feel free to use lab data.
- Both approaches are useful in their way, and for the best results, you can easily combine them.
So, how do you measure web performance?
You may already be familiar with Google’s tools like PageSpeed Insights, Lighthouse, or the CrUX Dashboard in Google Data Studio. Or maybe you’re still looking for a solution.
To make the right choice, you should first know what you want to measure and why.
While most of these tools use similar metrics, they often rely on different data sources. And the essential distinction you need to make is between lab data and field data in web performance.
In this article, we’ll go through the differences between lab and field data to help you make the right choice.
This is because the quality of data you use to optimize your website’s performance will determine how successful you are.
Let’s dive right into it.
Lab data vs. field data
The concept of lab and field data wasn’t invented to measure web performance. It’s been used in various scientific tests to distinguish between the experiments conducted in a laboratory and those conducted outside of it.
Lab data
Lab data is collected in a controlled environment and uses a predefined device and network specifications. This process is called synthetic monitoring.
So, when you measure your web performance with lab tools, they load your website using a predetermined device and connection speed and measure how performant it is.
When it comes to measuring web performance, lab data is useful in reproducing and debugging possible performance issues. While it doesn’t give you insight into your users’ experience, it’s viable if you don’t have access to real-user measurements.
Field data
Field data reflects the browsing experience of real users who use your website. It is affected by the connection and device they’re using while browsing. Field data often unearths the issues that are hard to capture in a lab environment.
Field data is also known as real user monitoring (RUM), real user metrics, real user measurement, or end-user experience monitoring. Google usually uses the term field data.
Web performance data and SEO
Google is using field data to rank your website.
For search rankings, we use field data, as this is what your site’s users have experienced over time. This makes the data more representative for your site, taking into account where your users are located and how they access your website.
John Mueller, Core Web Vitals and SEO
More specifically, Google announced that starting in May 2021, Core Web Vitals will become a part of the ranking algorithm. These three metrics (LCP, CLS, and FID) will influence your rankings, and meeting the thresholds set by Google will be a prerequisite for displaying a badge in search results.
While Googlers have repeatedly said that web performance is currently a minor ranking factor, Google’s initiatives like AMP and Page Experience indicate that web performance might soon become an essential part of Google’s ranking algorithm.
Collecting web performance data
One method of collecting web performance data is to use the relevant JavaScript libraries. By setting up tracking on your own, you get more freedom to precisely choose what you’re trying to measure, and you can send the aggregated results straight to your analytics tool.
However, setting up your own tracking is time-consuming and requires you to have advanced knowledge of JavaScript.
Various third-party services offer to measure your web performance, but most of them also require you to implement code on your end, and they tend to be expensive.
So my recommended method is to use the free tools created by Google.
Tools like Lighthouse and PageSpeed Insights run a quick lab test of your page. They’re easy to use and are convenient when you need a brief overview of your lab performance.
When it comes to field data, Google collects it from Chrome users and stores it in the Chrome User Experience Report (CrUX) .
The data from the CrUX report is accessible through several tools and APIs, which you can choose depending on your specific needs.
While it’s important to note that CrUX doesn’t give you the information about your users on other browsers, I still think CrUX is the ultimate source of web performance data. If you know that many people access your website on different browsers, you may implement additional tracking methods afterward, but CrUX is the best place to start.
Moreover, CrUX contains the same data that Google will use to rank websites when the Page Experience update goes live.
To sum up, using Google’s tools allows you to get a mix of lab and field data that you need to get a thorough understanding of your web performance.
Time to learn about these tools in more detail.
Field Data – Chrome User Experience Report
Field data gathered by Google can be accessed via Chrome User Experience Report (also known as CrUX). The report’s data is aggregated from Google Chrome users who have opted-in to syncing their browsing history, have not set up a Sync passphrase, and have usage statistic reporting enabled.
The list of web performance metrics you can collect from CrUX is impressive:
- First Paint,
- First Contentful Paint,
- DOMContentLoaded,
- onload,
- First Input Delay (FID),
- Largest Contentful Paint (LCP),
- Cumulative Layout Shift (CLS),
- Time to First Byte,
- Notification Permissions,
- Effective Connection Type,
- Device Type,
- Country.
In December 2020, the CrUX database included over 8M origins, and it continues to grow.
The same goes for the metrics available in this report. As the official documentation says:
We hope to add more metrics and dimensions, both to provide more insight into loading and other critical factors that most affect user experience.
So we can expect more metrics to be added to CrUX in the future.
Want to know more about FLD, LCP, and CLS? Check out our Core Web Vitals guide.
Accessing CrUX
You can access the CrUX data with several tools:
- Google Search Console,
- Google Data Studio Dashboard,
- Google BigQuery,
- CrUX API,
- PageSpeed Insights API,
- Google PageSpeed Insights.
If you’re just starting, using the Search Console, Google Data Studio, or PageSpeed Insights is the way to go – these tools are easy to use, although they only give you a sneak peek into what CrUX can offer.
By using Google BigQuery or one of the APIs, you can access more metrics and look at your performance in specific countries, on particular devices, and connection types.
Pros & Cons of Using Google’s Field Data
| Pros: | Cons: |
|---|---|
|
|
|
|
|
|
|
Lab Data
Lab data is artificially collected in the test environment. It doesn’t come from real users but is simulated on a single device, with a predefined location and network connection.
Google’s Lab Data Tools
The most popular lab data tools are:
- Lighthouse,
- PageSpeed Insights (contains a mix of lab and field data),
- Google Dev Tools (or developer tools in other web browsers),
- WebPageTest.
Pros & Cons of Using Lab Data
| Pros: | Cons: |
|---|---|
|
|
|
|
|
|
|
|
Field data or lab data – which one should you use?
If you want to know how real users are experiencing your website, field data is the right choice.
As Google’s Martin Splitt puts it:
Field data is probably a better indicator for how real users are experiencing your website than lab data. Because lab data is literally just someone’s server making a request to your thing. And then if that server happens to be quite beefy then you get pretty good-looking numbers, but then the real world isn’t as beefy and nice.
So field data is what you should be monitoring to know if your website’s users around the world have a positive browsing experience.
However, if you are in the process of actively optimizing your site, you have no choice but to rely on lab data – it allows you to evaluate your improvements without having to wait for the real user data to come in.
That being said, there’s no need to decide that one approach is superior and more useful than the other. Your course of action should always depend on why you need the data.
For example, you can use field data to define where your users are, how fast their internet connection is, and what kind of device they’re using. With this information, you can simulate your user with lab tools when you’re optimizing your pages and verify how much the changes you’re implementing affect the results.
Field Data vs Lab Data
Here is our short summary of characteristics unique to field and lab data.
| Field Data | Lab Data |
|---|---|
|
|
|
|
|
|
|
|
|
|
|
|
