Tables

Table of Contents

Overview

The RUM Archive specifies two types of tables:

  • page_loads: Browser page load experiences
  • resources: Third party resource fetches

All tables are partitioned by the DATE column to assist with reducing the amount of data queried. We suggest you limit all queries to a specific date (or date range) to limit your BigQuery query costs.

Page Loads

Page Loads represent browser navigation experiences, whether from a traditional Multi-Page App (MPA) or Single-Page App (SPA). SPA navigations can be broken down into both Hard Navigations (the first navigation to the page) and Soft Navigations (in-page route changes).

Data is aggregated for each date.

Schema

CREATE TABLE `%PROJECT%.%DATASET%.%PREFIX%_page_loads`
(
SOURCE STRING,
SITE STRING,
DATE DATE,
DEVICETYPE STRING,
USERAGENTFAMILY STRING,
USERAGENTVERSION STRING,
USERAGENTENGINE STRING,
USERAGENTENGINEVERSION STRING,
DEVICEMODEL STRING,
OS STRING,
OSVERSION STRING,
BEACONTYPE STRING,
COUNTRY STRING,
VISIBILITYSTATE STRING,
NAVIGATIONTYPE STRING,
PROTOCOL STRING,
IPVERSION STRING,
LANDINGPAGE BOOLEAN,
INDUSTRY STRING,
BEACONS INTEGER,
PLTHISTOGRAM STRING,
PLTAVG FLOAT64,
PLTSUMLN FLOAT64,
PLTCOUNT INTEGER,
DNSHISTOGRAM STRING,
DNSAVG FLOAT64,
DNSSUMLN FLOAT64,
DNSCOUNT INTEGER,
TCPHISTOGRAM STRING,
TCPAVG FLOAT64,
TCPSUMLN FLOAT64,
TCPCOUNT INTEGER,
TLSHISTOGRAM STRING,
TLSAVG FLOAT64,
TLSSUMLN FLOAT64,
TLSCOUNT INTEGER,
TTFBHISTOGRAM STRING,
TTFBAVG FLOAT64,
TTFBSUMLN FLOAT64,
TTFBCOUNT INTEGER,
FCPHISTOGRAM STRING,
FCPAVG FLOAT64,
FCPSUMLN FLOAT64,
FCPCOUNT INTEGER,
LCPHISTOGRAM STRING,
LCPAVG FLOAT64,
LCPSUMLN FLOAT64,
LCPCOUNT INTEGER,
RTTHISTOGRAM STRING,
RTTAVG FLOAT64,
RTTSUMLN FLOAT64,
RTTCOUNT INTEGER,
RAGECLICKSHISTOGRAM STRING,
RAGECLICKSAVG FLOAT64,
RAGECLICKSSUMLN FLOAT64,
RAGECLICKSCOUNT INTEGER,
CLSHISTOGRAM STRING,
CLSAVG FLOAT64,
CLSSUMLN FLOAT64,
CLSCOUNT INTEGER,
FIDHISTOGRAM STRING,
FIDAVG FLOAT64,
FIDSUMLN FLOAT64,
FIDCOUNT INTEGER,
TBTHISTOGRAM STRING,
TBTAVG FLOAT64,
TBTSUMLN FLOAT64,
TBTCOUNT INTEGER,
TTIHISTOGRAM STRING,
TTIAVG FLOAT64,
TTISUMLN FLOAT64,
TTICOUNT INTEGER,
REDIRECTHISTOGRAM STRING,
REDIRECTAVG FLOAT64,
REDIRECTSUMLN FLOAT64,
REDIRECTCOUNT INTEGER,
INPHISTOGRAM STRING,
INPAVG FLOAT64,
INPSUMLN FLOAT64,
INPCOUNT INTEGER,
UNOHISTOGRAM STRING,
UNOAVG FLOAT64,
UNOSUMLN FLOAT64,
UNOCOUNT INTEGER,
TRANSFERSIZEHISTOGRAM STRING,
TRANSFERSIZEAVG FLOAT64,
TRANSFERSIZESUMLN FLOAT64,
TRANSFERSIZECOUNT INTEGER,
INTERIMRESPONSEHISTOGRAM STRING,
INTERIMRESPONSEAVG FLOAT64,
INTERIMRESPONSESUMLN FLOAT64,
INTERIMRESPONSECOUNT INTEGER,
LCPLOADDELAYHISTOGRAM STRING,
LCPLOADDELAYAVG FLOAT64,
LCPLOADDELAYSUMLN FLOAT64,
LCPLOADDELAYCOUNT INTEGER,
LCPLOADTIMEHISTOGRAM STRING,
LCPLOADTIMEAVG FLOAT64,
LCPLOADTIMESUMLN FLOAT64,
LCPLOADTIMECOUNT INTEGER,
LCPRENDERDELAYHISTOGRAM STRING,
LCPRENDERDELAYAVG FLOAT64,
LCPRENDERDELAYSUMLN FLOAT64,
LCPRENDERDELAYCOUNT INTEGER,
INPINPUTDELAYHISTOGRAM STRING,
INPINPUTDELAYAVG FLOAT64,
INPINPUTDELAYSUMLN FLOAT64,
INPINPUTDELAYCOUNT INTEGER,
INPPROCESSINGDURATIONHISTOGRAM STRING,
INPPROCESSINGDURATIONAVG FLOAT64,
INPPROCESSINGDURATIONSUMLN FLOAT64,
INPPROCESSINGDURATIONCOUNT INTEGER,
INPPRESENTATIONDELAYHISTOGRAM STRING,
INPPRESENTATIONDELAYAVG FLOAT64,
INPPRESENTATIONDELAYSUMLN FLOAT64,
INPPRESENTATIONDELAYCOUNT INTEGER
) PARTITION BY DATE
;

Dimensions

The dimensions below are characteristics of the Page Load experience.

Not every dataset populates every dimension. Dimensions a dataset does not have data for are exported as empty strings.

The Cardinality column is an estimate from the largest value in either the mPulse or Cloudflare datasets.

Dimension Description Example values Cardinality Datasets2
SOURCE Source of the data, e.g. provider mpulse cloudflare 1 (both)
SITE Site being measured example.com (multiple) 1 (both)
DATE Date of aggregation 2022-01-01 (grows each day) (both)
DEVICETYPE Device type Mobile Desktop Tablet 3 (both)
USERAGENTFAMILY User Agent family Chrome Mobile Safari ~100 (both)
USERAGENTVERSION User Agent major version 124 12 (Safari: 17.4) ~600 (both)
USERAGENTENGINE Browser engine family Blink WebKit Gecko ~3 CF
USERAGENTENGINEVERSION Browser engine major version 139 18.5 ~900 CF
DEVICEMODEL Device model Apple iPhone Samsung Android 11 ~2000 MP
OS Operating System family Android OS Windows iOS ~30 (both)
OSVERSION Operation System major version 10 15 (iOS: 17.4) ~250 (both)
BEACONTYPE Beacon type page view spa hard spa bfcache 4 (both)
COUNTRY Country US GB GB ~230 (both)
VISIBILITYSTATE Visibility state visible hidden partial 3 MP
NAVIGATIONTYPE Navigation type navigate back forward reload back forward cache ~9 (both)
PROTOCOL HTTP protocol h2 http/1.1 h3 ~6 (both)
IPVERSION IP version IPv4 IPv6 3 MP
LANDINGPAGE Landing page true false 3 (both)
INDUSTRY Industry of the site 1 Technology Shopping & Auctions Sports Unknown 24 CF

Notes:

  1. INDUSTRY is set by the dataset provider based on its own categorization of the site. The Cloudflare dataset uses Cloudflare's domain categories, and reports Unknown for any site it cannot confidently categorize. Possible values are Ads, Adult Themes, Always Blocked, Business & Economy, CIPA, Education, Entertainment, Government & Politics, Health, Internet Communication, Job Search & Careers, Miscellaneous, Real Estate, Religion, Safe for Kids, Shopping & Auctions, Society & Lifestyle, Sports, Technology, Travel, Vehicles, Violence, Weather and Unknown.
  2. MP = mPulse, CF = Cloudflare.

Timers and Metrics

The BEACONS column contains how many Page Loads that row represents.

Each Timer or Metric has 4 columns:

  • *HISTOGRAM (JSON): Histogram
  • *AVG (FLOAT64): Weighted average
  • *SUMLN (FLOAT64): Sum of the natural logarithms
  • *COUNT (INTEGER): Number of measurements taken for this timer or metric

Not every dataset populates every Timer or Metric. Those a dataset does not have data for are exported with an empty *HISTOGRAM, a NULL *AVG and *SUMLN, and a *COUNT of 0.

Timer or Metric Column Name Prefix Datasets5
Page Load Time PLT (both)
DNS DNS (both)
TCP TCP (both)
TLS TLS (both)
Time to First Byte TTFB (both)
First Contentful Paint FCP (both)
Largest Contentful Paint LCP (both)
Round Trip Time RTT MP
Rage Clicks RAGECLICKS MP
Cumulative Layout Shift (*1000) CLS (both)
First Input Delay FID MP
Interaction to Next Paint INP (both)
Total Blocking Time TBT MP
Time to Interactive TTI MP
Redirect REDIRECT (both)
Unattributed Navigation Overhead UNO MP
Transfer Size (bytes) 1 TRANSFERSIZE CF
Time to First Interim Response 2 INTERIMRESPONSE CF
LCP: Resource Load Delay 3 LCPLOADDELAY CF
LCP: Resource Load Duration 3 LCPLOADTIME CF
LCP: Element Render Delay 3 LCPRENDERDELAY CF
INP: Input Delay 4 INPINPUTDELAY CF
INP: Processing Duration 4 INPPROCESSINGDURATION CF
INP: Presentation Delay 4 INPPRESENTATIONDELAY CF

Notes:

  1. TRANSFERSIZE is the transferSize of the HTML document itself (in bytes, not milliseconds), so it reflects how much the browser had to download for the main document.
  2. INTERIMRESPONSE is the time to firstInterimResponseStart, i.e. the first 1xx informational response such as 103 Early Hints. It is only measured for navigations that received an interim response.
  3. The three LCP* sub-parts break Largest Contentful Paint down into the phases that produced it, as defined by the web-vitals LCP attribution contract: TTFB + LCPLOADDELAY + LCPLOADTIME + LCPRENDERDELAY roughly equals LCP for a given page load.
  4. The three INP* sub-parts break Interaction to Next Paint down into the phases that produced it, as defined by the web-vitals INP attribution contract: INPINPUTDELAY + INPPROCESSINGDURATION + INPPRESENTATIONDELAY equals INP for a given interaction. Unlike the other paint and interaction timers, 0 is a valid measurement for these sub-parts (for example, an interaction with no JavaScript handler has a 0 Processing Duration), so zeros are kept rather than treated as "not measured".
  5. MP = mPulse, CF = Cloudflare.

Third-Party Resources

Third-Party Resources represent URLs (such as JavaScript, CSS, images, etc) have been seen across multiple websites and are third-party components such as libraries, analytics scripts, widgets, fonts, etc.

Data is aggregated for each date.

Schema

CREATE TABLE `%PROJECT%.%DATASET%.%PREFIX%_resources`
(
SOURCE STRING,
SITE STRING,
DATE DATE,
URLGROUP STRING,
URL STRING,
DEVICETYPE STRING,
USERAGENTFAMILY STRING,
USERAGENTVERSION STRING,
DEVICEMODEL STRING,
OS STRING,
OSVERSION STRING,
BEACONTYPE STRING,
COUNTRY STRING,
PROTOCOL STRING,
INITIATORTYPE STRING,
ASSETTYPE STRING,
FETCHES INTEGER,
TOTALHISTOGRAM STRING,
TOTALAVG FLOAT64,
TOTALSUMLN FLOAT64,
TOTALCOUNT INTEGER,
DNSHISTOGRAM STRING,
DNSAVG FLOAT64,
DNSSUMLN FLOAT64,
DNSCOUNT INTEGER,
TCPHISTOGRAM STRING,
TCPAVG FLOAT64,
TCPSUMLN FLOAT64,
TCPCOUNT INTEGER,
TLSHISTOGRAM STRING,
TLSAVG FLOAT64,
TLSSUMLN FLOAT64,
TLSCOUNT INTEGER,
REQUESTHISTOGRAM STRING,
REQUESTAVG FLOAT64,
REQUESTSUMLN FLOAT64,
REQUESTCOUNT INTEGER,
RESPONSEHISTOGRAM STRING,
RESPONSEAVG FLOAT64,
RESPONSESUMLN FLOAT64,
RESPONSECOUNT INTEGER,
TTFBHISTOGRAM STRING,
TTFBAVG FLOAT64,
TTFBSUMLN FLOAT64,
TTFBCOUNT INTEGER,
DOWNLOADHISTOGRAM STRING,
DOWNLOADAVG FLOAT64,
DOWNLOADSUMLN FLOAT64,
DOWNLOADCOUNT INTEGER,
REDIRECTHISTOGRAM STRING,
REDIRECTAVG FLOAT64,
REDIRECTSUMLN FLOAT64,
REDIRECTCOUNT INTEGER,
CACHEDHISTOGRAM STRING,
CACHEDAVG FLOAT64,
CACHEDSUMLN FLOAT64,
CACHEDCOUNT INTEGER,
ENCODEDSIZEHISTOGRAM STRING,
ENCODEDSIZEAVG FLOAT64,
ENCODEDSIZESUMLN FLOAT64,
ENCODEDSIZECOUNT INTEGER,
DECODEDSIZEHISTOGRAM STRING,
DECODEDSIZEAVG FLOAT64,
DECODEDSIZESUMLN FLOAT64,
DECODEDSIZECOUNT INTEGER,
TRANSFERSIZEHISTOGRAM STRING,
TRANSFERSIZEAVG FLOAT64,
TRANSFERSIZESUMLN FLOAT64,
TRANSFERSIZECOUNT INTEGER
) PARTITION BY DATE
;

Dimensions

The dimensions below are characteristics of the Page Load experience.

The Cardinality column is an estimate from the mPulse dataset.

Dimension Description Example values Cardinality
SOURCE Source of the data, e.g. provider mpulse 1
SITE Site being measured example.com (multiple) 1
DATE Date of aggregation 2022-01-01 (grows each day)
URLGROUP Group the URL belongs to https://thirdparty.com/analytics/*.js ~20
URL Third-Party Resource URL https://thirdparty.com/analytics/v1.js < 1000
DEVICETYPE Device type Mobile Desktop Tablet 3
USERAGENTFAMILY User Agent family Chrome Mobile Safari ~100
USERAGENTVERSION User Agent major version 124 12 (Safari: 17.4) ~350
DEVICEMODEL Device model Apple iPhone Samsung Android 11 ~2000
OS Operating System family Android OS Windows iOS ~30
OSVERSION Operation System major version 10 15 (iOS: 17.4) ~75
BEACONTYPE Beacon type page view spa hard spa bfcache 4
COUNTRY Country US GB GB ~230
PROTOCOL HTTP protocol h2 http/1.1 h3 ~10
INITIATORTYPE Initiator Type fetch link css iframe img xmlhttprequest beacon script other 9
ASSETTYPE mPulse Asset Type img font html js bcn xhr css other 8

Timers and Metrics

The FETCHES column contains how many resource fetches that row represents.

Each Timer or Metric has 4 columns:

  • *HISTOGRAM (JSON): Histogram
  • *AVG (FLOAT64): Weighted average
  • *SUMLN (FLOAT64): Sum of the natural logarithms
  • *COUNT (INTEGER): Number of measurements taken for this timer or metric
Timer or Metric Column Name Prefix
Total Time TOTAL
DNS Time DNS
TCP Time TCP
TLS Time TLS
Request Time REQUEST
Response Time RESPONSE
Time to First Byte TTFB
Download Time DOWNLOAD
Redirect Time REDIRECT
Cached CACHED
Encoded Body Size ENCODEDSIZE
Decoded Body Size DECODEDSIZE
Transfer Size TRANSFERSIZE