Web Scraping & Data Glossary

38 terms covering web scraping, data extraction infrastructure, data APIs and AI training data defined plainly and indexed A-Z.

38Total terms
9Fundamentals
9Infrastructure
8Data & APIs
12AI & LLM Data
Filter A–Z

All 38 terms

indexed A–Z
D
7
AI & LLM Data

Data Annotation

Data annotation is the process of labeling raw data — text, images, audio, or video — with tags or metadata so that machine learning models can learn to interpret it correctly.

ai-training-data
Read more →
Fundamentals

Data as a Service (DaaS)

Data as a Service (DaaS) is a cloud-based model that delivers ready-to-use data on demand, so businesses can consume datasets without building or maintaining their own collection infrastructure.

daasfundamentals
Read more →
Fundamentals

Data Cleansing

Data cleansing (or data cleaning) is the process of detecting and correcting or removing inaccurate, incomplete, or duplicate records within a dataset to improve its quality and reliability.

data-extraction
Read more →
Fundamentals

Data Extraction

Data extraction is the process of retrieving specific pieces of data from a source, especially unstructured or semi-structured sources, so they can be processed, stored, or analyzed.

data-extractionfundamentals
Read more →
Fundamentals

Data Mining

Data mining is the process of discovering patterns, correlations, and useful information within large datasets, typically using statistical and machine learning methods.

data-extractionanalytics
Read more →
Fundamentals

Data Parsing

Data parsing is the process of converting raw data, such as HTML or plain text, into a structured, machine-readable format by breaking it down into identifiable components.

data-extractionfundamentals
Read more →
Data & APIs

Data Pipeline

A data pipeline is a series of automated steps that move data from one or more sources through processing stages to a final destination, such as a database, dashboard, or another application.

data-apisdata-pipeline
Read more →
R
6
Infrastructure

Rate Limiting

Rate limiting is a technique used by servers to control the number of requests a client can make within a given time period, protecting the server from overload or abuse.

scraping-infrastructureapis
Read more →
AI & LLM Data

Reinforcement Learning from Human Feedback (RLHF)

Reinforcement Learning from Human Feedback (RLHF) is a machine learning technique that fine-tunes a model's behavior using a reward signal derived from human preference judgments, rather than a fixed labeled dataset alone.

ai-training-data
Read more →
Infrastructure

Residential Proxy

A residential proxy routes internet traffic through an IP address assigned by an internet service provider to a real home connection, making requests appear to come from an ordinary consumer device.

scraping-infrastructure
Read more →
Data & APIs

REST API

A REST API is a web API that follows the constraints of Representational State Transfer (REST), an architectural style that uses standard HTTP methods to access and manipulate resources.

data-apis
Read more →
AI & LLM Data

Retrieval-Augmented Generation (RAG)

Retrieval-Augmented Generation (RAG) is a technique that lets a large language model retrieve relevant external data at the time of a query, rather than relying only on knowledge learned during training.

ai-training-datatrending
Read more →
Infrastructure

robots.txt

robots.txt is a standard text file placed at a website's root that tells automated crawlers which parts of the site they are permitted or not permitted to access.

scraping-infrastructurecompliance
Read more →

Need the data behind these terms, not just the definitions?

APISCRAPY runs the proxies, rendering and delivery pipelines so you receive clean, structured web data on a schedule.

Talk to a Data Expert