Web Scraping & Data Glossary
38 terms covering web scraping, data extraction infrastructure, data APIs and AI training data defined plainly and indexed A-Z.
All 38 terms
indexed A–ZTry a different letter range or category, or clear the search field.
AI Training Data
AI training data is the dataset used to teach a machine learning model to recognize patterns and make predictions, typically consisting of labeled or structured examples relevant to the task at hand.
Read more →AI & LLM DataAlternative Data
Alternative data refers to non-traditional data sources, such as web-scraped pricing, satellite imagery, or transaction records, used to gain insights that conventional data sources don't provide, especially in finance and market research.
Read more →Data & APIsAPI (Application Programming Interface)
An API (Application Programming Interface) is a defined set of rules that lets different software applications communicate with each other and exchange data.
Read more →Data & APIsAPI Endpoint
An API endpoint is a specific URL where an API can be accessed to retrieve or send data for a particular resource or function.
Read more →Data Annotation
Data annotation is the process of labeling raw data — text, images, audio, or video — with tags or metadata so that machine learning models can learn to interpret it correctly.
Read more →FundamentalsData as a Service (DaaS)
Data as a Service (DaaS) is a cloud-based model that delivers ready-to-use data on demand, so businesses can consume datasets without building or maintaining their own collection infrastructure.
Read more →FundamentalsData Cleansing
Data cleansing (or data cleaning) is the process of detecting and correcting or removing inaccurate, incomplete, or duplicate records within a dataset to improve its quality and reliability.
Read more →FundamentalsData Extraction
Data extraction is the process of retrieving specific pieces of data from a source, especially unstructured or semi-structured sources, so they can be processed, stored, or analyzed.
Read more →FundamentalsData Mining
Data mining is the process of discovering patterns, correlations, and useful information within large datasets, typically using statistical and machine learning methods.
Read more →FundamentalsData Parsing
Data parsing is the process of converting raw data, such as HTML or plain text, into a structured, machine-readable format by breaking it down into identifiable components.
Read more →Data & APIsData Pipeline
A data pipeline is a series of automated steps that move data from one or more sources through processing stages to a final destination, such as a database, dashboard, or another application.
Read more →JavaScript Rendering
JavaScript rendering is the process of executing a page's JavaScript so that dynamically loaded content becomes visible and extractable, as opposed to relying only on the initial static HTML.
Read more →Data & APIsJSON
JSON (JavaScript Object Notation) is a lightweight, text-based data-interchange format that represents structured data as key-value pairs, widely used for transmitting data between servers and applications.
Read more →Rate Limiting
Rate limiting is a technique used by servers to control the number of requests a client can make within a given time period, protecting the server from overload or abuse.
Read more →AI & LLM DataReinforcement Learning from Human Feedback (RLHF)
Reinforcement Learning from Human Feedback (RLHF) is a machine learning technique that fine-tunes a model's behavior using a reward signal derived from human preference judgments, rather than a fixed labeled dataset alone.
Read more →InfrastructureResidential Proxy
A residential proxy routes internet traffic through an IP address assigned by an internet service provider to a real home connection, making requests appear to come from an ordinary consumer device.
Read more →Data & APIsREST API
A REST API is a web API that follows the constraints of Representational State Transfer (REST), an architectural style that uses standard HTTP methods to access and manipulate resources.
Read more →AI & LLM DataRetrieval-Augmented Generation (RAG)
Retrieval-Augmented Generation (RAG) is a technique that lets a large language model retrieve relevant external data at the time of a query, rather than relying only on knowledge learned during training.
Read more →Infrastructurerobots.txt
robots.txt is a standard text file placed at a website's root that tells automated crawlers which parts of the site they are permitted or not permitted to access.
Read more →Sentiment Analysis
Sentiment analysis is a natural language processing technique that determines the emotional tone or attitude expressed in a piece of text, such as classifying a review as positive, negative, or neutral.
Read more →FundamentalsStructured Data
Structured data is information organized according to a predefined format or schema, such as rows and columns in a table, or key-value pairs in JSON, making it easy to search, sort, and analyze.
Read more →AI & LLM DataSynthetic Data
Synthetic data is artificially generated data that mimics the statistical properties of real-world data, used to train or test machine learning models when real data is scarce, sensitive, or imbalanced.
Read more →Unstructured Data
Unstructured data is information that does not have a predefined data model or organization, such as free-form text, images, video, or audio.
Read more →InfrastructureUser Agent
A user agent is a string of text sent with a web request that identifies the client software making the request, such as a specific browser, version, and operating system.
Read more →Web Crawling
Web crawling is the automated process of systematically browsing the web, following hyperlinks from page to page, typically to discover and index content.
Read more →FundamentalsWeb Scraping
Web scraping is the automated process of extracting data from websites by fetching pages and parsing their content into a structured, usable format.
Read more →Data & APIsWeb Scraping API
A web scraping API is a service that handles the technical complexity of scraping — proxies, browser rendering, and anti-bot evasion — and returns clean, structured data from a given URL through a simple API call.
Read more →Data & APIsWebhook
A webhook is an automated HTTP callback that delivers data to a specified URL in real time when a particular event occurs, rather than requiring the receiver to repeatedly request updates.
Read more →Need the data behind these terms, not just the definitions?
APISCRAPY runs the proxies, rendering and delivery pipelines so you receive clean, structured web data on a schedule.
Talk to a Data Expert