MCP server · Research · official
WebScraping.AI MCP server
by webscraping-ai · official
Lets your AI read web pages, pull out details you ask for, and search Google for you.
This is a helper that connects your AI assistant to WebScraping.AI, a service that fetches web pages for you. Once it is set up, you can ask your AI things like what a page says or what a product costs, and it will go and look. It is handy for anyone who spends time copying information from websites into a spreadsheet or a document.
What is an MCP server? The 30-second version
On its own, your AI can only chat with you using what it already knows. An MCP server is a small helper program that gives your AI one new skill. This helper gives it a connection to WebScraping.AI, a service that opens web pages and reads them. So when you ask about a page, your AI sends the request through this helper, and the helper brings the answer back.
What this MCP server does
You ask your AI a question about a web page, or you give it a page and a list of things to find. Your AI passes that to this helper, which talks to WebScraping.AI. WebScraping.AI opens the page, runs any JavaScript so the page loads fully, and reads it. The answer or the extracted details come back to your AI, and your AI shows them to you in the chat.
Click to zoomWhat you can do with it
- Ask questions about what a web page says
- Pull out specific details like prices, titles or descriptions
- Get the plain text of a page
- Get the full HTML of a page
- Grab just one part of a page using a CSS selector
- Search Google and get the results as a list
- Get structured details from sites like YouTube, TikTok, X, LinkedIn, Instagram and Reddit
Try asking your AI
- “What is this page about? https://example.com/article”
- “From this product page, get me the title, price and description”
- “Search Google for coffee machines and list the top results”
- “Get the transcript of this YouTube video”
What it gives back to you
You get answers in plain words, lists of search results, or details laid out in a neat structure. For example, if you ask for a price and a title, you get those back as a small list you can copy. If you ask for the text of a page, you get the readable text. If you ask it to search, you get titles, links and short snippets.
Before you start
What you need
- A WebScraping.AI account and API key (a kind of password for apps; there is a free trial, no credit card needed)
- The Claude desktop app or another app that supports MCP servers
- Node.js installed on your computer if you run it yourself
Good to know
Some requests cost money on your WebScraping.AI account, so keep an eye on your usage, and be careful about scraping pages you are not allowed to read.
Install it with your AI
Add WebScraping.AI MCP server to your AI, no technical skills needed
You don't install anything by hand. You copy one prompt, paste it into an AI that can work on your computer, and it checks, installs and connects the server for you, asking you when it needs something.
Sign in to get the install prompt
Members get a ready-made prompt that lets the Claude desktop app check WebScraping.AI MCP server, install it and connect it for them, step by step. You don't need any technical skills: you copy, paste and answer a few questions. Your connected AI can also find and install any of the 4,066 MCP servers here for you.
Who it's for
Anyone who regularly copies information from websites, like researchers, marketers, analysts or assistants.
