Complete AI Training

MCP server · Research

LookaCrawler MCP server

by lucasmartins-ai

Lets your AI fetch web pages, turn them into clean text, and crawl whole sites for you.

Flow diagram: you ask your AI “Read this page and summarize it for me”, on your own computer the LookaCrawler MCP server works with web pages on your computer, and you get back clean text your AI can read.

LookaCrawler is a free tool that reads web pages for your AI and hands back just the useful text, not the messy code behind the page. It runs on your own computer, so nothing is sent to a company's servers. It is handy if you often ask your AI about a website and it cannot see the page.

What is an MCP server? The 30-second version

On its own, your AI can only chat with you. It cannot open a website or look something up online. An MCP server is a small helper program that gives your AI a new skill. This one connects your AI to the web, so when you ask about a page, the AI can actually go read it and answer you.

What this MCP server does

You ask your AI something about a web page or a whole website. The AI passes that request to LookaCrawler, which runs quietly on your computer. LookaCrawler opens the page, throws away the parts you do not need like scripts and menus, and keeps the real content. It hands that clean text back to your AI. Your AI then reads it and gives you an answer, a summary, or a list.

Flow diagram: you ask your AI “Read this page and summarize it for me”, on your own computer the LookaCrawler MCP server works with web pages on your computer, and you get back clean text your AI can read. Click to zoom

What you can do with it

  • Read a single web page and turn it into clean text
  • Crawl a whole website and collect many pages at once
  • List every page found on a site before you crawl it
  • Fetch several pages at the same time in one go
  • Pull out specific details like titles, dates, or links
  • Click buttons or scroll a page first, then read it
  • Reuse pages it already read so it does not fetch them twice

Try asking your AI

  • “Read this page and summarize the main points: https://example.com/article”
  • “Crawl the docs at https://example.com/docs two levels deep and list what you find”
  • “What pages are on https://example.com? Give me the list first”
  • “Grab the title and all the links from https://example.com and show them as a table”

What it gives back to you

You get back clean text, usually as tidy Markdown, plus things like page titles, descriptions, dates, and links. For a crawl, you get a collection of pages with a count of how many were read. In the chat it looks like a normal answer from your AI, with the content already summarized or listed. You can also ask it to save the result to a file.

Before you start

What you need

  • Bun 1.1 or newer installed on your computer (a free tool that runs the crawler)
  • Google Chrome installed, for the deeper mode that handles tricky sites
  • The Claude desktop app or Cursor, if you want to use it through your AI chat

Good to know

It reads pages from the open web and saves what it finds in a small file on your computer, so avoid pointing it at private or login-only pages you would not want stored.

Install it with your AI

Add LookaCrawler MCP server to your AI, no technical skills needed

You don't install anything by hand. You copy one prompt, paste it into an AI that can work on your computer, and it checks, installs and connects the server for you, asking you when it needs something.

Sign in to get the install prompt

Members get a ready-made prompt that lets the Claude desktop app check LookaCrawler MCP server, install it and connect it for them, step by step. You don't need any technical skills: you copy, paste and answer a few questions. Your connected AI can also find and install any of the 4,066 MCP servers here for you.

Sign in Become a member

Who it's for

Anyone who asks their AI about websites, like researchers, writers, analysts, and support or marketing staff who gather information from the web.