> For the complete documentation index, see [llms.txt](https://manual.formwise.ai/formwise/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://manual.formwise.ai/formwise/advanced-features/web-intelligence.md).

# Web Intelligence

Web Intelligence lets your **SmartForms** and **CoPilots** pull fresh context from the web. Use it when your tool needs current facts, or when users paste a URL.

### Pick the right feature

#### Web Searching (Internet Access)

Use this when you need **quick, up-to-date facts**. It pulls information from the **main Google results page**. It does **not** click into results or scrape pages.

Good for:

* “What’s the latest news about \_\_\_?”
* Company snapshots, basic public info, quick research
* Reducing outdated answers and hallucinations

#### Web Crawling (URL scraping)

Use this when you need **the actual text from a specific page**. Your tool crawls a **single URL** and brings that page’s text into the prompt.

Good for:

* Summarizing an article someone links
* Turning a blog post into email/social variations
* Extracting details from a product or landing page

{% hint style="info" %}
Web crawling is available on **GPT‑4-class models and above**.
{% endhint %}

### Quick links

<table data-view="cards"><thead><tr><th>Guide</th><th data-card-target data-type="content-ref">Open</th></tr></thead><tbody><tr><td><strong>Web Searching</strong> (Internet Access)</td><td><a href="/formwise/advanced-features/web-intelligence/web-searching.md">Web Searching</a></td></tr><tr><td><strong>Web Crawling</strong> (scrape a URL)</td><td><a href="/formwise/advanced-features/web-intelligence/web-crawling.md">Web Crawling</a></td></tr></tbody></table>

### Best practices

* **Ask for sources.** Have the tool cite the URL or query it used.
* **Keep tasks narrow.** “Summarize this URL in 5 bullets” beats “analyze everything.”
* **Verify before acting.** Treat web results as input, not truth.

### Known limits (so you can design around them)

* **Web Searching** only sees the **search results page**.
* **Web Crawling** reads **text content** from a URL. It may skip paywalled, blocked, or heavy JS-rendered pages.
* Both features can fail if the source blocks bots or rate limits.

### Common patterns

* **SmartForm “Research + Write”**
  * Input: topic or brand name
  * Web Searching: pull current context
  * Output: brief + draft content
* **CoPilot “Paste a link, get help”**
  * User drops a URL
  * Web Crawling: ingest the page
  * CoPilot: answers questions using that page as context

### Safety and compliance notes

* Only crawl content you’re allowed to access and reuse.
* Avoid collecting sensitive personal data from the web.
* If you sell outputs, add your own review step.