Metadata-Version: 2.4
Name: anybrowse
Version: 1.0.0
Summary: Python client for anybrowse.dev — URL to Markdown scraping API
Project-URL: Homepage, https://anybrowse.dev
Project-URL: Documentation, https://anybrowse.dev/docs
Project-URL: Repository, https://github.com/kc23go/anybrowse
Author-email: Heimat LLC <hello@anybrowse.dev>
License: MIT
Keywords: ai,browser,langchain,llm,markdown,scraping,web-scraping
Classifier: Intended Audience :: Developers
Classifier: License :: OSI Approved :: MIT License
Classifier: Programming Language :: Python :: 3
Classifier: Topic :: Internet :: WWW/HTTP
Classifier: Topic :: Software Development :: Libraries :: Python Modules
Requires-Python: >=3.8
Requires-Dist: httpx>=0.24.0
Provides-Extra: all
Requires-Dist: langchain>=0.1.0; extra == 'all'
Requires-Dist: llama-index-core>=0.10.0; extra == 'all'
Provides-Extra: langchain
Requires-Dist: langchain>=0.1.0; extra == 'langchain'
Provides-Extra: llamaindex
Requires-Dist: llama-index-core>=0.10.0; extra == 'llamaindex'
Description-Content-Type: text/markdown

# anybrowse

**Turn any URL into LLM-ready Markdown.** Python SDK for [anybrowse.dev](https://anybrowse.dev).

Handles JavaScript, dynamic pages, paywalls, and anti-bot measures — so your agents don't have to.

---

## Install

```bash
pip install anybrowse
```

With LangChain support:
```bash
pip install anybrowse[langchain]
```

With LlamaIndex support:
```bash
pip install anybrowse[llamaindex]
```

Everything:
```bash
pip install anybrowse[all]
```

---

## Quick Start

```python
from anybrowse import AnybrowseClient

client = AnybrowseClient()  # uses free tier
# or: client = AnybrowseClient(api_key="your-key")

result = client.scrape("https://techcrunch.com")
print(result.markdown)

results = client.search("web scraping API 2025")
for r in results:
    print(r.title, r.url)
```

---

## Client Usage

```python
from anybrowse import AnybrowseClient

client = AnybrowseClient(api_key="your-api-key")  # optional for free tier

# Scrape a page → clean Markdown
page = client.scrape("https://news.ycombinator.com")
print(page.markdown)

# Scrape with context (better extraction)
page = client.scrape(
    "https://stripe.com/pricing",
    context="Extract all pricing tiers and their features"
)

# Crawl a site (multiple pages)
pages = client.crawl("https://docs.example.com", limit=20)

# Web search → Markdown results
results = client.search("best Python web scraping libraries 2024", count=5)
for r in results:
    print(r.title, r.url)
```

---

## Convenience Functions

```python
import anybrowse

# No client needed
result = anybrowse.scrape("https://example.com")
print(result.markdown)

results = anybrowse.search("AI news today", count=5)
```

---

## LangChain Integration

```python
from anybrowse.langchain import AnybrowseScrape, AnybrowseSearch, get_tools
from langchain.agents import initialize_agent, AgentType
from langchain.chat_models import ChatOpenAI

llm = ChatOpenAI(model="gpt-4")
tools = get_tools(api_key="your-api-key")

agent = initialize_agent(tools, llm, agent=AgentType.OPENAI_FUNCTIONS)
agent.run("Research the latest news on AI agents and summarize the top 3 stories")
```

---

## LlamaIndex Integration

```python
from anybrowse.llamaindex import AnybrowseReader

reader = AnybrowseReader(api_key="your-api-key")
docs = reader.load_data([
    "https://docs.python.org/3/library/asyncio.html",
    "https://fastapi.tiangolo.com/tutorial/",
])

from llama_index.core import VectorStoreIndex
index = VectorStoreIndex.from_documents(docs)
query_engine = index.as_query_engine()
response = query_engine.query("How do I use async with FastAPI?")
```

---

## MCP (Model Context Protocol)

Use anybrowse directly in Claude Desktop:

```json
{
  "mcpServers": {
    "anybrowse": {
      "command": "npx",
      "args": ["-y", "anybrowse-mcp"],
      "env": {
        "ANYBROWSE_API_KEY": "your-api-key"
      }
    }
  }
}
```

→ [Full MCP setup guide](https://anybrowse.dev/docs/mcp)

---

## Free Tier

No API key needed to get started. The free tier includes scraping with reasonable rate limits.

Need more? → [anybrowse.dev/pricing](https://anybrowse.dev/pricing)

---

## Links

- 🌐 [anybrowse.dev](https://anybrowse.dev)
- 📖 [Docs](https://anybrowse.dev/docs)
- 💬 [GitHub](https://github.com/kc23go/anybrowse)
