LiteLLM

LiteLLM supports two separate ways to use Parallel: its native Search provider or a connection to the Parallel Search MCP through the LiteLLM MCP Gateway. The native Search provider does not require MCP.

Native LiteLLM Search provider

Install LiteLLM and set your Parallel API key:

pip install litellm
export PARALLEL_API_KEY="your-parallel-api-key"

Python SDK

Use search_provider="parallel_ai" to call Parallel Search through the LiteLLM Python SDK:

from litellm import search

response = search(
    query="latest AI developments",
    search_provider="parallel_ai",
    max_results=5,
)

for result in response.results:
    print(result.title, result.url, result.snippet)

For more information, see LiteLLM’s Parallel Search provider documentation.

LiteLLM AI Gateway

Install the proxy dependencies and set a separate master key to authenticate requests to your local LiteLLM gateway:

pip install 'litellm[proxy]'
export LITELLM_MASTER_KEY="sk-your-local-proxy-key"

Create a config.yaml file that explicitly registers parallel-search:

search_tools:
  - search_tool_name: parallel-search
    litellm_params:
      search_provider: parallel_ai
      api_key: os.environ/PARALLEL_API_KEY

general_settings:
  master_key: os.environ/LITELLM_MASTER_KEY

Start the gateway:

litellm --config config.yaml --host 127.0.0.1

In another terminal, set the same LITELLM_MASTER_KEY and verify the tool is registered without making a Parallel Search request:

export LITELLM_MASTER_KEY="sk-your-local-proxy-key"

curl http://localhost:4000/v1/search/tools \
  -H "Authorization: Bearer $LITELLM_MASTER_KEY"

To run a real search, call the explicitly named parallel-search endpoint:

curl http://localhost:4000/v1/search/parallel-search \
  -H "Authorization: Bearer $LITELLM_MASTER_KEY" \
  -H "Content-Type: application/json" \
  -d '{"query":"latest AI developments","max_results":5}'

Parallel Search MCP through LiteLLM MCP Gateway

The LiteLLM MCP Gateway can also connect to Parallel Search MCP. This is separate from the native Search provider and exposes the web_search and web_fetch MCP tools. Add the server to your existing LiteLLM gateway configuration with HTTP transport:

mcp_servers:
  parallel_search:
    url: https://search.parallel.ai/mcp
    transport: http
    # Optional, for higher rate limits:
    # auth_type: bearer_token
    # auth_value: os.environ/PARALLEL_API_KEY

The connection is anonymous by default. To enable optional Bearer authentication for higher rate limits, set PARALLEL_API_KEY and uncomment both authentication settings. For more information, see LiteLLM’s MCP Gateway documentation and the Parallel Search MCP guide.

Getting started

Web Tools

Web Agents

Developer Tools

Platform Integrations

Data Integrations

Additional Resources

Native LiteLLM Search provider

Python SDK

LiteLLM AI Gateway

Parallel Search MCP through LiteLLM MCP Gateway

​Native LiteLLM Search provider

​Python SDK

​LiteLLM AI Gateway

​Parallel Search MCP through LiteLLM MCP Gateway

Native LiteLLM Search provider

Python SDK

LiteLLM AI Gateway

Parallel Search MCP through LiteLLM MCP Gateway