For AI agents: a documentation index is available at https://docs.parallel.ai/llms.txt. The full text of all docs is at https://docs.parallel.ai/llms-full.txt. You may also fetch any page as Markdown by appending
The Source Policy feature allows you to precisely control which domains Parallel processors can
access during web research and to apply a freshness constraint. It’s available for both Tasks and
Web Tools and lets you tailor search results by specifying domains to include or exclude and by
setting a start date so results are limited to recent content.
.md to its URL or sending Accept: text/markdown.Configuration
You can configure source control by setting the following parameters:
Specifying an apex domain such as
example.com will automatically include all its
subdomains (e.g., www.example.com, blog.example.com, api.example.com).
Domain Limit
Example
Best Practices
-
Use either
include_domainsorexclude_domainsin a single query. Specifyingexclude_domainsis redundant wheninclude_domainsis set, as onlyinclude_domainswill be applied. -
Use an apex domain such as
example.comto match that domain and all its subdomains, or specify a subdomain such asdocs.example.comto match that subdomain and any deeper subdomains. A leadingwww.is normalized away. -
Use a bare domain extension beginning with a period, such as
.org,.gov, or.co.uk, to match that extension. Literal wildcard syntax such as*.orgis not supported. -
Do not include schemes (
http://,https://), paths (example.com/blog), or ports (example.com:443). - Although there is a maximum limit of 200 domains, carefully using specific and targeted domains will give better results.