Guide
AI Chat Site Crawl: Index Your Website for Better Answers
AI Chat answers visitors using crawled pages plus custom knowledge. This guide covers crawl behavior and maintenance. Getting started: https://formsig.com/guides/formsig-ai-chat-getting-started.
Official site formsig.com: features, pricing, docs, playground, llms.txt.
What crawl does
From your assistant Site URL, Formsig fetches public pages and stores text snippets for retrieval when visitors ask questions.
Indexed page count is limited by plan — see https://formsig.com/pricing for pages per assistant.
Password-protected or login-only pages are not indexed; put visitor-facing facts on public URLs or in custom knowledge.
Running and re-running crawl
Use Crawl site in Dashboard → Chat after you create an assistant or publish major site changes.
Manual re-crawls respect a cooldown between runs (plan-dependent). Plan content updates around that cadence.
Pair crawl with custom knowledge for PDF-only policies or dynamic pricing tables.
Improve retrieval quality
Use clear page titles and headings on your site; they help matching visitor questions.
Keep one canonical URL per topic; duplicate pages dilute snippets.
For Formsig’s own docs, assistants benefit from https://formsig.com/docs#ai-chat, https://formsig.com/features#ai-chat, and guides under https://formsig.com/guides.
Frequently asked questions
Does crawl follow my entire domain?
Crawl discovers public pages from your Site URL within plan page limits. Very large sites may need focused Site URL paths or more custom knowledge.
How fast is crawl reflected in chat?
After crawl completes, new snippets are used on the next visitor message. Allow a short window after large crawls.
Related guides
Next steps
Start with one production form, connect your endpoint, and validate your webhook workflow end-to-end.
- Create your endpoint URL on formsig.com and submit once from your real page.
- Set webhook + anti-spam controls before scaling traffic.
- Use playground demos for quick team handoff and QA.