Skip to main content

Documentation Index

Fetch the complete documentation index at: https://docs.insitechat.ai/llms.txt

Use this file to discover all available pages before exploring further.

Syncing content

When your website or documents change, your chatbot’s knowledge base needs to be updated. InsiteChat offers manual sync, bulk sync, and per-source auto-sync.

How syncing works

When a sync runs, InsiteChat re-crawls or re-processes your sources and compares the new content against what was previously indexed. Only pages or documents that have changed are re-processed. Content that hasn’t changed is left as-is, so syncs are fast even for large knowledge bases.

Manual sync

Manual sync is available on all plans, including Free.
1

Go to sources

Select your chatbot and click the Sources tab.
2

Find your source

Use the search bar to find a source by title or URL, or use the status filter buttons to narrow the list.
3

Sync

Click the refresh icon on the source card. The status changes to pending and then crawling as the sync runs.

Bulk sync

Re-sync multiple sources at once:
  1. Use the checkboxes to select the sources you want to sync
  2. Click Re-sync in the bulk action bar
  3. All selected sources are queued for processing
This is useful after a major website update when you want to refresh all URL sources simultaneously.

Per-source auto-sync

When adding a URL source, you can set an auto-sync frequency for that specific source:
FrequencyMinimum PlanHow it works
NeverAll plansManual sync only
MonthlyStarterRe-crawls every 30 days
WeeklyGrowthRe-crawls every 7 days
DailyScaleRe-crawls every day
You cannot select a frequency higher than your plan allows. A Growth plan user can choose monthly or weekly, but not daily. If you downgrade your plan, sources set to a higher frequency will fall back to the plan’s maximum.

How auto-sync runs

  • Auto-sync runs hourly via a background dispatcher
  • Sources are staggered across the day to distribute load
  • Only changed content is re-processed (incremental sync)
  • The URL cache is bypassed during auto-sync to detect changes
  • Trial users are excluded from auto-sync

Plan-based defaults

If you don’t set a per-source frequency, the plan default applies:
PlanDefault auto-sync
FreeNone
StarterMonthly (30 days)
GrowthWeekly (7 days)
ScaleEvery 3 days

Choosing the right strategy

Free plan: Use manual sync after publishing major content updates. Starter plan: Monthly auto-sync covers most use cases. Trigger manual syncs for time-sensitive changes. Growth plan: Set frequently-changing sources (blog, docs) to weekly auto-sync. Set stable sources (about page, pricing) to monthly or never. Scale plan: Daily auto-sync keeps your chatbot tightly aligned with your content. Use bulk sync for immediate updates across all sources.

What gets re-processed

Only changed content is re-processed on each sync:
  • Website sources — Pages where the text content hash has changed
  • New pages — Discovered pages that weren’t in the previous crawl
  • Removed pages — Pages no longer accessible are archived from the knowledge base
  • Unchanged pages — Skipped entirely for efficiency

Failure notifications

If a source fails to sync after all retries, you’ll receive an email notification with the error details and a link to the Sources page. You can then review the error, fix the issue (e.g., update the URL or check access), and trigger a manual re-sync.