My content isn’t loading

If your site pages aren’t being pulled into TheSkinnyAI (e.g., advisors/team pages), it’s often due to bot protection (Cloudflare or similar) returning a browser challenge instead of the actual HTML.

Recommended fix (Cloudflare)

Please add a Cloudflare rule to allow our crawler:

If (User-Agent contains "TheSkinnyCrawler") then:
- Bypass Managed Challenge
- Skip Bot Fight Mode

We’ll identify our crawler with a dedicated User-Agent string. This safely bypasses bot checks for our requests only.

Optional allow‑listing

Path exceptions: Allow /sitemap.xml and key content paths (e.g., /team, /advisors) so discovery succeeds.
Static IP allowlist: If you prefer IP rules, we can route crawling through a fixed egress and provide a single IP to allow in Cloudflare.

Why this happens

Bot protection can serve a “Just a moment…” page to non‑browser fetches. In that case, our system stores the challenge page instead of your content, so answers are incomplete.

What we need from you

Confirm you’ve added the Cloudflare rule above for our crawler User‑Agent.
Optionally share any additional allow‑listing details you applied (paths, IP allowlist).

Tip: If you use a different bot protection service, create an equivalent rule that exempts requests with User‑Agent containing TheSkinnyCrawler from bot challenges.