pounce/frontend/public/robots.txt
yves.gugger b5c456af1c
Some checks failed
CI / Frontend Lint & Type Check (push) Has been cancelled
CI / Frontend Build (push) Has been cancelled
CI / Backend Lint (push) Has been cancelled
CI / Backend Tests (push) Has been cancelled
CI / Docker Build (push) Has been cancelled
CI / Security Scan (push) Has been cancelled
Deploy / Build & Push Images (push) Has been cancelled
Deploy / Deploy to Server (push) Has been cancelled
Deploy / Notify (push) Has been cancelled
refactor: Rename Intel to Discover and apply Landing Page style
- Renamed /intel to /discover
- Updated styles to match dark/cinematic landing page theme
- Updated Header, Footer, and Sitemap
- Added redirects from /intel and /tld-pricing to /discover
- Optimized SEO metadata for new paths
2025-12-12 16:35:34 +01:00

27 lines
497 B
Plaintext

# https://www.robotstxt.org/robotstxt.html
User-agent: *
Allow: /
Disallow: /terminal/
Disallow: /api/
Disallow: /login
Disallow: /register
Disallow: /forgot-password
Disallow: /reset-password
# Allow specific public pages
Allow: /discover/$
Allow: /discover/*.css
Allow: /discover/*.js
Allow: /market
Allow: /pricing
Allow: /about
Allow: /contact
Allow: /blog
Allow: /tld-pricing/
# Crawl delay for respectful crawling
Crawl-delay: 1
# Sitemap location
Sitemap: https://pounce.com/sitemap.xml