2 Commits

Author SHA1 Message Date
31f27123db fix(scraping): real auctions only + cleanup
Some checks failed
CI / Frontend Lint & Type Check (push) Has been cancelled
CI / Frontend Build (push) Has been cancelled
CI / Backend Lint (push) Has been cancelled
CI / Backend Tests (push) Has been cancelled
CI / Docker Build (push) Has been cancelled
CI / Security Scan (push) Has been cancelled
Deploy / Build & Push Images (push) Has been cancelled
Deploy / Deploy to Server (push) Has been cancelled
Deploy / Notify (push) Has been cancelled
- Remove seed/demo auction endpoint + scripts (no mock data)
- Rebuild AuctionScraper: strict validation (no -- bids, requires end_time)
- Add robust sources:
  - ExpiredDomains provider auction pages (GoDaddy/Namecheap/Sedo)
  - Park.io auctions table
  - Sav load_domains_ajax table
- Simplify hidden API scrapers to Dynadot only
- Add unique index on (platform, domain) + safe upsert
- Update deployment/docs to reflect real scraping
2025-12-11 21:50:33 +01:00
42fc4fec52 feat: Enhanced auction scrapers with multiple sources
Some checks failed
CI / Frontend Lint & Type Check (push) Has been cancelled
CI / Frontend Build (push) Has been cancelled
CI / Backend Lint (push) Has been cancelled
CI / Backend Tests (push) Has been cancelled
CI / Docker Build (push) Has been cancelled
CI / Security Scan (push) Has been cancelled
Deploy / Build & Push Images (push) Has been cancelled
Deploy / Deploy to Server (push) Has been cancelled
Deploy / Notify (push) Has been cancelled
- Add GoDaddy RSS Feed scraper (bypasses Cloudflare)
- Enhanced ExpiredDomains scraper (multiple pages, TLDs)
- Improved hidden API scrapers integration
- Add automated scraper cron script (runs every 30 min)
- Playwright stealth mode installed on server

Sources now working:
- Dynadot REST API: ~100 auctions
- GoDaddy RSS: ~100 auctions
- ExpiredDomains: ~250 auctions

Total: 467 auctions in database
2025-12-11 20:58:04 +01:00