42fc4fec52
feat: Enhanced auction scrapers with multiple sources
...
CI / Frontend Lint & Type Check (push) Has been cancelled
CI / Frontend Build (push) Has been cancelled
CI / Backend Lint (push) Has been cancelled
CI / Backend Tests (push) Has been cancelled
CI / Docker Build (push) Has been cancelled
CI / Security Scan (push) Has been cancelled
Deploy / Build & Push Images (push) Has been cancelled
Deploy / Deploy to Server (push) Has been cancelled
Deploy / Notify (push) Has been cancelled
- Add GoDaddy RSS Feed scraper (bypasses Cloudflare)
- Enhanced ExpiredDomains scraper (multiple pages, TLDs)
- Improved hidden API scrapers integration
- Add automated scraper cron script (runs every 30 min)
- Playwright stealth mode installed on server
Sources now working:
- Dynadot REST API: ~100 auctions
- GoDaddy RSS: ~100 auctions
- ExpiredDomains: ~250 auctions
Total: 467 auctions in database
2025-12-11 20:58:04 +01:00
e127f1fb52
feat: Add 4 new Hidden API scrapers (6 total)
...
NEW SCRAPERS:
- ✅ Dynadot REST API: 101 auctions (WORKING!)
- 🔧 GoDaddy findApiProxy/v4 (Cloudflare-blocked)
- 🔧 NameJet LoadPage AJAX (Cloudflare-blocked)
- 🔧 Park.io Backorders (API not public)
CURRENT STATUS:
- 537+ active auctions in database
- ExpiredDomains: 425 (web scraping)
- Dynadot: 101 (JSON API)
- Sedo: 7 (web scraping)
AFFILIATE MONETIZATION:
- All platform URLs include affiliate tracking
- Ready for: Dynadot, GoDaddy, Namecheap, Sedo
NEXT STEPS:
- Cloudflare bypass for GoDaddy/NameJet
- Register actual affiliate IDs
- Create first Pounce Direct listings
2025-12-11 11:43:54 +01:00
9c64f61fb6
fix: Remove estibot_appraisal field - Dynadot now works!
...
- Fixed: 'estibot_appraisal' is not a DomainAuction field
- Dynadot now saves 100 auctions to DB
- Total active auctions: 511 (was 386)
Sample data:
- embedgooglemap.net: $10,200 (51 bids)
- 9454.com: $2,550 (73 bids)
- swosh.com: $2,550 (31 bids)
2025-12-11 11:37:59 +01:00
de5662ab78
feat: Hidden JSON API Scrapers + Affiliate Monetization
...
TIER 0: Hidden JSON APIs (Most Reliable!)
- Namecheap GraphQL: aftermarketapi.namecheap.com/graphql
- Dynadot REST: 342k+ auctions with Estibot appraisals!
- Sav.com AJAX: load_domains_ajax endpoint
AFFILIATE MONETIZATION:
- All platform URLs include affiliate tracking
- Configured for: Namecheap, Dynadot, GoDaddy, Sedo, Sav
- Revenue potential: $10-50/sale
TECHNICAL:
- New hidden_api_scrapers.py with 3 platform scrapers
- Updated auction_scraper.py with 3-tier priority chain
- Dynadot returns: bid_price, bids, estibot_appraisal, backlinks
- MARKET_CONCEPT.md completely updated
Tested: Dynadot returns 5 real auctions with prices up to $10k!
2025-12-11 10:38:40 +01:00
