675b857323
fix(auctions): prevent time drift + consistent now
...
- Clamp end_time on updates to prevent drift from rounded time-left sources (e.g. Sav)
- Use a single request 'now' for time_remaining formatting across endpoints
- Avoid 'Ended' flicker caused by processing delays
2025-12-11 22:14:18 +01:00
325a684809
fix(scraping): correct timezones + no ended auctions in API
...
- Treat Park.io close_date as America/New_York (configurable) and convert to UTC
- Ensure /stats, /scrape-status, /opportunities only count not-ended auctions
- Make NameJet Playwright scraper strict: requires real end_time + price
- Add Playwright proxy pool support (SCRAPER_PLAYWRIGHT_PROXY_POOL)
- Simplify protected scraping to NameJet only
2025-12-11 22:00:06 +01:00
5e0d4c6590
fix(scraping): real auctions only + cleanup
...
- Remove seed/demo auction endpoint + scripts (no mock data)
- Rebuild AuctionScraper: strict validation (no -- bids, requires end_time)
- Add robust sources:
- ExpiredDomains provider auction pages (GoDaddy/Namecheap/Sedo)
- Park.io auctions table
- Sav load_domains_ajax table
- Simplify hidden API scrapers to Dynadot only
- Add unique index on (platform, domain) + safe upsert
- Update deployment/docs to reflect real scraping
2025-12-11 21:50:33 +01:00
de5cfdc10a
feat: Enhanced auction scrapers with multiple sources
...
- Add GoDaddy RSS Feed scraper (bypasses Cloudflare)
- Enhanced ExpiredDomains scraper (multiple pages, TLDs)
- Improved hidden API scrapers integration
- Add automated scraper cron script (runs every 30 min)
- Playwright stealth mode installed on server
Sources now working:
- Dynadot REST API: ~100 auctions
- GoDaddy RSS: ~100 auctions
- ExpiredDomains: ~250 auctions
Total: 467 auctions in database
2025-12-11 20:58:04 +01:00
3290c6e6d8
feat: Complete Market Implementation
...
✅ PLAYWRIGHT STEALTH SCRAPER:
- Headless browser with stealth mode
- Cloudflare bypass (partial - needs more work)
- Cookie persistence
- API intercept + DOM extraction
✅ POUNCE DIRECT LISTINGS:
- 5 test listings created:
• alpineresort.com - $8,500
• swisstech.ch - $4,500
• nftmarket.app - $3,200
• cryptoflow.io - $2,500
• dataops.dev - $1,200
✅ PUBLIC MARKET PAGE:
- Shows 'Pounce Exclusive' section prominently
- 100+ live auctions from Dynadot, GoDaddy, Sedo
- Deal Scores with 'Undervalued' labels
- Tabs: All Auctions, Ending Soon, Hot
📊 CURRENT DATA:
- 537+ active auctions in database
- 5 Pounce Direct listings
- Dynadot JSON API working (100+ auctions)
- ExpiredDomains web scraping (400+ auctions)
2025-12-11 11:54:31 +01:00
b2dcad4b68
feat: Hidden JSON API Scrapers + Affiliate Monetization
...
TIER 0: Hidden JSON APIs (Most Reliable!)
- Namecheap GraphQL: aftermarketapi.namecheap.com/graphql
- Dynadot REST: 342k+ auctions with Estibot appraisals!
- Sav.com AJAX: load_domains_ajax endpoint
AFFILIATE MONETIZATION:
- All platform URLs include affiliate tracking
- Configured for: Namecheap, Dynadot, GoDaddy, Sedo, Sav
- Revenue potential: $10-50/sale
TECHNICAL:
- New hidden_api_scrapers.py with 3 platform scrapers
- Updated auction_scraper.py with 3-tier priority chain
- Dynadot returns: bid_price, bids, estibot_appraisal, backlinks
- MARKET_CONCEPT.md completely updated
Tested: Dynadot returns 5 real auctions with prices up to $10k!
2025-12-11 10:38:40 +01:00
e9f06d1cbf
feat: DropCatch & Sedo API Clients + MARKET_CONCEPT v2
...
- DropCatch API Client mit OAuth2 Authentifizierung
- Sedo API Client (bereit für Credentials)
- Tier 1 APIs → Tier 2 Scraping Fallback-Logik
- Admin Endpoints: /test-apis, /trigger-scrape, /scrape-status
- MARKET_CONCEPT.md komplett überarbeitet:
- Realistische Bestandsaufnahme
- 3-Säulen-Konzept (Auktionen, Pounce Direct, Drops)
- API-Realität dokumentiert (DropCatch = nur eigene Aktivitäten)
- Roadmap und nächste Schritte
2025-12-11 09:36:32 +01:00
cff0ba0984
feat: Add Admin Panel enhancements, Blog system, and OAuth
...
Admin Panel:
- User Detail Modal with full profile info
- Bulk tier upgrade for multiple users
- User export to CSV
- Price Alerts overview tab
- Domain Health Check trigger
- Email Test functionality
- Scheduler Status with job info and last runs
- Activity Log for admin actions
- Blog management tab with CRUD
Blog System:
- BlogPost model with full content management
- Public API: list, featured, categories, single post
- Admin API: create, update, delete, publish/unpublish
- Frontend blog listing page with categories
- Frontend blog detail page with styling
- View count tracking
OAuth:
- Google OAuth integration
- GitHub OAuth integration
- OAuth callback handling
- Provider selection on login/register
Other improvements:
- Domain checker with check_all_domains function
- Admin activity logging
- Breadcrumbs component
- Toast notification component
- Various UI/UX improvements
2025-12-09 16:52:54 +01:00
88eca582e5
feat: Remove ALL mock data - real scraped data only
...
MOCK DATA REMOVED:
- Removed ALL hardcoded auction data from auctions.py
- Now uses real-time scraping from ExpiredDomains.net
- Database stores scraped auctions (domain_auctions table)
- Scraping runs hourly via scheduler (:30 each hour)
AUCTION SCRAPER SERVICE:
- Web scraping from ExpiredDomains.net (aggregator)
- Rate limiting per platform (10 req/min)
- Database caching to minimize requests
- Cleanup of ended auctions (auto-deactivate)
- Scrape logging for monitoring
STRIPE INTEGRATION:
- Full payment flow: Checkout → Webhook → Subscription update
- Customer Portal for managing subscriptions
- Price IDs configurable via env vars
- Handles: checkout.completed, subscription.updated/deleted, payment.failed
EMAIL SERVICE (SMTP):
- Beautiful HTML email templates with pounce branding
- Domain available alerts
- Price change notifications
- Subscription confirmations
- Weekly digest emails
- Configurable via SMTP_* env vars
NEW SUBSCRIPTION TIERS:
- Scout (Free): 5 domains, daily checks
- Trader (€19/mo): 50 domains, hourly, portfolio, valuation
- Tycoon (€49/mo): 500+ domains, realtime, API, bulk tools
DATABASE CHANGES:
- domain_auctions table for scraped data
- auction_scrape_logs for monitoring
- stripe_customer_id on users
- stripe_subscription_id on subscriptions
- portfolio_domain relationships fixed
ENV VARS ADDED:
- STRIPE_SECRET_KEY, STRIPE_WEBHOOK_SECRET
- STRIPE_PRICE_TRADER, STRIPE_PRICE_TYCOON
- SMTP_HOST, SMTP_PORT, SMTP_USER, SMTP_PASSWORD
- SMTP_FROM_EMAIL, SMTP_FROM_NAME
2025-12-08 14:08:52 +01:00
