Major changes: - Add TLD price scraper with Porkbun API (886+ TLDs, no API key needed) - Fix .ch domain checker using rdap.nic.ch custom RDAP - Integrate database for TLD price history tracking - Add admin endpoints for manual scrape and stats - Extend scheduler with daily TLD price scrape job (03:00 UTC) - Update API to use DB data with static fallback - Update README with complete documentation New files: - backend/app/services/tld_scraper/ (scraper package) - TLD_TRACKING_PLAN.md (implementation plan) API changes: - POST /admin/scrape-tld-prices - trigger manual scrape - GET /admin/tld-prices/stats - database statistics - GET /tld-prices/overview now uses DB data
40 lines
606 B
Plaintext
40 lines
606 B
Plaintext
# FastAPI & Server
|
|
fastapi>=0.115.0
|
|
uvicorn[standard]>=0.32.0
|
|
python-multipart>=0.0.12
|
|
|
|
# Database
|
|
sqlalchemy>=2.0.35
|
|
alembic>=1.14.0
|
|
aiosqlite>=0.20.0
|
|
|
|
# Authentication
|
|
python-jose[cryptography]>=3.3.0
|
|
passlib[bcrypt]>=1.7.4
|
|
bcrypt>=4.0.0,<4.1
|
|
|
|
# Domain Checking
|
|
python-whois>=0.9.4
|
|
dnspython>=2.7.0
|
|
whodap>=0.1.12
|
|
|
|
# Scheduling
|
|
apscheduler>=3.10.4
|
|
|
|
# Email (optional, for notifications)
|
|
aiosmtplib>=3.0.2
|
|
|
|
# Web Scraping
|
|
beautifulsoup4>=4.12.0
|
|
lxml>=5.0.0
|
|
|
|
# Utilities
|
|
python-dotenv>=1.0.1
|
|
pydantic[email]>=2.10.0
|
|
pydantic-settings>=2.6.0
|
|
httpx>=0.28.0
|
|
|
|
# Production Database (optional)
|
|
asyncpg>=0.30.0
|
|
|