bob
dc7c3f99ae
Brings up the pull-model scraper: the .NET C2 hands skin+wear jobs to Python nodriver workers that scrape cs.money and post results back, plus the supporting Core/EFCore data model, migrations, and docker-compose orchestration. IPRoyal proxying lets workers scale horizontally with a distinct residential exit IP each: every worker process mints its own sticky session at startup, and an in-process forwarding proxy injects the gateway auth so Chromium talks only to an auth-free localhost endpoint (zero CDP). On a Cloudflare challenge a worker rotates to a fresh session/IP and re-warms. Verified end-to-end against live IPRoyal: distinct US residential exits per worker and IP rotation on demand. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
6 lines
275 B
Plaintext
6 lines
275 B
Plaintext
# cs.money scraping worker.
|
|
# nodriver = the modern successor to undetected-chromedriver: it drives a normal
|
|
# Chromium over CDP directly (no chromedriver, so none of the cdc_/webdriver tells
|
|
# that got our .NET Selenium setup insta-challenged by Cloudflare).
|
|
nodriver>=0.39
|