bob
8b0eb0db78
JobQueue now skips bands swept within MinResweepHours (config, default 6h) instead of re-scraping the whole catalogue continuously — the dominant cost on the metered residential proxy. Roughly linear savings with no data loss (full pagination retained); 0 disables it. Worker logs the real compressed transferSize per job (what the proxy bills) rather than the ~6.5x-larger decompressed length, so spend is visible. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
18 lines
425 B
JSON
18 lines
425 B
JSON
{
|
|
"Logging": {
|
|
"LogLevel": {
|
|
"Default": "Information",
|
|
"Microsoft.AspNetCore": "Warning",
|
|
"Microsoft.EntityFrameworkCore": "Warning"
|
|
}
|
|
},
|
|
"AllowedHosts": "*",
|
|
"Urls": "http://0.0.0.0:5080",
|
|
"ConnectionStrings": {
|
|
"SkinTracker": "Host=localhost;Port=5432;Database=skintracker;Username=postgres"
|
|
},
|
|
"WorkerToken": "dev-worker-token",
|
|
"MaxPagesPerJob": 60,
|
|
"MinResweepHours": 6
|
|
}
|