Skip to content

Commit

Permalink
fix: set scale down factor to be faster
Browse files Browse the repository at this point in the history
  • Loading branch information
Patai5 committed Jul 30, 2024
1 parent 67d2ae2 commit 60077dd
Showing 1 changed file with 5 additions and 2 deletions.
7 changes: 5 additions & 2 deletions code/src/crawler.ts
Original file line number Diff line number Diff line change
Expand Up @@ -15,8 +15,11 @@ export const createCrawler = async (config: Config) => {
headless: true,
},
},
/** The default values scale up and down too quickly for larger runs, these values are half that */
autoscaledPoolOptions: { scaleDownStepRatio: 0.025, scaleUpStepRatio: 0.025 },
/**
* The default value scale up too quickly for larger runs, this value is half that
* - Scaling down is still the default value, meaning the pool will scale down faster than it scales up
*/
autoscaledPoolOptions: { scaleUpStepRatio: 0.025 },
retryOnBlocked: true,
requestHandlerTimeoutSecs: 3 * 60,
proxyConfiguration,
Expand Down

0 comments on commit 60077dd

Please sign in to comment.