4.4.2

Update CHANGELOG

4.4.1

4.4.1 - 2019-06-06

• handle relative paths after redirects correctly

4.4.0

• add getUrls and getPendingUrls

4.3.2

• Respect maximumDepth in combination with robots (#181)

4.3.1

• Properly handle noindex,follow urls.

4.3.0

• added capability of crawling links with rel= next or prev

4.2.0

• add setDelayBetweenRequests

4.1.7

• fix an issue where the node in the depthtree could be null

4.1.6

• improve performance by only building the depth three when needed
• handlers will get html after JavaScript has been processed

4.1.5

• refactor to improve extendability