v3.16.0

3.16.0 (2026-02-06)

Bug Fixes

• adaptive-crawler: Fix persistence of rendering type detection results (#3368) (4abca8b)
• certain redirect responses change request methods (#3296) (efac644), closes #2586
• clean turbo cache and tsbuildinfo files in yarn clean (#3348) (6cd9456)
• core: ensure maxCrawlDepth warning is logged only once (#3337) (9d01334), closes #3336
• handle multiple BasicCrawler.stop() calls correctly (#3324) (9c0580b), closes #3257
• impit-client: pause fromWeb stream to prevent early consumption (#3347) (72aacb4), closes #555
• more permissive accept (#3373) (d03af1b), closes #3242
• remove deprecation from RequestQueueV1 (#3341) (89309bc)
• suppress info message for undefined maxRequestsPerCrawl (#3237) (f3d9a79)

Features

• add @crawlee/stagehand package for AI-powered browser automation (#3331) (a89cb5a), closes #3064
• Add a counter of in-flight rendering type detections (#3355) (565fc34)
• implements async iterators (#3352) (7f7a4ab), closes #3338
• make handleCloudflareChallenge more configurable (#3247) (629daf8), closes #3127
• utils: add discoverValidSitemaps utility (#3339) (29f52ed)

Performance Improvements

• drop tsbuildinfo from published packages (#3243) (3450f27), closes #3239

v3.15.3

3.15.3 (2025-11-10)

Bug Fixes

• await retries inside _timeoutAndRetry (#3206) (9c1cf6d), closes /github.com/apify/crawlee/pull/3188#discussion_r2410256271
• cli: support creating projects with names that start with a number (#3219) (3f37845), closes #3213
• use shared enqueue links wrapper in AdaptivePlaywrightCrawler (#3188) (9569d19)

Features

• support custom userAgent with respectRobotsTxtFile (#3226) (354252d), closes #3222

v3.15.2

3.15.2 (2025-10-23)

Bug Fixes

• correctly apply launchOptions with useIncognitoPages (#3181) (84a4b70), closes #3173 #3173
• enable systemInfoV2 by default (#3208) (617a343)
• Re-export MemoryStorage from the crawlee package (#3200) (e183ea9)

Features

• export cheerio types in all crawler packages (#3204) (f05790b)

Performance Improvements

• don't await crawler.setStatusMessage (#3207) (1a67ffb)

v3.15.1

3.15.1 (2025-09-26)

Bug Fixes

• use correct config for storage classes to avoid memory leaks (#3144) (911a2eb)

Performance Improvements

• Improve glob performance by reusing minimatch objects (#3168) (e5632e2)

v3.15.0

3.15.0 (2025-09-17)

Bug Fixes

• ImpitHttpClient respects the internal Request timeout (#3103) (a35376d)
• proxyUrls list can contain null (#3142) (dc39cc2), closes #3136
• don't fail exportData calls on empty datasets (#3115) (298f170), closes #2734
• respect maxCrawlDepth with a custom enqueueLinks transformRequestFunction (#3159) (e2ecb74)

Features

• add collectAllKeys option for BasicCrawler.exportData (#3129) (2ddfc9c), closes #3007
• add TandemRequestProvider for combined RequestList and RequestQueue usage (#2914) (4ca450f), closes #2499

v3.14.1

3.14.1 (2025-08-05)

Note: Version bump only for package @crawlee/root

v3.14.0

3.14.0 (2025-07-25)

Bug Fixes

• don't retire browsers with long-running pre|postLaunchHooks prematurely (#3062) (681660e)
• respect exclude option in enqueueLinksByClickingElements (#3058) (013eb02)
• retry on blocked status codes in HttpCrawler (#3060) (b5fcd79), closes #3029
• validation of iterables when adding requests to the queue (#3091) (529a1dd), closes #3063

Features

• add maxCrawlDepth crawler option (#3045) (0090df9), closes #2633

v3.13.10

3.13.10 (2025-07-09)

Bug Fixes

• call onSkippedRequest for AdaptivePlaywrightCrawler.enqueueLinks (#3043) (fc23d34), closes #3026 #3039
• improve enqueueLinks limit checking (#3038) (2774124), closes #3037

v3.13.9

3.13.9 (2025-06-27)

Bug Fixes

• Do not log 'malformed sitemap content' on network errors in Sitemap.tryCommonNames (#3015) (64a090f), closes #2884
• Fix link filtering in enqueueLinks in AdaptivePlaywrightCrawler (#3021) (8a3b6f8), closes #2525

Features

• Accept (Async)Iterables in addRequests methods (#3013) (a4ab748), closes #2980
• Report links skipped because of various filter conditions (#3026) (5a867bc), closes #3016

v3.13.8

3.13.8 (2025-06-16)

Bug Fixes

• Do not enqueue more links than what the crawler is capable of processing (#2990) (ea094c8), closes #2728
• Persist rendering type detection results in AdaptivePlaywrightCrawler (#2987) (76431ba), closes #2899

Features

• dataset: add collectAllKeys option for full CSV export (#2945) (#3007) (3b629da)
• support KVS.listKeys() prefix and collection parameters (#3001) (5c4726d), closes #2974