RSSHub/lib/utils
Tony 2ae10a7a02
feat: replace rand-user-agent with header-generator (#20480)
* Initial plan

* Replace @tonyrl/rand-user-agent with header-generator and add sec-ch-* headers

Co-authored-by: TonyRL <11386903+TonyRL@users.noreply.github.com>

* Extract unwanted UA validation into standalone isValidUserAgent function

Co-authored-by: TonyRL <11386903+TonyRL@users.noreply.github.com>

* Add headerGeneratorPreset option to got and ofetch utilities

* Replace randUserAgent usage in lib/routes with headerGeneratorPreset option

Co-authored-by: TonyRL <11386903+TonyRL@users.noreply.github.com>

* chore: pin header-generator to exact match

* fix: replace randUserAgent with a static user agent string in config

* Remove deprecated _randUserAgent function and related tests

Co-authored-by: TonyRL <11386903+TonyRL@users.noreply.github.com>

* refactor: rename to header-generator

* Changes before error encountered

Co-authored-by: TonyRL <11386903+TonyRL@users.noreply.github.com>

* fix: update generateHeaders parameter type to Partial<HeaderGeneratorOptions>

* fix: add ios preset

* fix: rename headerGeneratorPreset to headerGeneratorOptions

* feat: add MODERN_IOS preset and update header-generator patch hash

* fix: use ios preset

* fix: update FetchOptions to include headerGeneratorOptions type

* refactor: simplify header generation and update header inclusion list

* fix: remove header-generator patch

* refactor: update user-agent handling in requests and tests

* test: remove redundant headerGeneratorOptions test and add new ofetch header preset test

* test: add custom user-agent test for ofetch

* test: update user-agent expectation in ofetch headers test

* Update lib/utils/ofetch.ts

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* refactor: replace hardcoded headers with generatedHeaders in fetch and get request handlers

* refactor: rename test suite from rand-user-agent to header-generator and remove unused dependency

* Update lib/utils/header-generator.ts

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

---------

Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: TonyRL <11386903+TonyRL@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
2025-11-14 00:49:41 +08:00
..
cache
otel
proxy
request-rewriter feat: replace rand-user-agent with header-generator (#20480) 2025-11-14 00:49:41 +08:00
cache.test.ts
camelcase-keys.spec.ts
camelcase-keys.ts
common-config.test.ts
common-config.ts
common-utils.test.ts
common-utils.ts
debug-info.ts
git-hash.ts
got-deprecated.ts
got.test.ts feat: replace rand-user-agent with header-generator (#20480) 2025-11-14 00:49:41 +08:00
got.ts
header-generator.test.ts feat: replace rand-user-agent with header-generator (#20480) 2025-11-14 00:49:41 +08:00
header-generator.ts feat: replace rand-user-agent with header-generator (#20480) 2025-11-14 00:49:41 +08:00
helpers.test.ts
helpers.ts fix(route/bilibili): duration for video route 2025-10-09 10:44:18 +08:00
logger.ts
md5.test.ts
md5.ts
ofetch.test.ts feat: replace rand-user-agent with header-generator (#20480) 2025-11-14 00:49:41 +08:00
ofetch.ts feat: replace rand-user-agent with header-generator (#20480) 2025-11-14 00:49:41 +08:00
parse-date.test.ts
parse-date.ts
puppeteer-utils.test.ts chore(deps-dev): bump eslint-plugin-unicorn from 60.0.0 to 61.0.2 (#19998) 2025-09-08 23:03:48 +08:00
puppeteer-utils.ts
puppeteer.test.ts fix(tests): update expected values and increase timeout for Puppeteer tests 2025-08-22 17:45:39 +08:00
puppeteer.ts
readable-social.test.ts
readable-social.ts
render.ts
request-rewriter.test.ts feat: replace rand-user-agent with header-generator (#20480) 2025-11-14 00:49:41 +08:00
rss-parser.test.ts
rss-parser.ts
timezone.test.ts
timezone.ts
valid-host.test.ts
valid-host.ts
wait.test.ts
wait.ts
wechat-mp.test.ts
wechat-mp.ts chore(deps-dev): bump eslint-plugin-unicorn from 61.0.2 to 62.0.0 (#20381) 2025-10-28 01:26:56 +08:00