xiaoxue_admin
/
RSSHub
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
7,443 Commits 1 Branch 0 Tags 161 MiB
Commit Graph

53 Commits

Author SHA1 Message Date
Tony 0f31bfa8b9
fix(utils): parse relative date with meridiem (#9775) 
* fix(utils): parse relative date with meridiem

* fix: use regex
 2022-05-17 20:21:47 +08:00
TonyRL 2bcc6f6ad0 test: puppeteer wait until test finish 2022-05-04 20:43:15 +00:00
Tony 0b544e1395
feat(utils): puppeteer-extra-plugin-stealth (#9676) 2022-05-03 01:17:17 +08:00
Rongrong 0522c63d5f
fix(core/utils): invalid request header `Server` (#9582) 
Signed-off-by: Rongrong <15956627+Rongronggg9@users.noreply.github.com>
 2022-04-20 22:32:46 +08:00
Tony bafb3534e1
feat(utils): random user agent (#9449) 
* feat(utils): random ua

* chore: bump rand-user-agent to 1.0.58(no more deps)
 2022-04-12 17:51:07 +08:00
Rongrong 74e1f88a32
feat(core)(utils/wechat-mp): normalize URL (#9497) 
Signed-off-by: Rongrong <15956627+Rongronggg9@users.noreply.github.com>
 2022-04-08 18:42:52 +08:00
Rongrong a79cc20ec1
feat(utils): add utils for WeChat MP (#9487) 
Motivation:
There are multiple routes that need to fetch articles from WeChat MP.
However, letting them fetch articles by themselves could potentially
lead to cache key collisions. Even if cache key collisions do not occur,
un-normalized URL could potentially lead to duplicated requests.
What's more, articles from WeChat MP have weird formats and need to be
fixed. Creating a universal function to do this work can create some
ease for new route contributors.

Note:
In order to make this PR atomic as much as possible, I did not touch
those broken routes. Once this PR is merged, I will try to fix them.

Signed-off-by: Rongrong <15956627+Rongronggg9@users.noreply.github.com>
 2022-04-07 21:46:15 +08:00
Rongrong 5b35471e39
fix(core): offending RFC4287 (#9441) 
* fix(core): offending RFC4287

should not leave `<updated>` blank when `<published>` is not blank
these two fields MUST conform to the "date-time" production in RFC3339

Signed-off-by: Rongrong <15956627+Rongronggg9@users.noreply.github.com>

* test(common-utils): complete tests

Signed-off-by: Rongrong <15956627+Rongronggg9@users.noreply.github.com>

* test(template): restrict expected value of `pubDate`

Signed-off-by: Rongrong <15956627+Rongronggg9@users.noreply.github.com>
 2022-04-02 17:44:45 +08:00
Ethan Shen bf834bdb7d
fix(utils): tests for parse-date (#9428) 2022-03-31 10:23:42 +08:00
Ethan Shen d5648b37ee
fix(utils): parse relative dates with multiple time units (#9365) 
* fix(utils): parse relative dates with multiple time units

* docs: remove warning

* fix: add more characters to match

* fix: rename to parse-date
 2022-03-26 16:45:42 +08:00
DIYgod 0c6516c893
test: fix puppeteer error 2021-11-28 01:37:20 +00:00
Sukka d82847f541
style/chore(eslint): enforce new rules (#8040) 
* style: prefer object shorthand syntax
* refactor: prefer Array#map over Array#forEach
* style: prefer arrow callback
* chore(eslint): update rules
* style: auto fix by eslint
 2021-08-17 22:23:23 +08:00
Sukka 6e3b58ed1d
refactor: avoid promise overhead (#8028) 2021-08-16 11:45:53 -07:00
Chih-Hsuan Yen 1c9c4ccfc8
fix(core): make sure timeout error messages include URLs (#7981) 
Before this fix, timeout messages are not quite useful

> error: Request undefined fail, retry attempt #1: TimeoutError: Timeout awaiting 'request' for 5000ms
 2021-08-12 01:27:07 -07:00
DIYgod 89e82d88fa
feat: got request timeout 2021-02-01 20:06:49 +08:00
dependabot-preview[bot] 68c15eaa5c
chore(deps): bump got from 11.1.4 to 11.3.0 (#4922) 
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
Co-authored-by: DIYgod <diy.d.god@gmail.com>
 2020-06-26 01:22:09 +08:00
DIYgod 6d7ab13150
test: longer closing puppeteer page time 2020-06-14 22:38:01 +08:00
zengxs 910cbbc170 update docs & test cases 2020-05-06 23:12:43 +08:00
DIYgod 17e54c0ec8
fix: redundant moment dependence 2020-04-19 21:06:10 +08:00
DIYgod 0e7b14e718
chore(deps-dev): bump prettier from 1.19.1 to 2.0.2 2020-04-02 21:21:46 +08:00
DIYgod 48b27fe811
feat: auto add header Host 2020-02-15 21:32:16 +08:00
DIYgod f6baa8d2cc
test: fix request-wrapper 2020-02-05 04:12:03 +08:00
DIYgod 77d55262ff
chore: bump got from 9.x to 10.x (#3875) 2020-02-04 01:09:14 +08:00
DIYgod eec4fe626c
test: add date test case 2020-02-01 18:21:39 +08:00
DIYgod da19f818a4
test: compatible with github actions 2019-11-25 21:59:24 +08:00
DIYgod 2d22563254
test: compatible with github actions 2019-11-25 12:10:39 +08:00
DIYgod 7a2dc47bf7
feat(core): auto referer 2019-10-22 17:25:32 +08:00
MachX 2204388bbd fea: webtoons (close #3164) (#3178) 2019-10-09 11:02:11 +08:00
Cloud 90a87b1723 refactor: optimize parameter (#3200) 2019-10-08 16:48:46 +08:00
DIYgod 4445443946
feat: use dynamical config 2019-09-18 17:45:21 +08:00
Cloud 4d6257af50 feat: replace baseUrl to prefixUrl when got's next version (#2996) 
* enhance: replace baseUrl to prefixUrl when got's next version

* test: baseUrl
 2019-09-05 12:01:44 +08:00
DIYgod 56566ef62d
test: remove handleImg 2019-08-28 14:45:33 +08:00
DIYgod 29f588e6a0
feat: handle description in parameter middleware 2019-08-28 12:06:50 +08:00
Cloud 43a2bf482e test: common-config (#2891) 
* test: common-config

* test: common-config
 2019-08-20 17:40:17 +08:00
Cloud cb408c94de test: test rule optimization (#2871) 2019-08-18 21:40:51 +08:00
DIYgod eba8f46875
feat: header x-app -> server 2019-08-15 23:14:48 +08:00
DIYgod e5d34eda6b
test: request-wrapper 2019-08-11 00:31:20 +08:00
sanmmmm 914034760d feat: 新增自动提取全文输出 (#2738) 2019-08-02 17:22:58 +08:00
Henry Wang d09affa703 feat: add addNoReferrer in common-utils (#2571) 
* fix: no-referrer tag

* chore: merge qdaily routes

* feat: add addNoReferrer in common-utils

This adds no-referrer attribute to images.
Parameters:

- add no-referrer attribute to images
- $: cheerio selector
- source: source selector, string
- target: target attribute name, typically for lazyload imgs, string
- srcPrefix: prefix for src, string
- removeAttr: attributes to remove, array: ['attrA','attrB']

* test: add test case

* doc: update
 2019-07-08 11:45:02 +08:00
DIYgod 56e74742fc
test: got axios options 2019-06-14 17:51:03 +08:00
DIYgod 909980fcce
test: proxy auth and url_regex 2019-06-14 11:18:18 +08:00
DIYgod a17c89abaf
test: proxy 2019-06-13 19:32:42 +08:00
DIYgod 749ede3af8
test: puppeteer auto close 2019-06-13 18:37:55 +08:00
DIYgod f8f427a414
test: date cases 2019-06-13 16:21:05 +08:00
Henry Wang 4531de80f9 feat: add common-utils (#2374) 2019-06-12 11:09:27 +08:00
DIYgod a56c0b5a39
refactor: rename axios to got 2019-06-03 18:03:05 +08:00
DIYgod 163a589e20 Merge branch 'master' into feature/got 2019-06-03 17:06:48 +08:00
DIYgod 0fe65cece8
test: add test cases for date 2019-05-07 14:39:24 +08:00
DIYgod 57a06b190f Merge branch 'use-got-fix-proxy' of https://github.com/fengkx/RSSHub into fengkx-use-got-fix-proxy 2019-04-17 23:05:13 +08:00
SettingDust f8990b7cb7 The cherrio config route (#1699) 
Use js config too build rss

close #349 close #1035
 2019-03-11 10:47:09 +08:00