Commit Graph

144 Commits

Author SHA1 Message Date
Ethan Shen e42bdf3d97
fix(utils): typo in parse-date (#9391)
* fix(utils): typo in parse-date

* fix: add `后日`
2022-03-26 19:44:27 +08:00
Ethan Shen d5648b37ee
fix(utils): parse relative dates with multiple time units (#9365)
* fix(utils): parse relative dates with multiple time units

* docs: remove warning

* fix: add more characters to match

* fix: rename to parse-date
2022-03-26 16:45:42 +08:00
Rongrong c48ca6bd5b
fix(core): invalid feed fields (#9286)
Signed-off-by: Rongrong <15956627+Rongronggg9@users.noreply.github.com>
2022-03-22 02:13:15 +08:00
Tony 2c2bf4ed09
fix: typo in puppeteer options 2022-03-06 23:42:32 +08:00
DIYgod 35c9834049
fix: puppeteer userDataDir 2021-11-28 01:21:42 +00:00
NeverBehave 0792f7ba25
feat(core): first attempt to init script standard (#8224)
- lazy load
- rate limit per path
- init .debug.json support
- docs
- maintainer
- radar
2021-09-22 05:41:00 -07:00
Daniel Li (李丹阳) d77a039f05
style(eslint): add no-implicit-coercion rule (#8175)
* refactor: add no-implicit-coercion rule for ESLint

* fix: errors from deepscan

* fix: errors from deepscan

* fix: errors from deepscan

* fix: errors from deepscan

* fix: errors from deepscan

* Update docs/en/joinus/quick-start.md

Co-authored-by: Sukka <isukkaw@gmail.com>

* Update docs/joinus/quick-start.md

Co-authored-by: Sukka <isukkaw@gmail.com>

* Update lib/routes/av01/tag.js

Co-authored-by: Sukka <isukkaw@gmail.com>

* Update lib/routes/gov/taiwan/mnd.js

Co-authored-by: Sukka <isukkaw@gmail.com>

* Update lib/routes/ps/product.js

Co-authored-by: Sukka <isukkaw@gmail.com>

* refactor: minify html string

Co-authored-by: Sukka <isukkaw@gmail.com>
2021-09-15 21:22:11 +08:00
Sukka 31720bbb1b
perf: lazy require dependencies (#8025) 2021-08-20 14:05:57 +08:00
Sukka d82847f541
style/chore(eslint): enforce new rules (#8040)
* style: prefer object shorthand syntax
* refactor: prefer Array#map over Array#forEach
* style: prefer arrow callback
* chore(eslint): update rules
* style: auto fix by eslint
2021-08-17 22:23:23 +08:00
Sukka 6e3b58ed1d
refactor: avoid promise overhead (#8028) 2021-08-16 11:45:53 -07:00
Chih-Hsuan Yen 1c9c4ccfc8
fix(core): make sure timeout error messages include URLs (#7981)
Before this fix, timeout messages are not quite useful

> error: Request undefined fail, retry attempt #1: TimeoutError: Timeout awaiting 'request' for 5000ms
2021-08-12 01:27:07 -07:00
Queensferry 65e74a1c5e
chore(utils): `parse-date` supports relative time & fix routes (#7530) 2021-05-14 23:08:33 -04:00
GitHub Action e1b3b5d877 style: auto format 2021-05-08 21:49:05 +00:00
Queensferry 10f5bb7bce
refactor: timezone conversion in `lib/utils/date.js` (#7438) 2021-05-08 17:45:37 -04:00
DIYgod 89e82d88fa
feat: got request timeout 2021-02-01 20:06:49 +08:00
DIYgod c5e3a27f44
feat: auto add headers.host 2020-12-17 18:54:29 +08:00
Herb Brewer d4bdf8c7e8
feat: add 豆瓣用户想看 (#6285) 2020-12-04 15:44:33 +00:00
Shun Zi 3442ca9196
feat: more readable twitter tweet (#6051) 2020-10-30 09:09:10 +00:00
Henry ec49562269
Revert #5271
Incomplete PR. #5261
2020-07-29 17:25:41 +01:00
sabuaka18 eddba23099
feat: javbus routes: `director` `label` `studio` (#5271)
Co-authored-by: zrenca <42361841+zrenca@users.noreply.github.com>
2020-07-28 15:59:30 +01:00
hoilc 90030ec017
fix anitama date (#5255) 2020-07-28 05:54:43 +01:00
dependabot-preview[bot] 68c15eaa5c
chore(deps): bump got from 11.1.4 to 11.3.0 (#4922)
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
Co-authored-by: DIYgod <diy.d.god@gmail.com>
2020-06-26 01:22:09 +08:00
DIYgod ae529572d7
feat: longer closing puppeteer page time 2020-06-14 22:28:43 +08:00
Mitt f7a1380dac
fix: host in headers after redirecting request (#4717) 2020-05-11 18:35:08 +08:00
DIYgod 8f371e6703 Merge branch 'proxy' of git://github.com/zengxs/RSSHub into zengxs-proxy 2020-05-07 00:42:56 +08:00
zengxs 58e930b4cc support proxy-uri 2020-05-06 22:43:09 +08:00
Mitt 725a733b2a
fix: ingore undefined got options (#4651) 2020-05-06 19:47:51 +08:00
DIYgod fedfc741d5
feat: add config noLogfiles, set noLogFiles for now 2020-04-28 18:21:36 +08:00
fengkx 7902c547cf
feat: depoly on now serverless function (#4554) 2020-04-28 17:28:57 +08:00
DIYgod 17e54c0ec8
fix: redundant moment dependence 2020-04-19 21:06:10 +08:00
DIYgod 0e7b14e718
chore(deps-dev): bump prettier from 1.19.1 to 2.0.2 2020-04-02 21:21:46 +08:00
DIYgod 0b63142add
test: fix undefined url 2020-02-15 21:46:10 +08:00
DIYgod 48b27fe811
feat: auto add header Host 2020-02-15 21:32:16 +08:00
DIYgod 77d55262ff
chore: bump got from 9.x to 10.x (#3875) 2020-02-04 01:09:14 +08:00
Luyu Huang fbabb3679c
feat: add route for netease god (#3801) 2020-02-01 18:11:02 +08:00
junfengP 252f314a19 feat: 增加Discuz通用路由 (#3721) 2020-01-16 14:20:10 +08:00
DIYgod 7a2dc47bf7
feat(core): auto referer 2019-10-22 17:25:32 +08:00
MachX 2204388bbd fea: webtoons (close #3164) (#3178) 2019-10-09 11:02:11 +08:00
DIYgod 4ae28e48b5
feat: disable console log for pkg 2019-09-18 17:57:05 +08:00
DIYgod 4445443946
feat: use dynamical config 2019-09-18 17:45:21 +08:00
Cloud 4d6257af50 feat: replace baseUrl to prefixUrl when got's next version (#2996)
* enhance: replace baseUrl to prefixUrl when got's next version

* test: baseUrl
2019-09-05 12:01:44 +08:00
DIYgod 70c9546871
fix: puppeteer close error 2019-09-03 23:04:42 +08:00
DIYgod a34b9ae542
feat: remove addNoReferrer 2019-08-28 14:33:05 +08:00
DIYgod 29f588e6a0
feat: handle description in parameter middleware 2019-08-28 12:06:50 +08:00
DIYgod 6f2ee73073
feat: move encodeURIComponent to routes 2019-08-18 18:03:41 +08:00
DIYgod eba8f46875
feat: header x-app -> server 2019-08-15 23:14:48 +08:00
Cloud d6fccdeeac feat: queshu title add book name (#2862) 2019-08-15 22:19:00 +08:00
Cloud 17b4946c00 feat: add queshu (#2850)
* feat: add queshu

* feat: add queshu
2019-08-14 17:34:21 +08:00
Cloud 3ce63c72b7 fix: try to solve #1888 (#2829) 2019-08-11 23:12:54 +08:00
DIYgod 0aaf1e3f6c
fix: object got query, close #2824 2019-08-11 01:33:33 +08:00
DIYgod 5d8cf35ef5 Merge branch 'request-wrapper' 2019-08-11 00:37:34 +08:00
DIYgod e5d34eda6b
test: request-wrapper 2019-08-11 00:31:20 +08:00
Cloud 054d159e8c fix: Request path contains unescaped characters error (#2784) 2019-08-08 22:49:32 +08:00
DIYgod 6f3a7836f2
feat: request wrapper 2019-08-06 13:00:22 +08:00
DIYgod 08878e1d52
fix: set proxy for http module, close #2647 #2094 2019-08-03 20:38:37 +08:00
DIYgod cd10dfcc93
refactor: format 2019-08-02 17:55:00 +08:00
sanmmmm 914034760d feat: 新增自动提取全文输出 (#2738) 2019-08-02 17:22:58 +08:00
Henry Wang 1d071836a9 fix: various optimizations (#2581)
* chore: string quotations

* fix: various optimizations

remove redundant checks
2019-07-08 11:52:47 +08:00
Henry Wang d09affa703 feat: add addNoReferrer in common-utils (#2571)
* fix: no-referrer tag

* chore: merge qdaily routes

* feat: add addNoReferrer in common-utils

This adds no-referrer attribute to images.
Parameters:

- add no-referrer attribute to images
- $: cheerio selector
- source: source selector, string
- target: target attribute name, typically for lazyload imgs, string
- srcPrefix: prefix for src, string
- removeAttr: attributes to remove, array: ['attrA','attrB']

* test: add test case

* doc: update
2019-07-08 11:45:02 +08:00
DIYgod 59bb15e761
fix: got encoding 2019-06-15 10:24:06 +08:00
DIYgod 56e74742fc
test: got axios options 2019-06-14 17:51:03 +08:00
DIYgod 749ede3af8
test: puppeteer auto close 2019-06-13 18:37:55 +08:00
DIYgod f8f427a414
test: date cases 2019-06-13 16:21:05 +08:00
Henry Wang 4531de80f9 feat: add common-utils (#2374) 2019-06-12 11:09:27 +08:00
DIYgod ea508b8bc2
fix: post type 2019-06-04 18:28:06 +08:00
DIYgod 907d7498ca
fix: compatible with axios data and params 2019-06-04 15:10:27 +08:00
DIYgod 3efdb57be0
fix: got option.body 2019-06-04 11:59:36 +08:00
DIYgod feab46cb15
fix: got.all 2019-06-04 11:54:20 +08:00
DIYgod 2bd3b39fcd
fix: always parse response body 2019-06-04 11:13:54 +08:00
DIYgod a56c0b5a39
refactor: rename axios to got 2019-06-03 18:03:05 +08:00
DIYgod c4bf4fcdb4
fix: agent option 2019-06-03 17:44:22 +08:00
DIYgod 163a589e20 Merge branch 'master' into feature/got 2019-06-03 17:06:48 +08:00
Xiang Li 633154c778 refactor: 重构 rss-parser 作为工具类 (#2280) 2019-06-02 12:45:52 +08:00
DIYgod e2badbfa98
chore: module alias for all routes 2019-05-15 15:27:15 +08:00
zengxs 4e5f50fe56 feat: OSChina 新闻抓取的时候解析时间字符串 (#2062) 2019-05-07 12:08:51 +08:00
DIYgod df026d7198
support http and https proxy 2019-04-18 14:27:07 +08:00
DIYgod 07b2771b63
fix buffer encoding 2019-04-18 00:20:39 +08:00
DIYgod 57a06b190f Merge branch 'use-got-fix-proxy' of https://github.com/fengkx/RSSHub into fengkx-use-got-fix-proxy 2019-04-17 23:05:13 +08:00
DIYgod 9ff646c066
fix douyin 2019-04-11 14:35:16 +08:00
footair ba57ded1cd 解决一分钟之内发布的微博,pubDate为'刚刚'的bug (#1874)
解决一分钟之内发布的微博,pubDate为'刚刚'的bug

close #1870
2019-04-08 11:28:27 +08:00
Marcus ee137c4007 增加艾瑞产业研究报告 2019-03-25 13:10:48 +08:00
DIYgod f4a958d93a
format 2019-03-23 00:41:40 +08:00
SettingDust f8990b7cb7 The cherrio config route (#1699)
Use js config too build rss

close #349 close #1035
2019-03-11 10:47:09 +08:00
fengkx ca0b9bca33 format code 2019-03-10 09:37:15 +08:00
fengkx 1c0bf5697f test 2019-03-10 00:19:54 +08:00
fengkx a1259483cd replace axios using got 2019-02-28 21:51:24 +08:00
Chenyang Shi 19fa9093af add segmentfault频道 (#1543) 2019-02-19 11:50:42 +08:00
DIYgod 58f0333cca
test: date 2019-01-23 11:55:50 +08:00
DIYgod d00c4dc263
test: utils/date 2019-01-22 18:01:23 +08:00
DIYgod bd657cb4be
format 2019-01-15 10:51:52 +08:00
NStal c956c8a0dd Add socks proxy support (#1379) 2019-01-14 14:52:30 +08:00
DIYgod 38a089a436
restore date range test, remove problematic test cases 2019-01-09 19:04:37 +08:00
DIYgod 21877b1f28
unit test 2018-12-30 14:38:11 +08:00
DIYgod 38a90e29b0
optimize directory structure 2018-12-26 18:35:10 +08:00