x2009again
42dfd5cc81
feat(route): 增加微语简报源 ( #9577 )
...
* 添加微语简报源
* 精简列表描述
* 优化微语简报排版,增加文档说明
* 修复部分序号错误问题
* 增加v2版微语简报源
* 时区修改
* 删除微语简报旧路由
* 按建议修改
* 修改微语简报网址
2022-04-21 23:18:35 +08:00
Howard Yin and TonyRL
67d87e2eea
feat(route): E站增加封面图嵌入RSS和封面图替换为代理网址的功能 ( #9344 )
...
* 增加封面图嵌入RSS的功能
* 增加EH封面图代理的功能
* 改用URLSearchParams代替querystring
增加对"Minimal", "Minimal+" and "Extended"页面模式的支持
* fix: matching logic
* refactor: migrate to v2
* docs: add missing description of EH_IMG_PROXY
* docs: remove ignoring EH_SK
Co-authored-by: TonyRL <TonyRL@users.noreply.github.com >
2022-04-21 23:03:55 +08:00
任平生 and blankyu
9d9926d0bf
fix(utils): 修复抓取微信已删除文章时遇到的报错 ( #9589 )
...
* fix(utils): 支持微信公众号单图片文章抓取
* fix(utils): 支持输出微信公众号转载文章阅读原文链接
* fix(utils): 修复抓取微信已删除文章时遇到的报错
* refactor: migrate to v2
Co-authored-by: blankyu(于海洋) <blankyu@tencent.com >
2022-04-21 21:40:16 +08:00
04206ca5b1
feat(route): 封面新闻 ( #9587 )
...
* feat(route): 封面
* Update docs/new-media.md
Co-authored-by: Tony <TonyRL@users.noreply.github.com >
* Update lib/v2/thecover/radar.js
Co-authored-by: Tony <TonyRL@users.noreply.github.com >
* Update lib/v2/thecover/radar.js
Co-authored-by: Tony <TonyRL@users.noreply.github.com >
Co-authored-by: yuxinliu <yuxin2@mgtv.com >
Co-authored-by: Tony <TonyRL@users.noreply.github.com >
2022-04-21 18:59:58 +08:00
yuxinliu-alex and yuxinliu
35347a921d
feat(route): 中国新闻网 ( #9584 )
...
* feat(route): 中国新闻网
* Update docs/traditional-media.md
* Update lib/v2/chinanews/index.js
Co-authored-by: yuxinliu <yuxin2@mgtv.com >
2022-04-21 03:32:13 -02:00
dependabot[bot] and TonyRL
dd4a216648
chore(deps): bump socks-proxy-agent from 6.1.1 to 6.2.0 ( #9572 )
...
* chore(deps): bump socks-proxy-agent from 6.1.1 to 6.2.0
Bumps [socks-proxy-agent](https://github.com/TooTallNate/node-socks-proxy-agent ) from 6.1.1 to 6.2.0.
- [Release notes](https://github.com/TooTallNate/node-socks-proxy-agent/releases )
- [Changelog](https://github.com/TooTallNate/node-socks-proxy-agent/blob/master/CHANGELOG.md )
- [Commits](https://github.com/TooTallNate/node-socks-proxy-agent/compare/v6.1.1...v6.2.0 )
---
updated-dependencies:
- dependency-name: socks-proxy-agent
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
* fix: use dot notation
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: TonyRL <TonyRL@users.noreply.github.com >
2022-04-21 03:54:53 +08:00
Rongrong
0522c63d5f
fix(core/utils): invalid request header Server ( #9582 )
...
Signed-off-by: Rongrong <15956627+Rongronggg9@users.noreply.github.com >
2022-04-20 22:32:46 +08:00
yuxinliu-alex and alex
7e9af67274
feat(route): 环球网 ( #9580 )
...
* feat(route): 环球网
* feat(route): 环球网 加入通用参数limit限制条数及格式调整
Co-authored-by: alex <yuxin2@mgtv.com >
2022-04-20 22:30:11 +08:00
Rongrong
cc48b48bc8
feat(route): add wechat/data258 ( #9571 )
...
Signed-off-by: Rongrong <15956627+Rongronggg9@users.noreply.github.com >
2022-04-20 21:43:34 +08:00
Levi Zim
a43542ee2d
feat(route): /sdu/wh/jwc/:column? for 山东大学(威海)教务处 ( #9585 )
...
* feat: extractor for https://jwc.wh.sdu.edu.cn/
* feat(route): /sdu/wh/jwc for 山东大学(威海)教务处
* feat(radar): 山东大学(威海)教务处
* fix(radar): match wildcard path for 山东大学(威海)新闻网
* docs: for route /sdu/wh/jwc
* fix: update maintainer.js
2022-04-20 21:13:12 +08:00
yuxinliu-alex and Alex Liu
fccb91838d
fix(route): 央视新闻-专题 支持获取Author字段 ( #9568 )
...
* fix(route): 央视新闻-专题 支持获取Author字段
* refactor: migrate to v2
* fix: date parsing in /cctv/photo/jx
* fix: special date parsing
fix: xwlb not working
fix: mzzlbg item description
fix: news use https
fix: xinwen1j1 not working
* feat: add radar
Co-authored-by: Alex Liu <yuxinliu.alex@gmail.com >
2022-04-20 20:11:58 +08:00
yuxinliu-alex and alex
80aab00fdb
feat(route): 国家广播电视总局 ( #9566 )
...
* feat(route): 国家广播电视总局
* move the nrta to lib\v2\gov
* fix: feed link
* fix: radar
* fix: radar
Co-authored-by: alex <yuxin2@mgtv.com >
2022-04-19 19:51:52 +08:00
yuxinliu-alex and alex
5f4cf8a2f0
feat(route): 参考消息 ( #9564 )
...
* feat(route): 参考消息
* fixed the router's & ref bugs
* docs: fix example
* fix: prefer https
* fix: radar
Co-authored-by: alex <yuxin2@mgtv.com >
2022-04-19 19:17:42 +08:00
yuxinliu-alex and alex
103a14ba06
fix(route): cnbeta去除广告并添加Author字段 ( #9562 )
...
Co-authored-by: alex <yuxin2@mgtv.com >
2022-04-19 18:39:20 +08:00
Fatpandac
9b459f02aa
fix(route): npm/package fix route params ( #9578 )
2022-04-19 18:38:00 +08:00
8d2d835cd1
fix(route): 新华社新闻_新华网获取Pubdate字段 ( #9570 )
...
* 新华网修复部分文章无法获取pubDate问题
* fix(route): 新华社新闻_新华网获取Pubdate字段
Co-authored-by: alex <yuxin2@mgtv.com >
Co-authored-by: Alex Liu <yuxinliu.alex@gmail.com >
2022-04-19 02:37:57 +08:00
任平生
f3e069d399
fix(utils): 支持微信公众号单图片文章抓取; 增加输出阅读原文链接 ( #9557 )
...
* fix(utils): 支持微信公众号单图片文章抓取
* fix(utils): 支持输出微信公众号转载文章阅读原文链接
2022-04-19 01:29:45 +08:00
Fatpandac
864016c598
fix(route): dongqiudi/top_news cannot convert undefined or null to ob… ( #9558 )
...
* fix(route): dongqiudi/top_news cannot convert undefined or null to object
* refactor: migrate to v2
* refactor: daily parseDate cache.tryGet
* fix: legacy url.parse, cache article
* refactor: result use parseDate
* refactor: `cache.get` to `cache.tryGet`
* fix: add radar
* fix: Incomplete URL substring sanitization
2022-04-19 01:19:10 +08:00
yuxinliu-alex and alex
3edf239759
fix(route): 观察网源支持获取Author字段 ( #9561 )
...
Co-authored-by: alex <yuxin2@mgtv.com >
2022-04-18 20:00:59 +08:00
Bin Wang
6b7381e1e3
feat(core): add custom fields to atom feed ( #9355 )
...
* Add custom fields to atom feed
Atom allows to extend the xml with custom namespaces. This commit is
a first commit that tries to add some custom RSSHub fields to atom feed.
In this commit, I added three very common fields: upvotes, downvotes
and comments. Lots of websites has these common fields, like Youtube,
Twitter, Reddit, HackerNews and so on. Within these fields, RSS readers
can have more information to sort the contents, and can display these
information to user in a better format.
The document has been updated to reflect these new fields. I also changed
Bilibili video route as an example to show how to add number of comments
to the generated feed.
* docs: interactions
2022-04-18 02:54:32 +08:00
尹傲雄
1e11388c90
fix(route): update zju/grs ( #9551 )
...
* update zju/grs in university
* refactor: migrate to v2
* fix: add radar
* fix: not working routes
* fix: add migration note
* docs: remove N/A types from physics table
* fix(radar): migrate old rules
2022-04-18 02:04:53 +08:00
FledgeShiu
fafb2d2ed4
fix(route): chinacerf ( #9554 )
...
* fix(route): chinacerf
* Remove redundant `await`.
2022-04-17 21:42:03 +08:00
331405d69e
feat(route): 黄健宏博客 ( #9553 )
...
* ✨ feat(route): add blog: huangz
* 🐞 fix(route): huangz url missing
* 📃 docs(radar): update docs url
* 📃 docs(radar): fix url
* ✨ feat(route): add maintainer.js
* 🐞 fix(radar): fix huangz blog radar source
* Update lib/v2/huangz/index.js
Co-authored-by: Tony <TonyRL@users.noreply.github.com >
* Update lib/v2/huangz/radar.js
Co-authored-by: Tony <TonyRL@users.noreply.github.com >
* Update lib/v2/huangz/radar.js
Co-authored-by: Tony <TonyRL@users.noreply.github.com >
* Update index.js
* style: auto format
* docs: fix link break
Co-authored-by: Tony <TonyRL@users.noreply.github.com >
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2022-04-17 21:33:27 +08:00
Fatpandac
cff988ad9f
feat(route): add Eagle's blog and refactor to V2 ( #9546 )
...
* feat(route): add Eagle's blog and refactor to V2
* fix: remove deprecated eagle radar rules
* fix: changelog date and guid
* fix(route): add language option
2022-04-17 21:24:17 +08:00
Levi Zim and Tony
958be6266e
feat(route): 山东大学(威海)新闻网 ( #9537 )
...
* feat(sduwh): add extractors.
* feat(route): add route for 山东大学(威海)新闻网
* docs: for route sduwh/news
* docs: for route sduwh/news
(cherry picked from commit 831830167a39a658520dd9a46b375fdbbcb5d611)
* feat(radar): for route 山东大学(威海)新闻网
* refactor: change `got.get` to `got`.
* refactor: prefer `parseDate()` to `new Date()`
Co-authored-by: Tony <TonyRL@users.noreply.github.com >
* fix: incomplete URL substring sanitization.
Make CodeQL happy.
* fix(radar): fix target field.
* fix: change route /sduwh to /sdu/wh
* fix: remove superfluous slash character in url.
* feat: look for exact date first.
* feat: extract exact date from news extractor.
* feat: extract exact date from view extractor.
* feat: extractor for www.sdrj.sdu.edu.cn
* refactor: semantic separation of sduwh with sdu
* feat(radar): more accurate name
* docs: update documentation
* refactor: migrate to v2
* refactor: fix deprecated url.resolve
* fix: update docs url
Co-authored-by: Tony <TonyRL@users.noreply.github.com >
* fix: sdu not working routes
* fix: accurate `ctx.state.data.url`
Co-authored-by: Tony <TonyRL@users.noreply.github.com >
* fix: better error handling for extractors.
* fix: timezone
Co-authored-by: Tony <TonyRL@users.noreply.github.com >
* fix: better error handling.
Co-authored-by: Tony <TonyRL@users.noreply.github.com >
2022-04-17 00:01:39 +08:00
5622641efa
feat(route): 首席经济学家论坛 ( #9550 )
...
* add(route): 首席经济学家论坛
* fix(route) : merge from FledgeXu
* fix(route) : merge from FledgeXu
* (fix) typo
* feat(route): remove radar from radar-rules.js
* Update lib/v2/chinacef/hot.js
Co-authored-by: Tony <TonyRL@users.noreply.github.com >
* Update lib/v2/chinacef/router.js
Co-authored-by: Tony <TonyRL@users.noreply.github.com >
* Update lib/v2/chinacef/maintainer.js
Co-authored-by: Tony <TonyRL@users.noreply.github.com >
* Update lib/v2/chinacef/experts.js
Co-authored-by: Tony <TonyRL@users.noreply.github.com >
* Update lib/v2/chinacef/experts.js
Co-authored-by: Tony <TonyRL@users.noreply.github.com >
* Update hot.js
* Update experts.js
Co-authored-by: linkai <linkai@mochasoft.com.cn >
Co-authored-by: Tony <TonyRL@users.noreply.github.com >
2022-04-16 23:30:10 +08:00
Tony
658570be69
fix(route): taptap topic review ( #9540 )
...
* fix(route): taptap topic review
* fix: review url
* refactor: use utility
* docs: add back warning
2022-04-15 22:04:49 +08:00
FledgeShiu
a0f067ca71
feat(route): 首席经济学家 ( #9543 )
...
* Add chinacef router.
* Update the document.
* Move to V2.
* Fix document errors and improve the code.
2022-04-15 21:07:21 +08:00
任平生
eb467afae1
fix(utils): 支持将微信公众号转载文章的正文抓取回来 ( #9534 )
...
* feat: 修正日期时间匹配规则、移除一些不必要评论元素
* fix(route)(fortunechina): 修正财富中文网1、双语文章中文内容重复问题;2、移除 kol 大头像
* fix(route)(wechat): 支持将微信公众号转载文章的正文抓取回来
2022-04-15 19:23:09 +08:00
Tony
edb6e5deec
fix(route): add debug json output and cookie support ( #9539 )
...
* fix(route): add debug json output and cookie support
* Update lib/v2/qbittorrent/news.js
2022-04-14 14:19:33 -09:00
stanly0726
996b66fdf2
fix(core): issue #8162 ( #9533 )
...
* fixing issue #8162
* fixing issue #8162
* change max width value of class .debu-item
* remove duplicated css
* max width
* Update welcome.art
2022-04-14 01:16:26 +08:00
github-actions[bot]
472e0d8f19
style: auto format
2022-04-13 10:11:44 +00:00
Fatpandac
56ccda8f72
fix(route): add the title to the first article and refactor to V2 ( #9532 )
2022-04-13 18:09:17 +08:00
Ethan Shen
6f98d3cee6
fix(route): 果壳网科学人 ( #9531 )
...
* fix(route): 果壳网科学人
* ref: use got instead of got.get
* ref: rename channel.js
2022-04-13 17:50:11 +08:00
Fatpandac
d63ece212f
fix(route): yystv change selector path, add radar and refactor to V2 ( #9529 )
...
* fix(route): change selector path, add radar and refactor to V2
* fix: use parse-date utils
* fix: use https
2022-04-13 17:23:23 +08:00
任平生
ae66123996
fix(route)(fortunechina): 修正财富中文网双语文章中文内容重复的问题 ( #9526 )
...
* feat: 修正日期时间匹配规则、移除一些不必要评论元素
* fix(route)(fortunechina): 修正财富中文网1、双语文章中文内容重复问题;2、移除 kol 大头像
2022-04-12 23:11:35 +08:00
Tony
bafb3534e1
feat(utils): random user agent ( #9449 )
...
* feat(utils): random ua
* chore: bump rand-user-agent to 1.0.58(no more deps)
2022-04-12 17:51:07 +08:00
Ethan Shen and Tony
55ecc71784
feat(route): add 科学网用户博客 ( #9525 )
...
* feat(route): add 科学网用户博客
* update lib/v2/sciencenet/user.js
Co-authored-by: Tony <TonyRL@users.noreply.github.com >
Co-authored-by: Tony <TonyRL@users.noreply.github.com >
2022-04-12 04:56:50 +01:00
Tony
fb2a407b02
feat(route): qbittorrent news ( #9524 )
2022-04-11 23:17:09 +01:00
Ethan Shen
12760cad1d
feat(route): add 大连理工大学盘锦校区 ( #9515 )
...
* feat(route): add 大连理工大学盘锦校区
* fix typo
2022-04-11 20:33:11 +08:00
Ethan Shen
4c9b820f2e
feat(route): add 大连理工大学盘锦校区教学事务办公室 ( #9509 )
2022-04-11 07:33:46 +08:00
Ethan Shen
a25fd4b67f
fix(utils): wrong date with same weekday in parse-date ( #9506 )
2022-04-10 23:40:35 +08:00
Ethan Shen
0c3888787a
feat(route): add 大连理工大学 ( #8580 )
...
* feat(route): add 大连理工大学
* add radar
* fix: add maintainer
* fix typo
* docs: fix url
* fix: incomplete multi-character sanitization
2022-04-10 23:39:24 +08:00
Odin Zhang and github-actions[bot]
c5741650d2
feat(route): add bookfere ( #9501 )
...
* feat(route): add bookfere
* style: auto format
* fix(route): change bookfere to v2
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2022-04-09 23:43:08 +08:00
Fatpandac
ef8e2e187a
fix(radar): fix docs URL ( #9504 )
2022-04-09 19:06:49 +08:00
Jigsaw
69210f7cad
fix(route)(twreporter): title,author,pubDate ( #9502 )
...
* fix(route): twreporter title,author,pubDate
* refactor: migrate to v2
* fix: missing maintainer
2022-04-09 19:06:03 +08:00
Fatpandac
928b089cc8
feat(route): add 逛丢 ( #9503 )
...
* feat(route): add 逛丢
* fix(route): fix path
2022-04-09 14:18:49 +08:00
Rongrong
2dab2ad5bc
fix(route)(wechat/ce): anti-crawler and pubDate ( #9495 )
...
Signed-off-by: Rongrong <15956627+Rongronggg9@users.noreply.github.com >
2022-04-09 00:00:02 +08:00
Chenxing Luo and Tony
ef94bcde8e
feat(route): add two blogs: Stratechery & Miris Whispers ( #9496 )
...
* Add two blogs
* fix(utils): add parseDate timezone common-config
* Update lib/v2/stratechery/index.js
Co-authored-by: Tony <TonyRL@users.noreply.github.com >
* Update docs/blog.md
Co-authored-by: Tony <TonyRL@users.noreply.github.com >
* Update docs/en/blog.md
Co-authored-by: Tony <TonyRL@users.noreply.github.com >
* Update lib/v2/miris/blog.js
2022-04-08 23:48:28 +08:00
NathanDai and Tony
6996efd070
fix(route):雪球 基金净值数据来源调整为蛋卷基金 ( #9489 )
...
* 雪球基金净值更新调整为蛋卷基金
* Update docs/finance.md
Co-authored-by: Tony <TonyRL@users.noreply.github.com >
* Update docs/finance.md
Co-authored-by: Tony <TonyRL@users.noreply.github.com >
* refactor: migrate to v2
* fix: parseDate
* fix: fund unnecessary String()
* feat: add radar
* fix: stock comments template
* style: add a linebreak
* docs: fund example path
2022-04-08 23:38:33 +08:00