Commit Graph

3686 Commits

Author SHA1 Message Date
Ethan Shen 3d98cf66ef
fix(route): 京东商品价格标题 (#9638)
* fix(route): 京东商品价格标题

* fix: add guid
2022-04-27 07:01:49 +01:00
Tony ff977597f1
fix(route): bilibili video page ordering, accept common limit params (#9634) 2022-04-27 04:19:38 +08:00
Jigsaw a82e9057ca
feat(route): add 中南大学计算机学院通知 (#9631)
* feat(route): add 中南大学计算机学院通知

* fix: use nullish coalescing
2022-04-26 19:48:50 +08:00
Ethan Shen 3b73533f95
feat(route): add 京东商品价格 (#9629) 2022-04-26 13:29:40 +08:00
TonyRL 44eb849ed7 fix: typo in comment
[skip ci]
2022-04-25 13:47:48 +00:00
Rongrong 6510892497
feat(route)(douyin/user): major rewrite (#9618)
new:
embedded video
pubDate
category
avatar
user description

fix:
potential element class change

Signed-off-by: Rongrong <i@rong.moe>
2022-04-25 21:43:29 +08:00
Ethan Shen bc92dbcdc2
feat(route): add 中南财经政法大学通知公告 (#9616) 2022-04-25 20:56:47 +08:00
Derek 68b2499d4a
feat(route): optimize the display title of jasa, ieee and elsevier journal (#9615) 2022-04-25 10:15:39 +01:00
zytomorrow 133a9602e7
fix(route): sichuan/deyang 政府公开信息 (#9613) 2022-04-25 08:22:50 +01:00
huangliangshusheng 65857026f8
feat(route): add syosetu (#9612)
* feat(route): add syosetu

* fix doc
2022-04-25 11:01:47 +08:00
kdan 377c2c4d57
feat(route): add chinafactcheck (#9611)
* add(route): 首席经济学家论坛

* fix(route) : merge from FledgeXu

* fix(route) : merge from FledgeXu

* (fix) typo

* feat(route): remove radar from radar-rules.js

* Update lib/v2/chinacef/hot.js

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* Update lib/v2/chinacef/router.js

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* Update lib/v2/chinacef/maintainer.js

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* Update lib/v2/chinacef/experts.js

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* Update lib/v2/chinacef/experts.js

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* Update hot.js

* Update experts.js

* docs: fix Route's path and example of chinacef

* Revert "docs: fix Route's path and example of chinacef"

This reverts commit 0ec9e7d9d6d1eff201482e38a26b255478861a5c.

* docs: fix Route's path and example of chinacef

* feat(route): add chinafactcheck

Co-authored-by: linkai <linkai@mochasoft.com.cn>
Co-authored-by: Tony <TonyRL@users.noreply.github.com>
2022-04-25 10:37:48 +08:00
Ethan Shen c9e423b8f1
feat(route): add Coomer (#9610)
* feat(route): add Coomer

* fix typo
2022-04-25 08:56:03 +08:00
swwind 29c04851da
feat(route): add arknights announce (#9607)
* feat: add arknights announce

* feat: dynamic rss title

* migrate arknights to v2

* fix: replace dayjs to parseDate

* refactor: sort maintainer and router

feat: add radar

refactor: use parseDate utils
2022-04-24 23:36:14 +08:00
DylanXie123 10acacfa46
feat(route): add 北京大学学生就业指导服务中心 (#7904)
* feat(route): add 北京大学学生就业指导服务中心

* fix(route): get content from sript tag

request content in script tag to get full text

* fix(doc): fix parameter description

* fix(route): fix header and selector

* add test request and wait

* docs: fix warning

* refactor: migrate to v2

* fix: eecs

refactor: legacy url.resolve

refactor: use parseDate from utils

* docs: fix recruit path

Co-authored-by: TonyRL <TonyRL@users.noreply.github.com>
2022-04-24 23:14:17 +08:00
Max-Tortoise c9bb12fc34
feat(route): add 抖音 (#9604)
* feat(route): add 抖音

* Update lib/v2/douyin/user.js

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* Update lib/v2/douyin/user.js

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* fix substring and add config require

Co-authored-by: Tony <TonyRL@users.noreply.github.com>
2022-04-24 17:14:27 +11:00
Sxuet c7aa447100
feat(route): 北极星光伏 (#9542)
* 新增北极星光伏网路由

* 规范化北极星光伏网路由

* 修改一些文本错误

* refactor: migrate to v2
2022-04-23 19:16:16 +08:00
ZhenHappy ac11c9e2f5
feat(route): add A姐分享NSFW (#9596)
* feat(route): add A姐分享NSFW

* feat(route): add A姐分享NSFW
2022-04-23 13:41:14 +08:00
github-actions[bot] 312fd168ac style: auto format 2022-04-23 04:39:25 +00:00
shininome ef8aeab553
fix(route): 解决bilibili专栏多张图片时无法获取问题 (#9601)
* Add files via upload

* Update lib/v2/bilibili/article.js

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* Update lib/v2/bilibili/article.js

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* Update lib/v2/bilibili/article.js

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* Update article.js

Co-authored-by: Tony <TonyRL@users.noreply.github.com>
2022-04-23 10:37:25 +06:00
github-actions[bot] a9799e47a5 style: auto format 2022-04-22 18:23:39 +00:00
程序员老马 159da9059e
fix(route): 教育部路由新增教育要闻分类,修复部分文章标题取值;优化雪球路由,对于讨论帖直接获取完整内容 (#9556)
* 雪球的讨论帖可以直接从text字段中取到完整内容,长文帖只有description字段有值,获取逻辑不变

* 教育部路由增加“教育要闻”栏目类型获取,同时修复教育部文章title获取不到的问题

* 补充教育部路由增加教育要闻栏目类型的文档

* refactor: migrate to v2

* fix: legacy url.resolve

* 修复雪球返回完整讨论帖时遗漏了转发内容的问题

* 移除重复的key

Co-authored-by: TonyRL <TonyRL@users.noreply.github.com>
2022-04-23 02:21:38 +08:00
yuxinliu-alex 4dbd8f0e57
fix(route): CCTV - The link to detail page got blanks which cause the script can't get that item. (#9594)
Co-authored-by: yuxinliu <yuxin2@mgtv.com>
2022-04-22 19:48:04 +08:00
yuxinliu-alex bf156eb324
feat(route): 投中网 (#9593)
Co-authored-by: yuxinliu <yuxin2@mgtv.com>
2022-04-22 19:41:23 +08:00
Fatpandac fa3428f8fc
fix(route): dx2025/category policy-achievement is failure and refactor to V2 (#9592) 2022-04-22 19:28:15 +08:00
x2009again 42dfd5cc81
feat(route): 增加微语简报源 (#9577)
* 添加微语简报源

* 精简列表描述

* 优化微语简报排版,增加文档说明

* 修复部分序号错误问题

* 增加v2版微语简报源

* 时区修改

* 删除微语简报旧路由

* 按建议修改

* 修改微语简报网址
2022-04-21 23:18:35 +08:00
Howard Yin 67d87e2eea
feat(route): E站增加封面图嵌入RSS和封面图替换为代理网址的功能 (#9344)
* 增加封面图嵌入RSS的功能

* 增加EH封面图代理的功能

* 改用URLSearchParams代替querystring
增加对"Minimal", "Minimal+" and "Extended"页面模式的支持

* fix: matching logic

* refactor: migrate to v2

* docs: add missing description of EH_IMG_PROXY

* docs: remove ignoring EH_SK

Co-authored-by: TonyRL <TonyRL@users.noreply.github.com>
2022-04-21 23:03:55 +08:00
任平生 9d9926d0bf
fix(utils): 修复抓取微信已删除文章时遇到的报错 (#9589)
* fix(utils): 支持微信公众号单图片文章抓取

* fix(utils): 支持输出微信公众号转载文章阅读原文链接

* fix(utils): 修复抓取微信已删除文章时遇到的报错

* refactor: migrate to v2

Co-authored-by: blankyu(于海洋) <blankyu@tencent.com>
2022-04-21 21:40:16 +08:00
yuxinliu-alex 04206ca5b1
feat(route): 封面新闻 (#9587)
* feat(route): 封面

* Update docs/new-media.md

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* Update lib/v2/thecover/radar.js

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* Update lib/v2/thecover/radar.js

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

Co-authored-by: yuxinliu <yuxin2@mgtv.com>
Co-authored-by: Tony <TonyRL@users.noreply.github.com>
2022-04-21 18:59:58 +08:00
yuxinliu-alex 35347a921d
feat(route): 中国新闻网 (#9584)
* feat(route): 中国新闻网

* Update docs/traditional-media.md

* Update lib/v2/chinanews/index.js

Co-authored-by: yuxinliu <yuxin2@mgtv.com>
2022-04-21 03:32:13 -02:00
dependabot[bot] dd4a216648
chore(deps): bump socks-proxy-agent from 6.1.1 to 6.2.0 (#9572)
* chore(deps): bump socks-proxy-agent from 6.1.1 to 6.2.0

Bumps [socks-proxy-agent](https://github.com/TooTallNate/node-socks-proxy-agent) from 6.1.1 to 6.2.0.
- [Release notes](https://github.com/TooTallNate/node-socks-proxy-agent/releases)
- [Changelog](https://github.com/TooTallNate/node-socks-proxy-agent/blob/master/CHANGELOG.md)
- [Commits](https://github.com/TooTallNate/node-socks-proxy-agent/compare/v6.1.1...v6.2.0)

---
updated-dependencies:
- dependency-name: socks-proxy-agent
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

* fix: use dot notation

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: TonyRL <TonyRL@users.noreply.github.com>
2022-04-21 03:54:53 +08:00
Rongrong 0522c63d5f
fix(core/utils): invalid request header `Server` (#9582)
Signed-off-by: Rongrong <15956627+Rongronggg9@users.noreply.github.com>
2022-04-20 22:32:46 +08:00
yuxinliu-alex 7e9af67274
feat(route): 环球网 (#9580)
* feat(route): 环球网

* feat(route): 环球网 加入通用参数limit限制条数及格式调整

Co-authored-by: alex <yuxin2@mgtv.com>
2022-04-20 22:30:11 +08:00
Rongrong cc48b48bc8
feat(route): add wechat/data258 (#9571)
Signed-off-by: Rongrong <15956627+Rongronggg9@users.noreply.github.com>
2022-04-20 21:43:34 +08:00
Levi Zim a43542ee2d
feat(route): `/sdu/wh/jwc/:column?` for 山东大学(威海)教务处 (#9585)
* feat: extractor for https://jwc.wh.sdu.edu.cn/

* feat(route): /sdu/wh/jwc for 山东大学(威海)教务处

* feat(radar): 山东大学(威海)教务处

* fix(radar): match wildcard path for 山东大学(威海)新闻网

* docs: for route /sdu/wh/jwc

* fix: update maintainer.js
2022-04-20 21:13:12 +08:00
yuxinliu-alex fccb91838d
fix(route): 央视新闻-专题 支持获取Author字段 (#9568)
* fix(route): 央视新闻-专题 支持获取Author字段

* refactor: migrate to v2

* fix: date parsing in /cctv/photo/jx

* fix: special date parsing

fix: xwlb not working

fix: mzzlbg item description

fix: news use https

fix: xinwen1j1 not working

* feat: add radar

Co-authored-by: Alex Liu <yuxinliu.alex@gmail.com>
2022-04-20 20:11:58 +08:00
yuxinliu-alex 80aab00fdb
feat(route): 国家广播电视总局 (#9566)
* feat(route): 国家广播电视总局

* move the nrta to lib\v2\gov

* fix: feed link

* fix: radar

* fix: radar

Co-authored-by: alex <yuxin2@mgtv.com>
2022-04-19 19:51:52 +08:00
yuxinliu-alex 5f4cf8a2f0
feat(route): 参考消息 (#9564)
* feat(route): 参考消息

* fixed the router's & ref bugs

* docs: fix example

* fix: prefer https

* fix: radar

Co-authored-by: alex <yuxin2@mgtv.com>
2022-04-19 19:17:42 +08:00
yuxinliu-alex 103a14ba06
fix(route): cnbeta去除广告并添加Author字段 (#9562)
Co-authored-by: alex <yuxin2@mgtv.com>
2022-04-19 18:39:20 +08:00
Fatpandac 9b459f02aa
fix(route): npm/package fix route params (#9578) 2022-04-19 18:38:00 +08:00
yuxinliu-alex 8d2d835cd1
fix(route): 新华社新闻_新华网获取Pubdate字段 (#9570)
* 新华网修复部分文章无法获取pubDate问题

* fix(route): 新华社新闻_新华网获取Pubdate字段

Co-authored-by: alex <yuxin2@mgtv.com>
Co-authored-by: Alex Liu <yuxinliu.alex@gmail.com>
2022-04-19 02:37:57 +08:00
任平生 f3e069d399
fix(utils): 支持微信公众号单图片文章抓取; 增加输出阅读原文链接 (#9557)
* fix(utils): 支持微信公众号单图片文章抓取

* fix(utils): 支持输出微信公众号转载文章阅读原文链接
2022-04-19 01:29:45 +08:00
Fatpandac 864016c598
fix(route): dongqiudi/top_news cannot convert undefined or null to ob… (#9558)
* fix(route): dongqiudi/top_news cannot convert undefined or null to object

* refactor: migrate to v2

* refactor: daily parseDate cache.tryGet

* fix: legacy url.parse, cache article

* refactor: result use parseDate

* refactor: `cache.get` to `cache.tryGet`

* fix: add radar

* fix: Incomplete URL substring sanitization
2022-04-19 01:19:10 +08:00
yuxinliu-alex 3edf239759
fix(route): 观察网源支持获取Author字段 (#9561)
Co-authored-by: alex <yuxin2@mgtv.com>
2022-04-18 20:00:59 +08:00
Bin Wang 6b7381e1e3
feat(core): add custom fields to atom feed (#9355)
* Add custom fields to atom feed

Atom allows to extend the xml with custom namespaces. This commit is
a first commit that tries to add some custom RSSHub fields to atom feed.

In this commit, I added three very common fields: upvotes, downvotes
and comments. Lots of websites has these common fields, like Youtube,
Twitter, Reddit, HackerNews and so on. Within these fields, RSS readers
can have more information to sort the contents, and can display these
information to user in a better format.

The document has been updated to reflect these new fields. I also changed
Bilibili video route as an example to show how to add number of comments
to the generated feed.

* docs: interactions
2022-04-18 02:54:32 +08:00
尹傲雄 1e11388c90
fix(route): update zju/grs (#9551)
* update zju/grs in university

* refactor: migrate to v2

* fix: add radar

* fix: not working routes

* fix: add migration note

* docs: remove N/A types from physics table

* fix(radar): migrate old rules
2022-04-18 02:04:53 +08:00
FledgeShiu fafb2d2ed4
fix(route): chinacerf (#9554)
* fix(route): chinacerf

* Remove redundant `await`.
2022-04-17 21:42:03 +08:00
stormbuf 331405d69e
feat(route): 黄健宏博客 (#9553)
*  feat(route): add blog: huangz

* 🐞 fix(route): huangz url missing

* 📃 docs(radar): update docs url

* 📃 docs(radar): fix url

*  feat(route): add maintainer.js

* 🐞 fix(radar): fix huangz blog radar source

* Update lib/v2/huangz/index.js

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* Update lib/v2/huangz/radar.js

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* Update lib/v2/huangz/radar.js

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* Update index.js

* style: auto format

* docs: fix link break

Co-authored-by: Tony <TonyRL@users.noreply.github.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2022-04-17 21:33:27 +08:00
Fatpandac cff988ad9f
feat(route): add Eagle's blog and refactor to V2 (#9546)
* feat(route): add Eagle's blog and refactor to V2

* fix: remove deprecated eagle radar rules

* fix: changelog date and guid

* fix(route): add language option
2022-04-17 21:24:17 +08:00
Levi Zim 958be6266e
feat(route): 山东大学(威海)新闻网 (#9537)
* feat(sduwh): add extractors.

* feat(route): add route for 山东大学(威海)新闻网

* docs: for route sduwh/news

* docs: for route sduwh/news

(cherry picked from commit 831830167a39a658520dd9a46b375fdbbcb5d611)

* feat(radar): for route 山东大学(威海)新闻网

* refactor: change `got.get` to `got`.

* refactor: prefer `parseDate()` to `new Date()`

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* fix: incomplete URL substring sanitization.

Make CodeQL happy.

* fix(radar): fix target field.

* fix: change route /sduwh to /sdu/wh

* fix: remove superfluous slash character in url.

* feat: look for exact date first.

* feat: extract exact date from news extractor.

* feat: extract exact date from view extractor.

* feat: extractor for www.sdrj.sdu.edu.cn

* refactor: semantic separation of sduwh with sdu

* feat(radar): more accurate name

* docs: update documentation

* refactor: migrate to v2

* refactor: fix deprecated url.resolve

* fix: update docs url

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* fix: sdu not working routes

* fix: accurate `ctx.state.data.url`

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* fix: better error handling for extractors.

* fix: timezone

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* fix: better error handling.

Co-authored-by: Tony <TonyRL@users.noreply.github.com>
2022-04-17 00:01:39 +08:00
kdan 5622641efa
feat(route): 首席经济学家论坛 (#9550)
* add(route): 首席经济学家论坛

* fix(route) : merge from FledgeXu

* fix(route) : merge from FledgeXu

* (fix) typo

* feat(route): remove radar from radar-rules.js

* Update lib/v2/chinacef/hot.js

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* Update lib/v2/chinacef/router.js

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* Update lib/v2/chinacef/maintainer.js

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* Update lib/v2/chinacef/experts.js

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* Update lib/v2/chinacef/experts.js

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* Update hot.js

* Update experts.js

Co-authored-by: linkai <linkai@mochasoft.com.cn>
Co-authored-by: Tony <TonyRL@users.noreply.github.com>
2022-04-16 23:30:10 +08:00