Commit Graph

7273 Commits

Author SHA1 Message Date
Rongrong cc48b48bc8
feat(route): add wechat/data258 (#9571)
Signed-off-by: Rongrong <15956627+Rongronggg9@users.noreply.github.com>
2022-04-20 21:43:34 +08:00
Levi Zim a43542ee2d
feat(route): `/sdu/wh/jwc/:column?` for 山东大学(威海)教务处 (#9585)
* feat: extractor for https://jwc.wh.sdu.edu.cn/

* feat(route): /sdu/wh/jwc for 山东大学(威海)教务处

* feat(radar): 山东大学(威海)教务处

* fix(radar): match wildcard path for 山东大学(威海)新闻网

* docs: for route /sdu/wh/jwc

* fix: update maintainer.js
2022-04-20 21:13:12 +08:00
yuxinliu-alex fccb91838d
fix(route): 央视新闻-专题 支持获取Author字段 (#9568)
* fix(route): 央视新闻-专题 支持获取Author字段

* refactor: migrate to v2

* fix: date parsing in /cctv/photo/jx

* fix: special date parsing

fix: xwlb not working

fix: mzzlbg item description

fix: news use https

fix: xinwen1j1 not working

* feat: add radar

Co-authored-by: Alex Liu <yuxinliu.alex@gmail.com>
2022-04-20 20:11:58 +08:00
Fatpandac 0664feadb1
fix(docs): steam/search change example in docs (#9583) 2022-04-20 15:14:43 +06:00
github-actions[bot] c1af2de268 style: auto format 2022-04-19 11:53:27 +00:00
yuxinliu-alex 80aab00fdb
feat(route): 国家广播电视总局 (#9566)
* feat(route): 国家广播电视总局

* move the nrta to lib\v2\gov

* fix: feed link

* fix: radar

* fix: radar

Co-authored-by: alex <yuxin2@mgtv.com>
2022-04-19 19:51:52 +08:00
yuxinliu-alex 5f4cf8a2f0
feat(route): 参考消息 (#9564)
* feat(route): 参考消息

* fixed the router's & ref bugs

* docs: fix example

* fix: prefer https

* fix: radar

Co-authored-by: alex <yuxin2@mgtv.com>
2022-04-19 19:17:42 +08:00
yuxinliu-alex 103a14ba06
fix(route): cnbeta去除广告并添加Author字段 (#9562)
Co-authored-by: alex <yuxin2@mgtv.com>
2022-04-19 18:39:20 +08:00
Fatpandac 9b459f02aa
fix(route): npm/package fix route params (#9578) 2022-04-19 18:38:00 +08:00
dependabot[bot] 615c81d06a
chore(deps): bump rand-user-agent from 1.0.58 to 1.0.59 (#9573)
Bumps [rand-user-agent](https://github.com/WebScrapingAPI/rand-user-agent) from 1.0.58 to 1.0.59.
- [Release notes](https://github.com/WebScrapingAPI/rand-user-agent/releases)
- [Commits](https://github.com/WebScrapingAPI/rand-user-agent/commits)

---
updated-dependencies:
- dependency-name: rand-user-agent
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-04-19 05:18:04 +08:00
dependabot[bot] a56a51e5dd
chore(deps-dev): bump fs-extra from 10.0.1 to 10.1.0 (#9574)
Bumps [fs-extra](https://github.com/jprichardson/node-fs-extra) from 10.0.1 to 10.1.0.
- [Release notes](https://github.com/jprichardson/node-fs-extra/releases)
- [Changelog](https://github.com/jprichardson/node-fs-extra/blob/master/CHANGELOG.md)
- [Commits](https://github.com/jprichardson/node-fs-extra/compare/10.0.1...10.1.0)

---
updated-dependencies:
- dependency-name: fs-extra
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-04-19 05:11:22 +08:00
yuxinliu-alex 8d2d835cd1
fix(route): 新华社新闻_新华网获取Pubdate字段 (#9570)
* 新华网修复部分文章无法获取pubDate问题

* fix(route): 新华社新闻_新华网获取Pubdate字段

Co-authored-by: alex <yuxin2@mgtv.com>
Co-authored-by: Alex Liu <yuxinliu.alex@gmail.com>
2022-04-19 02:37:57 +08:00
任平生 f3e069d399
fix(utils): 支持微信公众号单图片文章抓取; 增加输出阅读原文链接 (#9557)
* fix(utils): 支持微信公众号单图片文章抓取

* fix(utils): 支持输出微信公众号转载文章阅读原文链接
2022-04-19 01:29:45 +08:00
Fatpandac 864016c598
fix(route): dongqiudi/top_news cannot convert undefined or null to ob… (#9558)
* fix(route): dongqiudi/top_news cannot convert undefined or null to object

* refactor: migrate to v2

* refactor: daily parseDate cache.tryGet

* fix: legacy url.parse, cache article

* refactor: result use parseDate

* refactor: `cache.get` to `cache.tryGet`

* fix: add radar

* fix: Incomplete URL substring sanitization
2022-04-19 01:19:10 +08:00
yuxinliu-alex 3edf239759
fix(route): 观察网源支持获取Author字段 (#9561)
Co-authored-by: alex <yuxin2@mgtv.com>
2022-04-18 20:00:59 +08:00
Bin Wang 6b7381e1e3
feat(core): add custom fields to atom feed (#9355)
* Add custom fields to atom feed

Atom allows to extend the xml with custom namespaces. This commit is
a first commit that tries to add some custom RSSHub fields to atom feed.

In this commit, I added three very common fields: upvotes, downvotes
and comments. Lots of websites has these common fields, like Youtube,
Twitter, Reddit, HackerNews and so on. Within these fields, RSS readers
can have more information to sort the contents, and can display these
information to user in a better format.

The document has been updated to reflect these new fields. I also changed
Bilibili video route as an example to show how to add number of comments
to the generated feed.

* docs: interactions
2022-04-18 02:54:32 +08:00
Tony 455594aff2
chore: switch back from `pull_request_target` to `pull_request` 2022-04-18 02:32:51 +08:00
尹傲雄 1e11388c90
fix(route): update zju/grs (#9551)
* update zju/grs in university

* refactor: migrate to v2

* fix: add radar

* fix: not working routes

* fix: add migration note

* docs: remove N/A types from physics table

* fix(radar): migrate old rules
2022-04-18 02:04:53 +08:00
FledgeShiu fafb2d2ed4
fix(route): chinacerf (#9554)
* fix(route): chinacerf

* Remove redundant `await`.
2022-04-17 21:42:03 +08:00
stormbuf 331405d69e
feat(route): 黄健宏博客 (#9553)
*  feat(route): add blog: huangz

* 🐞 fix(route): huangz url missing

* 📃 docs(radar): update docs url

* 📃 docs(radar): fix url

*  feat(route): add maintainer.js

* 🐞 fix(radar): fix huangz blog radar source

* Update lib/v2/huangz/index.js

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* Update lib/v2/huangz/radar.js

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* Update lib/v2/huangz/radar.js

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* Update index.js

* style: auto format

* docs: fix link break

Co-authored-by: Tony <TonyRL@users.noreply.github.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2022-04-17 21:33:27 +08:00
Fatpandac cff988ad9f
feat(route): add Eagle's blog and refactor to V2 (#9546)
* feat(route): add Eagle's blog and refactor to V2

* fix: remove deprecated eagle radar rules

* fix: changelog date and guid

* fix(route): add language option
2022-04-17 21:24:17 +08:00
kdan d7d6dc3022
docs: fix Route's path and example of chinacef (#9552)
* add(route): 首席经济学家论坛

* fix(route) : merge from FledgeXu

* fix(route) : merge from FledgeXu

* (fix) typo

* feat(route): remove radar from radar-rules.js

* Update lib/v2/chinacef/hot.js

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* Update lib/v2/chinacef/router.js

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* Update lib/v2/chinacef/maintainer.js

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* Update lib/v2/chinacef/experts.js

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* Update lib/v2/chinacef/experts.js

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* Update hot.js

* Update experts.js

* docs: fix Route's path and example of chinacef

* Revert "docs: fix Route's path and example of chinacef"

This reverts commit 0ec9e7d9d6d1eff201482e38a26b255478861a5c.

* docs: fix Route's path and example of chinacef

Co-authored-by: linkai <linkai@mochasoft.com.cn>
Co-authored-by: Tony <TonyRL@users.noreply.github.com>
2022-04-17 00:09:01 +08:00
Levi Zim 958be6266e
feat(route): 山东大学(威海)新闻网 (#9537)
* feat(sduwh): add extractors.

* feat(route): add route for 山东大学(威海)新闻网

* docs: for route sduwh/news

* docs: for route sduwh/news

(cherry picked from commit 831830167a39a658520dd9a46b375fdbbcb5d611)

* feat(radar): for route 山东大学(威海)新闻网

* refactor: change `got.get` to `got`.

* refactor: prefer `parseDate()` to `new Date()`

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* fix: incomplete URL substring sanitization.

Make CodeQL happy.

* fix(radar): fix target field.

* fix: change route /sduwh to /sdu/wh

* fix: remove superfluous slash character in url.

* feat: look for exact date first.

* feat: extract exact date from news extractor.

* feat: extract exact date from view extractor.

* feat: extractor for www.sdrj.sdu.edu.cn

* refactor: semantic separation of sduwh with sdu

* feat(radar): more accurate name

* docs: update documentation

* refactor: migrate to v2

* refactor: fix deprecated url.resolve

* fix: update docs url

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* fix: sdu not working routes

* fix: accurate `ctx.state.data.url`

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* fix: better error handling for extractors.

* fix: timezone

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* fix: better error handling.

Co-authored-by: Tony <TonyRL@users.noreply.github.com>
2022-04-17 00:01:39 +08:00
kdan 5622641efa
feat(route): 首席经济学家论坛 (#9550)
* add(route): 首席经济学家论坛

* fix(route) : merge from FledgeXu

* fix(route) : merge from FledgeXu

* (fix) typo

* feat(route): remove radar from radar-rules.js

* Update lib/v2/chinacef/hot.js

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* Update lib/v2/chinacef/router.js

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* Update lib/v2/chinacef/maintainer.js

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* Update lib/v2/chinacef/experts.js

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* Update lib/v2/chinacef/experts.js

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* Update hot.js

* Update experts.js

Co-authored-by: linkai <linkai@mochasoft.com.cn>
Co-authored-by: Tony <TonyRL@users.noreply.github.com>
2022-04-16 23:30:10 +08:00
Devesh Pal 08c1a032aa
docs: fix typo in english docs (#9549) 2022-04-16 12:49:59 +08:00
dependabot[bot] 61da6e9c30
chore(deps): bump dayjs from 1.11.0 to 1.11.1 (#9547)
Bumps [dayjs](https://github.com/iamkun/dayjs) from 1.11.0 to 1.11.1.
- [Release notes](https://github.com/iamkun/dayjs/releases)
- [Changelog](https://github.com/iamkun/dayjs/blob/dev/CHANGELOG.md)
- [Commits](https://github.com/iamkun/dayjs/compare/v1.11.0...v1.11.1)

---
updated-dependencies:
- dependency-name: dayjs
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-04-16 05:56:40 +08:00
dependabot[bot] e35940b3bd
chore(deps): bump cirrus-actions/rebase from 1.5 to 1.6 (#9548)
Bumps [cirrus-actions/rebase](https://github.com/cirrus-actions/rebase) from 1.5 to 1.6.
- [Release notes](https://github.com/cirrus-actions/rebase/releases)
- [Commits](https://github.com/cirrus-actions/rebase/compare/1.5...1.6)

---
updated-dependencies:
- dependency-name: cirrus-actions/rebase
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-04-16 05:56:16 +08:00
TonyRL 7b9c0f3ea1 chore(deps): bump async from 2.6.3 to 2.6.4
fix CVE-2021-43138 aka GHSA-fwr7-v2mv-hh25
2022-04-15 14:21:17 +00:00
Tony 658570be69
fix(route): taptap topic review (#9540)
* fix(route): taptap topic review

* fix: review url

* refactor: use utility

* docs: add back warning
2022-04-15 22:04:49 +08:00
Rongrong c6a8efbb1d
docs: update cache expiry time (#9545)
Signed-off-by: Rongrong <15956627+Rongronggg9@users.noreply.github.com>
2022-04-15 22:02:30 +08:00
FledgeShiu a0f067ca71
feat(route): 首席经济学家 (#9543)
* Add chinacef router.

* Update the document.

* Move to V2.

* Fix document errors and improve the code.
2022-04-15 21:07:21 +08:00
任平生 eb467afae1
fix(utils): 支持将微信公众号转载文章的正文抓取回来 (#9534)
* feat: 修正日期时间匹配规则、移除一些不必要评论元素

* fix(route)(fortunechina): 修正财富中文网1、双语文章中文内容重复问题;2、移除 kol 大头像

* fix(route)(wechat): 支持将微信公众号转载文章的正文抓取回来
2022-04-15 19:23:09 +08:00
Henry 47715045ba
docs: Translate documentation of shopping craigslist from Chinese to English. (#9536)
* Translate documentation of shopping craigslist from Chinese to English.

From docs/shopping.md to docs/en/shopping.md

* Update docs/en/shopping.md, route descrption of Craigslist

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

Co-authored-by: Tony <TonyRL@users.noreply.github.com>
2022-04-14 15:13:23 -09:00
Tony edb6e5deec
fix(route): add debug json output and cookie support (#9539)
* fix(route): add debug json output and cookie support

* Update lib/v2/qbittorrent/news.js
2022-04-14 14:19:33 -09:00
dependabot[bot] 48c0faa01c
chore(deps): bump https-proxy-agent from 5.0.0 to 5.0.1 (#9538)
Bumps [https-proxy-agent](https://github.com/TooTallNate/node-https-proxy-agent) from 5.0.0 to 5.0.1.
- [Release notes](https://github.com/TooTallNate/node-https-proxy-agent/releases)
- [Commits](https://github.com/TooTallNate/node-https-proxy-agent/compare/5.0.0...5.0.1)

---
updated-dependencies:
- dependency-name: https-proxy-agent
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-04-14 13:40:57 -09:00
dependabot[bot] 334f4b2178
chore(deps-dev): bump @vercel/nft from 0.18.1 to 0.18.2 (#9535)
Bumps [@vercel/nft](https://github.com/vercel/nft) from 0.18.1 to 0.18.2.
- [Release notes](https://github.com/vercel/nft/releases)
- [Commits](https://github.com/vercel/nft/compare/0.18.1...0.18.2)

---
updated-dependencies:
- dependency-name: "@vercel/nft"
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-04-14 07:03:33 +09:00
stanly0726 996b66fdf2
fix(core): issue #8162 (#9533)
* fixing issue #8162

* fixing issue #8162

* change max width value of class .debu-item

* remove duplicated css

* max width

* Update welcome.art
2022-04-14 01:16:26 +08:00
TonyRL 4f6873f5d1 chore: rename to .eslintrc.json
`.eslintrc` is deprecated long ago <https://stackoverflow.com/questions/62340976/is-the-config-file-eslintrc-deprecated-in-favor-of-eslintrc-files>
2022-04-13 12:34:07 +00:00
github-actions[bot] 472e0d8f19 style: auto format 2022-04-13 10:11:44 +00:00
Fatpandac 56ccda8f72
fix(route): add the title to the first article and refactor to V2 (#9532) 2022-04-13 18:09:17 +08:00
Ethan Shen 6f98d3cee6
fix(route): 果壳网科学人 (#9531)
* fix(route): 果壳网科学人

* ref: use got instead of got.get

* ref: rename channel.js
2022-04-13 17:50:11 +08:00
Fatpandac d63ece212f
fix(route): yystv change selector path, add radar and refactor to V2 (#9529)
* fix(route): change selector path, add radar and refactor to V2

* fix: use parse-date utils

* fix: use https
2022-04-13 17:23:23 +08:00
任平生 ae66123996
fix(route)(fortunechina): 修正财富中文网双语文章中文内容重复的问题 (#9526)
* feat: 修正日期时间匹配规则、移除一些不必要评论元素

* fix(route)(fortunechina): 修正财富中文网1、双语文章中文内容重复问题;2、移除 kol 大头像
2022-04-12 23:11:35 +08:00
Tony bafb3534e1
feat(utils): random user agent (#9449)
* feat(utils): random ua

* chore: bump rand-user-agent to 1.0.58(no more deps)
2022-04-12 17:51:07 +08:00
Tony 3526170c79
chore: add eslint along with reviewdong 2022-04-12 17:38:58 +08:00
Ethan Shen 55ecc71784
feat(route): add 科学网用户博客 (#9525)
* feat(route): add 科学网用户博客

* update lib/v2/sciencenet/user.js

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

Co-authored-by: Tony <TonyRL@users.noreply.github.com>
2022-04-12 04:56:50 +01:00
TonyRL 6c7988c481 chore: rebuild yarn.lock
* minimist 1.2.5 CVE-2021-44906
2022-04-11 23:38:08 +00:00
Tony fb2a407b02
feat(route): qbittorrent news (#9524) 2022-04-11 23:17:09 +01:00
dependabot[bot] 84f282b2fe
chore(deps-dev): bump @vercel/nft from 0.18.0 to 0.18.1 (#9523)
Bumps [@vercel/nft](https://github.com/vercel/nft) from 0.18.0 to 0.18.1.
- [Release notes](https://github.com/vercel/nft/releases)
- [Commits](https://github.com/vercel/nft/compare/0.18.0...0.18.1)

---
updated-dependencies:
- dependency-name: "@vercel/nft"
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-04-12 05:00:28 +08:00
dependabot[bot] cc51a3f05d
chore(deps): bump lru-cache from 7.8.0 to 7.8.1 (#9521)
Bumps [lru-cache](https://github.com/isaacs/node-lru-cache) from 7.8.0 to 7.8.1.
- [Release notes](https://github.com/isaacs/node-lru-cache/releases)
- [Changelog](https://github.com/isaacs/node-lru-cache/blob/main/CHANGELOG.md)
- [Commits](https://github.com/isaacs/node-lru-cache/compare/v7.8.0...v7.8.1)

---
updated-dependencies:
- dependency-name: lru-cache
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-04-12 02:53:27 +08:00