Commit Graph

1701 Commits

Author SHA1 Message Date
CancerGary 950bfa61ed
feat(route): add juejin news (#7969)
* feat(route): add juejin news

* feat(route): add juejin news

* fix(route): juejin news pubDate

* fix: fix utility

* refactor: migrate to v2

* fix: typo

Co-authored-by: TonyRL <TonyRL@users.noreply.github.com>
2022-05-20 01:55:18 +08:00
b0ttle f477e3e8bf
fix(route): fixed routes/earthquake and ceic timezone shift (#9780)
* fixed routes/earthquake and ceic timezone shift

* use utils/timezone and remove changes on yarn.lock

* edit format problem

* refactor: migrate to v2
2022-05-19 01:29:58 +08:00
KotoriK 6187a08227
fix(route:aliyun/developer/group): 获取到的全是0 (#9741)
* fix(route:aliyun/developer/group): 获取到的全是0

* Update lib/routes/aliyun/developer/group.js

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* Update lib/routes/aliyun/developer/group.js

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* refactor: migrate to v2

* refactor: use cache.tryGet

* fix: add radar

* fix: article parsing
2022-05-19 00:03:00 +08:00
Nite07 f17ff7104c
feat(route): add Mobilism (#8949)
* Add(route): add Mobilism

* 去除注释
去除登录

* Revert "去除注释"

This reverts commit 8b1409aee2f44335bca39efdab8d524e749ccb3e.

* 尝试修复重复推送问题

* 修复部分情况下时间获取错误

* 去除时间获取(重复推送BUG无法解决)
增加全文获取

* 添加参数判断是否获取全文

* 修改

* 2022年1月30日14:22:40

* fix: remove login, use built-in `toTitleCase`

* docs: add missing docs

* fix: radar

* fix: typo

Co-authored-by: Nite07 <nmy1207@outlook.com>
Co-authored-by: TonyRL <TonyRL@users.noreply.github.com>
2022-05-17 23:36:06 +08:00
Fatpandac 8d5836e3f3
fix(route): 9to5/subsite fix selector, use tag and refactor to V2 (#9771)
* fix(route): 9to5/subsite fix selector and refactor to V2

* Update lib/v2/9to5/radar.js

Co-authored-by: Rongrong <i@rong.moe>

* Update lib/v2/9to5/radar.js

Co-authored-by: Rongrong <i@rong.moe>

* Update lib/v2/9to5/radar.js

Co-authored-by: Rongrong <i@rong.moe>

* fix(route): change link

* Update lib/v2/9to5/subsite.js

Co-authored-by: Rongrong <i@rong.moe>

* Update lib/v2/9to5/radar.js

Co-authored-by: Rongrong <i@rong.moe>

* Update lib/v2/9to5/radar.js

Co-authored-by: Rongrong <i@rong.moe>

* Update lib/v2/9to5/radar.js

Co-authored-by: Rongrong <i@rong.moe>

* fix(docs): add radar and rssbud badges

* Update lib/v2/9to5/subsite.js

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

Co-authored-by: Rongrong <i@rong.moe>
Co-authored-by: Tony <TonyRL@users.noreply.github.com>
2022-05-17 23:18:02 +08:00
Arracc f7c02471d0
fix(route): yomiuri news list structure changed (#9764) 2022-05-17 01:13:55 +08:00
Tony 039e8eb80f
fix(route): nature (#9748) 2022-05-14 00:37:06 +08:00
Yue 08602c778c
fix(route): 修复/zhihu/question无法获取,需要设置非登录状态下cookie (#9729)
* 修复/zhihu/question,需要设置非登录状态下cookie

* Update lib/routes/zhihu/execlib/g_encrypt.js

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* 根据TonyRL review建议进行了修改

* Update lib/routes/zhihu/question.js

Co-authored-by: Rongrong <Rongronggg9@outlook.com>

* Update lib/routes/zhihu/question.js

Co-authored-by: Rongrong <Rongronggg9@outlook.com>

* Update lib/routes/zhihu/question.js

Co-authored-by: Rongrong <Rongronggg9@outlook.com>

* Update lib/routes/zhihu/question.js

Co-authored-by: Rongrong <Rongronggg9@outlook.com>

* Update lib/routes/zhihu/question.js

Co-authored-by: Rongrong <Rongronggg9@outlook.com>

* Update lib/routes/zhihu/question.js

Co-authored-by: Rongrong <Rongronggg9@outlook.com>

* 增加cookie中dc_0字段检验

* Update lib/routes/zhihu/question.js

Co-authored-by: Rongrong <Rongronggg9@outlook.com>

* Update lib/routes/zhihu/question.js

Co-authored-by: Rongrong <Rongronggg9@outlook.com>

* refactor: migrate to v2

* fix: Incomplete URL substring sanitization

Co-authored-by: Rongrong <Rongronggg9@outlook.com>
2022-05-14 00:21:11 +08:00
jerry1119 0c3ca1bb11
fix(route): fix pianyuan, add pianyuan/search (#9721)
* fix route pianyuan, add route pianyuan/search

* update doc

* changes for reviews

* Update lib/routes/pianyuan/utils.js

Co-authored-by: Rongrong <Rongronggg9@outlook.com>

* changes for reviews

* refactor: migrate to v2

Co-authored-by: Rongrong <Rongronggg9@outlook.com>
2022-05-09 01:00:29 +08:00
Rongrong 63ccc9499b
fix(route/jike): image URL; outdated usage (#9693)
* fix(route/jike): image URL; outdated usage

Signed-off-by: Rongrong <i@rong.moe>

* refactor: migrate to v2

* fix: unescaped .

* feat(route/jike): new radar rule

Signed-off-by: Rongrong <i@rong.moe>
2022-05-05 20:28:04 +08:00
Halcao be1a1b303c
fix(route): uraaka-joshi (#7908)
* modify uraaka-joshi to puppeteer

* style: auto format

* fix(route): uraaka-joshi and user

* docs: fix author

Co-authored-by: GitHub Action <action@github.com>
Co-authored-by: TonyRL <TonyRL@users.noreply.github.com>
2022-05-05 04:22:23 +08:00
Zhiyang Guo ac7b3666d8
fix(route): 南京理工大学 (#9659)
* fix(route): 南京理工大学

* refactor: migrate to v2

* refactor: migrate to v2

* Update yarn.lock

* fix: remove standalone puppeteer extra

* fix(route): minor misc changes

* fix(route): sort routes in alphabetical order

* fix(route): update utils.js
2022-05-03 19:37:58 +08:00
Tony 24e435d48f
feat(route)!: remove dwnews (#9675) 2022-05-01 23:49:31 +08:00
Mengxin Cao a428c4c5cd
fix(route): broken link embassy/us (#9673)
* Fix broken link embassy/us

* refactor: migrate to v2

* fix: embassy/us selector
2022-05-01 21:27:20 +08:00
Zhiyang Guo f88e58b493
feat(route): 中国科学技术大学-研究生院/信息科学技术学院/电子工程与信息科学系 (#9666)
* fix(route): 中科大官网通知公告正文内容获取

* refactor: migrate to v2

* feat(route): 中国科学技术大学-研究生院/信息科学技术学院/电子工程与信息科学系

* fix: sort router

* fix: deprecated url.resolve

* fix: fulltext cache

fix: nullish coalescing

fix: data.link

fix: cache.tryGet

* fix: deepscan
2022-05-01 17:36:33 +08:00
Henry Wang 1a547caf3b
feat(route): 更新少数派全文支持 (#9653)
* feat: 少数派首页全文输出

* feat: 少数派全路由全文

* feat: 少数派专栏全文

* refactor: migrate to v2

* fix: cache key
2022-05-01 17:34:45 +08:00
Ethan Shen e5484a75bd
feat(route): add 云听 (#9665)
* feat(route): add 云听

* fix typo

* fix: wrong data
2022-05-01 06:13:57 +08:00
Ethan Shen 22bbc76ef5
fix(route): 深圳证券交易所问询函件 (#9658)
* fix(route): 深圳证券交易所问询函件

* fix typo

* fix description

* docs: fix category
2022-04-30 23:03:30 +08:00
bao1991213 bba6a46d19
feat(route): add 人人影视-今日播出 (#9619)
* feat(route): add 人人影视-今日播出

* feat(route): 人人影视-今日更新 v2 standard

* refactor: migrate to v2

* fix: apply suggestion
2022-04-27 23:01:32 +08:00
Jigsaw a82e9057ca
feat(route): add 中南大学计算机学院通知 (#9631)
* feat(route): add 中南大学计算机学院通知

* fix: use nullish coalescing
2022-04-26 19:48:50 +08:00
TonyRL 44eb849ed7 fix: typo in comment
[skip ci]
2022-04-25 13:47:48 +00:00
swwind 29c04851da
feat(route): add arknights announce (#9607)
* feat: add arknights announce

* feat: dynamic rss title

* migrate arknights to v2

* fix: replace dayjs to parseDate

* refactor: sort maintainer and router

feat: add radar

refactor: use parseDate utils
2022-04-24 23:36:14 +08:00
DylanXie123 10acacfa46
feat(route): add 北京大学学生就业指导服务中心 (#7904)
* feat(route): add 北京大学学生就业指导服务中心

* fix(route): get content from sript tag

request content in script tag to get full text

* fix(doc): fix parameter description

* fix(route): fix header and selector

* add test request and wait

* docs: fix warning

* refactor: migrate to v2

* fix: eecs

refactor: legacy url.resolve

refactor: use parseDate from utils

* docs: fix recruit path

Co-authored-by: TonyRL <TonyRL@users.noreply.github.com>
2022-04-24 23:14:17 +08:00
Sxuet c7aa447100
feat(route): 北极星光伏 (#9542)
* 新增北极星光伏网路由

* 规范化北极星光伏网路由

* 修改一些文本错误

* refactor: migrate to v2
2022-04-23 19:16:16 +08:00
程序员老马 159da9059e
fix(route): 教育部路由新增教育要闻分类,修复部分文章标题取值;优化雪球路由,对于讨论帖直接获取完整内容 (#9556)
* 雪球的讨论帖可以直接从text字段中取到完整内容,长文帖只有description字段有值,获取逻辑不变

* 教育部路由增加“教育要闻”栏目类型获取,同时修复教育部文章title获取不到的问题

* 补充教育部路由增加教育要闻栏目类型的文档

* refactor: migrate to v2

* fix: legacy url.resolve

* 修复雪球返回完整讨论帖时遗漏了转发内容的问题

* 移除重复的key

Co-authored-by: TonyRL <TonyRL@users.noreply.github.com>
2022-04-23 02:21:38 +08:00
Fatpandac fa3428f8fc
fix(route): dx2025/category policy-achievement is failure and refactor to V2 (#9592) 2022-04-22 19:28:15 +08:00
Howard Yin 67d87e2eea
feat(route): E站增加封面图嵌入RSS和封面图替换为代理网址的功能 (#9344)
* 增加封面图嵌入RSS的功能

* 增加EH封面图代理的功能

* 改用URLSearchParams代替querystring
增加对"Minimal", "Minimal+" and "Extended"页面模式的支持

* fix: matching logic

* refactor: migrate to v2

* docs: add missing description of EH_IMG_PROXY

* docs: remove ignoring EH_SK

Co-authored-by: TonyRL <TonyRL@users.noreply.github.com>
2022-04-21 23:03:55 +08:00
任平生 9d9926d0bf
fix(utils): 修复抓取微信已删除文章时遇到的报错 (#9589)
* fix(utils): 支持微信公众号单图片文章抓取

* fix(utils): 支持输出微信公众号转载文章阅读原文链接

* fix(utils): 修复抓取微信已删除文章时遇到的报错

* refactor: migrate to v2

Co-authored-by: blankyu(于海洋) <blankyu@tencent.com>
2022-04-21 21:40:16 +08:00
yuxinliu-alex fccb91838d
fix(route): 央视新闻-专题 支持获取Author字段 (#9568)
* fix(route): 央视新闻-专题 支持获取Author字段

* refactor: migrate to v2

* fix: date parsing in /cctv/photo/jx

* fix: special date parsing

fix: xwlb not working

fix: mzzlbg item description

fix: news use https

fix: xinwen1j1 not working

* feat: add radar

Co-authored-by: Alex Liu <yuxinliu.alex@gmail.com>
2022-04-20 20:11:58 +08:00
Fatpandac 864016c598
fix(route): dongqiudi/top_news cannot convert undefined or null to ob… (#9558)
* fix(route): dongqiudi/top_news cannot convert undefined or null to object

* refactor: migrate to v2

* refactor: daily parseDate cache.tryGet

* fix: legacy url.parse, cache article

* refactor: result use parseDate

* refactor: `cache.get` to `cache.tryGet`

* fix: add radar

* fix: Incomplete URL substring sanitization
2022-04-19 01:19:10 +08:00
尹傲雄 1e11388c90
fix(route): update zju/grs (#9551)
* update zju/grs in university

* refactor: migrate to v2

* fix: add radar

* fix: not working routes

* fix: add migration note

* docs: remove N/A types from physics table

* fix(radar): migrate old rules
2022-04-18 02:04:53 +08:00
Fatpandac cff988ad9f
feat(route): add Eagle's blog and refactor to V2 (#9546)
* feat(route): add Eagle's blog and refactor to V2

* fix: remove deprecated eagle radar rules

* fix: changelog date and guid

* fix(route): add language option
2022-04-17 21:24:17 +08:00
Levi Zim 958be6266e
feat(route): 山东大学(威海)新闻网 (#9537)
* feat(sduwh): add extractors.

* feat(route): add route for 山东大学(威海)新闻网

* docs: for route sduwh/news

* docs: for route sduwh/news

(cherry picked from commit 831830167a39a658520dd9a46b375fdbbcb5d611)

* feat(radar): for route 山东大学(威海)新闻网

* refactor: change `got.get` to `got`.

* refactor: prefer `parseDate()` to `new Date()`

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* fix: incomplete URL substring sanitization.

Make CodeQL happy.

* fix(radar): fix target field.

* fix: change route /sduwh to /sdu/wh

* fix: remove superfluous slash character in url.

* feat: look for exact date first.

* feat: extract exact date from news extractor.

* feat: extract exact date from view extractor.

* feat: extractor for www.sdrj.sdu.edu.cn

* refactor: semantic separation of sduwh with sdu

* feat(radar): more accurate name

* docs: update documentation

* refactor: migrate to v2

* refactor: fix deprecated url.resolve

* fix: update docs url

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* fix: sdu not working routes

* fix: accurate `ctx.state.data.url`

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* fix: better error handling for extractors.

* fix: timezone

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* fix: better error handling.

Co-authored-by: Tony <TonyRL@users.noreply.github.com>
2022-04-17 00:01:39 +08:00
Tony 658570be69
fix(route): taptap topic review (#9540)
* fix(route): taptap topic review

* fix: review url

* refactor: use utility

* docs: add back warning
2022-04-15 22:04:49 +08:00
Fatpandac 56ccda8f72
fix(route): add the title to the first article and refactor to V2 (#9532) 2022-04-13 18:09:17 +08:00
Ethan Shen 6f98d3cee6
fix(route): 果壳网科学人 (#9531)
* fix(route): 果壳网科学人

* ref: use got instead of got.get

* ref: rename channel.js
2022-04-13 17:50:11 +08:00
Fatpandac d63ece212f
fix(route): yystv change selector path, add radar and refactor to V2 (#9529)
* fix(route): change selector path, add radar and refactor to V2

* fix: use parse-date utils

* fix: use https
2022-04-13 17:23:23 +08:00
Ethan Shen 55ecc71784
feat(route): add 科学网用户博客 (#9525)
* feat(route): add 科学网用户博客

* update lib/v2/sciencenet/user.js

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

Co-authored-by: Tony <TonyRL@users.noreply.github.com>
2022-04-12 04:56:50 +01:00
Ethan Shen 0c3888787a
feat(route): add 大连理工大学 (#8580)
* feat(route): add 大连理工大学

* add radar

* fix: add maintainer

* fix typo

* docs: fix url

* fix: incomplete multi-character sanitization
2022-04-10 23:39:24 +08:00
Jigsaw 69210f7cad
fix(route)(twreporter): title,author,pubDate (#9502)
* fix(route): twreporter title,author,pubDate

* refactor: migrate to v2

* fix: missing maintainer
2022-04-09 19:06:03 +08:00
NathanDai 6996efd070
fix(route):雪球 基金净值数据来源调整为蛋卷基金 (#9489)
* 雪球基金净值更新调整为蛋卷基金

* Update docs/finance.md

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* Update docs/finance.md

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* refactor: migrate to v2

* fix: parseDate

* fix: fund unnecessary String()

* feat: add radar

* fix: stock comments template

* style: add a linebreak

* docs: fund example path
2022-04-08 23:38:33 +08:00
Tony f11b5758d7
fix(route): gamer gnn news (#9465) 2022-04-05 02:02:49 +08:00
Ethan Shen d68e5a8d54
feat(route): add Quicker动作更新 (#9357)
* feat(route): add Quicker动作更新

* fix typo

* delete outdated routes

* fix: add h2 header

* fix: invalid pubDate
2022-03-31 22:32:30 +08:00
Ethan Shen d50e0948dc
feat(route): add 虎扑首页 (#9416) 2022-03-29 22:03:13 +08:00
Genghis Yang 33eb860b08
fix(route): mpaypass news (#9367)
* fix(route): mpaypass news

* refactor: migrate to v2

* fix: parseDate
2022-03-28 20:41:20 +08:00
Ethan Shen 5927f28121
fix(route): PubMed Trending articles (#9402) 2022-03-28 20:20:30 +08:00
忧郁的紫色毛衣男孩 e61a90db77
fix(route): geo daily photo (#7555)
* 完成issues#7485,在每日一图-国家地理中增加每日精选节点

* 修改文档和router位置

* 对日期pubDate规范进行了调整

* 优化调整获取内容逻辑,修改pubDate字段的获取方式

* 调整pubDate参数

* 删除代码中多余的console

* 调整parse-date引用

* 调整时区

* issues-#7471,解决国家地理每日一图获取失败问题,因为网站更改,并且网站对图片进行了处理,所以调整获取方式。

* 删除无用代码

* 调整代码,错删了代码

* refactor: migrate to v2

* fix: nat geo photo of the day

* fix: natgeo parseDate

* style: lint

* feat: radar for natgeomedia.com

Co-authored-by: TonyRL <TonyRL@users.noreply.github.com>
2022-03-27 00:09:34 +08:00
Ethan Shen 8ecad32db2
feat(route): add 澎湃明查 (#9380)
* feat(route): add 澎湃明查

* fix: 839studio routes

* docs: update example url

* fix: parseDate
2022-03-25 22:05:27 +08:00
Qin Ruizhe f3618bb148
feat(route): fix NUAA 教务处/计算机科学与技术学院信息 (#9361)
* feat(route): fix NUAA 教务处/计算机科学与技术学院信息

* refactor: migrate to v2

* fix: deprecated url.resolve
2022-03-25 03:21:32 +08:00
Fatpandac 259bcf1e5c
fix(route): ifeng/feng this route is empty (#9372)
* ifeng/feng this route is empty

* refactor: migrate to v2

* fix: parseDate
2022-03-24 01:47:29 +08:00