950bfa61ed
feat(route): add juejin news ( #7969 )
...
* feat(route): add juejin news
* feat(route): add juejin news
* fix(route): juejin news pubDate
* fix: fix utility
* refactor: migrate to v2
* fix: typo
Co-authored-by: TonyRL <TonyRL@users.noreply.github.com>
2022-05-20 01:55:18 +08:00
f477e3e8bf
fix(route): fixed routes/earthquake and ceic timezone shift ( #9780 )
...
* fixed routes/earthquake and ceic timezone shift
* use utils/timezone and remove changes on yarn.lock
* edit format problem
* refactor: migrate to v2
2022-05-19 01:29:58 +08:00
6187a08227
fix(route:aliyun/developer/group): 获取到的全是0 ( #9741 )
...
* fix(route:aliyun/developer/group): 获取到的全是0
* Update lib/routes/aliyun/developer/group.js
Co-authored-by: Tony <TonyRL@users.noreply.github.com>
* Update lib/routes/aliyun/developer/group.js
Co-authored-by: Tony <TonyRL@users.noreply.github.com>
* refactor: migrate to v2
* refactor: use cache.tryGet
* fix: add radar
* fix: article parsing
2022-05-19 00:03:00 +08:00
f17ff7104c
feat(route): add Mobilism ( #8949 )
...
* Add(route): add Mobilism
* 去除注释
去除登录
* Revert "去除注释"
This reverts commit 8b1409aee2f44335bca39efdab8d524e749ccb3e.
* 尝试修复重复推送问题
* 修复部分情况下时间获取错误
* 去除时间获取(重复推送BUG无法解决)
增加全文获取
* 添加参数判断是否获取全文
* 修改
* 2022年1月30日14:22:40
* fix: remove login, use built-in `toTitleCase`
* docs: add missing docs
* fix: radar
* fix: typo
Co-authored-by: Nite07 <nmy1207@outlook.com>
Co-authored-by: TonyRL <TonyRL@users.noreply.github.com>
2022-05-17 23:36:06 +08:00
8d5836e3f3
fix(route): 9to5/subsite fix selector, use tag and refactor to V2 ( #9771 )
...
* fix(route): 9to5/subsite fix selector and refactor to V2
* Update lib/v2/9to5/radar.js
Co-authored-by: Rongrong <i@rong.moe>
* Update lib/v2/9to5/radar.js
Co-authored-by: Rongrong <i@rong.moe>
* Update lib/v2/9to5/radar.js
Co-authored-by: Rongrong <i@rong.moe>
* fix(route): change link
* Update lib/v2/9to5/subsite.js
Co-authored-by: Rongrong <i@rong.moe>
* Update lib/v2/9to5/radar.js
Co-authored-by: Rongrong <i@rong.moe>
* Update lib/v2/9to5/radar.js
Co-authored-by: Rongrong <i@rong.moe>
* Update lib/v2/9to5/radar.js
Co-authored-by: Rongrong <i@rong.moe>
* fix(docs): add radar and rssbud badges
* Update lib/v2/9to5/subsite.js
Co-authored-by: Tony <TonyRL@users.noreply.github.com>
Co-authored-by: Rongrong <i@rong.moe>
Co-authored-by: Tony <TonyRL@users.noreply.github.com>
2022-05-17 23:18:02 +08:00
f7c02471d0
fix(route): yomiuri news list structure changed ( #9764 )
2022-05-17 01:13:55 +08:00
bab100a487
feat(route/twitter): allow force using Web API ( #9760 )
...
Signed-off-by: Rongrong <i@rong.moe>
2022-05-15 22:17:23 +08:00
039e8eb80f
fix(route): nature ( #9748 )
2022-05-14 00:37:06 +08:00
08602c778c
fix(route): 修复/zhihu/question无法获取，需要设置非登录状态下cookie ( #9729 )
...
* 修复/zhihu/question，需要设置非登录状态下cookie
* Update lib/routes/zhihu/execlib/g_encrypt.js
Co-authored-by: Tony <TonyRL@users.noreply.github.com>
* 根据TonyRL review建议进行了修改
* Update lib/routes/zhihu/question.js
Co-authored-by: Rongrong <Rongronggg9@outlook.com>
* Update lib/routes/zhihu/question.js
Co-authored-by: Rongrong <Rongronggg9@outlook.com>
* Update lib/routes/zhihu/question.js
Co-authored-by: Rongrong <Rongronggg9@outlook.com>
* Update lib/routes/zhihu/question.js
Co-authored-by: Rongrong <Rongronggg9@outlook.com>
* Update lib/routes/zhihu/question.js
Co-authored-by: Rongrong <Rongronggg9@outlook.com>
* Update lib/routes/zhihu/question.js
Co-authored-by: Rongrong <Rongronggg9@outlook.com>
* 增加cookie中dc_0字段检验
* Update lib/routes/zhihu/question.js
Co-authored-by: Rongrong <Rongronggg9@outlook.com>
* Update lib/routes/zhihu/question.js
Co-authored-by: Rongrong <Rongronggg9@outlook.com>
* refactor: migrate to v2
* fix: Incomplete URL substring sanitization
Co-authored-by: Rongrong <Rongronggg9@outlook.com>
2022-05-14 00:21:11 +08:00
0c3ca1bb11
fix(route): fix pianyuan, add pianyuan/search ( #9721 )
...
* fix route pianyuan, add route pianyuan/search
* update doc
* changes for reviews
* Update lib/routes/pianyuan/utils.js
Co-authored-by: Rongrong <Rongronggg9@outlook.com>
* changes for reviews
* refactor: migrate to v2
Co-authored-by: Rongrong <Rongronggg9@outlook.com>
2022-05-09 01:00:29 +08:00
a37cf18153
refactor (route/mastodon): quick fix on empty reposted toots ( #9700 )
2022-05-06 17:03:57 +08:00
63ccc9499b
fix(route/jike): image URL; outdated usage ( #9693 )
...
* fix(route/jike): image URL; outdated usage
Signed-off-by: Rongrong <i@rong.moe>
* refactor: migrate to v2
* fix: unescaped .
* feat(route/jike): new radar rule
Signed-off-by: Rongrong <i@rong.moe>
2022-05-05 20:28:04 +08:00
be1a1b303c
fix(route): uraaka-joshi ( #7908 )
...
* modify uraaka-joshi to puppeteer
* style: auto format
* fix(route): uraaka-joshi and user
* docs: fix author
Co-authored-by: GitHub Action <action@github.com>
Co-authored-by: TonyRL <TonyRL@users.noreply.github.com>
2022-05-05 04:22:23 +08:00
ac7b3666d8
fix(route): 南京理工大学 ( #9659 )
...
* fix(route): 南京理工大学
* refactor: migrate to v2
* refactor: migrate to v2
* Update yarn.lock
* fix: remove standalone puppeteer extra
* fix(route): minor misc changes
* fix(route): sort routes in alphabetical order
* fix(route): update utils.js
2022-05-03 19:37:58 +08:00
24e435d48f
feat(route)!: remove dwnews ( #9675 )
2022-05-01 23:49:31 +08:00
a428c4c5cd
fix(route): broken link embassy/us ( #9673 )
...
* Fix broken link embassy/us
* refactor: migrate to v2
* fix: embassy/us selector
2022-05-01 21:27:20 +08:00
f88e58b493
feat(route): 中国科学技术大学-研究生院/信息科学技术学院/电子工程与信息科学系 ( #9666 )
...
* fix(route): 中科大官网通知公告正文内容获取
* refactor: migrate to v2
* feat(route): 中国科学技术大学-研究生院/信息科学技术学院/电子工程与信息科学系
* fix: sort router
* fix: deprecated url.resolve
* fix: fulltext cache
fix: nullish coalescing
fix: data.link
fix: cache.tryGet
* fix: deepscan
2022-05-01 17:36:33 +08:00
1a547caf3b
feat(route): 更新少数派全文支持 ( #9653 )
...
* feat: 少数派首页全文输出
* feat: 少数派全路由全文
* feat: 少数派专栏全文
* refactor: migrate to v2
* fix: cache key
2022-05-01 17:34:45 +08:00
e5484a75bd
feat(route): add 云听 ( #9665 )
...
* feat(route): add 云听
* fix typo
* fix: wrong data
2022-05-01 06:13:57 +08:00
22bbc76ef5
fix(route): 深圳证券交易所问询函件 ( #9658 )
...
* fix(route): 深圳证券交易所问询函件
* fix typo
* fix description
* docs: fix category
2022-04-30 23:03:30 +08:00
e063633cd7
refactor: switch to `twitter-api-v2` from `twit` ( #9652 )
2022-04-29 01:35:10 +08:00
bba6a46d19
feat(route): add 人人影视-今日播出 ( #9619 )
...
* feat(route): add 人人影视-今日播出
* feat(route): 人人影视-今日更新 v2 standard
* refactor: migrate to v2
* fix: apply suggestion
2022-04-27 23:01:32 +08:00
a82e9057ca
feat(route): add 中南大学计算机学院通知 ( #9631 )
...
* feat(route): add 中南大学计算机学院通知
* fix: use nullish coalescing
2022-04-26 19:48:50 +08:00
29c04851da
feat(route): add arknights announce ( #9607 )
...
* feat: add arknights announce
* feat: dynamic rss title
* migrate arknights to v2
* fix: replace dayjs to parseDate
* refactor: sort maintainer and router
feat: add radar
refactor: use parseDate utils
2022-04-24 23:36:14 +08:00
10acacfa46
feat(route): add 北京大学学生就业指导服务中心 ( #7904 )
...
* feat(route): add 北京大学学生就业指导服务中心
* fix(route): get content from sript tag
request content in script tag to get full text
* fix(doc): fix parameter description
* fix(route): fix header and selector
* add test request and wait
* docs: fix warning
* refactor: migrate to v2
* fix: eecs
refactor: legacy url.resolve
refactor: use parseDate from utils
* docs: fix recruit path
Co-authored-by: TonyRL <TonyRL@users.noreply.github.com>
2022-04-24 23:14:17 +08:00
c7aa447100
feat(route): 北极星光伏 ( #9542 )
...
* 新增北极星光伏网路由
* 规范化北极星光伏网路由
* 修改一些文本错误
* refactor: migrate to v2
2022-04-23 19:16:16 +08:00
159da9059e
fix(route): 教育部路由新增教育要闻分类，修复部分文章标题取值；优化雪球路由，对于讨论帖直接获取完整内容 ( #9556 )
...
* 雪球的讨论帖可以直接从text字段中取到完整内容，长文帖只有description字段有值，获取逻辑不变
* 教育部路由增加“教育要闻”栏目类型获取，同时修复教育部文章title获取不到的问题
* 补充教育部路由增加教育要闻栏目类型的文档
* refactor: migrate to v2
* fix: legacy url.resolve
* 修复雪球返回完整讨论帖时遗漏了转发内容的问题
* 移除重复的key
Co-authored-by: TonyRL <TonyRL@users.noreply.github.com>
2022-04-23 02:21:38 +08:00
fa3428f8fc
fix(route): dx2025/category policy-achievement is failure and refactor to V2 ( #9592 )
2022-04-22 19:28:15 +08:00
67d87e2eea
feat(route): E站增加封面图嵌入RSS和封面图替换为代理网址的功能 ( #9344 )
...
* 增加封面图嵌入RSS的功能
* 增加EH封面图代理的功能
* 改用URLSearchParams代替querystring
增加对"Minimal", "Minimal+" and "Extended"页面模式的支持
* fix: matching logic
* refactor: migrate to v2
* docs: add missing description of EH_IMG_PROXY
* docs: remove ignoring EH_SK
Co-authored-by: TonyRL <TonyRL@users.noreply.github.com>
2022-04-21 23:03:55 +08:00
9d9926d0bf
fix(utils): 修复抓取微信已删除文章时遇到的报错 ( #9589 )
...
* fix(utils): 支持微信公众号单图片文章抓取
* fix(utils): 支持输出微信公众号转载文章阅读原文链接
* fix(utils): 修复抓取微信已删除文章时遇到的报错
* refactor: migrate to v2
Co-authored-by: blankyu(于海洋) <blankyu@tencent.com>
2022-04-21 21:40:16 +08:00
fccb91838d
fix(route): 央视新闻-专题 支持获取Author字段 ( #9568 )
...
* fix(route): 央视新闻-专题 支持获取Author字段
* refactor: migrate to v2
* fix: date parsing in /cctv/photo/jx
* fix: special date parsing
fix: xwlb not working
fix: mzzlbg item description
fix: news use https
fix: xinwen1j1 not working
* feat: add radar
Co-authored-by: Alex Liu <yuxinliu.alex@gmail.com>
2022-04-20 20:11:58 +08:00
864016c598
fix(route): dongqiudi/top_news cannot convert undefined or null to ob… ( #9558 )
...
* fix(route): dongqiudi/top_news cannot convert undefined or null to object
* refactor: migrate to v2
* refactor: daily parseDate cache.tryGet
* fix: legacy url.parse, cache article
* refactor: result use parseDate
* refactor: `cache.get` to `cache.tryGet`
* fix: add radar
* fix: Incomplete URL substring sanitization
2022-04-19 01:19:10 +08:00
1e11388c90
fix(route): update zju/grs ( #9551 )
...
* update zju/grs in university
* refactor: migrate to v2
* fix: add radar
* fix: not working routes
* fix: add migration note
* docs: remove N/A types from physics table
* fix(radar): migrate old rules
2022-04-18 02:04:53 +08:00
cff988ad9f
feat(route): add Eagle's blog and refactor to V2 ( #9546 )
...
* feat(route): add Eagle's blog and refactor to V2
* fix: remove deprecated eagle radar rules
* fix: changelog date and guid
* fix(route): add language option
2022-04-17 21:24:17 +08:00
958be6266e
feat(route): 山东大学（威海）新闻网 ( #9537 )
...
* feat(sduwh): add extractors.
* feat(route): add route for 山东大学（威海）新闻网
* docs: for route sduwh/news
* docs: for route sduwh/news
(cherry picked from commit 831830167a39a658520dd9a46b375fdbbcb5d611)
* feat(radar): for route 山东大学（威海）新闻网
* refactor: change `got.get` to `got`.
* refactor: prefer `parseDate()` to `new Date()`
Co-authored-by: Tony <TonyRL@users.noreply.github.com>
* fix: incomplete URL substring sanitization.
Make CodeQL happy.
* fix(radar): fix target field.
* fix: change route /sduwh to /sdu/wh
* fix: remove superfluous slash character in url.
* feat: look for exact date first.
* feat: extract exact date from news extractor.
* feat: extract exact date from view extractor.
* feat: extractor for www.sdrj.sdu.edu.cn
* refactor: semantic separation of sduwh with sdu
* feat(radar): more accurate name
* docs: update documentation
* refactor: migrate to v2
* refactor: fix deprecated url.resolve
* fix: update docs url
Co-authored-by: Tony <TonyRL@users.noreply.github.com>
* fix: sdu not working routes
* fix: accurate `ctx.state.data.url`
Co-authored-by: Tony <TonyRL@users.noreply.github.com>
* fix: better error handling for extractors.
* fix: timezone
Co-authored-by: Tony <TonyRL@users.noreply.github.com>
* fix: better error handling.
Co-authored-by: Tony <TonyRL@users.noreply.github.com>
2022-04-17 00:01:39 +08:00
658570be69
fix(route): taptap topic review ( #9540 )
...
* fix(route): taptap topic review
* fix: review url
* refactor: use utility
* docs: add back warning
2022-04-15 22:04:49 +08:00
56ccda8f72
fix(route): add the title to the first article and refactor to V2 ( #9532 )
2022-04-13 18:09:17 +08:00
6f98d3cee6
fix(route): 果壳网科学人 ( #9531 )
...
* fix(route): 果壳网科学人
* ref: use got instead of got.get
* ref: rename channel.js
2022-04-13 17:50:11 +08:00
d63ece212f
fix(route): yystv change selector path, add radar and refactor to V2 ( #9529 )
...
* fix(route): change selector path, add radar and refactor to V2
* fix: use parse-date utils
* fix: use https
2022-04-13 17:23:23 +08:00
55ecc71784
feat(route): add 科学网用户博客 ( #9525 )
...
* feat(route): add 科学网用户博客
* update lib/v2/sciencenet/user.js
Co-authored-by: Tony <TonyRL@users.noreply.github.com>
Co-authored-by: Tony <TonyRL@users.noreply.github.com>
2022-04-12 04:56:50 +01:00
0c3888787a
feat(route): add 大连理工大学 ( #8580 )
...
* feat(route): add 大连理工大学
* add radar
* fix: add maintainer
* fix typo
* docs: fix url
* fix: incomplete multi-character sanitization
2022-04-10 23:39:24 +08:00
69210f7cad
fix(route)(twreporter): title,author,pubDate ( #9502 )
...
* fix(route): twreporter title,author,pubDate
* refactor: migrate to v2
* fix: missing maintainer
2022-04-09 19:06:03 +08:00
2dab2ad5bc
fix(route)(wechat/ce): anti-crawler and pubDate ( #9495 )
...
Signed-off-by: Rongrong <15956627+Rongronggg9@users.noreply.github.com>
2022-04-09 00:00:02 +08:00
6996efd070
fix(route):雪球 基金净值数据来源调整为蛋卷基金 ( #9489 )
...
* 雪球基金净值更新调整为蛋卷基金
* Update docs/finance.md
Co-authored-by: Tony <TonyRL@users.noreply.github.com>
* Update docs/finance.md
Co-authored-by: Tony <TonyRL@users.noreply.github.com>
* refactor: migrate to v2
* fix: parseDate
* fix: fund unnecessary String()
* feat: add radar
* fix: stock comments template
* style: add a linebreak
* docs: fund example path
2022-04-08 23:38:33 +08:00
eb9026e470
fix(route)(wechat/ershicimi): outdated URL ( #9494 )
...
* fix(route)(wechat/ershicimi): outdated URL
Signed-off-by: Rongrong <15956627+Rongronggg9@users.noreply.github.com>
* fix: pubDate
2022-04-08 18:08:48 +08:00
f97cdb291c
fix: lack of config error url ( #9490 )
2022-04-07 22:34:33 +08:00
a79cc20ec1
feat(utils): add utils for WeChat MP ( #9487 )
...
Motivation:
There are multiple routes that need to fetch articles from WeChat MP.
However, letting them fetch articles by themselves could potentially
lead to cache key collisions. Even if cache key collisions do not occur,
un-normalized URL could potentially lead to duplicated requests.
What's more, articles from WeChat MP have weird formats and need to be
fixed. Creating a universal function to do this work can create some
ease for new route contributors.
Note:
In order to make this PR atomic as much as possible, I did not touch
those broken routes. Once this PR is merged, I will try to fix them.
Signed-off-by: Rongrong <15956627+Rongronggg9@users.noreply.github.com>
2022-04-07 21:46:15 +08:00
e0b7ca676d
fix(route)(twitter)(web API): retweet un-extracted ( #9488 )
...
Signed-off-by: Rongrong <15956627+Rongronggg9@users.noreply.github.com>
2022-04-07 20:38:54 +08:00
e9a51c0d35
fix(route)(weibo/timeline): improper caching usage ( #9474 )
...
Signed-off-by: Rongrong <15956627+Rongronggg9@users.noreply.github.com>
2022-04-05 20:26:02 -07:00
ee8ad5b7fa
feat(route)(twitter): API fallback ( #9475 )
...
Signed-off-by: Rongrong <15956627+Rongronggg9@users.noreply.github.com>
2022-04-06 05:11:09 +08:00
CancerGary
b0ttle
KotoriK
Nite07
Fatpandac
Arracc
Rongrong
Tony
Yue
jerry1119
notofoe
Halcao
Zhiyang Guo
Mengxin Cao
Henry Wang
Ethan Shen
bao1991213
Jigsaw
swwind
DylanXie123
Sxuet
程序员老马
Howard Yin
任平生
yuxinliu-alex
尹傲雄
Levi Zim
Ethan Shen
Rongrong
NathanDai