Commit Graph

1682 Commits

Author SHA1 Message Date
Jigsaw a82e9057ca
feat(route): add 中南大学计算机学院通知 (#9631)
* feat(route): add 中南大学计算机学院通知

* fix: use nullish coalescing
2022-04-26 19:48:50 +08:00
TonyRL 44eb849ed7 fix: typo in comment
[skip ci]
2022-04-25 13:47:48 +00:00
swwind 29c04851da
feat(route): add arknights announce (#9607)
* feat: add arknights announce

* feat: dynamic rss title

* migrate arknights to v2

* fix: replace dayjs to parseDate

* refactor: sort maintainer and router

feat: add radar

refactor: use parseDate utils
2022-04-24 23:36:14 +08:00
DylanXie123 10acacfa46
feat(route): add 北京大学学生就业指导服务中心 (#7904)
* feat(route): add 北京大学学生就业指导服务中心

* fix(route): get content from sript tag

request content in script tag to get full text

* fix(doc): fix parameter description

* fix(route): fix header and selector

* add test request and wait

* docs: fix warning

* refactor: migrate to v2

* fix: eecs

refactor: legacy url.resolve

refactor: use parseDate from utils

* docs: fix recruit path

Co-authored-by: TonyRL <TonyRL@users.noreply.github.com>
2022-04-24 23:14:17 +08:00
Sxuet c7aa447100
feat(route): 北极星光伏 (#9542)
* 新增北极星光伏网路由

* 规范化北极星光伏网路由

* 修改一些文本错误

* refactor: migrate to v2
2022-04-23 19:16:16 +08:00
程序员老马 159da9059e
fix(route): 教育部路由新增教育要闻分类,修复部分文章标题取值;优化雪球路由,对于讨论帖直接获取完整内容 (#9556)
* 雪球的讨论帖可以直接从text字段中取到完整内容,长文帖只有description字段有值,获取逻辑不变

* 教育部路由增加“教育要闻”栏目类型获取,同时修复教育部文章title获取不到的问题

* 补充教育部路由增加教育要闻栏目类型的文档

* refactor: migrate to v2

* fix: legacy url.resolve

* 修复雪球返回完整讨论帖时遗漏了转发内容的问题

* 移除重复的key

Co-authored-by: TonyRL <TonyRL@users.noreply.github.com>
2022-04-23 02:21:38 +08:00
Fatpandac fa3428f8fc
fix(route): dx2025/category policy-achievement is failure and refactor to V2 (#9592) 2022-04-22 19:28:15 +08:00
Howard Yin 67d87e2eea
feat(route): E站增加封面图嵌入RSS和封面图替换为代理网址的功能 (#9344)
* 增加封面图嵌入RSS的功能

* 增加EH封面图代理的功能

* 改用URLSearchParams代替querystring
增加对"Minimal", "Minimal+" and "Extended"页面模式的支持

* fix: matching logic

* refactor: migrate to v2

* docs: add missing description of EH_IMG_PROXY

* docs: remove ignoring EH_SK

Co-authored-by: TonyRL <TonyRL@users.noreply.github.com>
2022-04-21 23:03:55 +08:00
任平生 9d9926d0bf
fix(utils): 修复抓取微信已删除文章时遇到的报错 (#9589)
* fix(utils): 支持微信公众号单图片文章抓取

* fix(utils): 支持输出微信公众号转载文章阅读原文链接

* fix(utils): 修复抓取微信已删除文章时遇到的报错

* refactor: migrate to v2

Co-authored-by: blankyu(于海洋) <blankyu@tencent.com>
2022-04-21 21:40:16 +08:00
yuxinliu-alex fccb91838d
fix(route): 央视新闻-专题 支持获取Author字段 (#9568)
* fix(route): 央视新闻-专题 支持获取Author字段

* refactor: migrate to v2

* fix: date parsing in /cctv/photo/jx

* fix: special date parsing

fix: xwlb not working

fix: mzzlbg item description

fix: news use https

fix: xinwen1j1 not working

* feat: add radar

Co-authored-by: Alex Liu <yuxinliu.alex@gmail.com>
2022-04-20 20:11:58 +08:00
Fatpandac 864016c598
fix(route): dongqiudi/top_news cannot convert undefined or null to ob… (#9558)
* fix(route): dongqiudi/top_news cannot convert undefined or null to object

* refactor: migrate to v2

* refactor: daily parseDate cache.tryGet

* fix: legacy url.parse, cache article

* refactor: result use parseDate

* refactor: `cache.get` to `cache.tryGet`

* fix: add radar

* fix: Incomplete URL substring sanitization
2022-04-19 01:19:10 +08:00
尹傲雄 1e11388c90
fix(route): update zju/grs (#9551)
* update zju/grs in university

* refactor: migrate to v2

* fix: add radar

* fix: not working routes

* fix: add migration note

* docs: remove N/A types from physics table

* fix(radar): migrate old rules
2022-04-18 02:04:53 +08:00
Fatpandac cff988ad9f
feat(route): add Eagle's blog and refactor to V2 (#9546)
* feat(route): add Eagle's blog and refactor to V2

* fix: remove deprecated eagle radar rules

* fix: changelog date and guid

* fix(route): add language option
2022-04-17 21:24:17 +08:00
Levi Zim 958be6266e
feat(route): 山东大学(威海)新闻网 (#9537)
* feat(sduwh): add extractors.

* feat(route): add route for 山东大学(威海)新闻网

* docs: for route sduwh/news

* docs: for route sduwh/news

(cherry picked from commit 831830167a39a658520dd9a46b375fdbbcb5d611)

* feat(radar): for route 山东大学(威海)新闻网

* refactor: change `got.get` to `got`.

* refactor: prefer `parseDate()` to `new Date()`

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* fix: incomplete URL substring sanitization.

Make CodeQL happy.

* fix(radar): fix target field.

* fix: change route /sduwh to /sdu/wh

* fix: remove superfluous slash character in url.

* feat: look for exact date first.

* feat: extract exact date from news extractor.

* feat: extract exact date from view extractor.

* feat: extractor for www.sdrj.sdu.edu.cn

* refactor: semantic separation of sduwh with sdu

* feat(radar): more accurate name

* docs: update documentation

* refactor: migrate to v2

* refactor: fix deprecated url.resolve

* fix: update docs url

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* fix: sdu not working routes

* fix: accurate `ctx.state.data.url`

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* fix: better error handling for extractors.

* fix: timezone

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* fix: better error handling.

Co-authored-by: Tony <TonyRL@users.noreply.github.com>
2022-04-17 00:01:39 +08:00
Tony 658570be69
fix(route): taptap topic review (#9540)
* fix(route): taptap topic review

* fix: review url

* refactor: use utility

* docs: add back warning
2022-04-15 22:04:49 +08:00
Fatpandac 56ccda8f72
fix(route): add the title to the first article and refactor to V2 (#9532) 2022-04-13 18:09:17 +08:00
Ethan Shen 6f98d3cee6
fix(route): 果壳网科学人 (#9531)
* fix(route): 果壳网科学人

* ref: use got instead of got.get

* ref: rename channel.js
2022-04-13 17:50:11 +08:00
Fatpandac d63ece212f
fix(route): yystv change selector path, add radar and refactor to V2 (#9529)
* fix(route): change selector path, add radar and refactor to V2

* fix: use parse-date utils

* fix: use https
2022-04-13 17:23:23 +08:00
Ethan Shen 55ecc71784
feat(route): add 科学网用户博客 (#9525)
* feat(route): add 科学网用户博客

* update lib/v2/sciencenet/user.js

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

Co-authored-by: Tony <TonyRL@users.noreply.github.com>
2022-04-12 04:56:50 +01:00
Ethan Shen 0c3888787a
feat(route): add 大连理工大学 (#8580)
* feat(route): add 大连理工大学

* add radar

* fix: add maintainer

* fix typo

* docs: fix url

* fix: incomplete multi-character sanitization
2022-04-10 23:39:24 +08:00
Jigsaw 69210f7cad
fix(route)(twreporter): title,author,pubDate (#9502)
* fix(route): twreporter title,author,pubDate

* refactor: migrate to v2

* fix: missing maintainer
2022-04-09 19:06:03 +08:00
NathanDai 6996efd070
fix(route):雪球 基金净值数据来源调整为蛋卷基金 (#9489)
* 雪球基金净值更新调整为蛋卷基金

* Update docs/finance.md

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* Update docs/finance.md

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* refactor: migrate to v2

* fix: parseDate

* fix: fund unnecessary String()

* feat: add radar

* fix: stock comments template

* style: add a linebreak

* docs: fund example path
2022-04-08 23:38:33 +08:00
Tony f11b5758d7
fix(route): gamer gnn news (#9465) 2022-04-05 02:02:49 +08:00
Ethan Shen d68e5a8d54
feat(route): add Quicker动作更新 (#9357)
* feat(route): add Quicker动作更新

* fix typo

* delete outdated routes

* fix: add h2 header

* fix: invalid pubDate
2022-03-31 22:32:30 +08:00
Ethan Shen d50e0948dc
feat(route): add 虎扑首页 (#9416) 2022-03-29 22:03:13 +08:00
Genghis Yang 33eb860b08
fix(route): mpaypass news (#9367)
* fix(route): mpaypass news

* refactor: migrate to v2

* fix: parseDate
2022-03-28 20:41:20 +08:00
Ethan Shen 5927f28121
fix(route): PubMed Trending articles (#9402) 2022-03-28 20:20:30 +08:00
忧郁的紫色毛衣男孩 e61a90db77
fix(route): geo daily photo (#7555)
* 完成issues#7485,在每日一图-国家地理中增加每日精选节点

* 修改文档和router位置

* 对日期pubDate规范进行了调整

* 优化调整获取内容逻辑,修改pubDate字段的获取方式

* 调整pubDate参数

* 删除代码中多余的console

* 调整parse-date引用

* 调整时区

* issues-#7471,解决国家地理每日一图获取失败问题,因为网站更改,并且网站对图片进行了处理,所以调整获取方式。

* 删除无用代码

* 调整代码,错删了代码

* refactor: migrate to v2

* fix: nat geo photo of the day

* fix: natgeo parseDate

* style: lint

* feat: radar for natgeomedia.com

Co-authored-by: TonyRL <TonyRL@users.noreply.github.com>
2022-03-27 00:09:34 +08:00
Ethan Shen 8ecad32db2
feat(route): add 澎湃明查 (#9380)
* feat(route): add 澎湃明查

* fix: 839studio routes

* docs: update example url

* fix: parseDate
2022-03-25 22:05:27 +08:00
Qin Ruizhe f3618bb148
feat(route): fix NUAA 教务处/计算机科学与技术学院信息 (#9361)
* feat(route): fix NUAA 教务处/计算机科学与技术学院信息

* refactor: migrate to v2

* fix: deprecated url.resolve
2022-03-25 03:21:32 +08:00
Fatpandac 259bcf1e5c
fix(route): ifeng/feng this route is empty (#9372)
* ifeng/feng this route is empty

* refactor: migrate to v2

* fix: parseDate
2022-03-24 01:47:29 +08:00
Tony 6ba0cb246e
fix(route): dbmv category not working (#9366) 2022-03-23 22:34:35 +08:00
Kevin Schaul 95789aafaa
feat(rotue): add nytimes/author route (#9356)
* Add nytimes/author route

* Removed unnecessary logger and fs usage

* refactor: migrate to v2
2022-03-22 22:52:49 +08:00
Ethan Shen d84ab79163
feat(route): add 中华人民共和国外交部外交动态 (#9348)
* feat(route): add 中华人民共和国外交部外交动态

* fix: wrong pubDate
2022-03-22 04:20:12 +08:00
Ethan Shen 6477e6b8e4
feat(route): 观察者网输出全文 (#9338)
* feature(route): 观察者网输出全文

* fix: add radar

* fix typo

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* fix: add timezone

Co-authored-by: Tony <TonyRL@users.noreply.github.com>
2022-03-19 21:01:03 +08:00
Tony ba198d09c4
fix(route): rfa missing url property (#9326)
* fix(route): rfa missing url property

* docs: add missing en h3 title

* fix: use nullish coalescing operator
2022-03-16 05:14:49 +08:00
Fatpandac 0ec2b01ec2
feat(route): add 政策研究, 工作论文 and refactor to V2 (#9324)
* feat(route): add 政策研究, 工作论文 and refactor to V2

* fix: depreciated url.resolve pubDate
2022-03-16 04:13:45 +08:00
Fatpandac 194a522fc8
fix(route): ixigua_user anti-crawler policy upgrade and refactor to V2 (#9314)
* fix(route): ixigua_user anti-crawler policy upgrade and refactor to V2

* fix(route): replaces '/' with itself and fix item's link
2022-03-15 03:08:14 +08:00
Fatpandac ea0022cbcf
feat(route): add 差评快讯 and refactor to V2 (#9319)
* feat(route): add 差评快讯 and refactor to V2

* fix: parseDate
2022-03-15 02:30:06 +08:00
Shao ye ee1eab23d8
fix njupt posts with url redirections (#8961)
* fix njupt posts with url redirections

skip posts that are redirected to error pages due to access control

* fix: migrate to v2

* fix: pubDate depreciated url.resolve

Co-authored-by: TonyRL <TonyRL@users.noreply.github.com>
2022-03-13 22:24:06 +08:00
Fatpandac 43f1d1813d
fix(route): sohu_mp can not get author's link and refactor to V2 (#9311)
* fix(route): sohu_mp can not get author's link and refactor to V2

* fix: pubDate

* fix: remove unused timezone

Co-authored-by: TonyRL <TonyRL@users.noreply.github.com>
2022-03-13 21:11:12 +08:00
Jigsaw 01146e3e6f
feat(route): add bilibili online list (#9308)
* feat(route): add bilibili online list

* fix(route): bilibili online list

* fix(route): bilibili online list

* refactor: migrate to v2
2022-03-12 17:09:28 +08:00
Fatpandac 7e3bdc45fc
fix(route): segmentfault return empty and refactor to V2 (#9270)
* fix(route): return empty and refactor to V2

* docs: update segmentfault user example
2022-03-08 22:01:44 +08:00
liuxsdev 007948efcd
feat(route): 生态环境部-要闻动态 (#9248)
* feat(route): 生态环境部-要闻动态
2022-03-08 21:49:30 +08:00
StevenRCE0 6a4b939509
feat(route): 机核网添加分类标签和标签路由 (#9239)
* Gcores tagging

* Gcore tags

* Comfort v2

* Update router

* Update router.js

* refactor: use cache.tryGet
2022-03-06 20:06:37 +08:00
Fatpandac 3b53c4430e
feat(route): add 工业和信息化部 (#9221)
* feat(route): add 工业和信息化部

* fix(route): change route path, docs and refactor to V2
2022-03-05 23:22:46 +08:00
Rongrong 44f1ea3718
feat(route)(picuki/profile): migrate to v2, fetch stories (#9216)
* refactor(route)(picuki/profile): migrate to v2

other changes:
fix linebreak
fix header
add location
`displayVideo` param defaults to enable

Signed-off-by: Rongrong <15956627+Rongronggg9@users.noreply.github.com>

* refactor(route)(picuki/profile): use template

Signed-off-by: Rongrong <15956627+Rongronggg9@users.noreply.github.com>

* feat(route)(picuki/profile): fetch stories

Signed-off-by: Rongrong <15956627+Rongronggg9@users.noreply.github.com>
2022-03-02 22:26:21 +08:00
Ethan Shen ef2e78f546
fix(route): MM范 (#8701)
* fix(route): MM范

* fix: add radar

* fix: use art-template
2022-02-26 23:56:20 +08:00
Jinkin 1fe6abfb87
feat(route): 牛客网面经 (#9199)
* 增加牛客网面经,测试完成

* 修改描述
2022-02-26 21:35:39 +08:00
Ethan Shen 8b0deaa7a6
fix(route): 中山大学计算机学院 (#8333)
* fix(route): 中山大学计算机学院

* docs: fix path and paramsDesc

Co-authored-by: TonyRL <TonyRL@users.noreply.github.com>
2022-02-25 11:22:51 +08:00