Commit Graph

63 Commits

Author SHA1 Message Date
Felix Hsu 9d4cff8a7c
fix(route): fix bphc URL changed (#11810) 2023-02-09 01:41:56 +08:00
Tony 4a70a0ede9
feat(route): wuhan (#11701)
Co-authored-by: nczitzk <nczitzk@gmail.com>
2023-01-27 05:02:47 +08:00
github-actions[bot] f3b841f4f8 style: auto format 2022-12-18 14:30:48 +00:00
水货 f6ab7b6ac9
feat(route): 增加茂名地方政府网站 (#11239)
* feat(route): 增加茂名地方政府网站

* docs: 删除无关文档

* fix: 删除暂时未使用的路由

* feat: 增加从多个选择器中获取正文的功能

* fix: Avoid unnecessary redirects

* fix: 修复公开目录平台存在未使用的列表元素问题

* fix: 修复茂南页面列表中存在其他网站导致获取到空值的问题

* feat: 增加处理微信文章链接

* fix: 修复公开目录平台存在非文章链接的问题

* docs: 对维护者列表进行排序

* feat: 适配更多茂名政府网站页面

* feat: 适配更多茂名政府网站页面

* fix: 修复茂南的缓存问题

* feat: 使用 API 获取政策解读平台内容

* feat: 政策解读平台模板增加涉企信息

* feat: 政策解读平台模版增加样式

* fix: 修复政策解读平台解读条目缺失换行的问题

* docs: fix missing closing tag

* fix: 修复茂名市相关网站浏览器扩展匹配规则缺失域名部分的问题

* docs: 修改部分要填充内容的描述

* docs: 修改名称与文档一致

* docs: 修改茂名市相关网站层级
2022-12-18 22:29:01 +08:00
Tony 98a4c7ad77
feat(route): sasac (#11433) 2022-12-10 23:36:41 +08:00
drgnchan 51ec49d0de
feat(route): 新增广州市人民政府 (#11339)
* feat[route]: 新增广州市人民政府

* fix(v2ex): enable allowEmpty and enrich pubDate

* refactor: move `gzgov` dir under `gov`

* refactor: replace `gzgov` by `gz` and change doc accordingly

* refactor: polish code

* refactor: polish code

* fix: maintainer path
2022-12-08 01:15:00 +08:00
何艺麒 f3db351b52
fix(route): gov.customs (#11387) 2022-12-05 17:17:19 -05:00
Shansing bcef9b23f6
feat(route): 支持长沙市市长信箱 (#11303)
* feat(route): 支持长沙市市长信箱

* fix(route): 长沙市市长信箱文章使用缓存

之前不使用缓存是担心详情页会新增信件回复。回想以后,很可能是先有回复才放出信件,综合考虑可以使用缓存。

* refactor(route): 长沙市市长信箱 follows suggestions
2022-11-22 21:05:08 +08:00
zxx-457 10cf5a2468
feat(route): add 国务院政策文件库 (#11301)
* feat(route): add 国务院政策文件库

* fix wrong author

* typo

* refactor: migrate to v2
2022-11-22 01:53:40 +08:00
Tony 493b2baafa
fix(route): nmpa stealth puppeteer (#11279) 2022-11-15 18:46:34 +08:00
Ethan Shen b408e1d45d
fix(route): 上海市药品监督管理局发布时间 (#11265) 2022-11-14 23:18:33 +08:00
Tony 58aee4c315
fix(route): jseea (#11075)
* fix(route): jseea

* fix: docs anchor
2022-10-13 20:07:17 +08:00
Felix Hsu b523c4dc31
feat(route): add bphc 北京共有产权住房租赁平台 (#10955)
* bphc

* radar ok

* change maintainer

* fix null checking err

* rss link should be rootUrl

* fix: sort routes
2022-09-30 00:14:20 +08:00
Felix Hsu 8edc638f79
fix(route): finally bypass the ccdi.gov cookie and js based anti-spider system (#10944)
* try to minic the js cookie behavior and bypass the anti spider

* add more selector for diff article

* regex polished

* fix(route): cookie setting should be called in await

* Extract the anti spider from js and finally bypass it
2022-09-29 08:37:34 +00:00
Felix Hsu 6ee0d23892
fix(route): ccdi cookie should be called in await style (#10927)
* try to minic the js cookie behavior and bypass the anti spider

* add more selector for diff article

* regex polished

* fix(route): cookie setting should be called in await
2022-09-28 04:39:06 +00:00
Bang-Bo 4271262854
fix(route): 广东省深圳市人民政府 - 通知公告 (#10910)
* fix(route): 广东省深圳市人民政府 - 通知公告

页面改版导致内容和时间异常

* chore: use parseDate

* refactor: migrate to v2
2022-09-27 04:04:43 +08:00
Felix Hsu 64322895ec
refactor: try to mimic the js cookie behavior and bypass the anti spider in ccdi.gov (#10890)
* try to minic the js cookie behavior and bypass the anti spider

* add more selector for diff article

* regex polished
2022-09-26 19:13:18 +08:00
Felix Hsu de48ec5015
fix(route): CCDI.gov.cn route broken (#10879)
* fix ccdi site

* fix doc

* upgrade rate limit countermeasure and sort the router alphabetically

* set anticrawler flag in docs
2022-09-24 23:47:03 +08:00
Felix Hsu 7fdffa9133
refactor: Stats gov, change the img href from relative href to absolute href for better rss reading experiences. (#10875)
* add new statsgov

* Fix radar.js

* 1. Fix the missing optional chaining operator in reg matching 2. add the missing timezone change

* remove the dup $ in item

* optimize url

* stats.gov.cn refactored

* Modify doc

* more flexible pathname parsing

* Fix radar data

* change image src to absolute src

* more accurate comment.
2022-09-24 00:21:47 +08:00
Felix Hsu 0f2dd302c5
feat(route): Add stats.gov 国家统计局 (#10860)
* add new statsgov

* Fix radar.js

* 1. Fix the missing optional chaining operator in reg matching 2. add the missing timezone change

* remove the dup $ in item

* optimize url

* stats.gov.cn refactored

* Modify doc

* more flexible pathname parsing

* Fix radar data
2022-09-23 20:50:40 +08:00
Ethan Shen ea32d46ba9
feat(route): add 全国哲学社会科学工作办公室 (#10704)
* feat(route): add 全国哲学社会科学工作办公室

* add radar
2022-09-05 22:39:23 +08:00
Tony e3ffd5d7c1
fix(route): mofcom (#10641)
* fix(route): mofcom

* fix: typo
2022-08-28 10:33:16 -12:00
Tony b9e370f4b6 fix: remove `normalizeWhitespace` property
ref: https://github.com/cheeriojs/cheerio/pull/2688
2022-08-24 12:09:54 +00:00
Ethan Shen b1af9b812d
feat(route): 中国互联网络信息中心新闻中心 (#10591)
* chore(deps): bump dayjs from 1.11.4 to 1.11.5 (#258)

Bumps [dayjs](https://github.com/iamkun/dayjs) from 1.11.4 to 1.11.5.
- [Release notes](https://github.com/iamkun/dayjs/releases)
- [Changelog](https://github.com/iamkun/dayjs/blob/v1.11.5/CHANGELOG.md)
- [Commits](https://github.com/iamkun/dayjs/compare/v1.11.4...v1.11.5)

---
updated-dependencies:
- dependency-name: dayjs
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* chore(deps): bump rand-user-agent from 1.0.76 to 1.0.77 (#259)

Bumps [rand-user-agent](https://github.com/WebScrapingAPI/rand-user-agent) from 1.0.76 to 1.0.77.
- [Release notes](https://github.com/WebScrapingAPI/rand-user-agent/releases)
- [Commits](https://github.com/WebScrapingAPI/rand-user-agent/commits)

---
updated-dependencies:
- dependency-name: rand-user-agent
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* chore(deps): bump twitter-api-v2 from 1.12.3 to 1.12.5 (#261)

Bumps [twitter-api-v2](https://github.com/plhery/node-twitter-api-v2) from 1.12.3 to 1.12.5.
- [Release notes](https://github.com/plhery/node-twitter-api-v2/releases)
- [Changelog](https://github.com/PLhery/node-twitter-api-v2/blob/master/changelog.md)
- [Commits](https://github.com/plhery/node-twitter-api-v2/compare/1.12.3...1.12.5)

---
updated-dependencies:
- dependency-name: twitter-api-v2
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* chore(deps): bump puppeteer from 16.1.0 to 16.1.1 (#262)

Bumps [puppeteer](https://github.com/puppeteer/puppeteer) from 16.1.0 to 16.1.1.
- [Release notes](https://github.com/puppeteer/puppeteer/releases)
- [Changelog](https://github.com/puppeteer/puppeteer/blob/main/CHANGELOG.md)
- [Commits](https://github.com/puppeteer/puppeteer/compare/v16.1.0...v16.1.1)

---
updated-dependencies:
- dependency-name: puppeteer
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* chore(deps): bump rand-user-agent from 1.0.77 to 1.0.78 (#268)

Bumps [rand-user-agent](https://github.com/WebScrapingAPI/rand-user-agent) from 1.0.77 to 1.0.78.
- [Release notes](https://github.com/WebScrapingAPI/rand-user-agent/releases)
- [Commits](https://github.com/WebScrapingAPI/rand-user-agent/commits)

---
updated-dependencies:
- dependency-name: rand-user-agent
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* chore(deps): bump ioredis from 5.2.2 to 5.2.3 (#271)

Bumps [ioredis](https://github.com/luin/ioredis) from 5.2.2 to 5.2.3.
- [Release notes](https://github.com/luin/ioredis/releases)
- [Changelog](https://github.com/luin/ioredis/blob/main/CHANGELOG.md)
- [Commits](https://github.com/luin/ioredis/compare/v5.2.2...v5.2.3)

---
updated-dependencies:
- dependency-name: ioredis
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* feat(route): 中国互联网信息中心新闻中心

* docs: fix typo

* update docs/government.md


Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-08-24 19:14:21 +08:00
2PoL 51b6f13340
feat(route): add 太原市人力资源和社会保障局 (#10413)
* add 太原市人力资源和社会保障局.

* change radar.js.

* fix pubDate.

* Standardized Code and make alphabetical order.

* fix: radar domain
2022-08-07 20:10:43 +08:00
Ethan Shen 6e3b368de3
fix(route): 中国载人航天飞行任务图片URL (#10390) 2022-08-04 06:51:11 +05:00
Ethan Shen e761af6c86
feat(route): add 中国载人航天 (#10355)
* feat(route): add 中国载人航天

* docs: add category for /fxrw

* update lib/v2/gov/cmse/index.js

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* docs: add xwzt
2022-08-03 01:27:19 +08:00
terrytw e2ca9b81f6
fix(route): 国家药品监督管理局医疗器械标准管理中心 (#10364) 2022-07-31 03:06:36 -12:00
Ethan Shen 54aea1e4e7
feat(route): add 国家药品监督管理局医疗器械标准管理中心 (#10206)
* feat(route): add 国家药品监督管理局医疗器械标准管理中心

* fix: shorten the route

* fix: bad urls

* fix: only 1 puppeteer request
2022-07-16 20:47:53 +08:00
Ethan Shen 967492dcaa
fix(route): 上海市药品监督管理局 (#10205) 2022-07-13 20:02:38 +08:00
Tony b4d37f9837
feat(route): moj aac (#10168) 2022-07-07 19:31:20 +08:00
Tony 9fa248c324
fix(route): nmpa feed items on 3rd party site (#10146)
* fix(route): nmpa feed items on 3rd party site

* fix: regex unescaped .
2022-07-06 00:46:05 +08:00
Ethan Shen 5deba293c1
fix(route): 国家自然科学基金委基金要闻 (#10137)
* fix(route): 国家自然科学基金委基金要闻

* fix: add images
2022-07-05 22:15:30 +08:00
Ethan Shen 31f84a9706
feat(route): add 上海市药品监督管理局 (#10138)
* feat(route): add 上海市药品监督管理局

* fix typo
2022-07-05 21:34:03 +08:00
Ethan Shen d3a5949402
feat(route): add 陕西省科学技术厅 (#10115)
* feat(route): add 陕西省科学技术厅

* fix typo

* fix: pubDate

* fix typo
2022-07-05 19:40:48 +08:00
Tony 7823d4d97e
feat(route): nmpa (#10108)
* feat(route): nmpa

* docs: add puppeteer attr

* fix: close puppeteer page
2022-07-04 00:21:51 +08:00
Ethan Shen 7afd8686f6
feat(route): add 徐州市人力资源和社会保障局 (#10048)
* feat(route): add 徐州市人力资源和社会保障局

* fix pubDate
2022-06-27 19:36:47 -11:00
Tony ae2464de6e
perf(route): block unnecessary requests in all puppeteer routes (#10010)
* fix: block unnecessary request in all puppeteer routes

* fix(route): prestige-av migrate to v2

* fix(route): ncwu migrate to v2

* fix(route): nju/rczp without puppeteer
2022-06-22 22:54:29 +08:00
Ethan Shen f3aee1b3b5
feat(route): add 北京市教育委员会通知公告 (#9978) 2022-06-18 23:23:11 +08:00
陈鲲 c316c7c20f
fix(route): 中国工业和信息化部 (#8898)
* Update wjgs.js

更新了信息源

* Update wjgs.js

* Update wjgs.js

* Update wjgs.js

* update miit cookie config

* update cookie

* Update wjgs.js

* fix(route): miit wjgs zcjd

Co-authored-by: Tony <TonyRL@users.noreply.github.com>
2022-06-08 21:57:32 +08:00
Tony bec81248f0
fix(route): customs (#9879) 2022-06-03 00:08:39 +08:00
Ethan Shen a4ce5128ab
feat(route): add 河北省财政厅 (#9759)
* feat(route): add 河北省财政厅

* regenerate

* fix typo

* fix typo
2022-05-15 22:21:42 +08:00
Liu233w 145ad517b6
feat: add immiau (#9722)
* feat(route): add immiau

Add news entry of Immigration and Citizenship, Department of Home Affairs, Australia.

* feat(route): add cn document for immiau

* refactor(router): move immiau to gov folder
2022-05-08 23:27:19 +08:00
github-actions[bot] 115bf9338e style: auto format 2022-05-06 16:43:25 +00:00
程序员老马 808147545f
fix(route): bug fix and perf improve for moe (#9703)
* 有些直播页没有内容可提取,直接返回直播页的url

* 公告公示的详情页需要使用id选择器来提取内容

* lint code & add referer header to simulate the behavior of a real browser

* forgot the 'method' option
2022-05-07 00:41:48 +08:00
zytomorrow 133a9602e7
fix(route): sichuan/deyang 政府公开信息 (#9613) 2022-04-25 08:22:50 +01:00
程序员老马 159da9059e
fix(route): 教育部路由新增教育要闻分类,修复部分文章标题取值;优化雪球路由,对于讨论帖直接获取完整内容 (#9556)
* 雪球的讨论帖可以直接从text字段中取到完整内容,长文帖只有description字段有值,获取逻辑不变

* 教育部路由增加“教育要闻”栏目类型获取,同时修复教育部文章title获取不到的问题

* 补充教育部路由增加教育要闻栏目类型的文档

* refactor: migrate to v2

* fix: legacy url.resolve

* 修复雪球返回完整讨论帖时遗漏了转发内容的问题

* 移除重复的key

Co-authored-by: TonyRL <TonyRL@users.noreply.github.com>
2022-04-23 02:21:38 +08:00
yuxinliu-alex 80aab00fdb
feat(route): 国家广播电视总局 (#9566)
* feat(route): 国家广播电视总局

* move the nrta to lib\v2\gov

* fix: feed link

* fix: radar

* fix: radar

Co-authored-by: alex <yuxin2@mgtv.com>
2022-04-19 19:51:52 +08:00
zytomorrow e7558e88b1
fix(route): sichuan/deyang 政府公开信息 (#9480)
* fead: add 雪球股票评论

* style: auto format

* fix: 修复雪球评论转发时未带原文

* refactor: 微博个人时间线接入util,支持可读性优化,同时打开emoji表情展示

* route: 雪球评论标题长度自定义

* style: auto format

* fix: 风之动漫域名更换

* fix: 风之漫画新域名适配

* refactor: 微博个人时间线接入util,支持可读性优化,同时打开emoji表情展示

* fix: 雪球股票评论格式调整

* fix: 风之动漫域名更换

* fix: 风之动漫link修复

* fix: 雪球股票评论正文使用art模板,日期解析调整

* feat(route): add 德阳考试中心

* feat(route): add 德阳考试中心

* fix: 风之动漫获取数量去掉限制

* fix: 风之动漫获取数量去掉限制

* fix: 风之动漫获取数量使用通用参数控制

* fix: 风之动漫获取数量使用通用参数控制

* style: auto format

* fix: dykszx

* fix: 德阳考试中心 ssl证书过期

* Merge branch 'master' of https://github.com/DIYgod/RSSHub into dykszx

* Merge branch 'master' of https://github.com/DIYgod/RSSHub into dykszx

* tmp1

* tmp2:

* tmp3

* feat(route):  add 政府公开信息

* feat(route):  add 政府公开信息

* feat(route):  add 政府公开信息

* feat(route):  add 政府公开信息

* feat(route):  add 政府公开信息

* Revert "feat(route):  add 政府公开信息"

This reverts commit c9d59af9e09b14f7357014382037b7f378d65ea7.

* feat(route):  add 政府公开信息

* fix: 修复德阳政府公开信息

* fix: 修复德阳政府公开信息

* Merge branch 'master' of https://github.com/DIYgod/RSSHub into fix_router

* Merge branch 'master' of https://github.com/DIYgod/RSSHub into fix_router

* Merge branch 'master' of https://github.com/DIYgod/RSSHub into fix_router

* fix: 修复德阳政府公开信息

* fix: 修复德阳政府公开信息

* fix: 修复德阳政府公开信息

* fix(route): add ipv6 support

* fix(route): add ipv6 support

Co-authored-by: GitHub Action <action@github.com>
2022-04-07 18:00:06 +08:00
zytomorrow 476b3934bc
fix(route): sichuan/deyang 政府公开信息 (#9453)
* fead: add 雪球股票评论

* style: auto format

* fix: 修复雪球评论转发时未带原文

* refactor: 微博个人时间线接入util,支持可读性优化,同时打开emoji表情展示

* route: 雪球评论标题长度自定义

* style: auto format

* fix: 风之动漫域名更换

* fix: 风之漫画新域名适配

* refactor: 微博个人时间线接入util,支持可读性优化,同时打开emoji表情展示

* fix: 雪球股票评论格式调整

* fix: 风之动漫域名更换

* fix: 风之动漫link修复

* fix: 雪球股票评论正文使用art模板,日期解析调整

* feat(route): add 德阳考试中心

* feat(route): add 德阳考试中心

* fix: 风之动漫获取数量去掉限制

* fix: 风之动漫获取数量去掉限制

* fix: 风之动漫获取数量使用通用参数控制

* fix: 风之动漫获取数量使用通用参数控制

* style: auto format

* fix: dykszx

* fix: 德阳考试中心 ssl证书过期

* Merge branch 'master' of https://github.com/DIYgod/RSSHub into dykszx

* Merge branch 'master' of https://github.com/DIYgod/RSSHub into dykszx

* tmp1

* tmp2:

* tmp3

* feat(route):  add 政府公开信息

* feat(route):  add 政府公开信息

* feat(route):  add 政府公开信息

* feat(route):  add 政府公开信息

* feat(route):  add 政府公开信息

* Revert "feat(route):  add 政府公开信息"

This reverts commit c9d59af9e09b14f7357014382037b7f378d65ea7.

* feat(route):  add 政府公开信息

* fix: 修复德阳政府公开信息

* fix: 修复德阳政府公开信息

* Merge branch 'master' of https://github.com/DIYgod/RSSHub into fix_router

* Merge branch 'master' of https://github.com/DIYgod/RSSHub into fix_router

* Merge branch 'master' of https://github.com/DIYgod/RSSHub into fix_router

* fix: 修复德阳政府公开信息

Co-authored-by: GitHub Action <action@github.com>
2022-04-03 22:52:45 +08:00