Commit Graph

8046 Commits

Author SHA1 Message Date
DIYgod 140fbed60d
feat: add aliyundrive 2022-09-08 21:37:37 +01:00
Tony ba2df5d3d9
fix(route): dcard (#10739)
* fix: dcard

use puppeteer

* docs: add pptr attr

* fix: use cookies

* docs: add warning
2022-09-09 00:55:42 +08:00
Charlie Jiang 655b899715
feat(core): 增加 `sorted` 参数来控制结果排序 (#10744)
* feat: 增加 `sorted` 参数来控制结果排序

* feat: 添加 `sorted` 参数的测试

重用了 `sort` 的代码和数据:是不是可以考虑将两者结合?
2022-09-09 00:11:18 +08:00
Tony 6de48c433f docs: push custom settings before scrape 2022-09-08 16:07:51 +00:00
Charlie Jiang b5c6c00098
feat(route): 添加南京大学本科生交换生系统 (#10746)
* feat(route): 添加南京大学本科生交换生系统

* fix: radar rules
2022-09-08 23:15:32 +08:00
Ethan Shen 58156eaa50
fix(route): 虎扑社区比赛信息 (#10742) 2022-09-08 18:32:01 +08:00
dependabot[bot] c6dd4e2495
chore(deps): bump winston from 3.8.1 to 3.8.2 (#10737)
Bumps [winston](https://github.com/winstonjs/winston) from 3.8.1 to 3.8.2.
- [Release notes](https://github.com/winstonjs/winston/releases)
- [Changelog](https://github.com/winstonjs/winston/blob/master/CHANGELOG.md)
- [Commits](https://github.com/winstonjs/winston/compare/v3.8.1...v3.8.2)

---
updated-dependencies:
- dependency-name: winston
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-07 21:07:14 +00:00
dependabot[bot] 03d75e31d6
chore(deps): bump puppeteer from 17.1.1 to 17.1.2 (#10738)
Bumps [puppeteer](https://github.com/puppeteer/puppeteer) from 17.1.1 to 17.1.2.
- [Release notes](https://github.com/puppeteer/puppeteer/releases)
- [Changelog](https://github.com/puppeteer/puppeteer/blob/main/CHANGELOG.md)
- [Commits](https://github.com/puppeteer/puppeteer/compare/v17.1.1...v17.1.2)

---
updated-dependencies:
- dependency-name: puppeteer
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-07 21:07:02 +00:00
Tony 3531bf54c3
fix(route): tiktok wait longer (#10736) 2022-09-07 22:49:42 +08:00
shininome 41e4d7cf84
feat: 添加漫画柜个人订阅 (#10727)
* 1

1

* 添加个人订阅

* Delete 1

* Add files via upload

* 添加mhgui的cookie获取

* 添加manhuagui个人订阅

* Add files via upload

* Update subscribe.js

* Update subscribe.js

* style: auto format

* 修改 manhuagui/selfhost=1

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* Update docs/anime.md

Co-authored-by: Tony <TonyRL@users.noreply.github.com>

* manhuagui规范文档

* style: auto format

* 添加漫画柜渲染文件

* 使用模板渲染,修改radar格式

* style: auto format

* refactor: migrate to v2

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2022-09-07 22:32:41 +08:00
miles 7ef62beb65
fix(route): qweather/now timezone (#10734) 2022-09-07 20:46:26 +08:00
Ethan Shen 1daf3a3242
fix(route): 深潮TechFlow (#10732) 2022-09-07 20:30:51 +08:00
dependabot[bot] e15406fe81
chore(deps-dev): bump eslint-plugin-yml from 1.1.0 to 1.2.0 (#10730)
Bumps [eslint-plugin-yml](https://github.com/ota-meshi/eslint-plugin-yml) from 1.1.0 to 1.2.0.
- [Release notes](https://github.com/ota-meshi/eslint-plugin-yml/releases)
- [Changelog](https://github.com/ota-meshi/eslint-plugin-yml/blob/master/CHANGELOG.md)
- [Commits](https://github.com/ota-meshi/eslint-plugin-yml/compare/v1.1.0...v1.2.0)

---
updated-dependencies:
- dependency-name: eslint-plugin-yml
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-07 02:42:11 +05:00
mokevip8 2c3fa64035
feat(route): 增加前瞻网 (#10524)
* 增加前瞻网

* style: auto format

* chore(deps): bump rand-user-agent from 1.0.77 to 1.0.79 (#137)

Bumps [rand-user-agent](https://github.com/WebScrapingAPI/rand-user-agent) from 1.0.77 to 1.0.79.
- [Release notes](https://github.com/WebScrapingAPI/rand-user-agent/releases)
- [Commits](https://github.com/WebScrapingAPI/rand-user-agent/commits)

---
updated-dependencies:
- dependency-name: rand-user-agent
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* fix: apply suggestions from cr

* fix: deepscan warning

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-07 02:31:05 +05:00
Tony 4434f8765e
fix(route): gamme lazy load img (#10729)
again
2022-09-07 04:44:38 +08:00
Tony ab2765a9fa fix(route): gamme lazy load img 2022-09-06 19:37:49 +00:00
Tony 5ac511199d
feat(route): gamme (#10728) 2022-09-07 03:11:48 +08:00
DIYgod 9329a44c80
feat(core): support proxy config for pupperteer (#10714)
* feat: support proxy config for pupperteer

* test: add puppeteer proxy detection

* fix: package.json

* test: fix regex
2022-09-07 00:07:04 +08:00
linbuxiao 57b466908f
fix: yxdown missing cookies (#10719)
* fix: yxdown missing cookies

* refactor: migrate to v2

* fix: cookie parsing

* docs: fix attr
2022-09-06 19:38:52 +08:00
ETiV 9ec2a9a562
fix(route): bilibili/vsearch use cache (#10723) 2022-09-06 19:24:20 +08:00
Zixuan Tan 7d42b80f3f
fix(route): 修复 /zju/grs/:type 的解析 (#10720) 2022-09-06 19:03:00 +08:00
savokiss dfe14d4300
fix: domp4 详情返回 guid (#10702)
* fix: domp4 详情返回 guid

* fix: domp4 guid with urlType
2022-09-06 18:49:52 +08:00
DIYgod 38aa2eb4ab
fix: tiktok puppeteer waitUntil (#10713)
* fix: tiktok puppeteer waitUntil

* fix: use `networkidle2` instead

ref: https://github.com/puppeteer/puppeteer/issues/1552#issuecomment-350954419
2022-09-06 18:15:59 +08:00
dependabot[bot] 260a3887a8
chore(deps): bump rand-user-agent from 1.0.79 to 1.0.80 (#10712)
Bumps [rand-user-agent](https://github.com/WebScrapingAPI/rand-user-agent) from 1.0.79 to 1.0.80.
- [Release notes](https://github.com/WebScrapingAPI/rand-user-agent/releases)
- [Commits](https://github.com/WebScrapingAPI/rand-user-agent/commits)

---
updated-dependencies:
- dependency-name: rand-user-agent
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-05 21:08:01 +00:00
dependabot[bot] 1560e25757
chore(deps): bump puppeteer from 17.1.0 to 17.1.1 (#10711)
Bumps [puppeteer](https://github.com/puppeteer/puppeteer) from 17.1.0 to 17.1.1.
- [Release notes](https://github.com/puppeteer/puppeteer/releases)
- [Changelog](https://github.com/puppeteer/puppeteer/blob/main/CHANGELOG.md)
- [Commits](https://github.com/puppeteer/puppeteer/compare/v17.1.0...v17.1.1)

---
updated-dependencies:
- dependency-name: puppeteer
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-05 21:07:52 +00:00
dependabot[bot] 3972323faf
chore(deps-dev): bump jest from 29.0.1 to 29.0.2 (#10710)
Bumps [jest](https://github.com/facebook/jest/tree/HEAD/packages/jest) from 29.0.1 to 29.0.2.
- [Release notes](https://github.com/facebook/jest/releases)
- [Changelog](https://github.com/facebook/jest/blob/main/CHANGELOG.md)
- [Commits](https://github.com/facebook/jest/commits/v29.0.2/packages/jest)

---
updated-dependencies:
- dependency-name: jest
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-05 21:07:10 +00:00
aether 43baaf9227
feat(route): Touhou event calendar from THBWiki. 添加路由:东方活动日程(来自 THBWiki) (#10639)
* Add route: Touhou event calendar from THBWiki.

* Added start time, end time and type of event.

* fix docs url address in radar.js

* fix: use domain name as route path

there isn't a site called touhou-events.com, etc.
2022-09-06 02:49:29 +08:00
Tony fd1d453642
feat(route): bluestacks (#10709)
* feat(route): bluestacks

* fix: use puppeteer

* fix: radar
2022-09-06 02:24:49 +08:00
Tony 936dc889d9
feat(route)!: remove kuaibao (#10708) 2022-09-06 01:35:15 +08:00
Tony 4e9b596e81
feat(route): rarehistoricalphotos (#10707) 2022-09-06 01:21:56 +08:00
Ethan Shen 40d0f00959
fix(route): 35photo genre more images (#10706) 2022-09-06 01:08:03 +08:00
Tony be39871730
fix(route): dcard (#10705)
* fix(route): dcard

* docs: anti crawler attr
2022-09-06 00:20:27 +08:00
Ethan Shen ea32d46ba9
feat(route): add 全国哲学社会科学工作办公室 (#10704)
* feat(route): add 全国哲学社会科学工作办公室

* add radar
2022-09-05 22:39:23 +08:00
erriy 0a92a54ca6
fix(route): github topic (#10700) 2022-09-05 20:05:06 +08:00
miles e47c9c1d8c
fix(route): 壹蘋新聞網獲取失敗 (#10697)
* fix(route): 壹蘋新聞網獲取失敗

* fix(route): rate limit
2022-09-05 03:05:09 -05:00
syrinka d0fcff9fbb
fix(route): nga 匿名帖子获取失败 (#10695)
* fix

* add new domain

* list format

* fix
2022-09-04 19:27:03 +08:00
xiaokyo cde7722bee
feat(route): 特斯拉价格 (#10507)
* feat: 特斯拉价格

* fix: missing docs

* fix: url
2022-09-04 00:16:57 +08:00
auto-bot-ty f29094db96
fix(route): 起点 章节 (#10693)
* fix /qidian/chapter

* fix /qidian/chapter

* delete gitpod.yml

* fix: name parsing

Co-authored-by: pull[bot] <39814207+pull[bot]@users.noreply.github.com>
2022-09-03 23:57:37 +08:00
Felix Hsu a5d0eaeafa
fix(route): producthunt rss failure #10688 (#10690)
* Fix producthunt rss 

apolloState prop has been changed from putting the "Post" item first into the third one.

* Fix the producthunt misleading '__typename' caused rss problem

* refactor: simplify call
2022-09-03 23:47:31 +08:00
dependabot[bot] 85eab6cdec
chore(deps): bump puppeteer from 17.0.0 to 17.1.0 (#10684)
Bumps [puppeteer](https://github.com/puppeteer/puppeteer) from 17.0.0 to 17.1.0.
- [Release notes](https://github.com/puppeteer/puppeteer/releases)
- [Changelog](https://github.com/puppeteer/puppeteer/blob/main/CHANGELOG.md)
- [Commits](https://github.com/puppeteer/puppeteer/compare/v17.0.0...v17.1.0)

---
updated-dependencies:
- dependency-name: puppeteer
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-02 20:53:08 -03:00
Tony 8e8ed3d979
fix(route): github pulls labels (#10682)
fix(route): github pulls labels
2022-09-02 13:32:02 -09:00
dependabot[bot] c157b590a3
chore(deps): bump @sentry/node from 7.12.0 to 7.12.1 (#10683)
Bumps [@sentry/node](https://github.com/getsentry/sentry-javascript) from 7.12.0 to 7.12.1.
- [Release notes](https://github.com/getsentry/sentry-javascript/releases)
- [Changelog](https://github.com/getsentry/sentry-javascript/blob/master/CHANGELOG.md)
- [Commits](https://github.com/getsentry/sentry-javascript/compare/7.12.0...7.12.1)

---
updated-dependencies:
- dependency-name: "@sentry/node"
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-02 21:32:38 +00:00
Tony 7036f4b78b
fix(route): bilibili vsearch (#10681) 2022-09-03 04:02:22 +08:00
Tony ad74376adb
fix(route): mirror.xyz (#10680) 2022-09-03 03:36:12 +08:00
dependabot[bot] ff57adb089
chore(deps-dev): bump @vercel/nft from 0.21.0 to 0.22.1 (#10675)
* chore(deps-dev): bump @vercel/nft from 0.21.0 to 0.22.1

Bumps [@vercel/nft](https://github.com/vercel/nft) from 0.21.0 to 0.22.1.
- [Release notes](https://github.com/vercel/nft/releases)
- [Commits](https://github.com/vercel/nft/compare/0.21.0...0.22.1)

---
updated-dependencies:
- dependency-name: "@vercel/nft"
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

* Revert "docs: vercel workaround (#10665)"

This reverts commit f57e6230ac.

* fix: scrape settings

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-03 01:54:37 +08:00
github-actions[bot] b71847f3cf style: auto format 2022-09-02 12:31:33 +00:00
miles cf04b7e199
feat(route): add X岛匿名版 (#10678)
* feat(route): add X岛匿名版

* refactor(route): use template
2022-09-02 20:29:29 +08:00
hoilc e7d1a26b54
feat(route): add 英雄联盟台服新闻 (#10674)
* add loltw news

* simplify api query
2022-09-02 00:21:07 +08:00
miles 173c4e6970
feat(route): add 壹蘋新聞網 (#10671)
* feat(route): add 壹蘋新聞網

* feat(route): remove comments

* docs: fix tag closing
2022-09-01 23:55:05 +08:00
Fatpandac aedf5c8cb7
feat(route): add 学工部 (#10673)
* feat(route): add 学工部

* Update lib/v2/bnu/dwxgb.js
2022-09-01 23:23:19 +08:00