* feat(route): add eastmoney gerenzhongxin cfh
* feat(route): add eastmoney gerenzhongxin guba trpl
* feat(route): add eastmoney gerenzhongxin gather
* Update lib/routes/eastmoney/gerenzhongxin/cfh.ts
Co-authored-by: Tony <TonyRL@users.noreply.github.com>
* Update lib/routes/eastmoney/gerenzhongxin/cfh.ts
Co-authored-by: Tony <TonyRL@users.noreply.github.com>
* Update lib/routes/eastmoney/gerenzhongxin/guba.ts
Co-authored-by: Tony <TonyRL@users.noreply.github.com>
* Update lib/routes/eastmoney/gerenzhongxin/cfh.ts
Co-authored-by: Tony <TonyRL@users.noreply.github.com>
* Update lib/routes/eastmoney/gerenzhongxin/trpl.ts
Co-authored-by: Tony <TonyRL@users.noreply.github.com>
* Update lib/routes/eastmoney/gerenzhongxin/guba.ts
Co-authored-by: Tony <TonyRL@users.noreply.github.com>
* Update lib/routes/eastmoney/gerenzhongxin/trpl.ts
Co-authored-by: Tony <TonyRL@users.noreply.github.com>
* Update lib/routes/eastmoney/gerenzhongxin/gather.ts
Co-authored-by: Tony <TonyRL@users.noreply.github.com>
* Update lib/routes/eastmoney/gerenzhongxin/guba.ts
Co-authored-by: Tony <TonyRL@users.noreply.github.com>
* Update lib/routes/eastmoney/gerenzhongxin/trpl.ts
Co-authored-by: Tony <TonyRL@users.noreply.github.com>
* Update use post_title instead.
* Update use blockquote instead.
* restore the abbreviated content as title. For the website is like twitter, there are only contents, no post_title.
* use blockquote to properly and semantically format the post and reply content
* Some of the posts do have a valid post_title. Now the post title has a precedence, if it is not valid, then use the abbreviated content
* fix deepscan result for INSUFFICIENT_NULL_CHECK
* fix deepscan result
---------
* fix(route/yjsy): use puppeteer to bypass WAF
* fix: chage waiting-util to get fully loaded page
* fix: remove 'stylesheet' from excludeResourceTypes in yjsy route
* chore: provide default title for notifications in yjsy route
* fix: add HTTP headers for Puppeteer page requests in yjsy route
* fix: replace global ua in config with a static value
* fix: change waitUntil from 'networkidle0' to 'networkidle2'
* fix: set ua with setUserAgent
* fix: ensure user agent is set after HTTP headers in Puppeteer page requests
* fix: add limit parameter to handler for controlling result set size
* fix: update resource type handling in request interception
- use default maxAge managed by env
* Fix content extraction and html output
- Content extraction was breaking in case it included a templating
instruction
- the html output was non-compliant html by having nested <ul>...</ul>
not belonging to a <li>...</li> element.
* refactor processListsAndLines in smaller functions
* fix date consistency
- title was using a date reconstructed from UTC time which led to
discrepancy between the content date and the title
- pubDate was based off the gmt time at which the process was
run. Instead, if the last possible entry time (23.59.59 gmt-12) is
passed, we use that, if not we use current time. This should reflect
more or less a form of 'publish' date status from this portal.
* ensure empty-ish page doesn't lead to entry creation
* fix(route/sciencedirect): fix abstract will not show when highlights appear
now both abstract and highlights will show. only abstract will be shown when there is no highlights for the paper
* Update current-issue.ts
* fix(route/sciencedirect): fix vary length of abstract array
* fix(route/taptap/topic): add extra check to make sure the existance of topic.id_str
* fix(route/taptap/topic): return valid content instead of filter