Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

wuxiaworld.com unable to detect chapter for v3.2.7 and using subscription champion account #1995

Closed
freaking1990 opened this issue Jul 6, 2023 · 5 comments

Comments

@freaking1990
Copy link

Novel URL: (https://www.wuxiaworld.com/novel/overgeared)
App Version: 3.2.6 - 3.2.7

Describe this issue

Hello,
first time creating post issues.
I tried to create epub for overgeared. but it seems it doesn't detect the chapter after i login my account with and without the token bearer.
i have tried on both version 3.2.6 and 3.2.7 with no luck detecting chapter.

but on 3.2.3 it was successful detect chapter after login. but it densest detect my login as "subcription champion" which unlock all chapter except the early access chapter. when it compile. it only compile teaser chapter.

my account bear the "champion subscription" which unlock all the chapter for the specific novel : fyi

best regards

===============issues=================

C:\Users\fxxxx>lncrawl --login Bearer 3xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx-1 -s https://www.wuxiaworld.com/novel/overgeared

                      [#] Lightnovel Crawler v3.2.7
              https://github.com/dipu-bd/lightnovel-crawler

-> Press Ctrl + C to exit

Retrieving novel info...
Exception in thread Thread-1 (read_novel_info):
cloudscraper.exceptions.CloudflareChallengeError: Detected a Cloudflare version 2 Captcha challenge, This feature is not available in the opensource (free) version.

During handling of the above exception, another exception occurred:

selenium.common.exceptions.InvalidArgumentException: Message: invalid argument: unrecognized capability: quietExceptionsStacktrace:
Backtrace:
GetHandleVerifier [0x00F1A813+48355]
(No symbol) [0x00EAC4B1]
(No symbol) [0x00DB5358]
(No symbol) [0x00DCAC31]
(No symbol) [0x00DFFCEE]
(No symbol) [0x00DFF9A8]
(No symbol) [0x00E00AD7]
(No symbol) [0x00E0093C]
(No symbol) [0x00DFA536]
(No symbol) [0x00DD82DC]
(No symbol) [0x00DD93DD]
GetHandleVerifier [0x0117AABD+2539405]
GetHandleVerifier [0x011BA78F+2800735]
GetHandleVerifier [0x011B456C+2775612]
GetHandleVerifier [0x00FA51E0+616112]
(No symbol) [0x00EB5F8C]
(No symbol) [0x00EB2328]
(No symbol) [0x00EB240B]
(No symbol) [0x00EA4FF7]
BaseThreadInitThunk [0x75CF00C9+25]
RtlGetAppContainerNamedObjectPath [0x77D77B4E+286]
RtlGetAppContainerNamedObjectPath [0x77D77B1E+238]

! Error: No chapters found


================================================================================
[#] Lightnovel Crawler v3.2.7
https://github.com/dipu-bd/lightnovel-crawler

-> Press Ctrl + C to exit

? Enter novel page url or query novel: https://www.wuxiaworld.com/novel/overgeared
? Do you want to log in? Yes
? User/Email: fxxxxxxxxx0
? Password: ************
Retrieving novel info...
Exception in thread Thread-1 (read_novel_info):
cloudscraper.exceptions.CloudflareChallengeError: Detected a Cloudflare version 2 Captcha challenge, This feature is not available in the opensource (free) version.

During handling of the above exception, another exception occurred:

selenium.common.exceptions.InvalidArgumentException: Message: invalid argument: unrecognized capability: quietExceptions
Stacktrace:
Backtrace:
GetHandleVerifier [0x00F1A813+48355]
(No symbol) [0x00EAC4B1]
(No symbol) [0x00DB5358]
(No symbol) [0x00DCAC31]
(No symbol) [0x00DFFCEE]
(No symbol) [0x00DFF9A8]
(No symbol) [0x00E00AD7]
(No symbol) [0x00E0093C]
(No symbol) [0x00DFA536]
(No symbol) [0x00DD82DC]
(No symbol) [0x00DD93DD]
GetHandleVerifier [0x0117AABD+2539405]
GetHandleVerifier [0x011BA78F+2800735]
GetHandleVerifier [0x011B456C+2775612]
GetHandleVerifier [0x00FA51E0+616112]
(No symbol) [0x00EB5F8C]
(No symbol) [0x00EB2328]
(No symbol) [0x00EB240B]
(No symbol) [0x00EA4FF7]
BaseThreadInitThunk [0x75CF00C9+25]
RtlGetAppContainerNamedObjectPath [0x77D77B4E+286]
RtlGetAppContainerNamedObjectPath [0x77D77B1E+238]

! Error: No chapters found


@alzamer2
Copy link
Contributor

hello
after reading #1991 i tried to uninstall latest selenium
and reinstall selenium 4.9.0
the code worked for free chapter
but for paid chapter he was unable to log in so it was only teaser that got scraped
no idea if that because they changed some thing in site or selenium

@freaking1990
try doing this
in commandline type
pip uninstall selenium
pip install selenium==4.9.0

then run the script and tell me what happed

@freaking1990
Copy link
Author

@alzamer2
Hello,
i have tried uninstall and install selenium==4.9.0 with success.

this time i can found the chapter. but cannot compile latest chapter. it will only load teaser chapter.
sad.
thank you for helping though.

@freaking1990
Copy link
Author

updated,

i have tried with the version 3.2.8. and manage to detect the chapter. But only the free chapter. the apps not detected the subscription champion and will only download teaser chapter.

@alzamer2
Copy link
Contributor

i tried to check the wuxai coding
there is to way to scrap chapter

  1. by using api, but at moment its blocked with cloudflare
  2. by using selenium, but it does not support logging in

@alzamer2
Copy link
Contributor

alzamer2 commented Dec 11, 2023

hello @freaking1990
i submitted pull #2204 , which is fix that allowed you to scrap paid chapter (including champion chapters)
try it out and tell me how it work

update:
hello
new update was issued for wuxiaworld.com
update your sources and try scraping

@dipu-bd dipu-bd closed this as completed Feb 29, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants