Error Message: src.scraper.StuckInGmapsException

[swiftismyname]

I am receiving an error message that says google maps is stuck in scrollng as well as this:

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/workspace/.pyenv_mirror/user/current/lib/python3.12/site-packages/botasaurus/decorators.py", line 375, in run_task
result = func(driver, data)
^^^^^^^^^^^^^^^^^^
File "/workspace/google-maps-scraper/src/scraper.py", line 319, in scrape_places
raise e
File "/workspace/google-maps-scraper/src/scraper.py", line 312, in scrape_places
retry_if_is_error(put_links, [StaleElementReferenceException], STALE_RETRIES, raise_exception=False
File "/workspace/.pyenv_mirror/user/current/lib/python3.12/site-packages/botasaurus/utils.py", line 84, in retry_if_is_error
raise e
File "/workspace/.pyenv_mirror/user/current/lib/python3.12/site-packages/botasaurus/utils.py", line 77, in retry_if_is_error
created_result = func()
^^^^^^
File "/workspace/google-maps-scraper/src/scraper.py", line 276, in put_links
raise StuckInGmapsException()
src.scraper.StuckInGmapsException

[Chetan11-dev]

Please follow these Steps.

⿡ Clone the Magic 🧙‍♀:

git clone https://github.com/omkarcloud/outlook-account-generator
cd outlook-account-generator

⿢ Install Dependencies 📦:

python -m pip install -r requirements.txt

⿣ Let's Roll 😎:

python main.py 

And Run the following command to update packages:

python -m pip install botasaurus --upgrade

Incase it occurs again, Let me know.

[swiftismyname]

No success. Although it did try to create a outlook account. How would that fix this issue?

I am still receiving this error:

DevTools listening on ws://127.0.0.1:52264/devtools/browser/ccfd3273-cd3b-492f-9a8b-6073a3e9a8a1
Google Maps was stuck in scrolling. Retrying after a minute.
Traceback (most recent call last):
File "C:\Users*\AppData\Local\Programs\Python\Python312\Lib\site-packages\botasaurus\decorators.py", line 394, in run_task
result = func(driver, data)
^^^^^^^^^^^^^^^^^^
File "C:\Users********\google-maps-scraper\src\scraper.py", line 319, in scrape_places
raise e
File "C:\Users*\google-maps-scraper\src\scraper.py", line 312, in scrape_places
retry_if_is_error(put_links, [StaleElementReferenceException], STALE_RETRIES, raise_exception=False
File "C:\Users******\AppData\Local\Programs\Python\Python312\Lib\site-packages\botasaurus\utils.py", line 84, in retry_if_is_error
raise e
File "C:\Users*******\AppData\Local\Programs\Python\Python312\Lib\site-packages\botasaurus\utils.py", line 77, in retry_if_is_error
created_result = func()
^^^^^^
File "C:\Users***********\google-maps-scraper\src\scraper.py", line 276, in put_links
raise StuckInGmapsException()
src.scraper.StuckInGmapsException

[Chetan11-dev]

Okay I posted wrong instructions. Kindly follow these steps:
Please follow these Steps.

Run the following command to update packages:

python -m pip install botasaurus --upgrade

⿡ Clone the Magic 🧙‍♀:

git clone https://github.com/omkarcloud/google-maps-scraper
cd google-maps-scraper

⿢ Install Dependencies 📦:

python -m pip install -r requirements.txt

⿣ Let's Roll 😎:

python main.py 

And Let me know, if it occurs again. Also attach error_log zip.

[swiftismyname]

Thank You! I really appreciate your prompt responses! It seems to work but when I change the output limit from 5 to 50 It says:
Google Maps was stuck in scrolling. Retrying after a minute.

[Chetan11-dev]

Your OS?

[swiftismyname]

Windows 11 it's a fresh out of the box mini pc

…

On Tue, Jan 9, 2024, 12:44 PM Chetan Jain ***@***.***> wrote: Your OS? — Reply to this email directly, view it on GitHub <#97 (reply in thread)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/BEVJZO6UV3MUCGMFWSQKJFTYNV6ZPAVCNFSM6AAAAABBSI4OEOVHI2DSMVQWIX3LMV43SRDJONRXK43TNFXW4Q3PNVWWK3TUHM4DANRZHE2DS> . You are receiving this because you authored the thread.Message ID: <omkarcloud/google-maps-scraper/repo-discussions/97/comments/8069949@ github.com>

[brandonlarue00]

Also running into this issue. Seems like the scraper is getting stuck on the first page of results for some queries because for the queries where this happened, I only got 20 results even though doing the same search manually results in 50+.

[Chetan11-dev]

@brandonlarue00, could you please open scraper.py, DELETE the line starting with block_resources on line 196, and let me know if the issue occurs again? I've highlighted the line in the image below.

[Chetan11-dev]

@brandonlarue00 Did it work?

[Jer0]

I've been running the script all day and I see that same error many times in my console. Has anyone found a solution? I'm on a Mac M1

[Jer0]

I just tried the new version, to my surprise, after updating and running, it found an error on line 208 of the scraper.py file, it turns out that it is a duplicate "reuse_driver=True"

I've been testing for a while and I just got the first error... in the virtual machine with Windows 11, this doesn't happen to me

########################

Traceback (most recent call last):
File "/Users//miniconda3/lib/python3.11/site-packages/botasaurus/decorators.py", line 422, in run_task
result = func(driver, data)
^^^^^^^^^^^^^^^^^^
File "/Users//Desktop/google-maps-scraper-pro-master/src/scraper.py", line 329, in scrape_places
raise e
File "/Users//Desktop/google-maps-scraper-pro-master/src/scraper.py", line 322, in scrape_places
retry_if_is_error(put_links, [StaleElementReferenceException], STALE_RETRIES, raise_exception=False
File "/Users//miniconda3/lib/python3.11/site-packages/botasaurus/utils.py", line 84, in retry_if_is_error
raise e
File "/Users//miniconda3/lib/python3.11/site-packages/botasaurus/utils.py", line 77, in retry_if_is_error
created_result = func()
^^^^^^
File "/Users//Desktop/google-maps-scraper-pro-master/src/scraper.py", line 286, in put_links
raise StuckInGmapsException()
src.scraper.StuckInGmapsException

########################

[Chetan11-dev]

Thank you, @Jer0, for the suggestion.

Also, I'm unable to reproduce the issue on my PC, so I'd like to suggest a few potential solutions for you to try one after another:

1. Open scraper.py at line 206 and delete the following line:
   add_arguments=add_arguments,

2. Open scraper.py at line 208 and add the following lines after "keep_drivers_alive=True,":

   user_agent=bt.UserAgent.REAL,
   window_size=bt.WindowSize.REAL,
   

3. If still does not works, then use stealth driver as follows

from botasaurus.create_stealth_driver import create_stealth_driver

@browser(
    create_driver=create_stealth_driver(
        start_url=None,
    ),
    user_agent=bt.UserAgent.REAL, 
    window_size=bt.WindowSize.REAL,
    reuse_driver=True,
    keep_drivers_alive=True, 
    lang=get_lang,
    close_on_crash=True,
    max_retry = 3,
    headless=False, # Make Non Headless
    output=None,
)

4. If none of the above solutions work, consider changing your IP address. If you're using Wi-Fi, you can turn it off and then on to get a new IP address.