Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Page Event Crawler seems to be working no longer #9

Open
michael-spengler opened this issue Jun 28, 2021 · 9 comments
Open

Page Event Crawler seems to be working no longer #9

michael-spengler opened this issue Jun 28, 2021 · 9 comments

Comments

@michael-spengler
Copy link

michael-spengler commented Jun 28, 2021

It seems Facebook changed their page's upcoming events structure severely if my observations are representative.

Example:
https://www.facebook.com/changa.dance/events/?ref=page_internal

If you are not logged in, you only see past events now + even if you are logged in - the data is no longer delivered via html if my analysis is correct so far.

@DaWe35
Copy link
Owner

DaWe35 commented Jun 29, 2021

Wow FB is improving their privacy, wooow. And this is very sad at the same time. Aaaaa

@DaWe35
Copy link
Owner

DaWe35 commented Jun 29, 2021

Should I archive this repo, or is it worth to fix it?

@albionx
Copy link

albionx commented Sep 5, 2021

In my research, it seems that you can't see anything about public events if you are not logged in :( And using your user to crawl (authenticated) is quite dangerous as they can detect it and end up dinging it. Does anybody have a solution? (I wish they had their API in good shape and open to folks ...)

@DaWe35
Copy link
Owner

DaWe35 commented Sep 6, 2021

@albionx Thank why we recommend everyone to use a separate Facebook account for crawling. You can create new accounts anytime they ban.

@engine-er
Copy link

If You want to see future events without log in - You have to use address for mobile browser instead for desktop - m.facebook.com/FANPAGENAME/events

@ghost
Copy link

ghost commented May 16, 2022

If You want to see future events without log in - You have to use address for mobile browser instead for desktop - m.facebook.com/FANPAGENAME/events

this works when i am using the crawler on my local windows machine, but it does not when i use it on a linux (Ubuntu 20.04) server. I am always prompted to log in first to see information. Is there a setting i am missing?

@engine-er
Copy link

maybe set or change user-agent, do You use some of Your crawler with cURL?
I could curl m.facebook.com/FANPAGENAME/events but only nearest 5events :(

@ghost
Copy link

ghost commented May 16, 2022

tried with the user-agent in this code and also with an edge user agent. but on linux i am always promted to log in. cURL doesnt return anything for me for facebook, doesn't matter what facebook url i am using.

@DaWe35
Copy link
Owner

DaWe35 commented May 18, 2022

I'm sorry guys, I don't really have any ideas what is the problem (have you tried to log in in your normal browser? Does it work?). I'm not actively working on this project, but feel free to submit any PRs.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants