Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

RSS Version="2.0" sources are not working #261

Open
hsninbil opened this issue Apr 15, 2024 · 4 comments
Open

RSS Version="2.0" sources are not working #261

hsninbil opened this issue Apr 15, 2024 · 4 comments

Comments

@hsninbil
Copy link

hsninbil commented Apr 15, 2024

1- Can you confirm if RSS version 2.0 is not working?
i.e. https://www.exploit-db.com/rss.xml
2- when i can use the collector atom ? is it in this case for example?
https://seclists.org/rss/fulldisclosure.rss
https://blogs.jpcert.or.jp/en/atom.xml

@hasninbl
Copy link

Dear @milankowww , @multiflexi ,
can you confirm the rss version 2.0?

@multiflexi
Copy link
Contributor

  1. I am getting this for the RSS provided:
collectors-1  | [2024-04-30 07:41:40 +0200] [8] [WARNING] [None] OSINTSource name: RSS2
collectors-1  | [2024-04-30 07:41:40 +0200] [8] [WARNING] [None] ERROR: HTTP Error 403: Forbidden
collectors-1  | [2024-04-30 07:41:40 +0200] [8] [DEBUG] [None] Traceback (most recent call last):
collectors-1  |   File "/app/collectors/rss_collector.py", line 125, in collect
collectors-1  |     with opener(request) as response:
collectors-1  |          ^^^^^^^^^^^^^^^
collectors-1  |   File "/usr/local/lib/python3.12/urllib/request.py", line 215, in urlopen
collectors-1  |     return opener.open(url, data, timeout)
collectors-1  |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
collectors-1  |   File "/usr/local/lib/python3.12/urllib/request.py", line 521, in open
collectors-1  |     response = meth(req, response)
collectors-1  |                ^^^^^^^^^^^^^^^^^^^
collectors-1  |   File "/usr/local/lib/python3.12/urllib/request.py", line 630, in http_response
collectors-1  |     response = self.parent.error(
collectors-1  |                ^^^^^^^^^^^^^^^^^^
collectors-1  |   File "/usr/local/lib/python3.12/urllib/request.py", line 559, in error
collectors-1  |     return self._call_chain(*args)
collectors-1  |            ^^^^^^^^^^^^^^^^^^^^^^^
collectors-1  |   File "/usr/local/lib/python3.12/urllib/request.py", line 492, in _call_chain
collectors-1  |     result = func(*args)
collectors-1  |              ^^^^^^^^^^^
collectors-1  |   File "/usr/local/lib/python3.12/urllib/request.py", line 639, in http_error_default
collectors-1  |     raise HTTPError(req.full_url, code, msg, hdrs, fp)
collectors-1  | urllib.error.HTTPError: HTTP Error 403: Forbidden
collectors-1  | 
collectors-1  | [2024-04-30 07:41:40 +0200] [8] [DEBUG] [None] RSS_COLLECTOR collection finished.
  1. The nmap uses RSS. The Japanese feed is Atom. Both work when added. Atom and RSS are two different standards for the same thing.

@hasninbl
Copy link

hasninbl commented May 7, 2024

thank You @multiflexi . i will retry its.

@Progress1
Copy link
Collaborator

look here: #262 Step to add collector RSS v.2 and ATOM

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants