Skip to content

Commit

Permalink
(docs) README updated
Browse files Browse the repository at this point in the history
  • Loading branch information
kevincobain2000 committed Mar 27, 2024
1 parent cc4edb7 commit 646fc05
Showing 1 changed file with 8 additions and 5 deletions.
13 changes: 8 additions & 5 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -72,12 +72,15 @@ email_extractor -limit-urls=100 -url=kevincobain2000.github.io
```sh
-depth int
depth of urls to crawl.
-1 for infinite depth
0 for no depth, only the url provided
1 for only the url provided and links from the url provided until the first level
2 for only the url provided and links from the url provided until the second level (default -1)
-1 for the url provided & all depths (default)
0 for the url provided only
1 for the url provided & until the first level
2 for the url provided & until the second level (default -1)
-ignore-queries
ignore query params in the url (default true)
ignore query params in the url
Note: pagination links are usually query params
Set it to false, if you want to crawl such links
(default true)
-limit-urls int
limit of urls to crawl (default 1000)
-out string
Expand Down

0 comments on commit 646fc05

Please sign in to comment.