Skip to content

Commit

Permalink
(feat) help msg
Browse files Browse the repository at this point in the history
  • Loading branch information
kevincobain2000 committed Mar 28, 2024
1 parent 2f0b758 commit 2676111
Show file tree
Hide file tree
Showing 2 changed files with 8 additions and 8 deletions.
8 changes: 4 additions & 4 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -74,10 +74,10 @@ email_extractor -limit-urls=100 -url=kevincobain2000.github.io
```sh
-depth int
depth of urls to crawl.
-1 for the url provided & all depths (default)
0 for the url provided only
1 for the url provided & until the first level
2 for the url provided & until the second level (default -1)
-1 for url provided & all depths (both backward and forward)
0 for url provided (only this)
1 for url provided & until first level (forward)
2 for url provided & until second level (forward) (default -1)
-ignore-queries
ignore query params in the url
Note: pagination links are usually query params
Expand Down
8 changes: 4 additions & 4 deletions main.go
Original file line number Diff line number Diff line change
Expand Up @@ -96,10 +96,10 @@ func SetupFlags() {
flag.IntVar(&f.limitEmails, "limit-emails", 1000, "limit of emails to crawl")

flag.IntVar(&f.depth, "depth", -1, `depth of urls to crawl.
-1 for the url provided & all depths (default)
0 for the url provided only
1 for the url provided & until the first level
2 for the url provided & until the second level`)
-1 for url provided & all depths (both backward and forward)
0 for url provided (only this)
1 for url provided & until first level (forward)
2 for url provided & until second level (forward)`)

flag.Int64Var(&f.timeout, "timeout", 10000, "timeout limit in milliseconds for each request")
flag.Int64Var(&f.sleep, "sleep", 0, "sleep in milliseconds before each request to avoid getting blocked")
Expand Down

0 comments on commit 2676111

Please sign in to comment.