Tokenizer (docs)

Packagist

Tokenizer are available on Packagist.org, just add the dependency to your composer.json.

{
  "require" : {
    "yep/tokenizer": "dev-master"
  }
}

Usage

No time to write manual. 😞

Try to look into tests folder.