Skip to content

v.0.2.0: More providers, extractors, examples, and refactor🥳

Compare
Choose a tag to compare
@jogonba2 jogonba2 released this 25 Jan 12:04
· 66 commits to main since this release
10ed71b

The 0.2.0 release of TextMachina includes:

  • New providers: Amazon Bedrock, AI21, Azure OpenAI, and inference servers (vllm and trt).
  • Refactor the Huggingface Remote provider to make retries through HTTPAdapter.
  • Two new extractors for mixcase tasks: sentence_masking and word_masking. Differently from the sentence_gap and word_gap extractors, LLMs must reconstruct masks in whole texts, instead of writing text between boundaries.
  • Extend the dataset generator for mixcase tasks to consider masking extractors.
  • Add config examples to learn about the extractors.
  • Small refactors: colors in logger, inheritance in some tokenizers, etc.