Source code for dialogy.plugins.text.classification.tokenizers

[docs]def identity_tokenizer(text: str) -> str:
    return text