v0.1.7

What's Changed

• feat: add support for latest embedding models by @matthiasthomas in #43
• feat: support o200k_base (gpt-4o) by @WqyJh in #47

New Contributors

• @matthiasthomas made their first contribution in #43
• @WqyJh made their first contribution in #47

Full Changelog: v0.1.6...v0.1.7

v0.1.6

add custom constructor

v0.1.5

Fix the issue of excessive memory consumption when initializing Encoding with multiple goroutines.

v0.1.4

Allow set bpe loader

v0.1.3

Merge pull request #25 from pkoukk/enhance_safe-get-encoding

enhancement: thread safe for get encoding

v0.1.2

Merge barnch of Optimize encodeNative by @bakks

v0.1.1

Fix bugs of special tokens
Add support for gpt-3.5-turobo-* and gpt-4-*

Init

Init version