0.8.5

What's Changed

More Documentation 📚

• docs: update the macOS ARM64 in README by @kemingy in #509

Minor changes 🧹

• chore: fix typos and broken links by @kemingy in #522
• chore: bump version to avoid CI failure by @kemingy in #529

Others 🔔

• test: add arm in ci by @kemingy in #510

Full Changelog: 0.8.4...0.8.5

0.8.4

🎉 We support macOS ARM release now! 🎉

What's Changed

More Documentation 📚

• docs: add conda installation command by @kemingy in #492
• docs: cross-encoder rerank model by @kemingy in #504

Minor changes 🧹

• chore: fix release docker image by @kemingy in #490
• chore: adopt ruff by @kemingy in #503
• chore: support macOS ARM release by @kemingy in #508

Full Changelog: 0.8.3...0.8.4

0.8.3

What's Changed

Changes 🛠

• fix: upgrade to hyper 1 by @kemingy in #478

Minor changes 🧹

• chore: upload artifacts to os specific dir and merge downloads by @kemingy in #489

Full Changelog: 0.8.2...0.8.3

0.8.2

What's Changed

Exciting New Features 🎉

• feat: use utc time for log by @kemingy in #471

More Documentation 📚

• docs: organize the examples folder by @kemingy in #456
• docs: add emb example by @kemingy in #457

Minor changes 🧹

• chore: fix the docker image tags by @kemingy in #454

Full Changelog: 0.8.1...0.8.2

0.8.1

What's Changed

Exciting New Features 🎉

• feat: add endpoint label to the code metrics by @kemingy in #437
• feat: add py 3.12 test and release by @kemingy in #447

More Documentation 📚

• docs: add build from source code guide by @kemingy in #431

Minor changes 🧹

• chore: fix CI docker release tag by @kemingy in #428
• chore: bump utoipa version, update dep license file by @kemingy in #453

Full Changelog: 0.8.0...0.8.1

0.8.0

What's Changed

Exciting New Features 🎉

• feat: support swagger-ui for the openapi by @n063h in #407
• feat: support multi-route with shared workers by @kemingy in #423

More Documentation 📚

• docs: update readme about pid 1 and dynamic batching by @kemingy in #400
• docs: fix readthedocs build config by @kemingy in #401
• docs: add performance tuning guide by @kemingy in #409
• docs: add concepts, faq, migration guide by @kemingy in #411

Minor changes 🧹

• chore: add readthedoc support by @kemingy in #396
• chore: add gpu docker image in release by @kemingy in #398
• chore: align the naming, fix the test lint by @kemingy in #399
• chore: add the codeql lint config by @kemingy in #406
• chore: fix the sphinx ci by @kemingy in #412
• chore: use collapsible readme by @lkevinzc in #413
• chore: add conda-forge badge to the readme by @kemingy in #425
• chore: increase the timeout for stable diffusion example by @kemingy in #427

Full Changelog: 0.7.2...0.8.0

0.7.2

What's Changed

Exciting New Features 🎉

• feat: provide openapi doc by @n063h in #370
• feat: support server sent event by @kemingy in #333
• feat: support --log-level CLI argument by @kemingy in #394

Refactoring 🧬

• refactor: sse abstraction in worker and coordinator by @kemingy in #391

Minor changes 🧹

• chore: add sleep to service test to catch the check bug by @kemingy in #380

Full Changelog: 0.7.1...0.7.2

v0.7.1

What's Changed

Changes 🛠

• fix: check child process exit code by @kemingy in #379

Full Changelog: 0.7.0...0.7.1

v0.7.0

What's Changed

Changes 🛠

• fix: use try to import msgspec by @lkevinzc in #368
• fix: plasma mixin should use super serde with shm storage by @kemingy in #369
• fix: args should only be checked when server is used by @kemingy in #371

Exciting New Features 🎉

• feat: add content type to the inference response header by @kemingy in #360
• feat: support redis shm mixin by @n063h in #367
• feat: support dynamic inference route by @cutecutecat in #374

More Documentation 📚

• docs: mark ipc wrapper as deprecated by @kemingy in #378

Minor changes 🧹

• chore: better logo for night mode by @lkevinzc in #365

New Contributors

• @cutecutecat made their first contribution in #374

Full Changelog: 0.6.7...0.7.0

v0.6.7

What's Changed

Exciting New Features 🎉

• feat: change plasma plugin to mixin by @kemingy in #350
• feat: support request validation according to annotation by @kemingy in #352

More Documentation 📚

• docs: fix plasma related doc, add deprecate warning by @kemingy in #354
• docs: combine the metrics related page by @kemingy in #358

Minor changes 🧹

• chore: only enable nightly test for Linux by @kemingy in #346
• chore: Add tencent cloud by @gaocegege in #356

Full Changelog: 0.6.6...0.6.7