v1.2.14

What's Changed

• fix: add scaled to zero in client by @FogDong in #4712
• ci: pre-commit autoupdate [skip ci] by @pre-commit-ci in #4713
• fix: serailization error when request with an invalid json input by @frostming in #4714
• fix: config pollution from other services by @frostming in #4715
• fix: handle ssh git url without ref part by @frostming in #4716
• fix: correct the default value of timeout-keep-alive by @frostming in #4717

Full Changelog: v1.2.13...v1.2.14

v1.2.13

What's Changed

• docs: fix indentation in build option docs by @jianshen92 in #4688
• fix: bug: module 'bentoml' has no attribute 'build' by @frostming in #4689
• docs: update autoscaling by @ssheng in #4691
• docs: init io-descriptors example by @lycheel1 in #4646
• fix: uncaught error missing trace headers by @frostming in #4692
• chore: remove outdated examples by @larme in #4694
• fix: bypass /livez in traffic middleware by @frostming in #4696
• docs:Update credits by @Sherlock113 in #4700
• docs: Add model store reference in the Services doc by @Sherlock113 in #4706
• docs: Update example dir readme by @Sherlock113 in #4707
• fix: fix table overflow with fold by @FogDong in #4677
• fix: server socket binding on Windows by @frostming in #4685
• fix: correct the logic of bypassing infra endpoints in traffic middleware by @frostming in #4704
• fix: add scaled to zero to ready status by @FogDong in #4708
• chore(container): cache large pypi packages in layers by @bojiang in #4690
• feat: add uvicorn timeouts options by @gusghrlrl101 in #4682
• fix: include models from config for new SDK bentos by @frostming in #4705
• fix: annotation preparation list iteration bug by @adamliter in #4701
• fix: tuple schema and websocket connection by @frostming in #4709
• fix: show warning instead of hard failure when model is missing by @frostming in #4693

New Contributors

• @gusghrlrl101 made their first contribution in #4682
• @adamliter made their first contribution in #4701

Full Changelog: v1.2.12...v1.2.13

v1.2.12

What's Changed

• docs: Add GPU inference doc by @Sherlock113 in #4654
• chore: update quickstart by @ssheng in #4655
• docs: Add JSON output for bentovllm by @Sherlock113 in #4657
• chore: cleanup quickstart by @ssheng in #4658
• docs: Update help info by @Sherlock113 in #4664
• fix: remove the uvicorn server header by @frostming in #4665
• docs: Fix format by @Sherlock113 in #4666
• docs: Add model composition doc by @Sherlock113 in #4668
• docs: Update example project list by @Sherlock113 in #4673
• docs: Add the monitoring and data collection doc by @Sherlock113 in #4662
• docs: Add add_asgi_middleware doc by @Sherlock113 in #4672
• fix: delete useless enum and fix enum value by @FogDong in #4674
• docs: Add RAG tutorial by @Sherlock113 in #4675
• docs: Update the clients doc by @Sherlock113 in #4676
• docs: Add some explanations for bentoml.models.get by @Sherlock113 in #4660
• docs: Add e2e test doc by @Sherlock113 in #4679
• fix(cloud client): various type error by @bojiang in #4680
• fix(cli): bentoml cli verbosity not passed to the subprocess correctly by @frostming in #4661

Full Changelog: v1.2.11...v1.2.12

v1.2.11

What's Changed

• docs: added multi model load and store example by @lycheel1 in #4575
• docs: inference graph by @lycheel1 in #4609
• docs: Update high-level BentoML messaging by @Sherlock113 in #4644
• fix: delete trace error for timeout when deploying by @FogDong in #4649
• fix(cli): correct the comparison of upload status by @frostming in #4643

New Contributors

• @lycheel1 made their first contribution in #4575

Full Changelog: v1.2.10...v1.2.11

v1.2.10

What's Changed

• docs: Remove old example links by @Sherlock113 in #4610
• feat(build): use jinja template for install script by @aarnphm in #4607
• feat: download git+ssh dependencies to wheels/ folder by @frostming in #4612
• docs: Update the ASGI doc by @Sherlock113 in #4614
• fix: non batched request executed in non FIFO manner by @frostming in #4619
• feat: light-weighted dev sdist builder by @frostming in #4615
• fix: add response headers for error responses by @frostming in #4622
• docs: Refactor the autoscaling doc by @Sherlock113 in #4620
• docs: Add simple verification test for Services by @Sherlock113 in #4629
• ci: pre-commit autoupdate [skip ci] by @pre-commit-ci in #4630
• docs: Add workers doc by @Sherlock113 in #4628
• docs: Add worker doc links by @Sherlock113 in #4636
• docs: Add docs for bentoml.runner_service by @Sherlock113 in #4637
• docs: Add sync to async doc by @Sherlock113 in #4639
• fix: handle call on clients by @frostming in #4618
• fix(cli): bentoml get output in YAML format by @frostming in #4638
• fix: issue overriding default service config from config file by @frostming in #4627

Full Changelog: v1.2.9...v1.2.10

v1.2.9

What's Changed

• docs: add autoscaling docs by @ssheng in #4601
• docs: Fix old configurations doc link by @Sherlock113 in #4600
• docs: Update the concurrency doc by @Sherlock113 in #4602
• fix(reload): make sure to watch for all src for editable by @aarnphm in #4604
• fix(openapi): remove invalid fields for operations parameter by @aarnphm in #4605
• chore: update swagger UI generated to 5.12 [skip ci] by @aarnphm in #4606
• fix(cloud cli): workaround env update issue by @bojiang in #4608

Full Changelog: v1.2.8...v1.2.9

v1.2.8

What's Changed

• fix(stub): add envs to __init__ construction by @aarnphm in #4576
• docs: Add testing doc by @Sherlock113 in #4578
• chore(type): use TypedDict for inferred stubs by @aarnphm in #4577
• docs: Add lifecycle hooks doc by @Sherlock113 in #4579
• fix(build): remove deprecated warnings by @aarnphm in #4580
• fix: improve the bentoml build progress by @frostming in #4582
• fix: allow API endpoint to return response directly by @frostming in #4581
• fix: raise the priority of the routes from mount apps by @frostming in #4584
• fix(sdk): python build missing envs argument by @jianshen92 in #4585
• fix: build config env default to None by @jianshen92 in #4589
• fix: config from multiple services override with each other by @frostming in #4591
• feat: add concurrency config by @xianml in #4560
• docs: Add OpenAI compatible endpoints client doc by @Sherlock113 in #4593
• fix: ignore_extra_keys for v2 configuration schema by @xianml in #4598
• fix: emit warnings when copying large file by @frostming in #4597
• feat: service.to_async property by @frostming in #4595
• feat: picklev5 serialization by @frostming in #4594

Full Changelog: v1.2.7...v1.2.8

v1.2.7

What's Changed

• docs: Add doc for server_ready_timeout by @Sherlock113 in #4563
• fix: depracate all enum in schema by @FogDong in #4565
• feat: threaded serving by @frostming in #4562
• docs: Adjust existing Bento deployment wording by @Sherlock113 in #4567
• fix: fix list instance type by @FogDong in #4566
• docs: Add doc for using pydantic model at the top level by @Sherlock113 in #4568
• fix: delete access in admin console by @FogDong in #4569
• fix(client): set upload timeouts to 10 hours by @sauyon in #4564
• fix: respect the content type config for file output by @frostming in #4570
• docs: Update the adaptive batching doc by @Sherlock113 in #4571
• feat: Service.to_asgi() method by @frostming in #4572
• docs: Add asgi doc by @Sherlock113 in #4574
• fix: allow legacy runnable methods when calling API by @frostming in #4573

Full Changelog: v1.2.6...v1.2.7

v1.2.6

What's Changed

• docs: Add envs field in bentofile by @Sherlock113 in #4555
• docs: Add GitHub repo links for use case docs by @Sherlock113 in #4556
• docs: Update the vllm use case doc by @Sherlock113 in #4558
• docs: Add how to get deployment info doc by @Sherlock113 in #4544
• fix: rename the _bentoml_sdk.api module by @frostming in #4557
• fix: wait until server ready when initializing client by @frostming in #4559
• feat: Add server.on_deployment hook to execute deployment-specific logic by @frostming in #4561

Full Changelog: v1.2.5...v1.2.6

v1.2.5

What's Changed

• docs: Add client code examples without context manager by @Sherlock113 in #4512
• docs: Update docs by @Sherlock113 in #4515
• docs: Add authorization docs by @Sherlock113 in #4517
• docs: Change sample input to one line by @Sherlock113 in #4518
• docs: Update ControlNet use case docs by @Sherlock113 in #4519
• docs: Update the distributed services and get started docs by @Sherlock113 in #4521
• refactor(cli): make CLI commands available as modules by @frostming in #4487
• docs: Refactor BentoCloud docs by @Sherlock113 in #4525
• docs: Update token docs by @Sherlock113 in #4526
• fix: fix list deployment exception by @FogDong in #4522
• feat: add get endpoint url for deployment by @FogDong in #4516
• docs: Add BentoCloud CLI and API ref docs by @Sherlock113 in #4527
• fix: add missing to dict for deployment config by @FogDong in #4529
• feat(client): disallow media type other than json for HTTP clients by @frostming in #4520
• chore: clean unneeded dependencies by @frostming in #4528
• docs: Add call deployment endpoints doc by @Sherlock113 in #4531
• docs: Update all use cases by @Sherlock113 in #4532
• fix: correctly encode ValueError in response by @frostming in #4530
• fix: improve CLI message by @frostming in #4533
• chore(io): allow implicit pydantic type conversion by @aarnphm in #4534
• fix: type convertion of io descriptor by @frostming in #4537
• feat: add back service hooks by @frostming in #4524
• docs: fix typo by @sauyon in #4540
• docs: Add BentoSVD Use case doc by @Sherlock113 in #4535
• doc: Add adaptive batching doc by @Sherlock113 in #4536
• doc: allow reuse of existing directory by @jianshen92 in #4543
• feat: cloud context from env vars by @frostming in #4542
• docs: Update the clients doc by @Sherlock113 in #4539
• docs: Update adaptive batching docs by @Sherlock113 in #4547
• docs: Update vLLM use case doc by @Sherlock113 in #4548
• feat: export component context at top namespace by @frostming in #4551
• feat: use starlette request directly in service context by @frostming in #4552
• feat: mount asgi app and fastapi support by @frostming in #4538
• fix(sdk): build envs into dockerfile by @bojiang in #4546
• fix: rename server context attributes by @frostming in #4553
• fix: crash when pulling bento from organization with proxy mode by @frostming in #4554
• fix: add str in enum for deployment schema by @FogDong in #4549

Full Changelog: v1.2.4...v1.2.5