Discussions

• 1 You must be logged in to vote

  #️⃣

  feature: CTranslated2 Framework + Adaptive-batching for custom runner

  Matthieu-Tinycoaching asked Sep 30, 2022 in General · Unanswered

  

  

  2
• 1 You must be logged in to vote

  🙏

  Is there away in v1.2 to assemble docker image from a local folder (as it was in v0.13), not from a model store?

  Ziange asked Jun 14, 2024 in Q&A · Unanswered

  

  

  1
• 2 You must be logged in to vote

  🙏

  How to setup authentication

  ProVega asked Jun 21, 2024 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Get duplicate log from bentoml CLI when override with structlog

  quannguyenleanh asked Jun 27, 2024 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  💡

  Integration with https://github.com/michaelfeil/infinity

  michaelfeil asked Jun 11, 2024 in Ideas · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Best practice for multiple service serving

  tguner-arteriaai asked Jun 3, 2024 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  How to build a service that dynamically loads embedding models?

  kobiche asked Jun 3, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  #️⃣

  Example for kubeflow in latest version missing

  kobiche asked Jun 3, 2024 in General · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Got stuck with define bytes as api input

  ntvuongg asked Apr 30, 2024 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Is is possible to use Llava model with bentoml?

  michelgirault asked May 16, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Is it possible to save_model NVIDIA NeMo?

  Ormared asked May 15, 2024 in Q&A · Unanswered

  

  

  0
• 2 You must be logged in to vote

  🙏

  bentoml.depends on distributed services on kubernetes

  zsaladin asked Apr 12, 2024 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Issue when using bentoml 1.1.11 in the cloud vs using it in local

  xcadenas3 asked Apr 15, 2024 in Q&A · Unanswered

  

  

  0
• 3 You must be logged in to vote

  🙏

  Which one do I have to choose between OpenLLM and BentoVLLM?

  zsaladin asked Apr 12, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  resources configuration in bentoml.service

  zsaladin asked Apr 12, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  How to debug a bentoml app like fastapi flavor?

  decadance-dance asked Mar 28, 2024 in Q&A · Answered

  

  

  2
• 3 You must be logged in to vote

  🙏

  Is the gRPC in BentoML stable and actively maintained?

  ryan-3m asked Mar 3, 2023 in Q&A · Answered

  

  

  

  

  3
• 1 You must be logged in to vote

  🙏

  How to change temporary directory while create bentoml.Model?

  cnicolumn asked Apr 9, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  How to run bentoml service on multiple instances without BentoCloud?

  mihow asked Mar 29, 2024 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  #️⃣

  docker run cannot start service

  xytsinghua asked Mar 15, 2024 in General · Unanswered

  

  

  0
• 4 You must be logged in to vote

  #️⃣

  add documentation about BENTOML_HOME

  ALee008 asked Aug 25, 2022 in General · Unanswered

  

  

  1
• 1 You must be logged in to vote

  #️⃣

  Does yatai deployment require saving the model to the bentos model store?

  xytsinghua asked Feb 23, 2024 in General · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Batch runner inference: data transfer is slow

  l11ama asked Feb 19, 2024 in Q&A · Unanswered

  

  

  0
• 3 You must be logged in to vote

  🙏

  How to disable Swagger UI?

  6ixGODD asked Dec 19, 2023 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Parallel processing of runners

  DenisStefanAndrei asked Dec 29, 2023 in Q&A · Unanswered

  

  

  0