ithinkbot

Why RAG Applications Fail in Production - 1. Retrieval Quality 2. Hallucinations 3. Privacy and Security Concerns, Malicious Use and Content Safety 4. Domain-specific Challenges 5. Completeness and Brand Integrity 6. Technical and Operational Issues https://lnkd.in/gJ7AGVgG

🔔 GPT-4 in a Cancer Center: Challenges and Lessons from Dana-Farber’s Deployment My take Home messages - 1) Focus on boring low-risk tasks first 2) Dont get too technical early 3) Early design decisions will allow scaling 4) Everything has a cost 5) This use-case is administrative and not for clinical practice https://lnkd.in/g2vXdHph

🔔 The latest update to Huggingface’s PEFT v0.11.0 introduces several new Parameter-Efficient Fine-Tuning (PEFT) techniques (BOFT, VeRA, and PiSSA) https://lnkd.in/gWctEzuk

Today, we will examine chunk-size optimization during the development of an RAG application. We will assume that it is a business-specific use case. We will also observe how and where generic approaches to chunk-size finding can fail or excel. https://lnkd.in/grC8_4Cb

Today, we will examine chunk-size optimization during the development of an RAG application. We will assume that it is a business-specific use case. We will also observe how and where generic approaches to chunk-size finding can fail or excel. https://lnkd.in/grC8_4Cb