Fireworks AI

Compound AI Systems combine specialized models, retrievers, and external tools for specific tasks, offering greater flexibility and performance compared to single, mega models that can be less efficient and harder to specialize. Join us at CampFire Connect on July 11th at 10 AM PST to learn more 👇 RSVP - https://lnkd.in/eZ9MRrux

Excited to be co-hosting an Agents and Compound AI Hackathon! Join us in SF on August 11 to build AI systems that can utilize multiple models, tools and knowledge bases! lu.ma/kwp4mkr3

Join us next week at CampFire Connect to discover the latest from Fireworks AI, see new demos, and explore compound AI systems with Fireworks AI CEO Lin Qiao and LangChain CEO Harrison Chase.  📅 11th July, 10 AM PST 📌 Online RSVP now  👇 lu.ma/campfire-connect

Join us next week at CampFire Connect to discover the latest from Fireworks AI, see new demos, and explore compound AI systems with Fireworks AI CEO Lin Qiao and LangChain CEO Harrison Chase.  📅 11th July, 10 AM PST 📌 Online RSVP now  👇 lu.ma/campfire-connect

Cursor has trained a specialized model on the "fast apply" task, which involves planning and applying code changes. The fast-apply model surpasses the performance of GPT-4 and GPT-4o, achieving speeds of ~1000 tokens/s (approximately 3500 char/s) on a 70b model. Read more about how Cursor built Fast Apply using the Fireworks AI Speculative Decoding API 👇 https://lnkd.in/e9cPqFEx

Cursor has trained a specialized model on the "fast apply" task, which involves planning and applying code changes. The fast-apply model surpasses the performance of GPT-4 and GPT-4o, achieving speeds of ~1000 tokens/s (approximately 3500 char/s) on a 70b model. Read more about how Cursor built Fast Apply using the Fireworks AI Speculative Decoding API 👇 https://lnkd.in/e9cPqFEx

Keeping up with our same-day ritual for hot new models at Wordware (YC S24) we release Gemma 2 9B from Google. Thanks to Fireworks AI for helping to make this happen, accelerated by my nudging at the AI Engineer World Fair. #llm #ai #google #gemma2

I'm excited to announce FireAttention v2: a breakthrough for long context inference. At Fireworks AI, we challenge ourselves to deliver high impact innovation -- can we develop a dramatically more efficient serving for LLMs with RAG in a long context window with negligible quality tradeoff? We built our next generation runtime, FireAttention v2. When compared with vLLM, the Fireworks stack now serves Qwen2 and Mixtral (32k context window) up to ~12x faster and ~8x higher throughput. For technical details, check our blogpost: https://lnkd.in/eyN_sM6Z

80+ open-source models from Fireworks AI are now available on Portkey ✅ Test your existing prompts on faster, cheaper open source models ✅ Switch to open source models without changing any underlying code ✅ Version, track, and deploy your prompts to production with one click Just add your Fireworks API key to Portkey vault to get started!

📣 Attention Bay Area Generative AI developers and early-stage startups! Fireworks AI is proud to sponsor the MongoDB GenAI Hackathon with Amazon Web Services (AWS), co-hosted by Founders Bay and PolyAgent! Join us for an incredible day of learning, networking, and innovation. This is a fantastic opportunity to showcase your skills and connect with industry experts and fellow developers. 🗓 When? Friday, June 14th  📍 Location: Hacker Dojo in Mountain View, CA  ⏰ Time: 9:30am - 10:00pm PT 👉 Spots are limited, so register today:  https://lnkd.in/ehpDDFaw #VectorSearch #LLM #RAG #GenAI #Hackathon