Soma Capital’s Post

Meet Sohu, the fastest AI chip of all time. With over 500,000 tokens per second in Llama 70B throughput, Sohu lets you build products impossible on GPUs. Sohu is the world’s first specialized chip (ASIC) for transformers (the “T” in ChatGPT). By burning the transformer architecture into our chip, we can’t run most traditional AI models. But for generative AI models, like ChatGPT (text), SD3 (images), and Sora (video), Sohu has unparalleled performance. One Sohu server runs over 500,000 Llama 70B tokens per second: >20x more than an H100 server (23,000 tokens/sec), and >10x more than a B200 server. We recently raised $120M from Primary Venture Partners and Positive Sum, with participation from Two Sigma Ventures, Skybox Datacenters, Hummingbird Ventures, Oceans, Fundomo, Velvet Sea Ventures, Fontinalis Partners, Galaxy, Earthshot Ventures, Max Ventures and Lightscape Partners. We’re grateful for the support of industry leaders, including Peter Thiel, David Siegel, Thomas Dohmke, Jason Warner, Amjad Masad, Kyle Vogt, Stanley Freeman Druckenmiller, and many more. We’re on track for one of the fastest chip launches in history: - Top hardware engineers and AI researchers have left every major AI chip project to join us. - We’ve partnered directly with TSMC on their 4nm process. We’ve secured HBM and server supply from top vendors and can quickly ramp our first year of production. - Our early customers have reserved tens of millions of dollars of our hardware. As we hit the limits of speed, cost, and scale on GPUs, specialized chips are inevitable. If you want to change the future of AI compute, please join us at www.etched.com/careers. (Benchmarks are from running in FP8 without sparsity at 8x model parallelism with 2048 input/128 output lengths. 8xH100s figures are from TensorRT-LLM 0.10.08 (latest version), and 8xB200 figures are estimated. This is the same benchmark NVIDIA and AMD use.)

Pumped to announce our Series A! Couldn't have picked a better partner in Amy Cheetham and the Costanoa Ventures team. Hona is full speed ahead on a mission to revolutionize how legal teams communicate with their clients. Also one of those moments where I look back and realize how lucky I am to have partnered with Matt McClellan and Joshua Christensen. You don't REALLY know what you are getting yourself into until things get going... and these guys are the absolute best people and partners. Fun loving and amazing at what they do. Love the Hona team and excited to keep moving! Link to the press release: https://lnkd.in/eggVNJ7D

Really excited to share that we just launched a brand new version of Sweetspot (YC S23)! With this release, our goal was to create an all-in-one government sales platform. Here are some highlights: 🔎 AI-Powered Search: Leverage our new and improved AI-Powered search engine to find government opportunities that best suit your business. 💬 Opportunity Chat: Make a quick bid/no-bid decision by asking our AI questions about the opportunity. 📂 Pursuit Management: Collaborate with teammates to tackle tasks, organize files, and track the progress of the pursuit from inception to submission. 📝 Proposal Copilot: Draft a response to any opportunity by leveraging our intelligent AI copilot, equipped with an arsenal of tools and privately trained on your company's data. We have some huge follow-up updates coming out in the next several weeks, excited to share more then 🫡   Read more: https://www.sweetspot.so Sign up for a free account: https://lnkd.in/gxcp9MCY Book a demo: https://lnkd.in/gWh_UmVA #govcon #sales #startup #govtech #government #contracting #ai

https://lnkd.in/gw9eVvfr