Gjorgji Georgievski

Kyle Hale with a step by step walkthrough of how you teach AI/BI Genie about the semantics of your data.

28

Have you tried running the DBRX models from Databricks? In our latest blog post we provide a tutorial to get you started with the model on Ori’s public cloud. We were very impressed with DBRX’s performance on the Hugging Face Open LLM Leaderboard before the updates last week. While DBRX Instruct did not score as highly under the new scoring system, it's still one of the best open models for Language Understanding (MMLU), Programming (HumanEval), and Math (GSM8K). We also used BeFOri, the benchmarking framework from Ori to determine DBRX Base performs inference most efficiently between 40 and 256 concurrent requests on one of Ori's 8 x H100 PCIe bare metal servers. Check out the blog to learn how you can use BeFOri to optimise self-hosted LLM performance on any infrastructure! https://lnkd.in/gi55WEks

43

Imagine seamlessly ingesting incremental data from *any* API right into #DeltaLake via Structured #streaming. This article by Irfan Elahi goes deep into the new Custom Data Source API in #apachespark, showing how you can create your own data source for streaming - with checkpointing capabilities to achieve exactly-once guarantees! https://lnkd.in/gEvr5kQJ

17

We are thrilled to announce that Databricks has been identified as a Leader in The Forrester Wave™: Data Lakehouses, Q2 2024, achieving the highest scores in both current offering and strategy categories. The report evaluated 13 vendors against 24 criteria, and we are honoured to be recognised as a Leader in this field. Congratulations to our team on securing a Leader position! Download a free copy of the report to learn more about how Databricks can assist you with your data and AI needs. #Databricks #ForresterWave #DataLakehouses #Leaders

67

A great summary of the 5 ways to ingest data into #snowflake https://lnkd.in/gfc2VrtF

2

We have out-of-the-box support in LlamaIndex for Snowflake SOTA arctic-embed models (which outperform other leading embedding models in benchmarks) - it's a one-liner through our Hugging Face integration! And in ~4 more lines of code, you can build a RAG indexing pipeline over your data with these embedding models. Check out the screenshot below for how to get up and running with this - we might have more detailed benchmarks soon, stay tuned 💡

215

3 Comments

Understand how and why Apache Iceberg is becoming the industry standard for Lakehouse: 💡 True open source 💡 Wide community support 💡 Fast innovation

25

2 Comments

Developers can now store, index, and query vectors in PostgreSQL using pgvector, eliminating the need for a dedicated vector database. This new blog from Yugabyte expert Brett Hoyer deep dives into pgvector, and explains how to store text embeddings as vectors, execute similarity search, choose between indexes, and scale with distributed SQL.💡 Find out more!⬇️ https://hubs.la/Q02CNjWd0 #YugabyteDB #pgvector #vector #AI #Postgresql #cloudnative #distributedsql

10

In case you missed it 👀 Our very own Principal Data Engineer and Databricks Solution Architect Champion Dylan Ford created a guide into the world of DataOps, from foundational concepts to implementing best practices. In it, he shows you how to: ✅ Optimize data workflows ✅ Enhance cross-team collaboration ✅ Ensure the quality of your data assets 👉 Dive into Dylan's expert insights and embark on your DataOps journey in his blog post: https://lnkd.in/gGbHTFX6

40

With many benchmark blog posts, the caveats can threaten to violate the intended narrative. But here, the caveats only reinforce the main point: Ibis makes it so much easier to move a workload from one engine to another. So if DataFusion is faster than DuckDB for a particular query, you can just run that one on DataFusion, easy peasy.

12

Databricks Announced the GA of Serverless Compute for Notebooks, Workflows and Delta Live Tables ! This would immensely help Customers with: ➡Rapid workload startup ➡Automatic infrastructure scaling ➡Seamless version upgrades of Databricks runtime ➡Cost Savings, billed only when compute is assigned to your workloads and not for the time to acquire and set up compute instances. Fast ! Simple ! Reliable ! Databricks Digivate Labs https://lnkd.in/gHNF6SGB #Databricks #Serverless #Datalakehouse #DataEngineering #DataScience #Datalake

10

Data quality is the next big enterprise problem. 91% of companies say they need to improve it. Luckily, AI can help. That's why Anomalo just won the Databricks Emerging Partner Of The Year award! Their AI can detect data issues before they screw up your business. If data is gas in the modern economy, Anomalo not only measures your octane -- it can also identify what's polluting your oil. Congrats to all the "Anomallamas" including Elliot Shmukler and SignalFire XIR Doug M. from Splunk who joined alongside us leading the Series B. Thanks for helping the world trust its data! https://lnkd.in/geqZQ6PN

86

5 Comments

My favorite part about working at Amplitude is we aren't afraid of making big, bold bets, all in service of our customers and today is one of those exciting launch days! We were one of the early adopters of Snowflake at Amplitude (early 2017). We made a big, bold decision of transitioning over from Redshift, which was a well-established data-warehouse to Snowflake, which was a new product and probably had a few hundred customers. It felt like the right decision because the technology was miles ahead of any other competitor (Google Bigquery, Amazon Redshift, etc.) and we had conviction that this is where the world is headed. Fast forward a few years, and Snowflake has completely redefined the modern-day cloud data stack. Today, we are announcing a first of it's kind integration with Snowflake. You can get all the power of Amplitude without moving your data, without any engineering effort for FREE. We are just getting started. In this age of #ArtificialIntelligence, there's so much we can accomplish by combining Amplitude's behavioral data with the customer and business data that sits in Snowflake. #productanalytics #datawarehouse #snowflake #amplitude #analytics #ai

28

Want to know more about the future of Delta Lake and Apache Iceberg? We had the chance to interview Tathagata Das alias TD, major contributor to Delta Lake, who shared more insights on what's new & the direction both formats are taking. And he also shared some interesting metrics - counting in Baby Shark units - We discussed the past, present and future of Delta Lake, including the major features we all love - Clustering and the new Variant type! Watch the full episode now! ==> https://lnkd.in/e9wrTFsm Thanks Youssef Mrini & TD!

43

2 Comments

Join SqlDBM for a live demo on Transformational Modeling (Tx) in Snowflake on Wednesday, July 17th at 9 AM PST! Key Features: ✅ Easy data transformation with templates. ✅ Full control over data creation and loading. ✅ Integrated relational modeling to save time. 💡 Q&A with Snowflake SuperHero Serge Gershkovich. Register below! #DataModeling #TransformationalModeling #Snowflake

9

2 Comments

Should be a very interesting webinar if you have the time to attend. A look at how to leverage Kumo.AI GNNs to easily enable AI on your data stored in Snowflake.

11

As-a-Service models are unpredictable and forecasting is a challenge, right? Think again! Here's Yann Toutant from Black Winch debunking that common impression. Listen to the full episode 👉 https://hubs.ly/Q02wXBKC0 #DataForSubscriptions #ProductAsAService

23

Always nice to see approachable and easy-to-follow guides for data engineering beginners. 👍 After introducing how to build your first data platform using MySQL, Apache Doris, and Apache Flink, Mohamed Amine Turki moves a little upstream and explains on Change Data Capture (CDC) with step-by-step instructions. https://lnkd.in/g9igQNjY (P.S. Apache Doris provides a Flink-Doris-Connector with built-in CDC support: https://lnkd.in/gmPESd3V) #dataengineering #beginner #Flink #CDC

21

1 Comment