Tom Madureira

Dive into the binary log transaction compression feature, introduced in Readyset's most recent release. This feature reduces storage and network bandwidth by dynamically applying ZSTD compression to transactions. As part of this work, Readyset engineers contributed by adding support to it into the MySQL Rust driver, which now can be used by the broad rust community. Explore the detailed implementation and performance results: https://lnkd.in/eXkhwv-B

7

Autoscaling, serverless analytics, oh my! The latest #MariaDB #SkySQL release helps bring #cloud costs down while your productivity goes up. InfoWorld’s Anirban Ghoshal dives into the details.

30

1 Comment

[Article] Analyzing Unplanned Availability Group Outages and Failovers using AGDiag Learn how to use the AGDiag tool to troubleshoot and analyze SQL Server Always On Availability Group issues. Author: Edwin Sarmiento >>> https://lnkd.in/ezRVqgsP #sql #sqlserver #microsoftsqlserver #mssql #mssqlserver #agdiag #alwaysonavailability #outages #troubleshoot

4

PostgreSQL and pgvector: Now Faster than Pinecone, 75% cheaper, 100% open-source. Introducing pgvectorscale, an open-source PostgreSQL extension that builds on pgvector, enabling greater performance and scalability. Here’s how pgvectorscale helps pgvector outperform specialized vector database like Pinecone: 1️⃣ StreamingDiskANN:  A new vector search index that overcomes limitations of in-memory indexes like HNSW the index on disk, making it more cost-efficient to run and scale as vector workloads grow. Inspired by the DiskANN paper from Microsoft. 2️⃣ Statistical Binary Quantization (SBQ): Developed by researchers at Timescale, this technique improves on standard binary quantization techniques by improving accuracy when using quantization to reduce the space needed for vector storage 3️⃣ Written in Rust, giving the PostgreSQL community to contribute to vector support. 📈The result? On our benchmark of 50 million Cohere embeddings (768 dimensions each), PostgreSQL with pgvector and pgvectorscale achieves 28x lower p95 latency and 16x higher query throughput compared to Pinecone for approximate nearest neighbor queries at 99 % recall, all at 75 % less cost when self-hosted on AWS EC2. We also tested it against Pinecone’s p2 high performance index, see the blog post at the end of this post for full results (spoiler: It’s just as impressive). Pgvectorscale is open-source under the PostgreSQL license and free for you to use on any PostgreSQL database for your AI projects. To get started, see the pgvectorscale github repo: https://lnkd.in/ghXj2e-U Or try it on Timescale Cloud on any new database service. Eager to learn more about pgvectorscale and how it works? Head over to our blog post with all the details: https://lnkd.in/gcMcxrVb

78

3 Comments

"The company unveiled Grafana 11 at GrafanaCON, which is replete with improved visualizations, new data sources, including PagerDuty and SumoLogic, integration with Tempo and Traces, and simpler alerting. However, the most notable improvement is the introduction of Explore Metrics, which assists in wading through the reams of data spat out by the observability platform. Where knowledge of PromQL – a functional query language for the Prometheus monitoring system – has been a prerequisite for the proverbial needle in the data haystack, Grafana Labs reckons that Explore Metrics (and the similar Explore Logs) will make things query-less. Almost." Read more from Richard Speed via The Register. #grafanacon #grafana #observability

68

Tuning the size of the InnoDB buffer pool can unlock much better performance for your database. Benjamin Dicken demonstrates how it works in this video: https://lnkd.in/gtf2ss_w

8

🐍📰 Speed Up Your Python Program With Concurrency Learn what concurrency means in Python and why you might want to use it. You'll see a simple, non-concurrent approach and then look into why you'd want threading, asyncio, or multiprocessing #python

11

Templates have been our go-to for Infrastructure as Code (IaC), but let's face it, they can introduce drift. As the industry evolves, it's time to embrace standards over templates for streamlined deployments. #IaC #Infrastructure https://hubs.li/Q02vfhrn0

14

SHOULD you be using AWS S3 Access Grants? I spent much time this week trying to answer that question. Do you regularly shout these things during standup? • 🪣 S3 bucket policies are too big!!! • 🔌 There are S3 Access Points everywhere. Which one is mine!!! • 🔒 I'm in HR, why do I need "AWS SSO"... As with everything in tech, though, there are trade-offs, and I wasn't convinced those trade-offs were adequately explained by the product page. I've even provided a worked example that deploys an above-average data platform design with S3 Access Grants so that you can play around with it hands-on. Please let me know if this post helps you, and if it doesn't, or if something is unclear, I'd love to help address that, so absolutely reach out. https://lnkd.in/gavgddbw #awscloud #s3 #accessgrants #awscommunity

15

1 Comment

🔥 We dropped it like it's hot. The new Flame Graph AI in Grafana Cloud uses LLMs to assist with flame graph data interpretation so you can identify bottlenecks, root causes, and suggested fixes faster! You should read about it, take a second: https://bit.ly/4awbAtV

413

2 Comments

Complex Event Filtering with AWS EventBridge Pipes, Rules and No Custom Code: https://lnkd.in/gKiPfKDi (Thanks to Nathan Wilkerson for the link!) #aws #cloud #lambda

1

"Holy ****!" Who doesn't love a dashboard that turns heads and makes people blurt expletives (in a good way)? Join the webinar today at 9:30 AM PDT / 12:30 PM EDT to learn how to make dashboard creation your new super power.

49

1 Comment

Standing room only in Command Prompt, Inc.#DBA Grzegorz Dostatni's Postgres Conference 2024 "Advanced PostgreSQL Lock Management" session! Stay tuned for the slide deck to be posted online next week at https://lnkd.in/gSZVdkjP #professionaldevelopment #Postgres #LockManagement

12

Learn how to effectively administer a Patroni managed PostgreSQL cluster to ensure high availability and robust performance. Get tips on starting to tune a running system! https://hubs.ly/Q02zDJk20 #OpenSource #Percona

14

🚨 Stop the presses! 🚨 Observability Digest #013 just dropped, and it's a doozy! 📰 https://lnkd.in/e9ZCnpy2 Wondering how to take your Observability game to the next level? We've got you covered: 🤜🤛 Embrace and Grafana Labs are teaming up to bring Observability to mobile apps. Talk about a power couple! 🙌 Elastic's Universal Profiling agent just got the OpenTelemetry seal of approval. It's a big deal. 🚀 Parkar Digital's Vector 2.0 is here, and it's ready to shake things up. Hold onto your hats! 🕵️‍♀️ 𝗦𝗲𝗰𝘂𝗿𝗶𝘁𝘆 𝗔𝘄𝗮𝗿𝗲𝗻𝗲𝘀𝘀: Splunk's bringing out the big guns with advanced AI for security and Observability. They mean business! 📝 𝗢𝗯𝘀𝗲𝗿𝘃𝗮𝗯𝗶𝗹𝗶𝘁𝘆 𝗧𝘂𝘁𝗼𝗿𝗶𝗮𝗹𝘀: Nitesh Upadhyay's dropping knowledge bombs about Prometheus and Grafana on Medium. InfoQ's spilling the cider on Kubernetes logging. 🎙️ 𝗘𝘅𝗽𝗲𝗿𝘁 𝗩𝗼𝗶𝗰𝗲𝘀: Ahmed Ben Ali's preaching the gospel of Observability on LinkedIn. SiliconANGLE & theCUBE's diving deep into the world of generative AI. Don't be the last to know! Subscribe now and join the cool kids. 😎 #ObservabilityDigest #Observability #Devops #Kubernetes #Cloudnative #Microservices

12

5 Comments

This just in! Not every workload should be distributed and serverless!! https://lnkd.in/gbUnhRce There is some good stuff in here about real world costs related to moving data around. Something not enough people think about while building their systems. It is also very hard to predict. This sort of thing is a testament to the importance of metrics, monitoring and building software that is as easy to change as possible. I would argue the team did a lot of things right if they were able to analyze their system, realize how much cost was hurting them and be able to make changes to address the issues they found.

11

2 Comments