Anthony Ramirez

YugabyteDB’s automatic sharding overcomes PostgreSQL’s partition key limitations by allowing date range queries without modifying table partitioning.💡 Check out the new blog from Yugabyte expert Franck Pachot for more information, and step-by-step instructions!⬇️ https://hubs.la/Q02s_wKx0 #Yugabytedb #postgresql #sharding #partitionkey #cloudnative #partitioning

14

Postgres Women India Thanks Bharath Rupireddy for the Insightful blog on Durability and Write-Ahead logs. This blog gives detailed explanation on how databases handle durability without WAL logs. Key Takeaways: #Durability ensures data is permanently stored before acknowledging a write request. In-Memory #Databases lack durability as data is lost on shutdown. Disk Writing provides basic durability but isn't crash-safe without additional measures. #fsync is crucial for flushing data from the OS buffer to disk for true durability. Group Commit combines multiple write requests to reduce the performance impact of fsync. #WriteAheadLogs (WALs) optimize durability by writing changes to a log before updating the main database structure. For those interested in deepening their understanding of database durability, I highly recommend to check this blog.

11

1 Comment

Learn best practices for transitioning a graph workload to Azure Cosmos DB for NoSQL, based on real-world experience. Key strategies include efficient data modeling and migration to optimize performance and scalability. https://lnkd.in/e3YfzfNc

4

Reflector is a Kubernetes addon designed to monitor changes to resources (Secrets and ConfigMaps) and reflect changes to mirror resources in the same or other namespaces. More: https://lnkd.in/gNKQcUN

10

Last month, Redis' licensing model change sparked widespread dissatisfaction across LinkedIn and other forums. This backlash got me thinking about a critical question: Is caching still necessary in today's technological landscape? 🤔 With the throughput and latency of a couple of SSD disks on a PCIe bus now significantly surpassing network speeds, it's time to re-evaluate the role of caching in modern data management. #Caching #NoSQL #TechDiscussion

37

8 Comments

—1/60th memory usage —Single Cosmos DB instance —Pay for what you use See how DiskANN compares to HNSW for efficiency. https://lnkd.in/gJwhKbwy Ensure high-accuracy, efficient vector search at massive scale with Azure Cosmos DB. Leveraging Microsoft’s DiskANN, more IO traffic moves to disk to maximize storage capacity and enable high-speed similarity searches across all data, reducing memory dependency. This technology, powering global services like Microsoft 365, is now integrated into Azure Cosmos DB, enabling developers to build scalable, high-performance applications with built-in vector search, real-time fraud detection, and robust multi-tenancy support. #DiskANN

13

Prototype to Production: Crafting Applications with #AzureCosmosDB - Part 1 This is part one of the three-episode series that dives deep into the challenges faced when moving applications from prototype to production. https://lnkd.in/ePkypP6N

3

#WebAssembly interacts with #Kubernetes in a couple of distinct ways, but what are the right use cases for these models. In his Wasm I/O talk Taylor Thomas covers 'wrapped' and 'alongside' integration models, and the pros and cons of each approach. ☁ 🚀 https://lnkd.in/d8KEHwFB

3

Now I no longer can say, "I hate the term schemaless" when it comes to NoSQL databases. Now I can start schemaless, but then add in controls and enforcement as I develop my app or as requirements/functionality change. I can apply these controls as needed via gradual typing of my schema. The next video will be about migrating from your existing schema, or lack thereof, to the new schema you have designed and the tools Fauna Inc. delivers to help devs with that. No more "You're on your own" or "figure it out!!"

18

Boost query speed, reduce latency, and enhance cost efficiency without sacrificing accuracy by moving in-memory I/O traffic to SSDs. See how DiskANN is now built into Azure Cosmos DB. #DiskANN https://lnkd.in/evc49kWB

11

Azure Cosmos DB Mongo vCore just made a big update! The HNSW vector index type have gone GA, allowing for more efficient and accurate similarity search. IVFFlat divides vectors into multiple lists and assigns them to their nearest centroid, while HNSW creates a graph with each node as a vector for proximity layers. Make sure to select the right index type for your needs. Check out the https://lnkd.in/eiBFGrtZ for more details! #Azure #cosmosdb #mongo #HNSW #vector #index #GenerativeAI #OpenAI

21

In this third, extensively illustrated post of his windowing blog series, Bill Bejeck demonstrates sliding windows in Kafka Streams, and their logical equivalent in #FlinkSQL, OVER aggregations. Learn about use cases, like running average calculations, and more, here ➡️ https://cnfl.io/3W7N7qS

40

Student: How can I handle when a Step Function execution times out? (using a Lambda) Me: Here are 3 ways: 1. EventBridge (❌ Express Workflows) 2. CloudWatch Logs (a bit awkward to do) 3. Nested workflows (❤️ my fav) More detail, plus some honourable mentions in the full article below. https://lnkd.in/eqJeQbUU

64

7 Comments

🚀 New Blog Post 🚀 How to set up #Mosquitto #MQTTBroker on #AWS ✅ This step-by-step tutorial covers everything from configuring an EC2 instance to deploying a secure Pro Mosquitto MQTT broker in Docker. Whether you're a beginner or looking to optimize your current setup, this guide has you covered. 📗 Don't miss out on leveraging the power of cloud infrastructure for your MQTT workloads! ➡ Read the full guide here https://lnkd.in/eBTXZQnp #IoT #MQTT

8

Episode 2 of the Atsign Engineering Podcast is here! 🎙 Listen now, for a discussion on how how we leverage Kubernetes in our infrastructure with special guest Ian Miell https://lnkd.in/gGJc-yGH #Kubernetes #engineering #podcast #tech #innovation

5

Are your engineers spending time writing and maintaining common security policies for your Azure infrastructure with OPA? Policies like firewall rules, disabling RDP access, managed disks encryption, etc. Well, with ControlMonkey's 𝐌𝐚𝐧𝐚𝐠𝐞𝐝 𝐒𝐞𝐜𝐮𝐫𝐢𝐭𝐲 𝐏𝐨𝐥𝐢𝐜𝐢𝐞𝐬 for Azure, your engineers don't need to write a single policy ever again. These Security Policies are predefined, managed, and maintained by ControlMonkey. With ControlMonkey Managed Security Policies, you get a library of security policies to choose from straight out of the box, saving Cloud Engineering teams precious time. By shifting left Cloud Security and proactively applying security measures at the code level, you are setting the desired security standard for your resources and preventing unnecessary production misconfigurations. #devops #azure #terraform #iac

7

1 Comment

TIL that most SP-API developers look at logs weekly, if ever. 🤯 In an error logging session, Amazon polled the room: how often do you monitor logs/errors? The answer choices started at WEEKLY. As in, errors might accumulate for six days before someone looks at the logs. This explains why so many of our customers complain about data latency from other Amazon apps. There is no "secret" to Reason Automation data quality. We just work really hard at it. Step 1, log everything. Step 2, review those logs multiple times per day, to deeply understand trends and patterns. Step 3, create alerts and automation for variances. Step 4, create processes for reviewing, investigating, and solving variances. Step 5, react to customer feedback as a last resort. (Our goal is to detect and fix errors before customers notice.) If that process makes sense to you, please steal it! #amazondata #amazonvendor #finops #dataops

14

PaaS Offer (available below) requires end user to deploy an Azure container instance. The image includes: * Latest Ubuntu Release * PostgresQL 16 * 1 core and 1.5gb RAM * 4 open ports https://lnkd.in/gB_hcUr8

2

⚡ Breaking Benchmarks: Bare Metal K8s vs VMs ⚡ The numbers don't lie. Gcore's independent tests prove Kubernetes on bare metal hardware blows VM performance out of the water across CPU, RAM, storage, and network metrics. 💥🔥 https://lnkd.in/g4pYFmbA And the real gamechanger? QBO's innovative Kubernetes-in-Docker (KinD) solution running on bare metal servers. Purpose-built for AI/ML + beyond. 🚀 📈 #BareMetalKubernetes #CloudNative #Kubernetes #CloudComputing #AI #ML #SaaS

2