Forrest Jordan

New post on what happens after you add a control plane and local storage for observability: you get 1000x the telemetry when it matters. https://lnkd.in/gAvkk-qP

58

1 Comment

This is the initial infrastructure Tradescoop was built on. A few things have changed, some additions and removals; for example, we’ve gone from MongoDB on Digital Ocean to Mongo Atlas, Redis cloud to Memorystore, but the general appraoch remains. Simplicity. Shouts to Karl Obinna Amalu, CSM for cleaning it up and adding color ✨ #gcp #infrastructure #devops

16

1 Comment

Legit quotable and actionable advice: * Power of Threes - 3 mentors, 3 peers, 3 mentees. * If you want to go fast, go alone. If you want to go far, go together

7

Follow up to our "Tiered Storage Won't Fix Kafka" blog post. This one explains all the benefits of WarpStream's Zero Disk Architecture beyond just reducing costs! https://lnkd.in/epjCSVMv

71

1 Comment

At the core of effective engineering leadership is the ability to stay connected with your team. This is perhaps the most challenging aspect because retaining the respect of your people is difficult unless you remain technically involved yourself. In my journey as an engineering leader, staying true to the individual contributor role that originally earned their respect has kept me close. This approach extends beyond technical expertise; it's about maintaining a deep connection with the core activities that propel product development forward at Gearflow. One of my biggest professional fears is becoming irrelevant or disconnected from my team and our work. This fear motivates me to continually reinvent and retool in response to market demands. Next month, I'll be sharing about my adventures generating synthetic data recently. And while I'm no expert when I start preparing for these talks, the process is incredibly valuable. It's less about delivering a perfect talk and more about how the preparation expands my thinking and exposes me to new capabilities. This helps me connect the dots to opportunities at Gearflow that bring real innovation to our customers. Speaking regularly holds me accountable and pushes me to learn ahead of the curve, ensuring I remain relevant and impactful day-to-day. Every talk is a journey of discovery, helping me to lead with humility, communicate clearly, and inspire a culture of innovation through a deep, technical understanding of our work.

19

It has taken a while to write up my notes from Kafka Summit. I spoke with ~200 people over 2 days and had some great conversations. There were many topics, but these 4 were the most common by far: 1. Operational Analytics 2. Event Driven Architectures 3. Unified ETL with Apache Flink 4. Automation and Data as Code/Config (DaC) Here's the write up: https://lnkd.in/ekhBFB3f Curious to hear what other themes folks found? #kafka #kafkasummit

23

4 Comments

Super excited to share some massive wins from my teams in Bitbucket Cloud. On April 23rd, we shipped TWO massive new capabilities that catapult Bitbucket Cloud into a new paradigm for Code & CI/CD Management. Dynamic Pipelines are a powerful new tool for building intelligent, standardised, and scalable CI/CD workflows across your entire organisation: https://lnkd.in/eFb_6gf8 And Custom Merge Checks are your go-to tool for enforcing policy, process, and compliance controls when new code is being merged into your repositories: https://lnkd.in/efUi-M8m Check them out, get started, and stay-tuned for more! #bitbucket #CICD #devops #atlassian #pipelines

16

pgvectorscale: A Game-Changer for Vector Similarity Search 🚀 Timescale's #pgvectorscale extension for PostgreSQL has achieved a remarkable milestone, matching the performance of Pinecone, a dedicated vector database, while being 75% more cost-effective. 💰 In their latest blog post, Timescale showcases the impressive speed and efficiency of pgvectorscale, which leverages the power of PostgreSQL to deliver lightning-fast vector similarity search. This breakthrough opens up new possibilities for applications like semantic search, recommendation systems, and more. 🔍 Key takeaways: 🌟 pgvectorscale now matches Pinecone's performance in vector similarity search 💸 pgvectorscale is 75% more cost-effective compared to Pinecone 🔧 Easy integration with existing PostgreSQL databases 🌐 Scalable solution for handling billions of vectors ⚡ Optimized for fast and efficient search results pgvectorscale's seamless integration with PostgreSQL allows developers to incorporate vector similarity search into their applications with ease, while benefiting from the robustness and scalability of a proven database system. 🗄️ If you're looking for a high-performance, cost-effective solution for vector similarity search, pgvectorscale is definitely worth exploring. 🔍💡 #pgvectorscale #postgresql #vectorsimilaritysearch #semanticsearch #recommendationsystems #timescale https://lnkd.in/gsfgCK32

4

I spoke with Eric Ignasik and Michael Sols from The Software House about dealing with silos at work. 🎙️ We discussed how Technology Managers can help their engineers gain deep operational expertise and take full responsibility for product/feature delivery. The best practices I described in this interview come straight from Payhawk. It doesn’t mean they can simply be copied — but they might be inspiring to some. Happy reading 👋🏼 ➡️ hubs.ly/Q02xn9j-0 #softwaredevelopment #cto #softwaredelivery

152

4 Comments

Hosting your own backend server on AWS is not exactly cheap, I've always been a bit uneasy with the NAT Gateway charges ($33 per month per AZ). That's why I created these AWS CDK stacks, where you can spin up your FastAPI serverless backend with almost $0 per month and minimum effort (5 command lines). If you need it to be in a VPC, there is also a NAT instance version, which uses fck-nat (https://lnkd.in/eMgrKEsy) from Andrew Guenther, costing < $10 per month. https://lnkd.in/ePnZs8pV Have fun building your web apps without breaking your bank! 😊

3

The most intelligent Claude 3 model, with best-in-market performance on highly complex tasks. It can navigate open-ended prompts and sight-unseen scenarios with remarkable fluency and human-like understanding.

6

Workflows v2 just dropped including multiple paths, multiple charts, loops, and a brand new refined UX. Grab more details at https://lnkd.in/gEN_9Gvy and come give it a try! Observability reimagined just keeps getting better. 🚀

27

AI is innovating a variety of industries across the US and Agriculture is no exception. 🐄 My new friend, Catie McVey, has created a new "Agtech" startup that uses patented 3D Modeling and Machine Learning algorithms to evaluate the health of cows by looking at specific characteristics such as hoof morphology and facial characteristics. Working with her to architect how to get source data from "The Stockyards" to "The Cloud" has been a lot of fun. I am constantly discovering new ways AI can make an impact in industries from legal, to healthcare and now agriculture! Read more about Catie's journey on RIoT - Internet of Things' blog #AI #software #agtech

9

Now we have two first class data catalogs integrated with MS Fabric now available in Azure. Of course DataBricks is the heavy heavy favorite in the enterprise lakehouses as well as AI (as of the conference that just finished 🤓)

6

This my favorite feature from this launch week. Transforming Postgres CDC changes on-the-fly opens up many powerful use cases such as masking, encryption, changing data formats, better load distribution, and so on. I'm sure you'll be surprised to see how simple PeerDB (YC S23) makes this—don't miss the demos in the blog! Also don't forget giving it a try! 😊 I would love to hear your feedback.

17

Ever wondered how Stripe maintains 99.999+% availability? Our internal Database as a Service system handles version upgrades, resharding, and more while ensuring consistency without any downtime. Check out our latest blog post to lean!

37