Zach Wilson

small product management responsive system using CRUDS operations to create, read, update, delete, and search the data with some REGEX, and finally using local storage to save them.

11

4 Comments

I made lots of new connections on this app recently. For those, who don't know, I write about Cloud, Serverless, at The Cloud Handbook ☁ 🚀 ✅ Subscribe. It's FREE: 👉 cloudhandbook.substack.com Also, feel free to share your newsletter if you have any in the comments, I would be happy to recommend them. #aws #awscommunity #cloud #softwaredevelopment

31

1 Comment

In case you haven't caught it yet, OpenAPI Initiative's Arazzo specification is a standardized way to describe a sequence of related API calls (Congratulations to OAI on the 1.0 release!). Much of modern software relies on complex interconnected API workflows, but until recently, there was no formalized way to describe this. Wiring this up is typically done with ad hoc code or through visual builders. That's where Arazzo comes in. (Great name, too. Arazzo is Italian for "tapestry"). Today, on the Nordic APIs blog, our resident standards reviewer, Chris Wood, does a good job exploring some particular areas where Arazzo could help, from security workflows to HRM processes and healthcare lookup applications. Thanks, Chris, for helping the community understand how this new standard could be applied in practice! #arazzo #api #workflow #specification #apis https://lnkd.in/e3rQwwCJ

11

3 Comments

Remember Clidey Flows? Let’s deep dive! Flows are a Graph-based UI for running containerized testing or build processes. Flows are highly customizable! You can use your own Cloud Provider Cluster, environment variables, mount caching volumes, and configure RAM & CPU as you see fit. Flows with Hooks allow you to run any number of testing or build processes simultaneously in distributed computing. Sign up today for Early Access if you want an in-house out-of-the-box DevPortal for your company: https://clidey.com See you next week on how Hooks orchestrate Flows!

4

We have often seen many Customers asking one of the very interesting question. 🔥 We have deleted a large amount of data from some of the tables, but we still do not see the space reclaimed to disk. Why ? 🔥 🎇 Some of the database engines may also see performance degradation (no improvement) eventually, as the live tuples/records are scattered across more number of data blocks than actually required. This may be because the data that got deleted was scattered across a lot of data blocks but not really stored sequentially within a few data blocks. Queries on such tables may involve scanning more data blocks for a very few records. We call this as Table fragmentation. 🐘 This concern may not be limited to #postgres, the same is also applicable for #oracle or #sqlserver or any other database engine. 👨‍💼 👩‍💼 Database and Application Architects generally implement techniques like Partitioning and Sharding wherever applicable so that the challenges of data deletion/archival are completely avoided with a simple partition drop instead of a time and resource intensive "delete" statement. We will extend a little more on database scalability sometime later. For now, let us see what can we do to reclaim this space, if you are using PostgreSQL. 💰 Considering the resources and expertise available for #Oracle and #SQLServer like database engines, users might have already been aware of solutions to rebuild tables online in Oracle or SQL Server. 💸 Do note that such options are available only with Enterprise versions for most of the commercial database engines. For users migrating from #oracle to #PostgreSQL or newly deploying #postgres as the database engine, you could use one of the popular OpenSource extension called : pg_repack, that can safely rebuild tables online and reclaim the space back to disk. Manisankar K from HexaCluster has published this article on pg_repack and also compared with solutions available for the Oracle Enterprise versions. If you have a similar challenge where you could not avoid a massive delete but still want to rebuild the table online to reclaim space, read this article to safely implement pg_repack for PostgreSQL. Contact HexaCluster for expert assistance for your PostgreSQL databases and for database migrations to PostgreSQL. #postgres #postgresql #oracle #sqlserver #hexacluster #databasemigration #databasemaintenance

8

New Blog: The comprehensive guide to self-hosting github actions runners on AWS you didn't know you needed: 1. Directly on EC2 2. On ECS 3. On ECS + Fargate 4. Actions Runner Controller on k8s 5. Philips terraform module 6. Directly on k8s https://lnkd.in/g_8D99p5

24

4 Comments

here are 10 concise scenario-based interview questions on Apache Kafka: ⭕ How would you configure Kafka to handle high traffic loads efficiently? ⭕ What configurations do you use in Kafka to prevent data loss? ⭕ How do you set up Kafka for real-time data processing with minimal latency? ⭕ What steps would you take to scale a Kafka cluster facing performance bottlenecks? ⭕ How would you ensure fault tolerance in a Kafka setup? ⭕ How do you manage a Kafka cluster used by multiple teams with varying data access requirements? ⭕ How do you configure Kafka’s log retention settings to meet specific data retention policies? ⭕ What security mechanisms would you implement in a Kafka cluster handling sensitive data? ⭕ What tools and metrics do you use to monitor and troubleshoot a Kafka cluster? ⭕ Can you describe a project where you integrated Kafka with other systems and the challenges faced? 🚨 Today, we kicked off our most affordable and project-oriented Power BI crash course 😎  👉 Enroll Here - https://lnkd.in/dhwQDCkg We at Grow Data Skills are conducting super productive and practical FREE Masterclass: "Create & Deploy End-to-End Ecommerce ETL Data Piplines using DBT" 🚨 🔥 If you interested, here is the link: ➡️ Register Here For FREE - https://lnkd.in/dUEJ4WeH ➡️ Timings: 28-April-2024(Sunday), 12PM IST Grow Data Skills Shashank Mishra 🇮🇳 SHAILJA MISHRA🟢 Sahil Choudhary

61

5 Comments

In this tutorial, we'll cover how to deploy the PubNub Gateway using the Quickstart Template and how to integrate an Anzure Stream Analytics component.

3

1 Comment

I wrote a new post on the Sympathetic Ink blog to sum up The Deconstructed Database and what makes it composable. Learn more about the role of #Parquet, #Arrow, #DataFusion, Apache Iceberg, #Calcite and OpenLineage

64

4 Comments

Curious about DB internals? See the database drivers chapter in the free book, “Database Performance at Scale.” (by Piotr Sarna). It covers contextual awareness, maximizing concurrency while keeping latencies under control, correct usage of paging, timeout control, retry strategies, and more. https://lnkd.in/gezfGXHh #ScyllaDB #database #lowlatency

18

What's your API versioning strategy? With Traefik Hub, you have 4 versioning methods to mix and match, internal semantic versioning for easy tracking, and CRD-driven API and version header management. Check it out: https://bit.ly/3xDXARb

1

Good news: We've made a few DX improvements to Dub.co's API 👇 1. New `externalId` prop for simplified link management 2. Arbitrary `start` and `end` parameters for analytics endpoints 3. New `upsert` method for efficient link creation Read the changelog → d.to/dx-improvements

21

In this article, Dunith Danushka shows how to design a real-time analytics pipeline for tracking API invocation usage with Apache APISIX, Redpanda, and Apache Pinot

6

SAM Accelerate is one of my favorite features of AWS SAM. 🐰 ⚡ It allows the synchronization of local application changes with the AWS cloud. By utilizing the `$ sam sync` command, developers can efficiently deploy their local modifications to a live AWS environment, ensuring that their applications are tested in a real-world scenario and speeding the development cycle. Learn more about it in this article: https://lnkd.in/gsCJTCK9 #aws #sam #serverless

34

Elasticsearch & OpenSearch Percolate Queries! Want to learn more about this hidden gem? Read on... 💎 The Netflix tech team recently published that they needed to solve a complicated problem - managing dynamic subscriptions and notifications without direct entity associations. This is where you want to filter the subscribed items without having prior knowledge or specific tags to base them on other than the entity schema. 🤔 Enter Percolate Queries! ⭐ A Percolate Query is a specialized query mechanism within Elasticsearch and OpenSearch that allows users to index queries themselves and later match these queries against incoming documents. So, instead of filtering documents with a query, you actually filter queries with a document! 🤯 Learn how this approach minimizes their systems' workload while maintaining timely notifications. Explore the full story on InfoQ. 📜 #SoftwareArchitecture #ElasticSearch #OpenSearch #ReverseSearch #Netflix https://lnkd.in/gZJYWnkr

17

Here's a more detailed demo of the enhanced mapping available in DCDR. Richer data ✅ Planning tools ✅ Custom overlays ✅ Better decisions, faster ✅ Going live on May 28 #geopolitics #intelligence #decisionmaking

2

1 Comment