Jon Mittelhauser

Kafka is reborn cloud-native! Confluent acquired Warpstream. But Confluent also has Kora. Which one will be the successor, and what’s next? History has some lessons. I honestly did not expect this so soon. Confluent still moves as fast as Kafka. For those of you who don’t know Warpstream, you’ll know it soon. it’s cloud-native Kafka made simple. Just bring your own cloud (BYOC) and drop Warpstream in. Its pricing and simplicity made Kafka REALLY cost-effective. It’s a bold, great acquisition by Confluent. What’s next? If history tells us anything, and it does, here’s what we might expect to happen. 1. Kora will “evolve” into Warpstream. And that’s OK. Confluent now has two cloud-native Kafkas. Confluent has already made it clear that Warpstream is their new Kafka BYOC solution. That’s usually acquisition-speak for Warpstream is becoming part of the new foundation. So what happens to Kora? It probably evolves into managed Warpstream behind the existing UI and API. This isn’t the first time Confluent has built something and then acquired a better alternative. Think Flink. This change really shouldn’t matter much for existing customers because it will be hidden. 2. Bento must die. Warpstream committed to keeping a version of the original Benthos alive and open source. Will Confluent back it now? Is that part of the strategy? This one is a little harder. My guess is standalone Bento is done. There aren’t a lot of Warpstream customers. But many people depend on Connect and Flink. Let’s hope Flink gets a Bento box. 3. New messaging protocols will continue to emerge. The Warpstream acquisition adds fuel to the fire. People want lower cost Kafka, and “Confluent BYOC” will most likely become more expensive. Higher costs will continue to drive companies to look for alternatives for messaging and integration. This is good for other vendors: - RedPanda and other Kafka-compatible solutions will continue to grow - Estuary Flow is built on Gazette, which is cloud-native exactly-once delivery with stream store and replay. It already supports the Kafka consumer API for compatibility. - IoT vendors like NATS continue to grow. It’s a different market. - We’re also long overdue for new messaging vendors to replace JMS, RabbitMQ and others. 4. Kafka will become hidden plumbing. The question is, for what? The acquisition doesn’t change this at all. Data integration, real-time analytics, AI, and other technologies will hide Kafka and other messaging protocols. Estuary Flow hides Gazette. ELT vendors that use Kafka hide it. Even Confluent is innovating on top of Kafka. What do you see coming next? What will Confluent do next? Estuary Confluent WarpStream Apache Kafka Redpanda Data Synadia

110

25 Comments

The boss says “RI’s can’t handle our spiky workloads”. Fortunately, you’ve been exploring Xosphere Spot orchestration. Your exploration begins here: https://lnkd.in/dsibkiKE #ec2 #aws #kubernetes #k8s #costoptimization #finops Xosphere FinOps Foundation

4

1 Comment

Primitives or abstractions? I had the chance to pose this question to Matt Garman, CEO of AWS, at re:Invent last week. His response was clear: AWS is doubling down on both. They’re investing in innovating and owning key primitives such as foundation models, infrastructure, and chips, while also building powerful abstractions—services that enable developers to run diverse workloads and create innovative applications with industry-leading price-performance. Against the backdrop of thousands of attendees buzzing about all things AI, AWS once again delivered one of the best industry conferences. Here are my top 5 insights from the event.

16

4 Comments

For those interested in how cloud scale database systems work, below is a deep dive on Amazon MemoryDB. MemoryDB delivers microsecond-level read latencies, and throughput in the hundreds of millions of queries per second, while offering multi-AZ durability with automatic failover.

22

The speed at which these models improve is staggering, so is the cost to build them. Only way to keep up is to leverage principles such as AWS Bedrock so you have the flexibility you need to quickly select the model that works best for your task. https://lnkd.in/gNAR63YC https://lnkd.in/g_FtP6e9

36

🚀 Introducing Attestation Policies and more at Chainloop! 🚀 We're thrilled to introduce Attestation Policies and more exciting features that make it easier to keep your software delivery workflows secure and compliant. With Chainloop Policies, you can: - Block critical vulnerabilities or specific Log4j versions. - Manage open-source licenses with ease. - Build a centralized repository of controls. - Set quality gates for your #SBOMs. Contact us and we'll be happy to show you what we're cooking.  If you like what we do, join our community in Slack, or give Chainloop Evidence Store (Open Source) a star on GitHub https://lnkd.in/dKfqRGDu :) #Chainloop #Security #SupplyChainSecurity #SoftwareDelivery 

12

1 Comment

With MongoDB, we help engineering leaders get off the modernization hamster wheel and embrace predictable, optimised spending that fuels their most ambitious initiatives. With powerful features like automated cluster sizing, on-demand pausing, and granular spend visibility, MongoDB Atlas helps you right-size your data infrastructure and take complete control of your IT costs. Perfect way to break free from the constraints of economic uncertainty and get easier budget approvals. This blog helps you understand how MongoDB Atlas can help you take better control of your data costs. #MongoDB #cloud #innovation

29

1 Comment

Here's a practical example of how Formal Methods can make code faster: AWS's new proven-correct authorization engine is 65% faster (even at p99.9) than the previous version. https://lnkd.in/gVCdurKh Sean says in the talk "we wouldn't have attempted a lot of optimizations we did without this backing of proof". Formal methods allow us to optimize systems more boldly, by removing the risk that optimizations will affect correctness. They also allow our teams to move faster, with lower risk, by building confidence in correctness early on in the software development process.

435

4 Comments

Read ‘A document use case comparison: Aerospike vs. MongoDB Atlas’ #whitepaper to explore the key differences between #Aerospike 7.0 and #MongoDB Atlas v7.08, including key insights on superior throughput, consistent latency, and cost efficiency. https://lnkd.in/ekxy7m7E

8

Super excited about this talk! I'm going to dive into some of the work we've done under the covers in AWS, in services like Lambda, Aurora, and DynamoDB, to make them even more resilient, and how to apply those same techniques in your own systems.

152

2 Comments

EDB is proud to have three of our Postgres experts attending PGConf NYC sharing insights on new Postgres features and navigating common challenges for DBAs. Get a preview of EDB's talks at PGConf NYC this year. Read the blog here: 🔗 https://lnkd.in/gg8HUEj6 #Postgres #PostgreSQL #justsolveitwithPostgres #EDBPostgresAI #data #AI #database #DBA #opensource

7

With Qwak's MLOps solution integrated into JFrog's platform, customers can manage their AI models with JFrog Artifactory serving as the model registry and JFrog Xray ensuring the security of ML models

2

🤔 Unlock revenue tied to data streaming or keep your focus on the rest of your roadmap? Good news: that’s a choice you no longer need to make—the Confluent OEM Program is here to empower you to do both! MSPs, CSPs, and ISVs, don’t miss out—learn more about the program on our blog!

14

When handling billions and trillions of rows of data, there are times when we need to use aggregates. Learn how it's done at Hydrolix from Franz Knupfer #bigdata #observability #dataplatform https://lnkd.in/ewuGu-WT

18

Explore the path to interoperability in this in-depth conversation with Michael Armbrust, the original creator of #DeltaLake, and Ryan Blue, an original creator of #ApacheIceberg. For many organizations, struggling with which table format to choose delays lakehouse adoption and ultimately harms their data + AI strategy. But there is an easier way. This insightful discussion covers the evolution of open table formats, how Databricks is solving interoperability, data governance and more.

5

Amazon FSx for NetApp ONTAP now supports #NVMe-over-#TCP for simpler, lower-latency shared block storage. Read more here...

39

5 Comments