Trending searches: how many episodes in platform 7
- Hi, I'm Tim Berglund with Confluent here in the desert of the United Arab Emirates. just outside Dubai, to tell you all about
Confluent Platform 7.0. (soft guitar music) You know, the big theme
in 7.0 is hybrid cloud. This is the thing that is
becoming more and more common. It's a little bit of
an obvious thing to say that people are migrating to the cloud. That's very well known, but about 55%, according to
a recent Forrester Survey, 55% of organizations are doing
hybrid cloud deployments. And there's a lot of
reasons for this, right? Your brand new event-driven
microservices application, that's a greenfield design. You know, that thing's pretty
easy to migrate to the cloud, or you probably built
it to run in the cloud in the first place, but there are a lot of legacy applications that you don't just pick up
and put in a cloud somewhere. Running those things, they may stay on-prem really
for the foreseeable future. So getting the data in your enterprise that lives in those legacy applications connected to the data that's in your newer cloud-native things, that's a real problem. That's something we're
trying to address with 7.0. Bridging legacy on-prem
things and cloud things, and even modernizing parts
of those legacy applications and migrating to the cloud, absolutely a mission
critical activity these days, but it's kind of hard. There are a few things
that get in the way. We often find these are situations where point-to-point integration
technologies might be things that get entrenched. And as we know, those are
one point to one point. They tend to proliferate into
the classical spaghetti mess of lots of point-to-point integrations. And that's hard to scale.
That's hard to maintain. It's just not a pleasant way to live. There can be batch processes that get data from the on-prem system into the cloud. And again, that's slow data,
you're behind, this is again, not a good way for these
systems to operate, not how we aspire for our
cloud transitions to work out. So what you're looking
for really is something that's of course, highly available, consistent, secure, and real-time, not an old school batch
integration technology, but something that's gonna let us operate our legacy on-prem things
and our cloud native future as one system that
behaves like one system, where the availability
of the data is the way it would be if we had
built it as one system. And the big news in 7.0 is
the general availability of Cluster Linking. This is a feature that's been in preview. It's GA now, and it's here. So that's going to enable the kinds of things I've been talking about. And also, here's another thing,
self-service access to data. And this is just a trend. It's
really just a Kafka thing. Once data is in a topic and
that topic is accessible, subject to data governance
concerns, other developers, other business units, other applications they
can get at that data in a self-serve way, not something that is
overly centrally controlled. And this allows new
application functionality, new business units, new ventures really to kind of emerge growing
up around that data. That's the dynamic we want. And of course you want
that from an operational, from a business perspective, as something that is not
so expensive to operate. So we'd like a low TCO
and that's something that Cluster Linking and
Confluent Platform 7.0 are gonna make a little bit easier. So generally available Cluster
Linking is the big news here, but we've got other
features to talk about. And as usual, they fit into
these three buckets, Everywhere, Cloud-Native and Complete. Let's take those one at a time, Under Everywhere is Cluster Linking. So let's dive into that in
a little bit more detail. I've been talking about
bridge to cloud as kind of the primary use case
for Cluster Linking, but don't forget also cluster migrations. If I've got data in one cluster
and I need simply to move it to another, this is a fine way to do that. This is a much better
way to do that, frankly. Because you've got a feature
operating at the broker level, that's making byte for byte
copies of messages and topics, it's just a bulletproof
way to do migrations. We've also got now source initiated links. So you don't have to be initiating the link on the destination. And sometimes networking
considerations like might be harder to poke a hole in a firewall
here rather than there. And you don't want to be
constrained to only be able to initiate from one side. So we've got source initiated
links to give you options there for networking. And those are always nice to have. The way this would have worked of course, in the old days is your
on-prem data and some kind of batch process that's going
to sort of do some nightly bulk extract and some transformations, and then loading into the new system. You know, the old school
ETL sort of thing. The way we would rather
have things work now with Cluster Linking is
that data being extracted from systems in real
time through Confluent and now available to
self-service consumers, that is new applications
that can read that data, do what they want with it in
a way it's simply available there in Confluent for them to consume. Now with Confluent Replicator,
we had offset preservation. Offset preservation is
absolutely essential for disaster recovery use cases, or really any hope of failing over, in some sense, an application
from one cluster to another, you have to have offsets preserved. Replicator is based,
based on Kafka Connect. There's a little bit of
extra infrastructure there. And then sort of a post-processing step where offsets are updated. Here now, with this slightly
better way of doing it at the broker level, offsets are natively preserved in that, in that replication
process from the beginning, in that byte for byte copy of the messages from source
to destination topic. So a little bit smoother, should
be a lot easier to operate. A lot easier to operate of course means lower cost to operate. So the business will be happy with this, and if you're the architect designing it or the operator running it, you're gonna be a lot happier with the simplified architecture. In the Cloud-Native
bucket we've got updates to Confluent for Kubernetes
and updates to KRaft. Let's talk about both of those. Confluent for Kubernetes
of course was a part of the previous Confluent
Platform release in the spring, but it now offers API level
support for connectors, schemas and cluster links. We're making such a big
deal about Cluster Linking. Of course, that needs to be supported so you can define your cluster links in YAML the way
you've always wanted to. And of course, now this can be deployed
in an automatic way in your Kubernetes cluster, if you're using Confluent for Kubernetes. And this is certified
to run in VMware Tanzu and Red Hat OpenShift,
of course should work in any CNCF conformant
Kubernetes distribution, but certainly Tanzu and
OpenShift are certified things, it's labeled on the tin. Those should work great. KRaft is kind of the emerging
name for the net effect of the work going on under KIP-500. KIP-500 is a massive effort in Apache Kafka to remove ZooKeeper. So ZooKeeper, if you don't know, is the separate distributed
system that maintains the metadata, you know,
to what topics consist of what partitions, where are
the partitions located? Where's the lead replica,
all that kind of stuff. And more. That's traditionally
been stored in ZooKeeper. No one loves operating ZooKeeper.
It's served faithfully. It's been a wonderful part
of the system, but it's not, it's a separate distributed
system that you have to run. And Kafka is pulling that
functionality into itself in its own custom raft implementation,
which is called KRaft. So you've got Kafka, Apache
Kafka 3.0 functionality. So the current state of KRaft as of AK 3.0 now in Confluent Platform 7. This is still a developer preview feature. If you want to know more about it, you should check out the Kafka 2.4 and Kafka 3.0 release videos that are out there on YouTube,
should not be hard to find. I dig into the current
state of those things a little bit more in those videos. It's developer preview, not ready for production yet, but if you've got the bandwidth, you really should be looking
at this because it's gonna be an important part of
how you operate Kafka. It will be a substantial improvement to the way you operate Kafka. So check it out. You'll be able to scale to
larger numbers of partitions. You'll be able to fail over nodes faster, all kinds of great
things will be going on. So definitely something to check out. Now under the complete bucket, we've got reduced infrastructure
mode for control center, and as always updates to ksqlDB. Now in the previous release
of Confluent Platform, we introduced Health+. That was a feature that would
allow your on-prem cluster to send metrics to the
cloud, to Confluent securely and we could do monitoring from there and intelligent alerting
and all things based on our experience in operating
Confluent Cloud, you know, we're sort of bringing that to you now as a feature of Confluent Platform, the monitoring and alerting and things that we have to do to
operate our cloud service, you get to kind of
participate in the technology behind that in your cluster. Well, reduced infrastructure
mode for C3 allows you to disable monitoring in
Control Center and offload it to a cloud-based service in Health+. So if you want to do your
monitoring without operating local infrastructure to support
it, you're now able to do so. That should be an
improvement to your life. A little bit of infrastructure
you don't have to manage. So if you're running your cluster on-prem, then monitoring can
become a cloud service. And in ksqlDB, we've got 0.21. Remember KC will DB operates
as an independent project. It's got its own website, ksqldb.io. Something that I strongly
recommend you check out. You should look at release 0.21 because that's what you've
got in Confluent Platform 7. So a couple of high points here. There are type system updates, there are always type system updates. You've got improvements in
the date and time types, which are very important types in any SQL. The other one, and this one kind of snuck up
on me is a foreign key joins. It's funny, 'cause the
joins that ksql's been doing have always been primary key joins. 1:1 joins. Now I can join, I can do a
1:N join on a foreign key. So that's, should be a powerful
thing and should unlock some new use cases and some
new capabilities for you to check out. There's more to say about ksql than that. Again, I want to direct
you to that website and the 0.21 release if you
want to find more details. So with that, stay in touch. These are the key links that you need. If you have questions, of course, if you're a customer you've got
existing support mechanisms. If you're not, if you just want to know more
there's forum.confluent.io. If you have questions about any
of these features or others, you can post there, somebody will get back with
you in fairly short order, it's a great place to get help and to interact with other people. You can always reach out in
Confluent Community Slack, lots of channels for you. And as always, I look forward
to hearing what you build. (soft guitar music)
There's many videos of uh blowups on sets there's the famous one with david o russell there's a famous one with chris bale and but i i don't know if people realize that you could have one from every movie that was ever made movie sets are by their nature tense places sure and a lot of that tension is... Read more
English humor i know to an american or at least this american it's just it's so um you don't get it you don't like it no no no it's just it's it's it goes from i would characterize it by saying it goes from like the best to the worst i mean when it's great monty python and i mean the beatles themselves... Read more
I mean you made press because you were on stephen coar show and he said something like um you guys at cnn just report the news straight and the crowd burst into laughter look i'm on cnn now i guess we're on it right now i mean they showed this show the next night i don't know how they i don't know how... Read more
Zeppelin ich entdeckt next generation ich glaube in friedrichen gibt so jeden fall am bodense museum guau ich gerade mal richtung innenstadt da ist ein riesen da ferre wieder raus nach meersburg da ist ein riesen riesenrad da ist auch der hafen so wie das aussieht genau logisch wenn br rausfrt ist da... Read more
Hallo zusammen heute sind wir in konstanz am bodensee jetzt war ich die ganze zeit auf der anderen seite eine woche fast tage genau und hat keinen einzigen berg gesehen von der schweiz und jetzt sehe ich da hinten endlich die höheren berge gute luft hier richtig gute luft so ein riesen springbrunden... Read more
He'll never leave and there are people on the right pushing the american conservative magazine he hasn't conceded the 2020 election yet what do you mean how you make it sound like it's a crazy idea he is not conceited the one who did lose it is a crazy idea think about it if that were the case wouldn't... Read more
First time ever on stage was the improv ever uh and i did well did you do well the first time that kind of tends to be the of course not how could you do well the first time because it's audition night and and the crowd is very generous and i don't know it was that seemed to be the the way it went that's... Read more
Males who become females participating in female sports where is that now are are they allowing it for well that's interesting um i had uh riley gaines here once she's the woman who uh made a stink as i think she had a very good right to about leah thomas i don't know if you know who that is he's the... Read more
My book is out now it's called what this comedian said will shock you and it's available now anywhere you get your books the one thing i miss is going up in a room full of strangers and winning that audience over that's the thing i hated the most i would get a student loan i would register and my parents... Read more
Kann man die peinlich und asozialste klingball aussage eigentlich noch toppen antwort ja wir stehen a christdemokraten in der ersten reihe unser europa gegen alle radikalen kräfte zu verteidigen das haben wir immer klar gemacht da können sich die menschen da drauf verlassen es ist unser europa adenauer... Read more