This year has indeed been a stressful one for many reasons. I empathize with anyone who has dealt with these issues. Many people have written about the pandemic, the election, Hong Kong, the economy, and everything else going on in the world. Right now, I want to take this opportunity to talk about something that really hits home for me.Continue reading “An Open Letter to Managers of Black Employees”
DISCLAIMER: Everything I write here is based on my own personal experiences growing up in a predominantly white, far-right conservative, evangelical environment in Texas. I will be making comments about my experience that may make people uncomfortable but please respect my story and my experiences. It would also be a good time for a gut check to see what makes you uncomfortable, the racism or the story about racism.
“So what are you?” That question has plagued me most of my life. People would often ask me that because they couldn’t easily discern my race. While my skin is darker, it is on the fairer side of dark. My head wasn’t comprised of the typical black curls that you see on black men. I didn’t have any “cultural indicators” that one could use to deduct my background. In the end, many have confused me for being Mexican, Indian, or Arab. This was something that I just accepted for most of my life.Continue reading “Navigating #BlackLivesMatter while Being Mixed Race”
When we are talking about Serverlesss Eventing, we are talking about more than products and technologies. We are talking about a platform and best practices. One thing that I have not been mentioning in my blog posts is the importance of an “Eventing Bus”.
An “Eventing Bus” is a publisher-subscriber style communication system. Its primary purpose is to be a liaison between services rather than having them communicate directly. Many people call this a “Message Bus” or “Message Queue” but since we are talking about eventing, we’ll call it an “Eventing Bus”. There are various benefits to using an Eventing Bus as I fully believe that it is important to the Serverless Eventing philosophy.
Earlier we described Serverless Eventing as a platform that utilizes the microservices architecture (as opposed to monolithic). This architecture gives us the leniency to give our developers the ability to use the right tool(s) for their service(s) and accelerate development by decoupling the services. The side-effect is that you will have tens if not hundreds or thousands of individual services.
Let’s say that you went on a two week vacation in Tokyo with ten friends. Everyone dispersed throughout the day, doing their own thing, but you want to hit up an izakaya with everyone at night. The original place you wanted to visit is closed so you need to find a new one. It is now your job to communicate the closure, determine a new place to meet, and figure out where everyone is so you can find something somewhat central. What’s the best way to communicate and plan this?
Do we want everyone to send a text to everyone else and try to coordinate that way? Imagine texting Sally to see where she wants to go then texting Jimmy to say Sally wants to go here and Jimmy says he’d rather go here but then you text Laura and she is on the other part of Tokyo and would rather get something halfway between the hotel and where she is. Laura then texts Bob to see if he has heard from you and what you think. You get the idea. How crazy would those threads of text look? Probably something like this:
Inevitably, something is going to be lost in communication and someone will show up to the wrong restaurant, arrive at the wrong time and so on. I bet many of you have applications like this today.
This could be your services if you used simply REST or gRPC to communicate with services. Each service is directly communicating with another service(s) and messages are sent back and forth. Many people choose this option and in some cases it’s a fine choice (more on that later). However, you are setting yourself up for failure if you are designing your modern application this way.
For one, how are you guaranteeing messages are sent and received? By default, many services will error out if the receiver can’t receive messages. It may also send a message assuming that receiver is there but it isn’t and that message is lost forever.
Another notion is scale of distribution. This example has me sending texts to nine individuals (clients). What happens when the clients scale to a hundred or a thousand? Can your service handle the workload needed to both send and receive messages at this scale? How will it handle blocking? Are you able to guarantee receipt? Are you able to guarantee the immutability of the message?
Order is also very important. When we are dealing with real-time events, the order of events is very important. Using the izakaya example, if we are talking about one place then 20 minutes later agree on a new place, it is important that you get the most recent information after the older information.
THERE HAS TO BE A BETTER WAY! Of course, the “Eventing Bus”. Let’s look at this a different way. Instead of directly texting people, we create a group chat in some kind of chat app such as WhatsApp. Everyone joins (subscribes) to the group chat (“Eventing Bus”). You send the message once, it’s received by everyone. You get little notifications for when the message is received and read. Replies are sent to the room. Every message is time stamped. Now our communication looks like this:
Our microservices should be structured in a similar way. We should be using an Eventing Bus. Now, I will say that Eventing Bus isn’t a panacea for messaging issues. There are still times when REST or gRPC are a valid solution. Here are key times when you should be using REST or gRPC over HTTP.
- Tight Coupling: The services need to know the existence of other services. This usually means that a service is implicitly sending to another service.
- Publicly Facing APIs: You are wanting to create an API that is internet accessible. Something like OpenID.
- Synchronous Messaging: If you need message A to finish before handling message B and so on, this is a great option.
Otherwise, when creating loosely coupled services, you should absolutely use an Eventing Bus. An Eventing Bus should give you these benefits.
- Loose Coupling: Your services do not need to explicitly know the existence of other services. The service performs its task, sends its output as a message to the bus, and you write another service to consume from the bus.
- Asynchronous Messaging: You do not need to wait for a response before processing a new message. This allows for more effective resource usage.
- Delivery Guarantee: Many message buses have protocols built into them to ensure that the message is received by its intended recipient at least once.
- Resilience: Since the services are sending messages to a bus, if a receiving service is broken, this doesn’t immediately cause the message to be lost. The message is stored in the bus and what the recipient service returns, it can then read the message and continue.
- Scalability: Using an Eventing Bus allows you to more efficiently add recipient services/clients to a smaller amount of sending services. You would simply add the new services as a subscriber to the Eventing Bus.
Now, I am not here to endorse a specific technology or brand over another. My policy is “the right tool for the job”. Depending on your team’s comfort level, existing investments, business requirements, etc. you will choose a tool that fits those needs.
- Google Cloud Pub Sub
- Apache Camel
- Amazon Kinesis
- Amazon SQS
- Azure Service Bus
The great news is that Knative Eventing allows you to use many existing buses as an event source. As mentioned in an earlier post, you can also use SinkBinding to define your event source. You can also write a custom event source. This allows you to turn your legacy messaging queue/bus into an Eventing Bus, ready for Serverless Eventing.
So if today you are building an app and want to adopt the freedom of Serverless Eventing, please give a great consideration to using these apps.
Knative Eventing offers a variety of EventSources to use for building a serverless eventing platform. In my previous blog post I talk about SinkBinding and we use this concept to create an EventSource the pulls Twitter data.Continue reading “Serverless Eventing: Modernizing Legacy Streaming with Kafka”
You are writing an applicaiton where you are trying to analyze tweets in near-real time for a live TV broadcast. A tweet sent 5 hours ago serves you no purpose in this context. How would you do this?
We need to create an application capable of collecting the events and sending them to be ingested, or consumed. This is the the Producer-Consumer Pattern. One process creates an event and transmits it while the other receives the event and does something with the data.Continue reading “Serverless Eventing: SinkBinding 101”
Let’s take a step back and define “Serverless Eventing”.
What is Serverless?
It is no secret that I love serverless computing. As you know, we have discovered a way to transmit data through condensation. We actually beam data into nimbostratus clouds and that’s where the compute and storage takes place. You experience outages when the sky is clear.Continue reading “Serverless Eventing: What is it anyway?”
“I want a data-driven organization!” We have all heard this in recent years haven’t we? Maybe it was at an All-Hands, maybe your manager, probably at a mixer in Silicon Valley somewhere. My healthcare provider told me about their new “data-driven matching”.Continue reading “Serverless Eventing: A Series”
With 2019 coming to an end, it has become clear that Hybrid Cloud and Muli-Cloud have become the buzzwords of the year.
It wasn’t that long ago that we were talking about getting everyone onto the cloud and now we are talking about bringing the cloud to their datacenters. The cloud was supposed to promise endless scaling, new technology and innovation, etc. Are we going backwards or is there something more happening?Continue reading “What the *bleep* is Multi/Hybrid-Cloud Anyway?”
In recent years I have noticed more and more people seem to be dropping the term “serverless”. It is up there with “Blockchain”, “Crypto”, and “Micro-services” in the trending tech nomenclature.
It makes sense why people would love it though. I mean I just pay for what I use. I don’t think about networks or storage or patching servers. I just write and deploy my code and all of the server operator work is abstracted away.Continue reading “The Promise of Cloud Compute is Serverless”
“Diversity in Tech”. This seems to have been a rallying cry in Silicon Valley as of the past few years. All of the major tech firms talk about their desire to hire more and more underrepresented groups.
Diversity in tech is very important for a variety of reasons. I mean over 75% of each group represented uses a smart phone. We can see similar numbers in broadband users. From a pure business perspective, one could see that it would make sense to have a workforce developing products that represent their user base.Continue reading “Framing of Diversity in Tech”