Devops

Exciting News: Introducing Our Tech News Aggregation Section! We’re thrilled to announce a major enhancement to Omer’s Tech Blog - our brand new news aggregation section is now live! What’s New in Our Newsfeed Our dedicated newsfeed section will now serve as your go-to source for the latest developments in the tech world, specifically curated for professionals working with: Kubernetes & Container Orchestration - Latest releases, security updates, and best practices Machine Learning & AI - Framework updates, research breakthroughs, and deployment strategies DevOps & Cloud Computing - Tool releases, AWS updates, and infrastructure innovations Software Development - Emerging technologies, programming languages, and development practices Why This Matters for You Curated Content: We filter through hundreds of sources to bring you the most relevant tech news Separate from Blog Posts: News updates won’t clutter your main blog reading experience Regular Updates: Fresh content delivered to keep you informed Expert Curation: Hand-picked by someone who understands your technical needs ...

Today, one of the easiest ways to ship logs from a Kubernetes cluster is by using Fluent Bit. Fluent Bit Fluent Bit is the lightweight sibling of Fluentd. It is written in C, uses fewer resources, and is a great fit for running as a DaemonSet in Kubernetes to ship pod logs. Fluent Bit also enriches logs it collects from pods in Kubernetes using a built-in filter called kubernetes, which adds the following information: Pod Name Namespace Container Name Container ID Pod ID Labels Annotations The first four are collected from the pod tag and the last three from the Kubernetes API server. The data is stored in Fluent Bit’s cache, so there isn’t a big overhead on the API server. These records are appended to each log collected from the pods, making them easier to search. ...

Recently I’ve joined a project with real time machine learning inference. The project was set to run on Kubernetes 1.12 on AWS while development and training was made on-premise, and some were made using Docker. When the application was deployed to production we started to see poor performance and began to investigate. It was weird, on the developers machines and in docker everything worked faster. After debugging it for a while I understood that the jvm doesn’t see all available cores inside the pod. while searching for some solutions I found that when running java 8 with and adding some extra JVM_OPTS along with all the rest of the opts it would solve my issue. So I’ve added it to the deployment.yaml file and deployed it again. ...

Overview In this post, I am going to describe how to maintain access to Amazon AWS EKS - Kubernetes cluster with only attaching an IAM Role as an instance profile, without configuring access keys on the EC2 instance. The benefit of course is not storing any Amazon IAM credentials on the EC2 instance, having your infrastructure more secure. Use Case: Jenkins CI/CD Pipeline In my use case, I wanted to have my Jenkins CI server have access to EKS cluster for adding continuous delivery using Jenkins declarative pipeline to my continuous integration process. By doing that, I achieved a full CI/CD process for all the microservices that Jenkins handled. ...