#spark
Read more stories on Hashnode
Articles with this tag
Custom Log4J for Spark on Glue to decrease CloudWatch cost! · Introduction In today's cloud-centric computing environment, managing costs while ensuring...
It all started from a change in the checkpoint path of our Spark applications. We use Spark Structured streaming and AWS S3 buckets to maintain...
Overview In this post, we are going to review how to run a Spark application, as a single node Fargate task. If you are familiar with Spark and its...
Overview In this article, we will talk about the second-ugliest exception in the history of programming and attempt to handle it in our Spark apps. If...
Introduction Kafka producers and consumers are already decoupled in the sense that they do not communicate with one another directly; instead,...
