AWS
Introduction In today’s fast-paced technological landscape, businesses are afforded the opportunity to test out new business models for their clientele and witness immediate outcomes. Thanks to cutting-edge cloud technologies, such as AWS Cloud, both...
serverless
Introduction As you delve deeper into coding and your code becomes too heavy to run on your laptop, you may need to transfer your workload to a Cloud or High-Performance Computing (HPC) server. Computational Biology and Bioinformatics as a field have...
data analysis
What is Spatial Data? Spatial data, or geospatial data, refers to information about a physical object that numerical values can represent in a geographic coordinate system. Essentially, it’s the kind of data that tells you ‘where.’ It has long been u...
Data Product
The Problem Has anything like this ever happened to you? Developing three Spark applications to move 100 rows of Excel data through a pipeline? Developing a streaming pipeline but only receiving a few events per week? Spending several sprints on a...
AWS
If you are going to take the AWS Certified Machine Learning Specialty exam, you might have a lot of questions regarding the things you need to know before taking the $300 exam. I passed the exam in July 2022, and here I will be writing a comprehensiv...
AWS
Introduction Great Expectations(GE) allows us to oversee data pipelines and helps us to create data quality checks. In our previous post on running GE on EMR, we explored how to set up GE for your data pipeline and validate your data sources. Recentl...
Bias detection
Introduction In the previous article, we discussed why explaining machine learning (ML) models is as important as their performance and how it benefits all the stakeholders. Now, we are going to see what explainability and fairness of ML models requi...
Machine Learning
Why Serverless Machine Learning Inference? So now you have trained your machine learning model, and it works well; finally other people can use it. To make your model accessible to others, you need to deploy it on a server that gets the inputs and re...
KeyEncryption
Introduction As cloud storage of data becomes increasingly common, so does the need for data security. Data Encryption refers to the process of converting your data into a ciphertext so that only people (or groups) having access to a secret key or pa...
AWS
As a data science developer, I have seen several unsuccessful recommender system projects through my career. To be honest, developing a recommender system from scratch is not a simple project. Fortunately, all these failed projects show similar situa...
AWS
This year, AWS re:Invent was special in many ways. It was the first onsite re:invent after the pandemic forced the previous year’s conference to go virtual. Also, it was the first re:invent with new AWS CEO, Adam Selipsky delivering a keynote. AWS ma...
AWS
This year, AWS re:Invent was special in many ways, first onsite re:invent after the pandemic forced the previous year’s conference to go virtual and also the first re:invent with AWS new CEO, Adam Selipsky delivering a keynote. AWS made more than 120...