Machine Learning
Introduction If you’ve ever wondered how computers, which fundamentally understand only numbers, can grasp the intricacies of human language filled with words carrying complex meanings, you’re not alone. In this article, we dive deep into the world o...
What does Infrastructure as Code (IAC) mean? Infrastructure as Code (IAC) refers to the practice of managing and provisioning technology infrastructure using code and automation techniques. Instead of manually configuring servers, networks, and other...
Koalas
Introduction Pandas is one of the most widely used data manipulation libraries in Python, known for its ease of use and powerful functionality. However, as the data size grows, Pandas can become slow and memory-intensive. In this blog post, we will c...
Docker
Introduction The importance of efficient and scalable application deployments in the ever-changing technology landscape cannot be overstated. Docker and Kubernetes have emerged as leading solutions to meet these demands, providing businesses with str...
storage
Introduction In a previous post, we discussed how using serverless computing can assist life science researchers in analyzing their data in a more efficient and cost-effective manner. It also aids them in deploying their tools in a user-friendly way ...
AWS
Introduction In today’s fast-paced technological landscape, businesses are afforded the opportunity to test out new business models for their clientele and witness immediate outcomes. Thanks to cutting-edge cloud technologies, such as AWS Cloud, both...
serverless
Introduction As you delve deeper into coding and your code becomes too heavy to run on your laptop, you may need to transfer your workload to a Cloud or High-Performance Computing (HPC) server. Computational Biology and Bioinformatics as a field have...
data analysis
What is Spatial Data? Spatial data, or geospatial data, refers to information about a physical object that numerical values can represent in a geographic coordinate system. Essentially, it’s the kind of data that tells you ‘where.’ It has long been u...
Data Product
The Problem Has anything like this ever happened to you? Developing three Spark applications to move 100 rows of Excel data through a pipeline? Developing a streaming pipeline but only receiving a few events per week? Spending several sprints on a...
AWS
If you are going to take the AWS Certified Machine Learning Specialty exam, you might have a lot of questions regarding the things you need to know before taking the $300 exam. I passed the exam in July 2022, and here I will be writing a comprehensiv...
AWS
Introduction Great Expectations(GE) allows us to oversee data pipelines and helps us to create data quality checks. In our previous post on running GE on EMR, we explored how to set up GE for your data pipeline and validate your data sources. Recentl...
Bias detection
Introduction In the previous article, we discussed why explaining machine learning (ML) models is as important as their performance and how it benefits all the stakeholders. Now, we are going to see what explainability and fairness of ML models requi...