AWS Budget
Introduction In the world of AWS, it’s easy to set up any infrastructure you want with a click, and because of this simple reason, it’s too easy to lose track of what you are currently running. The Story At DataChef, we have several AWS accounts for ...
DGL
Introduction Graph neural networks provide a more flexible paradigm for machine learning models by explicitly accounting for entities and their relationships through neural networks. For example, It is easier to model a real problem with graphs in so...
databrew
What is AWS Glue DataBrew Setting Up Datasets Projects Recipes Jobs Data Profiling Security Benefits Limitations Pricing Final Word It is well known in the Data Science world that building predictive models is a small part of a data scientist’s da...
GPT-2
Since their introduction in 2017, transformers have gotten more popular by day. They were initially proposed in the paper Attention Is All You Need. In Natural Language Processing, a transformer is a structure that helps perform the seq2seq tasks (te...
Training Instance
Like EC2 instances, Amazon offers a variety of instances for training in SageMaker. Based on CPU cores, memory size and presence of GPUs, they come with different on-demand prices. A complete list can be found at Amazon SageMaker Pricing Page. From m...
python shell
What is AWS CDK AWS CDK is a software development framework for defining cloud infrastructure in code and provisioning it through AWS CloudFormation. So before explaining more about CDK, let’s first elaborate more about Infrastructure as Code and Clo...
emr
What is Great Expectations Great Expectations is a great tool to validate the quality of your data and can be configured against a number of data sources, including BigQuery, MySQL, Snowflake and Athena. It helps you to test data instead of code. Let...
Style Transfer
StyleTransfer is a natural language processing solution developed in-kitchen by the machine learning team at DataChef. Stylometry The Da Vinci Code, Angels & Demons, The Lost Symbol, Inferno. They all start with Robert Langdon finding himself in a m...
AWS
Amazon CloudWatch is a monitoring and observability service. CloudWatch monitors your resources and the applications you run on AWS in real-time. You can use CloudWatch to collect and track metrics, which are variables you can measure for your resour...
kafka
Introduction Kafka producers and consumers are already decoupled in the sense that they do not communicate with one another directly; instead, information transfer happens via Kafka topics. But they are coupled in the sense that consumers need to kno...