Published inITNEXTExponential Back-off Implemented in the form of an API Mount Adapter ClassA Reusable/Extendable Utility Class to Automate API Ingestion into Data Lake at Scale using Control TheoryJun 12, 2022Jun 12, 2022
Published inITNEXTAutomate generating an Avro Schema from a Spark DataframeA helpful script to translate your Spark Schema to Avro format which enables Producing Data into KafkaMay 10, 20222May 10, 20222
AWS Best Practices: Consuming .yaml Secrets File in an ApplicationIn production environments secrets for connecting to AWS or any other services which require credentials are handled through injection of…Jun 21, 2021Jun 21, 2021
Data is the new oil! Tools of Data Collection: 10.000 ft view of AWS Data Collection ServicesThe main intent in writing this article is to introduce the reader to AWS services used for Data Collection. I aim to provide general…Sep 7, 2020Sep 7, 2020
Django + GCP App Engine Deployment, the Proper Way.App Engine is very versatile so is Django! In this article I want to share with you common problems I have face when deploying a Django…Jul 27, 2020Jul 27, 2020
Apache Spark MLlib & Ease-of Prototyping With DockerThe core operational capabilities and how to launch a cluster instantly using just one commandJul 9, 20201Jul 9, 20201
