Artificial intelligence is now part of our everyday tools and technology. Ability of the machines to learn and reason like human is groundbreaking. At the heart of the machine intelligence is the AI models. GPU (Graphics Processing Unit) is the main component to process large amount of data and build AI models. Jupyter Notebook is […]
GPU enabled JupyterHub on GKE Autopilot Read More »
Apache Airflow supports multiple database backends; PostgreSQL, MySQL and SQLite. However, SQLite is only recommended for the development purposes due to many limitations. That leaves PostgreSQL and MySQL as two options for Apache Airflow database backend for a production environment. When I started working on a framework using Apache Airflow, I chose MySQL as a
Apache Airflow Database Backend MySQL vs PostgreSQL Read More »
Apache Airflow is the most widely used workflow management platform. I have been building a workflow system using Apache Airflow for more than a year now. The system is required to support workflows that handle large amount of data and scale on-demand. Even though there is help and documentation available online, I ran into few
Apache Airflow optimizations Read More »
I started learning Python programming few years ago because of the overall Eco-system. It has variety of frameworks for almost all major use-cases. Every organization is using Python to implement a software, either in a cloud or on-prem. With the exceptional collaboration in open source communities, there are tools available to code every component of
Modern Python project structure Read More »
Pandas is very widely used Python library for data manipulation and analysis. It allows to load data in a tabular format to manipulate it for different analysis and graphical presentation. DataFrame is the key data structure in Pandas to perform tabular operations. First step while analyzing data with Pandas is to read a file and
Read data from Azure to Pandas Read More »
Software container is a lightweight executable that runs consistently on any infrastructure. It is an instance of software bundle called an image. The image is simply a bundle of operating system (OS) libraries and dependencies to run application code. Using OS virtualization, a platform provides the ability to instantiate container from the image. Docker is
GraphQL API using serverless container architecture Read More »
GraphQL is one of the most popular query and manipulation languages for APIs. There are various libraries to build GraphQL API in different programming languages. With the popularity of serverless architecture on cloud infrastructure, serverless GraphQL API is becomming more and more common. Azure does not offer any fully managed services such as AWS AppSync,
Serverless GraphQL API on Azure using Python Read More »
Python is one of the fastest growing programming languages and it ranks amongst the top programming languages. I have been programming for more than 20 years now, and my colleagues always talked about learning Python. When I started on my journey to add Python to my skills, I followed the steps listed here to become
Python programming language – Learn on your own Read More »