The 12-Factor App defines a methodology for developing and deploying web applications, especially SaaS (software-as-a-service) apps.
These best practices are based on a few specific parameters for deployment of cloud-native applications:
- It uses declarative formats for setup automation
- It works with a clean contract with the operating system for greater portability between environments
- It limits the difference between development and production, for continuous deployment
- And it allows for scaling up and down without significant changes to tooling, architecture, or development practices.
The 12-factor methodology is programming language agnostic and works with any combination of backing services.
Looking at the parameters for 12-Factor app, I chose microservice architecture to build an app using Python, Docker, Git, Cloud Build, Terraform, Pytest, Sphinx etc. So that it will be easily scalable, portable, deployable. …
CI/CD using GitHub Actions.
Introduction
Terraform is an infrastructure as a code tool that makes it easy to provision infrastructure on any cloud or on-premise. Terraform is a tool for building, changing, and versioning infrastructure safely and efficiently.
It is preferred by a lot of people over Cloud Deployment Manager, AWS Cloud Formation and Azure ARM templates for its simplicity to read and understand. It’s popularity is growing day by day.
GitHub Actions add continuous integration to GitHub repositories to automate your software builds, tests, and deployments. Automating Terraform with CI/CD enforces configuration best practices, promotes collaboration and automates the Terraform workflow.
I have seen many blogs, articles, documents on Automating Terraform using GitHub Actions on AWS or Azure. But there is no documents for Google Cloud. This tutorial will help you on Google Cloud. …
Terraform module to create Pub/Sub notifications for Google Cloud Storage.
Introduction
I have been working on Terraform for last one year. In couple of projects we had a requirement to “establish a flow of event notification from Google Cloud Storage to a Cloud Pub/Sub.”
As part of creating this flow, we need to:
- Create a Google Cloud Storage bucket
- Create a Cloud Pub/Sub topic
- In order to enable notification, a special cloud storage service account unique to each project must have the IAM permission “roles/pubsub.publisher”.
- Create notification configured for a bucket for multiple trigger events.
Same code we had to copy and paste in several places with change in bucket_name, topic_name and trigger_event. …
A Complete Guide for who wants to take HashiCorp Infrastructure Automation Certification.
The Terraform Associate certification is for Cloud Engineers specializing in operations, IT, or developers who know the basic concepts and skills associated with open source HashiCorp Terraform. Candidates will be best prepared for this exam if they have professional experience using Terraform in production, but performing the exam objectives in a personal demo environment may also be sufficient.
Training Guide and Recommendations
- Exam details and Exam objectives are available here.
- Complete the official study guide first
- Review the specific objective from the review guide
- Familiarize yourself with the sample exam questions
- Understand the Terraform Core workflow
- You can also enroll in a course from Udemy created by Zeal Vora for both learning Terraform and preparing for the official exam. …
Asynchronous communication in microservices
Introduction
In a world of Microservices where big application split into the loosely coupled services which can be developed, deployed and maintained independently. Microservices often don’t talk to each other via direct request/response, but rather asynchronously, allowing services to scale independently.
Asynchronous execution is a well-established way to reduce request latency and make you application more responsive. Both Cloud Tasks and Cloud Pub/Sub can be used to implement asynchronous execution.
In this blog, we’ll see which is right product for your use case.
What is Cloud Tasks?
Cloud Tasks is a fully managed service that allows you to manage the execution, dispatch and delivery of a large number of distributed tasks. …
Develop, Deploy, Secure and Manage API
Introduction
In Google Cloud Next 2020, new API management service has been introduced. Google Cloud API Gateway is a fully managed service that makes it easy for developers to create, publish, maintain, monitor and secure APIs. It acts as “Front Door” for an application deployed on backend service like Cloud Functions, Cloud Run and App Engine, Compute Engine and Google Kubernetes Engine.
In this tutorial, we are going to deploy Employee APIs endpoints in Cloud Function, Cloud Run and App Engine Standard environment with front end proxy by API Gateway. …
Authenticate using API Keys and Bearer Token.
Introduction
Just as organisations need services management for microservices, they need API management for their APIs.
With serverless services like Cloud Run, Cloud Functions and App Engine, it is very easy and quick to create APIs. However, Security, Monitoring, Publishing APIs are some of the major challenges.
In this blog, we will see how to secure API’s in Cloud Run, Cloud Functions and App Engine Standard environment using API Keys and Bearer Token.
What is Cloud Endpoints?
Cloud Endpoints is a distributed API management system. …
First Serverless compute service by Google Cloud.
Introduction
Google Cloud has always believed in the vision of serverless by debuting with Google App Engine in 2008, the first fully serverless compute service. Since then, Google has evolved more serverless offerings in both application development and analytics.
I started working in Google App Engine in May 2017 and I am going to share my experience with GAE.
The reason we chose Google App Engine is its fully managed, scalable, flexible, easy to use, quick to build and deploy code in to production.
We are working in agile and deliver microservices to production every 2 weeks thanks to GAE.
It is fascinating, unique piece of service Google is offering. …
Automatic document processing and entity extraction
Does your company have a lot of Documents / PDF files that your employees have to check and enter into the database manually?
Yes! Then, you are on the right blog!
Introduction
Most businesses are now sitting on Document goldmines. These documents are contracts, PDFs, emails, customer feedback, patterns. These documents are increasing over time.
Following are some example of the business which has millions of contract documents. They need to read these documents at a different times of their lifecycle for analyzing it. This needs a lot of processing time and error prone.
- Mortgage Providers
- Insurance Companies
- School
These are unstructured data. …
End-to-End IoT Solution in GCP
Introduction
In this post, we’ll simulate a collection of sensors data measuring device’s temperature. Data, once collected, will be accessible by users to:
- Store device’s temperature in real-time.
- Monitor the device’s temperature in real time.
- Perform analysis to extract insights.
- Get alerts on Mobile / Email.
Components
The following components are represented on the diagram:
- Temperature sensors are simulated by running IoT python client on Docker container.
- The sensors send temperature data to an IoT Core Registry running on GCP through MQTT protocol.
- The IoT Core Registry publishes it into a Cloud Pub/Sub Topic.
- A Streaming Dataflow pipeline is capturing the temperature data in real time by subscribing to and reading from the PubSub topic. …
About
