Skip to main content


Abstract Colorful Glow Light Trail With Blue Red Particles Background.

Dynamic Merge in Snowflake using Stored Procedure and Python – For SCD Type 2

Pre-requisite Before going through SCD Type 2, I would suggest visiting my earlier post with respective to SCD Type  1 in here for better understanding of this blog. Dynamic Merge in Snowflake using Stored Procedure and Python – For SCD Type 1 / Blogs / Perficient SCD Type 2 It helps in tracking the history […]

Digital Screen With Cloud Computing And Abstract Glowing Circular Background. Security And Protection Data Cloud. Big Data Safe. Database Storage, 3d Render.

Catch Perficient thought leaders at Snowflake Summit 2023!

Ready? Set? Snowflake Summit!  Snowflake Summit kicks off the summer season in the heart of Las Vegas, NV at Caesars Palace from June 26th – 29th!   Summit is all about bringing data professionals together to discuss and present new ideas encompassing the ever–evolving data industry.  Learn how to access, build and monetize your data while […]

Team Of Young Coworkers Work Together At Night Office.young Woman Using Smartphone At The Table.horizontal.blurred Background.

SCD-2 ETL Data Pipeline from S3 to Snowflake using Informatica Cloud (IICS)

What is a Data warehouse? A Data warehouse is a concept that aggregates data from different sources into a single, central, consistent data store to provide meaningful business insights. It is typically used to connect and analyze heterogeneous sources of business data. To move data from one or more sources to the data warehouse, ETL […]

Istock 1366415101

SnowPipe: A Feature of Snowflake to Load Continuous Data

Introduction In this blog, we will discuss Snowpipe, a very important feature of Snowflake. SnowPipe allows you to automatically load data as soon as files appear in a particular bucket. When new files are added to the bucket, they are automatically loaded into the specified table. This is especially important when it comes to transactional […]

Two programmers working on some coding together

Snowflake Best Practices for Data Engineering

We often end up creating a problem while working on data. So, here are few best practices for data engineering using Snowflake: 1. Transform your data incrementally: A common mistake novice data engineers make is writing huge SQL statements that join, aggregate, and process many tables, misunderstanding that this is an efficient way to work. […]

Abstract colorful grid surrounded by glowing particles

Dynamic Merge in Snowflake using Stored Procedure and Python – For SCD Type 1

Creating Snowflake Account We can create a 30-day free trial account using below link. SCD Type 1 In short, keeps the latest the latest data only and old data is overwritten. SCD Type 1 in Snowflake Let us consider we have a scenario to load the data into Target table from the Source table. […]


 Creating a Matillion account: Guide

Let’s Begin!!! The creation of your Matillion ETL Journey There are two ways to create matillion instance. Matillion Account Snowflake Partner Connect First, create a Matillion Free Trail account on Matillion Hub here. (Note: Matillion account required organization domain ID. It will not allow a free domain ID like or Matillion will send you a […]

Istock 903569480 (5)

Cloud Migration using Denodo Data Virtualization

Many companies are moving their IT infrastructure to the cloud because of various reasons like minimized IT requirements, physical data storage, cost, accessibility, quick deployments, consolidation, controllability, increased productivity, efficiency and security. Cloud migration is a complex process, and it may lead to negative business impacts if the correct migration strategy and best practices are […]

Group of web developers working in an office.

Feature of Snowflake: Zero Copy Cloning

                                                                      Feature of Snowflake: Zero-Copy Cloning Zero Copy Cloning in Snowflake: Snowflakes have some advanced feature like Time Travel, zero-copy cloning […]

Istock 613347676

Feature of Snowflake: Time Travel

                                                                    Snowflake: Snowflake’s data cloud is powered by advanced data platform provided as software as a service.  Snowflake enables data storage, processing, […]

Traditional Software Engineering, Cmmi And Its Problems


Have you ever wondered if it would ever be possible to time travel like in the old movies with a time machine? If we could go back in time and see the world, would we? If you asked me, I would have said yes! But not in the way that Hollywood portrays science fiction films. […]


Handling ever changing source schema issues using Python and Snowflake

The problem statement: An organization having a lot of FMCG products, conducts campaigns in various cities across India. The main aim of this campaign is to promote the products and collect feedback from the customers both existing and prospective ones. The data is collected in excel files and loaded to a centralized location in the […]

Load More