Have you ever wondered if it would ever be possible to time travel like in the old movies with a time machine? If we could go back in time and see the world, would we? If you asked me, I would have said yes! But not in the way that Hollywood portrays science fiction films. […]
Snowflake
Handling ever changing source schema issues using Python and Snowflake
The problem statement: An organization having a lot of FMCG products, conducts campaigns in various cities across India. The main aim of this campaign is to promote the products and collect feedback from the customers both existing and prospective ones. The data is collected in excel files and loaded to a centralized location in the […]
How to implement incremental loading in Snowflake using Stream and Merge
Snowflake is Cloud hosted relational database used to create Datawarehouse on demand. Data in the data warehouse can be loaded as full load or incremental load. The full load is a process of deleting whole existing data and reloading it again. Full loads are time and resource-consuming tasks compared to incremental loads that only load […]
Load Data From Amazon RDS to Snowflake Using Matillion ETL Tool
Amazon Relational Database Service, a service provided by Amazon Web Services, is a fully managed SQL database cloud service that allows you to create and operate relational databases. With Amazon RDS, one can access all the files and database anywhere in a cost-effective and highly scalable way. Snowflake is a cloud-based platform that helps data […]
Getting Started with Matillion ETL Tool
In this article, I will show you how you can set up your own Matillion instance, but before we get started let’s talk about the Matillion ETL tool. What is Matillion, and why should you care? Matillion is an ETL tool that is available on the Cloud Marketplace. It is completely cloud-based, billed at an […]
Best practices for securing Snowflake
Understanding best practices for securing Snowflake and having a concrete implementation plan is a critical Day Zero deliverable. Snowflake is a secure, cloud-based data warehouse. There are no hardware or software components to select, install, configure, or maintain. There is virtually no software to install, configure, or manage. Snowflake takes care of ongoing maintenance and […]
HIPAA compliance with Redshift
At Perficient, our Data Solutions team has worked closely with our Healthcare division to implement Redshift for HIPAA and HITECH compliance. Snowflake offers healthcare organizations a secure data warehouse environment with many HIPAA compliance features. Perficient’s implementation team includes Snowflake and health industry subject matter experts. We’ll take a look at Snowflake’s benefits for healthcare providers […]
HIPAA compliance with Snowflake
At Perficient, our Data Solutions team has worked closely with our Healthcare division to implement Snowflake for HIPAA and HITECH compliance. Snowflake offers healthcare organizations a secure data warehouse environment with many HIPAA compliance features. Perficient’s implementation team includes Snowflake and health industry subject matter experts. We’ll take a look at Snowflake’s benefits for healthcare providers […]
Time Travel with Snowflake and BigQuery
Hello friends, I am back with another interesting topic called “time travel.” I believe many of you wish you could go back in time and fix something. The idea of time travel was made possible in the fictional world of movies and books, including Aditya 369 (released during my teens), recent Marvel movies, and Tenet. […]
Cloning with BigQuery and Snowflake
Today I write my first blog with the hope of posting more in the future. I call myself as data enthusiast who likes to analyze and understand data in order to write my solutions because, ultimately, it’s the data that is critical for any application. Without further ado, let’s jump into the today’s topic—cloning on […]
Snowflake for the Modern Data Platform
As times have evolved, so have our data challenges — but we have been trying to solve it for ages. Giving it dedicated resources, robust hardware, etc. we still end up missing SLAs in our traditional On-Premise & Cloud-hosted worlds. Add to the fact the constant dependency on personnel to manage the data loads, data […]
Snowflake Data Marketplace and Snowsight an Overview
The Snowflake Data Marketplace facilitates business Users and data Engineers find and use their Snowflake accounts’ third-party data sets for querying. Enterprises can create new markets, reach newer customers for greater revenue, leveraging capabilities right from free data offers, subscription data to data services with value add to loads of Snowflake consumers. How does Snowsight […]