Snowflake

Snowflake’s Stream Stream Stream is a CHANGE DATA CAPTURE methodology in Snowflake; it records the DML changes made to tables, including (Insert/Update/delete). When a stream is created for a table, it will create a pair of hidden columns to track the metadata.   create or replace stream s_emp on table emp append_only=false;   I have […]

Recently, the news broke that Optimizely acquired Netspring, a warehouse-native analytics platform. I’ll admit, I hadn’t heard of Netspring before, but after taking a closer look at their website and capabilities, it became clear why Optimizely made this strategic move. Simplifying Omnichannel Analytics for Real Digital Impact Netspring is not just another analytics platform. It […]

SNOWFLAKE’S SNOWPIPE Snow pipe: snow pipe is a one of the data loading strategies in snowflake , for continuous data loading, will create a snow pipe to load the data from any data source or storage or any cloud to snowflake tables, its an event trigger ideology whenever a file came to the source immediately […]

Joining the Crew Let’s face it.  Data projects are laced with problems. I have been in data my entire career and I love these challenges. 15 years in the industry has exposed me to first-hand digital transformation and cloud migrations.  At Perficient, we face challenges like this often and we embrace them with a strong […]

Data Warehouse/ETL Testing Data warehouse testing is a process of verifying data loaded in a data warehouse to ensure the data meets the business requirements. This is done by certifying data transformations, integrations, execution, and scheduling order of various data processes. Extract, transform, and load (ETL) Testing is the process of verifying the combined data […]

Reflecting on Summit At the Snowflake Summit, a strong commitment to AI was emphasized. Both Snowflake and NVIDIA have made strides in building their AI capabilities. The rise of AI, particularly generative AI, has been a prominent topic at cloud tech conferences over the past year. As a former Snowflake employee and current customer, I’m […]

See you at Summit! Snowflake’s Data Cloud Summit is being held in San Francisco, CA at the Moscone Center from June 3rd-6th. This conference brings together the best and brightest folks from all around the globe for an intuitive week of content on the Snowflake platform and its innovative use cases surrounding AI. Learn how […]

In this blog post, we’ll dive into two powerful features of Snowflake: Snowpipe and Streams. Both Snowpipe and Streams are crucial components for real-time data processing and analytics in Snowflake. We’ll explore what each feature entails and how they can be leveraged together to streamline data ingestion and analysis workflows, harnessing the Power of Snowflake’s […]

In the realm of data management and analytics, the terms ETL (Extract, Transform, Load) and ELT (Extract, Load, Transform) have been commonplace for decades. They describe the processes involved in moving data from one system to another, transforming it as needed along the way. However, with the advent of technologies like Salesforce Data Cloud, a […]

Imagine a world where we can skip Extract and Load, just do our data Transformations connecting directly to sources no matter what data platform you use? Salesforce has taken significant steps over the last 2 years with Data Cloud to streamline how you get data in and out of their platform and we’re excited to […]

In today’s ever-changing world, data is essential for every kind of organization, customer, or business. These days, most businesses use cloud storage to store data that is recoverable, quickly available, and safe. Users always want upgrades and the most recent technology to apply to their applications. Users won’t be able to obtain continuous data updates […]

Introduction AWS Glue is a fully managed ETL service from AWS which provides flexibility to work with both Snowflake tables and S3 files. AWS Glue Python shell allows to use additional python libraries (In our case, snowflake-connector-python) which helps in retrieval of data from snowflake and to run the queries directly in Snowflake with Snowflake […]