We implemented a data pipeline and used Snowflake tasks for orchestration. Immediately my mind started to think, how are we going to deploy this to the upper environments (QA and PROD)? The client does not have any automatic deployment, requires a QA Admin to deploy
One of the following Snowflake features or a third-party data integration tool (not shown) loads data continuously into a staging table: Snowpipe Snowpipe continuously loads micro-batches of data from an external stage location (Amazon S3, Google Cloud Storage, or Microsoft Azure) into a staging table.
✅ Looking up old versions of stored procedures must be done outside Snowflake. ✅ Consider keeping a master copy of each stored procedure’s CREATE PROCEDURE command in a source code control system. ✅ If a source code control system is not available, you can partly
Use SNOWFLAKE ORGANIZATIONS to simplify account management and billing, Database Replication and Failover/Failback, Snowflake Secure Data Sharing, and other account administration tasks. View, create, and manage all of your accounts across different regions and cloud platforms. Snowflake documentation – introduction A central view of all
Snowflake’s Secure Data Sharing is transformative to the world of data. What other platform, environment, or vendor can touch this? The World Is Going to Run On Snowflake! Gone are the days of old-school legacy slow, expensive, cumbersome, repetitive, and limiting transferring data. Snowflake enables
Here is an example of performance improvements we’ve obtained using Snowflake Clustering. The before join between a 9.4 TB, 35.4 billion row table with a 1.5 TB, 1.8 billion row table ran in 1:14:57 and costs $11.99 in compute credits. After clustering both tables, the
Take advantage of SNOWFLAKE role hierarchies to align access to database objects with business functions in your organization. ✅ In a role hierarchy, roles are granted to other roles to form an inheritance relationship. ✅ Permissions granted to roles at a lower level are inherited