Factspan’s Post

Aiming to become an expert in writing data from Snowpark DataFrames into Snowflake tables? Our latest blog post is here to help! Discover the best practices for writing modes, table types, and view creation methods to streamline and optimize your workflows, written by Lakshmi Haswitha Madupalli. Read up and expand your knowledge bank! 👉 https://bit.ly/3RjfEqF #Snowflake | #Data | #DataAnalysis | #Blog

Looking for a way to streamline your data pipeline and analytics? Look no further than Stitch! Our fully managed ETL pipeline can onboard data from over 140 sources, including Hubspot, MySQL, MongoDB, Google Analytics, and more with just a few clicks. Plus, we integrate with top platforms like Snowflake, Amazon Redshift, and BigQuery to take your data stack to the next level. Spend less time managing your data and more time analyzing it with Stitch's scheduling, maintenance, and data source management. Try Stitch today and see the difference for yourself! #dataanalytics #ETLpipeline #datamanagement #Stitch

Never lose important context for your #data again and ditch the cumbersome YAML comment files! 🤯 #SQLMesh's latest #release, 0.69, automatically registers comments and #metadata written in the model definition! 🥳 #bettertogether #metadatamanagement #datacleaning #blogpost https://lnkd.in/dJ2rk3Pa

Your specialty is writing #SQL not YAML + Jinja! #SQLMesh empowers you to write data pipelines with simply SQL. You can now propagate table and column descriptions with YAML. You can even get column level lineage and data contracts without YAML. Crazy right? The data industry has been stuck wrangling and managing config files for years but there's a better way! Finally there's a way to just write SQL.

This is pretty neat. A comment at the top of a SQL model automatically registers in the database as 'comment on table'... and a comment near a column in the model becomes 'comment on column' in the database. No need for a separate yml file + 'persist_docs' config. What do you think about this approach?

And we're up! Dynamic Tables for #DataVault on Snowflake, modified and tested a snapshot PIT table load (which outperforms the traditional PIT load - a customer deployed this new #SQL and turned the previous build time from 28 minutes to under 2 minutes!) Deploy that as a Dynamic Table to INCREMENTALLY build a SNAPSHOT PIT table instead. https://okt.to/XHAkIK

In this follow-up to the Snowflake Artic post, I delve into how Snowflake Artic's SQL expertise can serve as a valuable tool in syntax migration. Read the article below. https://lnkd.in/gtK7w24E #snowflake #snowflakeartic #llm #queryconversion #syntaxmigration

❄️ Snowflake Table Schema Evolution! ❄️ 🌟 This feature enables automatic updates to a table's schema, enhancing flexibility for new input data structures over time. 🚀 Explore my Medium post, featuring a quick 10-minute hands-on lab. Dive into creating and testing your first table with schema evolution enabled. 💡 Ideal for beginners! Find the SQL and CSV dataset in the GitHub repository. 🙏 Big thanks to Marianne Voogt for reviewing this Hands-On Lab before publication! Link: https://lnkd.in/eqmNH3Rf #DataEngineering #SchemaEvolution #DataManagement #TechForBeginners #Snowflake

Lyftrondata's exceptional job in data loader custom transformation from Postgres to SQL. Their innovative approach and seamless execution have set a new standard in data integration. ✨ Key Highlights: Precise and consistent data transformation Significantly reduced processing time and manual effort Immediate availability of data for analytical and BI purposes Lyftrondata continues to lead the way in data integration, making complex processes look effortless and delivering outstanding results. #DataTransformation #Lyftrondata #DataIntegration #Postgres #SQL #ETL #BigData #DataManagement #BusinessIntelligence #TechInnovation

I always thought Snowflake was just another data warehousing solution (what could be so different?), but it surprised me with some of its unique approaches to making ETL processes easier while maintaining efficiency and scale. It comes in handy for a current analytics project I have with one of the regional companies. I highly recommend this course!