☀️ Happy Friday. This week we have six new articles about data engineering but not only! From Back Market learning on Delta Lake to Reddit rex on recommendation.
Back Market — Subscriptions on a Delta Lake
Back Market engineering explains how they used Delta Lake to get data from production and then push it to Snowflake or S3.
Do we need new editor for SQL analysts?
Robert Yi asserts that IDE are not the future of SQL analytics and propose a solution with his new company to fix this. He started prequel.ai in order to help closing the gap.
Fivetran for collection in the Modern Data Stack
We all read the Modern Data Stack article from dbt CEO Tristan Handy (if not, go now!). Here Fivetran tries to write a small summary about this matter.
State of reverse ETL
A nice articles filled with charts on with market share of reverse ETL tools. We see that Snowflake and BigQuery have trully taken the lead in integrations regarding source, and for destination at least 40% of the tools are used for CRM.
Tips and tricks to setup your PostgreSQL as a DWH
Imagine a world where Snowflake and BigQuery does not exist. In this world you will need to configure your Postgres to act like a data warehouse, this article deep dives in the Postgres configuration to tune this perfectly. I like the Partitioning tip!
ML Friday, the Reddit journey on recommendation
Reddit shared their journey on from no recommendation to 100 billion recommendations a day. They speak about feature store and model feedback loop to improve predictions. A must read!
Join the newsletter to receive the latest updates in your inbox.