Insights into Data Observability, FinOps, and automated quality monitoring from the experts at Masthead Data.https://mastheadata.comhttps://mastheadata.com/blog/how-bigquery-fluid-autoscaling-eliminates-the-scale-down-latency-taxhttps://mastheadata.com/blog/how-bigquery-fluid-autoscaling-eliminates-the-scale-down-latency-taxIf you run BigQuery on GCP at scale, you are likely familiar with the challenge of capacity management. To keep query performance predictable while…Fri, 17 Jul 2026 00:00:00 GMTteam@mastheadata.com (Max Ostapenko)https://mastheadata.com/blog/understanding-and-managing-projects-with-heavy-data-processing-p-2https://mastheadata.com/blog/understanding-and-managing-projects-with-heavy-data-processing-p-2Beyond basic optimization lies a realm of advanced techniques that can significantly enhance BigQuery’s performance and cost-efficiency. This section…Thu, 27 Nov 2025 00:00:00 GMTteam@mastheadata.com (Yuliia Tkachova)https://mastheadata.com/blog/understanding-and-managing-projects-with-heavy-data-processing-p-1https://mastheadata.com/blog/understanding-and-managing-projects-with-heavy-data-processing-p-1In today’s data-driven landscape, managing BigQuery costs while maintaining performance has become a critical challenge for organizations of all sizes. As…Thu, 27 Nov 2025 00:00:00 GMTteam@mastheadata.com (Yuliia Tkachova)https://mastheadata.com/blog/mastering-bigquery-cost-optimizationhttps://mastheadata.com/blog/mastering-bigquery-cost-optimizationIn a recent LinkedIn Live session, Yuliia, CEO and co-founder of MastHead Data, talked about rising challenge facing data teams today: the rising costs of…Thu, 27 Nov 2025 00:00:00 GMTteam@mastheadata.com (Yuliia Tkachova)https://mastheadata.com/blog/bigquery-ad-hoc-usage-projectshttps://mastheadata.com/blog/bigquery-ad-hoc-usage-projectsBigQuery’s on-demand billing model offers a flexible and cost-effective solution for ad-hoc querying needs. However, understanding and managing projects…Thu, 27 Nov 2025 00:00:00 GMTteam@mastheadata.com (Yuliia Tkachova)https://mastheadata.com/blog/pricing-editionshttps://mastheadata.com/blog/pricing-editionsBigQuery Editions offer a flexible approach to data warehousing and analytics, catering to organizations of all sizes and with diverse workloads. The…Thu, 27 Nov 2025 00:00:00 GMTteam@mastheadata.com (Yuliia Tkachova)https://mastheadata.com/blog/data-products-and-all-the-fluff-aroundhttps://mastheadata.com/blog/data-products-and-all-the-fluff-aroundAt Big Data London, I attended a talk by an executive from a large corporation that is known worldwide. What caught my attention from the very beginning…Thu, 27 Nov 2025 00:00:00 GMTteam@mastheadata.com (Yuliia Tkachova)https://mastheadata.com/blog/google-bigquery-compute-cost-optimizationhttps://mastheadata.com/blog/google-bigquery-compute-cost-optimizationThis article is part of BigQuery Cost Optimization Series. Here is a Previous Article about GBQ Storage Cost.Thu, 27 Nov 2025 00:00:00 GMTteam@mastheadata.com (Yuliia Tkachova)https://mastheadata.com/blog/bigquery-storage-cost-structure-a-deep-dive-into-optimizationhttps://mastheadata.com/blog/bigquery-storage-cost-structure-a-deep-dive-into-optimizationHere is our first article from the BigQuery Cost Optimisation series.Thu, 27 Nov 2025 00:00:00 GMTteam@mastheadata.com (Yuliia Tkachova)https://mastheadata.com/blog/how-to-choose-between-bigquery-on-demand-and-editionshttps://mastheadata.com/blog/how-to-choose-between-bigquery-on-demand-and-editionsMasthead, a data reliability platform, presents new cost optimization feature for Google BigQuery optimization. This solution helps businesses reduce…Thu, 27 Nov 2025 00:00:00 GMTteam@mastheadata.com (Yuliia Tkachova)https://mastheadata.com/blog/building-self-service-data-platform-on-google-cloud-stack-insights-from-andrew-joneshttps://mastheadata.com/blog/building-self-service-data-platform-on-google-cloud-stack-insights-from-andrew-jonesThanks to C2C Global, I had a very interesting conversation with the one and only, Andrew Jones. This speaker boasts massive expertise in the data domain.…Thu, 27 Nov 2025 00:00:00 GMTteam@mastheadata.com (Yuliia Tkachova)https://mastheadata.com/blog/bigquery-cost-optimization-guidehttps://mastheadata.com/blog/bigquery-cost-optimization-guideAt Masthead, we monitor every interaction in our clients’ Google BigQuery using logs and metadata. This precise, real-time monitoring empowers us to…Thu, 27 Nov 2025 00:00:00 GMTteam@mastheadata.com (Yuliia Tkachova)https://mastheadata.com/blog/masthead-is-soc2-complianthttps://mastheadata.com/blog/masthead-is-soc2-compliantTo be frank with you, as a technical founder, I couldn’t fully appreciate this before. We built Masthead specifically not to access clients’ data – we…Mon, 10 Nov 2025 00:00:00 GMTteam@mastheadata.com (Yuliia Tkachova)https://mastheadata.com/blog/start-from-data-productshttps://mastheadata.com/blog/start-from-data-productsDisclaimer: At Masthead we engage and work with numerous data teams across different industries, domains, and sizes. All of them are way beyond average in…Mon, 03 Nov 2025 00:00:00 GMTteam@mastheadata.com (Yuliia Tkachova)https://mastheadata.com/blog/how-to-run-dbt-airflow-on-google-cloudhttps://mastheadata.com/blog/how-to-run-dbt-airflow-on-google-cloudHey there! It’s Sergey, co-founder and CTO at Masthead Data. With the recent changes in pricing for the dbt Cloud version, I realized there might be a…Mon, 20 Oct 2025 00:00:00 GMTteam@mastheadata.com (Sergii Tkachov)https://mastheadata.com/blog/bigquery-storage-costs-confident-recommendations-perspectivehttps://mastheadata.com/blog/bigquery-storage-costs-confident-recommendations-perspectiveFor businesses aiming to streamline data usage, managing cloud storage costs is crucial. Understanding billing models and optimization opportunities is…Mon, 06 Oct 2025 00:00:00 GMTteam@mastheadata.com (Yuliia Tkachova)https://mastheadata.com/blog/data-observability-for-streaming-data-lessons-from-handling-30000-events-per-minute-per-tablehttps://mastheadata.com/blog/data-observability-for-streaming-data-lessons-from-handling-30000-events-per-minute-per-tableThere’s endless debate about what constitutes real-time data versus micro-batch versus batch processing. I used to think I understood real-time…Fri, 26 Sep 2025 00:00:00 GMTteam@mastheadata.com (Yuliia Tkachova)https://mastheadata.com/blog/uniqness-of-log-based-data-observabilityhttps://mastheadata.com/blog/uniqness-of-log-based-data-observabilityLast year we won the client from SQL-first solution and successfully migrated them to Masthed.Sun, 14 Sep 2025 00:00:00 GMTteam@mastheadata.com (Yuliia Tkachova)https://mastheadata.com/blog/dbt-vs-dataformhttps://mastheadata.com/blog/dbt-vs-dataformThanks to C2C Global, I continue participating in discussions with the best data specialists in the industry. Quite recently, I dived into the concept of…Wed, 27 Nov 2024 00:00:00 GMTteam@mastheadata.com (Yuliia Tkachova)https://mastheadata.com/blog/data-observability-painkiller-or-vitaminhttps://mastheadata.com/blog/data-observability-painkiller-or-vitaminData observability is one of my favorite topics in the data domain. During a recent discussion organized by C2C Global, I had an opportunity to talk about…Tue, 03 Sep 2024 00:00:00 GMTteam@mastheadata.com (Yuliia Tkachova)https://mastheadata.com/blog/exploring-the-benefits-of-bigfunctions-for-bigquery-a-data-engineers-perspectivehttps://mastheadata.com/blog/exploring-the-benefits-of-bigfunctions-for-bigquery-a-data-engineers-perspectiveData engineers working with complex BigQuery-based data platforms and environments face numerous challenges due to the overwhelming number of processes…Fri, 26 Jul 2024 00:00:00 GMTteam@mastheadata.com (Yuliia Tkachova)https://mastheadata.com/blog/bigquery-compute-on-demand-or-editions-what-is-betterhttps://mastheadata.com/blog/bigquery-compute-on-demand-or-editions-what-is-betterNo answer fits all sizes and all businesses. However, from what we’ve observed, if we’re talking about reasonably predictable compute consumption, Editions (slot model) can be a better option.Mon, 15 Jul 2024 00:00:00 GMTteam@mastheadata.com (Yuliia Tkachova)https://mastheadata.com/blog/why-pipeline-observability-is-an-integral-part-of-data-platform-reliabilityhttps://mastheadata.com/blog/why-pipeline-observability-is-an-integral-part-of-data-platform-reliabilityIt is great that the data industry has moved beyond the notion that data quality equals data observability and data reliability. If you still find the…Wed, 03 Jul 2024 00:00:00 GMTteam@mastheadata.com (Yuliia Tkachova)https://mastheadata.com/blog/data-contracts-with-jean-georges-perrinunlocking-data-magichttps://mastheadata.com/blog/data-contracts-with-jean-georges-perrinunlocking-data-magicAmong the experts in the field of data management, Jean-Georges Perrin (JGP) is undoubtedly one of my favorites to converse with. As the founder of the…Fri, 07 Jun 2024 00:00:00 GMTteam@mastheadata.com (Yuliia Tkachova)https://mastheadata.com/blog/whats-new-in-data-my-reflection-on-google-cloud-next-24https://mastheadata.com/blog/whats-new-in-data-my-reflection-on-google-cloud-next-24Disclaimer: The thoughts and observations expressed are my own. They are based on numerous discussions with Google Cloud Product team members, users…Thu, 25 Apr 2024 00:00:00 GMTteam@mastheadata.com (Yuliia Tkachova)https://mastheadata.com/blog/data-transformations-insights-on-dataform-dbt-in-bigqueryhttps://mastheadata.com/blog/data-transformations-insights-on-dataform-dbt-in-bigqueryThrough the nature of my work, I engage in conversations not only with practitioners but also with pioneers—early adopters and optimists who are highly…Tue, 02 Apr 2024 00:00:00 GMTteam@mastheadata.com (Yuliia Tkachova)https://mastheadata.com/blog/yalos-cost-management-blueprint-elevating-google-bigquery-efficiency-with-masthead-datahttps://mastheadata.com/blog/yalos-cost-management-blueprint-elevating-google-bigquery-efficiency-with-masthead-dataAbout Yalo: Yalo is a conversational commerce software company that allows businesses to connect with their customers and enhance their outreach and sales…Sat, 10 Feb 2024 00:00:00 GMTteam@mastheadata.com (Yuliia Tkachova)https://mastheadata.com/blog/why-are-cloud-prices-growinghttps://mastheadata.com/blog/why-are-cloud-prices-growingA recent survey by CloudZero shows that 6 out of 10 organizations spend more than expected on cloud services. And these organizations will likely have to…Mon, 25 Dec 2023 00:00:00 GMTteam@mastheadata.com (Yuliia Tkachova)https://mastheadata.com/blog/why-data-teams-need-to-adopt-product-thinkinghttps://mastheadata.com/blog/why-data-teams-need-to-adopt-product-thinkingLet’s start from the basics. Data products are one of the key concepts of Data Mesh, which emphasizes that data can be a product internal to or external…Sat, 16 Dec 2023 00:00:00 GMTteam@mastheadata.com (Yuliia Tkachova)https://mastheadata.com/blog/how-logs-and-metadata-alone-ensure-data-platform-reliabilityhttps://mastheadata.com/blog/how-logs-and-metadata-alone-ensure-data-platform-reliabilityWhen we think about software observability, the first companies that come to mind are Datadog, New Relic, and Splunk. The value they deliver to…Wed, 06 Dec 2023 00:00:00 GMTteam@mastheadata.com (Yuliia Tkachova)https://mastheadata.com/blog/data-observability-vs-software-observabilityhttps://mastheadata.com/blog/data-observability-vs-software-observabilityWhat differentiates data observability from software observability? Let’s delve into the differences and similarities.Wed, 11 Oct 2023 00:00:00 GMTteam@mastheadata.com (Yuliia Tkachova)https://mastheadata.com/blog/masthead-data-achieves-google-cloud-ready-bigquery-designationhttps://mastheadata.com/blog/masthead-data-achieves-google-cloud-ready-bigquery-designationToronto, 8.29.2023 Masthead Data announced that it has successfully achieved Google Cloud Ready – BigQuery Designation.Fri, 29 Sep 2023 00:00:00 GMTteam@mastheadata.com (Yuliia Tkachova)https://mastheadata.com/blog/masthead-and-google-cloud-marketplacehttps://mastheadata.com/blog/masthead-and-google-cloud-marketplaceWe are excited to announce that Masthead Data is available on the Google Cloud Marketplace so you can use your pre-committed GoogleCloud credits to…Thu, 21 Sep 2023 00:00:00 GMTteam@mastheadata.com (Yuliia Tkachova)https://mastheadata.com/blog/masthead-data-achieves-google-cloud-ready-cloud-sql-designationhttps://mastheadata.com/blog/masthead-data-achieves-google-cloud-ready-cloud-sql-designationToronto, 08.29.2023 Masthead Data today announced that it has successfully achieved Google Cloud Ready – Cloud SQL Designation for Cloud SQL, Google…Mon, 11 Sep 2023 00:00:00 GMTteam@mastheadata.com (Yuliia Tkachova)https://mastheadata.com/blog/optimizing-google-bigquery-costs-strategies-for-data-engineers-in-a-cloud-driven-economyhttps://mastheadata.com/blog/optimizing-google-bigquery-costs-strategies-for-data-engineers-in-a-cloud-driven-economyCompanies have experienced such turbulence over the past three years that despite the continued uncertainty as to whether we’re actually in a recession…Mon, 10 Jul 2023 00:00:00 GMTteam@mastheadata.com (Yuliia Tkachova)https://mastheadata.com/blog/how-to-secure-your-looker-reports-and-dashboards-from-bad-datahttps://mastheadata.com/blog/how-to-secure-your-looker-reports-and-dashboards-from-bad-dataTo be sure that your data-driven business practices aren’t based on incomplete or corrupt data, it’s crucial to establish data reliability. Masthead’s…Tue, 30 May 2023 00:00:00 GMTteam@mastheadata.com (Yuliia Tkachova)https://mastheadata.com/blog/building-a-data-mesh-without-moving-data-using-dataplexhttps://mastheadata.com/blog/building-a-data-mesh-without-moving-data-using-dataplexAccording to Exploding Topics, 328.77 million terabytes of data are created each day, and this growth will, most probably, speed up over time.Sun, 07 May 2023 00:00:00 GMTteam@mastheadata.com (Yuliia Tkachova)https://mastheadata.com/blog/choosing-among-bigquery-pricing-modelshttps://mastheadata.com/blog/choosing-among-bigquery-pricing-modelsGoogle’s BigQuery is one of the most widely used data warehouse solutions in the world, with a market share of 13.21% in 2022 according to 6Sense.…Wed, 05 Apr 2023 00:00:00 GMTteam@mastheadata.com (Yuliia Tkachova)https://mastheadata.com/blog/wayfairs-journey-to-data-meshhttps://mastheadata.com/blog/wayfairs-journey-to-data-meshWayfair is a global marketplace platform and one of the most notable players in the $800B+ home goods market. The Wayfair marketplace boasts more than 22…Tue, 14 Mar 2023 00:00:00 GMTteam@mastheadata.com (Yuliia Tkachova)https://mastheadata.com/blog/maximizing-data-trust-through-data-observabilityhttps://mastheadata.com/blog/maximizing-data-trust-through-data-observabilityData-driven decision making has become a crucial aspect of running a successful business in the digital age. In order to stay competitive, it is essential…Thu, 29 Dec 2022 00:00:00 GMTteam@mastheadata.com (Yuliia Tkachova)https://mastheadata.com/blog/no-trust-without-data-reliability-no-privacy-without-data-integrityhttps://mastheadata.com/blog/no-trust-without-data-reliability-no-privacy-without-data-integrityBack in the late 90s, I was a so-called “webmaster”. One of my many responsibilities included website availability and performance for a dozen brands. We…Sun, 18 Sep 2022 00:00:00 GMTteam@mastheadata.com (Yuliia Tkachova)https://mastheadata.com/blog/what-is-data-as-a-product-and-what-to-consider-implementing-ithttps://mastheadata.com/blog/what-is-data-as-a-product-and-what-to-consider-implementing-itIn this blog post, we unfold the ‘data as a product’ principle of Data Mesh and elaborate on why product thinking is so essential for data, and how to…Sat, 20 Aug 2022 00:00:00 GMTteam@mastheadata.com (Yuliia Tkachova)https://mastheadata.com/blog/what-is-data-mesh-architecture-when-do-you-need-to-start-implementing-data-mesh-architecturehttps://mastheadata.com/blog/what-is-data-mesh-architecture-when-do-you-need-to-start-implementing-data-mesh-architectureData mesh architecture is revolutionizing the way organizations handle data. This guide offers a comprehensive look at its benefits, challenges, and how…Fri, 15 Jul 2022 00:00:00 GMTteam@mastheadata.com (Yuliia Tkachova)https://mastheadata.com/blog/best-data-engineering-practices-for-ensuring-high-data-qualityhttps://mastheadata.com/blog/best-data-engineering-practices-for-ensuring-high-data-qualityIn the modern-day, useful and useless data can be the deciding factor between making the right or wrong decision in business. So much so that particularly…Tue, 12 Jul 2022 00:00:00 GMTteam@mastheadata.com (Yuliia Tkachova)https://mastheadata.com/blog/journey-to-a-data-meshhttps://mastheadata.com/blog/journey-to-a-data-meshThanks to C2C Global, I got an opportunity to have an insightful conversation with Amy Raygada. A data solution integration manager with over 13 years of…Wed, 22 Jun 2022 00:00:00 GMTteam@mastheadata.com (Yuliia Tkachova)https://mastheadata.com/blog/reducing-qualitative-errors-with-the-soundex-functionhttps://mastheadata.com/blog/reducing-qualitative-errors-with-the-soundex-functionNaming deviations and manual entry errors such as typos and spelling mistakes are time sinks that data engineers spend their time working around. How many…Mon, 06 Jun 2022 00:00:00 GMTteam@mastheadata.com (Yuliia Tkachova)https://mastheadata.com/blog/how-to-improve-data-quality-with-gcp-protocol-buffershttps://mastheadata.com/blog/how-to-improve-data-quality-with-gcp-protocol-buffersE-commerce platforms and marketplaces generate data on every step of their operations: inventory, customer orders, pick-up locations, and customer delivery, not to mention marketing channels and integrations.Fri, 03 Jun 2022 00:00:00 GMTteam@mastheadata.com (Yuliia Tkachova)https://mastheadata.com/blog/how-important-data-quality-for-machine-learninghttps://mastheadata.com/blog/how-important-data-quality-for-machine-learningMachine learning and artificial intelligence are some of the most rapidly developing industries in the entire world right now. The global machine learning…Wed, 18 May 2022 00:00:00 GMTteam@mastheadata.com (Yuliia Tkachova)