Articles by Tag #bigquery

Browse our collection of articles on various topics related to IT technologies. Dive in and explore something new!

How to pass an Array of Structs in Bigquery's parameterized queries

In Google's Bigquery, SQL queries can be parameterized. If you're not familiar with this concept, it...

Learn More 12 2Oct 15 '24

Observability in Action: A Google Cloud Next demo

Quick run-down of one of the interactive demos that was presented at Next 2025, from the architecture to the products and features showcased.

Learn More 11 0May 5

Mastering Big Data with GCP: My Capstone Journey in Cloud Data Analysis

Introduction As a data enthusiast, I’ve always been fascinated by the power of cloud...

Learn More 6 0Mar 25

BigQuery's Capacity-Based Compute Pricing Model Explained

TL;DR BigQuery has two pricing models: On-demand, charging per byte processed, and...

Learn More 5 2Dec 9 '24

Loading data to Google Big Query using Dataproc workflow templates and cloud Schedule

Overview This project is designed to facilitate the ingestion of data from Google Cloud...

Learn More 3 0Sep 6 '24

Working with Gigantic Google BigQuery Partitioned Tables in DBT

The Problem When working with large tables (think TBs), I encountered a very serious...

Learn More 2 0Sep 20 '24

Taxi Drivers Efficiency Analysis with SQL & Tableau

I recently completed a hands-on SQL project using the Chicago Taxi Trips dataset on BigQuery, where I...

Learn More 2 1May 10

BigQuery's New JSON Functions: Struct vs. JSON - Choosing the Right Structure

BigQuery recently expanded its capabilities with new JSON helper functions, as seen on their release...

Learn More 2 0Aug 25 '24

A surprising thing about PyPI's BigQuery data

Moved to https://hugovk.dev/blog/2024/a-surprising-thing-about-pypis-bigquery-data/ You...

Learn More 2 0Nov 24 '24

My (Goofy) attempt on building a Flink BigQuery Source Connector

EDIT: So, I got told that post is probably way too long, and I fully agree. What I really suggest you...

Learn More 1 0Nov 18 '24

Streamline data transfer: The ultimate data integration guide SFTP to BigQuery

Link to original article written by Mage DevRel, Cole Freeman:...

Learn More 1 0Mar 7

Top 5 self-service BI solutions for BigQuery

What is Google BigQuery? Google BigQuery is a cloud service for processing large datasets,...

Learn More 1 0Dec 9 '24

Google Cloud, new APIs in your existing BigQuery projects | Quick Update

Google Cloud Update We’re writing to remind you that we are adding additional services to...

Learn More 1 0Apr 23

BigQuery’s Ridiculous Pricing Model Cost Us $10,000 in Just 22 Seconds!

Yes, you read that right. $10,000 burned in less than half a minute. Not because of inefficient...

Learn More 1 0Mar 26

Google’s Arcade Program - A Gateway to Creative Coding, Dev-ops, Sec Ops, and More.

In recent years, Google has ventured into the world of gaming and education through its Arcade...

Learn More 0 1Oct 9 '24

Chapter 5: The Unified Data Blueprint – Architecting Your Data Warehouse

Ever feel like your business is drowning in data but starving for wisdom? 🤔 You're not alone! Making...

Learn More 0 0May 17

Cloud Data Warehouse Comparison: Who’s the Real MVP?

Picking the right cloud data warehouse can feel a bit like trying to choose the best pizza...

Learn More 0 0Sep 24 '24

How to connect multiple data tools into a unified customer journey dashboard?

Hey dev/data folks I’m working on a project where we need to visualize the entire customer journey —...

Learn More 0 0Jun 9

Peer Review 2: Data Warehousing, Transformation, and Reproducibility in tfl-data-visualization (Part 2)

Welcome to the second part of my peer review series of the tfl-data-visualization project—a...

Learn More 0 0May 1

BigQuery

BigQuery é um serviço de análise de dados altamente escalável e rápido fornecido pela Google Cloud....

Learn More 0 0Dec 1 '24

Study Notes 2.2.7: Managing Schedules and Backfills with BigQuery in Kestra

Overview This study note covers the details from the video "DE Zoomcamp 2.2.7 - Manage...

Learn More 0 0Feb 4

Data Synchronization from Google BigQuery to ClickHouse in an AWS Air-Gapped Environment

Understanding the Key Components Airgap Environment An airgapped environment enforces strict...

Learn More 0 0Mar 6

Why do AWS dashboards keep breaking — and is there a better way?

We’ve been running dashboards on AWS — mainly using Redshift with Power BI — and honestly, it's been...

Learn More 0 1Jun 9

BigQuery Editions vs On Demand

These are some notes on the tradeoffs and best practices between On Demand pricing vs Editions...

Learn More 0 0Sep 5 '24

📊 Explorando tu facturación en Google Cloud con BigQuery (de forma sencilla)

¿Quieres tener visibilidad clara sobre en qué se va tu presupuesto en Google Cloud? Con BigQuery...

Learn More 0 0May 31

Embarking on the Big Query Quest: Exploring the Depths of its Inner Workings

BigQuery is a powerful serverless data warehouse solution available on Google Cloud Platform. It...

Learn More 0 0Sep 24 '24

Study Notes 5.6.3-4 Setting up a Dataproc Cluster & Connecting Spark to Big Query

Study Notes 5.6.3 - Setting Up a Dataproc Cluster in GCP 1. Introduction GCloud...

Learn More 0 0Mar 4

Study Notes 3.3.1: BigQuery Machine Learning (BQML)

Overview & Key Benefits Target Audience: Data analysts and managers No Python/Java...

Learn More 0 0Feb 11

Study Note 3.2.1: BigQuery Best Practices

Cost Reduction Strategies Column Selection Avoid using SELECT * Always specify required...

Learn More 0 0Feb 11

Study Note DE Zoomcamp 3.1.1 - Data Warehouse and BigQuery

Introduction This lecture covers data warehouses, with a focus on BigQuery. Topics...

Learn More 0 0Feb 11