Adi Polak articles - 50 total
Delta Lake essential Fundamentals: Part 2 - The DeltaLog
this blog post was originally posted on blog.adipolak.com. In the previous part, you learned what AC...
Delta Lake essential Fundamentals: Part 1 - ACID
Multi-part series that will take you from beginner to expert in Delta Lake. 🎉 Welcome to the first p...
Tech Exceptions Show: Accelerating Data Engineering with Azure
Data Engineers is the new hotness, many developers have been already working with distributed data te...
Tech Exceptions new Episode - The Importance of Testing data Applications
It was a true pleasure to have Angie Jones on the Microsoft Tech Exceptions show. Angie shared the T...
Tech Exceptions new Episode - Data Management and External Organization Collaboration
Remote work increases the chances of data breaches for organizations. A data breach is the intenti...
Apache Spark Ecosystem, Jan 2021 Highlights
If you've been reading here for a while, you know that I'm a big fan of Apache Spark and have been us...
Tech Exceptions new Episode -The Data Behind MLOps
Many times, when an organization is asked to add more ML-based features or products, they immediately...
Tech Exceptions new Episode - From Open Source to Multi B$$$ IPO
When JFrog started 12 years ago, they were built on the founders' open source project. They were amon...
Tech Exceptions new Episode - Stop wasting your time with Old-School Logging
🎙️ Jonah Kowall, CTO of Logz.io, joins Adi Polak to discuss his career path transition from engineeri...
![Panel Discussion: Data for Good [Create: Data]](https://media2.dev.to/dynamic/image/width=1000,height=420,fit=cover,gravity=auto,format=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fi%2Fqf0ml9dadxwi6jng5hkh.jpg)
Panel Discussion: Data for Good [Create: Data]
Panel: Data for Good Update! Few, what an experience, alright. Want to catch up with the...
![Driving a Data culture in a world of Remote Everything [Create: Data]](https://media2.dev.to/dynamic/image/width=1000,height=420,fit=cover,gravity=auto,format=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fi%2F6y81sw8vsr6irfm8i42n.jpg)
Driving a Data culture in a world of Remote Everything [Create: Data]
You know data is important to create a data-driven decision that will create value for you and your c...
![The Journey to Modern Warehousing [Create: Data]](https://media2.dev.to/dynamic/image/width=1000,height=420,fit=cover,gravity=auto,format=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fi%2Fd6ir2lliacrsz0nvgwa0.jpg)
The Journey to Modern Warehousing [Create: Data]
This is so very true, and just right on time for you to learn about Modern Data Warehousing. Pleas...
![Apache Spark and OSS Data Adventures [Create: Data]](https://media2.dev.to/dynamic/image/width=1000,height=420,fit=cover,gravity=auto,format=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fi%2Fdvf5dzymphaww3aujim2.jpg)
Apache Spark and OSS Data Adventures [Create: Data]
"For each input source, Spark Streaming launches receivers, which are tasks running within t...
Free Workshop on SQL Serverless
Free SQL Serverless Workshop On Dec 7th, I'll be hosting an hour workshop teaching you how...
Calling all Data Nerds
Happy to share that my colleagues are organizing a Data Week and I'm joining them for a panel to shar...
Tech Exceptions Show: Microsoft for Startups: Autonomous Driving Program
" Autonomous vehicles represent a digital transformation that will enable safer roads, efficient cit...
Tech Exceptions is Going Live
Today, I'm excited to share a project I've worked on for the last couple of months. An interview-base...
How to Build a Data Pipeline to enrich your data with PySpark and Sentiment Analysis
In this tutorial, you will learn how to enrich COVID19 tweets data with a positive sentiment score. Y...
The Future of Data Systems @ Microsoft Ignite 2020
I'm thrilled and super excited to be hosting this fantastic panel on the Future of Data Systems....
Becoming a Data Engineer
To become a data engineer, there are various skills and software to learn, but the basics are the sam...
Conferences: Online or Offline?
A post by Adi Polak
Spark & AI summit and a glimpse of Spark 3.0
If there is a framework that super excites me, it's Apache Spark. If there is a conference that excit...
Data Scientist or Machine Learning Engineer?
If you wish to work with data, there is a long list of titles you can require. The list of titles goe...
PySpark and Apache Spark Broadcast Mechanism
🐦 Follow me on Twitter, happy to take your suggestions on topics. Apache Spark is based on distri...
Simple Data Ingestion tutorial with Yahoo Finance API and Python
Clone the code ( and give us a star ) ➜➜ Tutorial Github Repo Data is everywhere; many companies...
Help! Hackers are mining my cloud for Bitcoin 😱
This is not a far fetch scenario; this actually happens to many cloud users; Experienced and newcomer...
Big Data from the Ground up
First thing first, what is Not Big Data? Basically, everything that can fit into one compu...
Apache Spark Accumulators, Simplified !
This is part of the series Apache Spark bitesize. Every post will take you less than 2 minutes to rea...
Introducing Azure Heroes with Blockchain-based badges
Are you an inclusive leader? content hero? community hero? mentor or maker? we would like to hear fro...
Kubernetes bitesize Q&A
Kubernetes bitesize series built for busy people. No more than 2 min read. Read it while waiting for...