Posts

Showing posts with the label Pandas

Data Engineering Interview Preparation #1: Python, Pandas, SQL and DuckDB

Summary : Start your Data Engineering interview preparation with a practical Kaggle notebook covering Python, Pandas, SQL, DuckDB, data validation and Python/SQL result verification. If you are preparing for a Data Engineering interview, knowing Python and SQL syntax is only the beginning. You also need to understand how data moves through a workflow, how transformations are validated, and how to explain your technical decisions clearly. That is the purpose of Data Engineering Interview Preparation #1 , the first practical asset in my progressive Data Engineering interview-preparation series. This notebook is designed to give learners a low-friction starting point. It uses the Kaggle notebook environment and a small Sales Transactions dataset to connect Python, Pandas and SQL through practical examples. What You Will Learn In this first notebook , you will practice: Python variables and basic data types Lists, indexing, slicing and mutation Dictionaries and nested dicti...

Pandas Is Changing: Powerful Upgrades Data Science Professionals Should Know About

Image
Summary : Pandas has evolved significantly in recent versions, bringing major improvements in performance, safety, and usability. This blog post highlights important upgrades that can help you write faster, cleaner, and more reliable data analysis code. Introduction: Pandas Is Evolving Fast For more than a decade, Pandas has been the go-to library for data manipulation in Python. Most of us have built strong habits around DataFrames, along with workarounds for a few long-standing quirks. If you are new to Pandas, view the Pandas Tutorial video below. Learn Pandas using the Pandas Playbook (datasets and Python code designed for data analysts and ML engineers, from Beginner to Intermediate, to master essential Pandas operations). What many developers do not realize is that some of those old frustrations are now being actively removed. With version 2.0 and beyond, Pandas has introduced deeper architectural improvements that change how it handles memory, performance, a...