Shubham

In this article, we will discuss how to create a column based on certain conditions in a pandas DataFrame. Table of Contents Preparing DataSet Method 1: Using numpy.where function Method 2: Using numpy.select() function Method 3: Using custom function Method 4: Using List Comprehension Summary Preparing DataSet To quickly get started, let’s create two sample […]

In this article, we will discuss how to join two pandas DataFrames based on multiple columns. We are going to use pandas.merge function and will cover different scenarios as below. Table of Contents Merge without any column keys mentioned Merge with column keys mentioned Merge with different column keys Summary To quickly get started, let’s

The combination of pandas groupby() and sum() function comes in handy multiple times in data science to summarize any statistics or feature engineering. In this article, we will look at how to use these functions together. Table of Contents Preparing DataSet Using pandas groupby and sum for all columns Using pandas groupby and sum for

In this article, we will discuss different methods to load multiple csv files into one pandas DataFrame. Table Of Contents Preparing DataSet Method 1: Using For Loop Method 2: Using the map() function Method 3: Using the dask library Summary Preparing DataSet To get started, we have created a few sample csv files in the

For every typical data-related project, we always need to filter our data based on certain conditions. Sometimes, including these conditions makes our code flow a little messy. Here, operator chaining is an important technique to reduce the number of code lines by chaining or combining multiple statements together. In this article, let’s look at multiple

In scenarios, where either we need to apply some statistical or ML models, we always hear that we need to normalize the data before fitting the models. Normalization is transforming the numerical variables to a certain scale and distribution. Additionally, there are multiple types of normalizing, we are going to discuss mean normalization (as highlighted

In this article, we will discuss multiple scenarios to get the index column name in pandas DataFrame. Table of Contents Preparing Dataset for solution Get Index Column name in DataFrame Get index name in MultiIndex DataFrame Summary Preparing Dataset for solution To quickly get started, let’s create a sample dataframe to experiment. We’ll use the

In this article, we will discuss multiple ways to reset index in a pandas DataFrame. Table of Contents Preparing Dataset Reset index of DataFrame using the index property Reset index of DataFrame using reset_index() function Reset index of DataFrame using set_index() function Summary Preparing Dataset To quickly get started, let’s create a sample dataframe to

In this article, we will discuss multiple ways to add an empty column to a pandas DataFrame. Table of Contents Preparing Dataset for solution Using Assignment operator Using assign() function Using insert() function Using reindex() function Summary Preparing Dataset for solution To quickly get started, let’s create a sample dataframe to experiment. We’ll use the

Multiple times while processing data, it is important to extract specific columns and store them in a new DataFrame. In this article, we will cover multiple ways to achieve that. Table of Contents Preparing Dataset Select subset of columns using copy() function Select subset of columns using filter() function Select subset of columns using drop()