pandas.apply(): Apply a function to each row/column in Dataframe
In this article we will discuss how to apply a given lambda function or user defined function or numpy function to each row or column in a dataframe.
Python’s Pandas Library provides an member function in Dataframe class to apply a function along the axis of the Dataframe i.e. along each row or column i.e.
|
1 |
DataFrame.apply(func, axis=0, broadcast=None, raw=False, reduce=None, result_type=None, args=(), **kwds) |
Important Arguments are:
- func : Function to be applied to each column or row. This function accepts a series and returns a series.
- axis : Axis along which the function is applied in dataframe. Default value 0.
- If value is 0 then it applies function to each column.
- If value is 1 then it applies function to each row.
- args : tuple / list of arguments to passed to function.
Let’s use this to apply function to rows and columns of a Dataframe.
Suppose we have a dataframe i.e.
|
1 2 3 4 5 6 7 8 9 10 11 |
# List of Tuples matrix = [(222, 34, 23), (333, 31, 11), (444, 16, 21), (555, 32, 22), (666, 33, 27), (777, 35, 11) ] # Create a DataFrame object dfObj = pd.DataFrame(matrix, columns=list('abc')) |
Contents of the dataframe in object dfObj are,
|
1 2 3 4 5 6 7 |
a b c 0 222 34 23 1 333 31 11 2 444 16 21 3 555 32 22 4 666 33 27 5 777 35 11 |
Apply a lambda function to each row or each column in Dataframe
Suppose we have a lambda function that accepts a series as argument returns a new series object by adding 10 in each value of the
given series i.e.
|
1 |
lambda x : x + 10 |
Now let’s see how to apply this lambda function to each column or row of our dataframe i.e.
Apply a lambda function to each column:
To apply this lambda function to each column in dataframe, pass the lambda function as first and only argument in Dataframe.apply()
with above created dataframe object i.e.
|
1 2 3 4 5 |
# Apply a lambda function to each column by adding 10 to each value in each column modDfObj = dfObj.apply(lambda x : x + 10) print("Modified Dataframe by applying lambda function on each column:") print(modDfObj) |
Output:
|
1 2 3 4 5 6 7 8 |
Modified Dataframe by applying lambda function on each column: a b c 0 232 44 33 1 343 41 21 2 454 26 31 3 565 42 32 4 676 43 37 5 787 45 21 |
As there were 3 columns in dataframe, so our lambda function is called three times and for each call a column will passed as argument to
the lambda function as argument. As, our lambda function returns a copy of series by infringement the value of each element in given column by 10. This returned series replaces the column in a copy of dataframe.
So, basically Dataframe.apply() calls the passed lambda function for each column and pass the column contents as series to this lambda function. Finally it returns a modified copy of dataframe constructed with columns returned by lambda functions, instead of altering original dataframe.
Apply a lambda function to each row:
Now, to apply this lambda function to each row in dataframe, pass the lambda function as first argument and also pass axis=1 as second argument in Dataframe.apply() with above created dataframe object i.e.
|
1 2 3 4 5 |
# Apply a lambda function to each row by adding 5 to each value in each column modDfObj = dfObj.apply(lambda x: x + 5, axis=1) print("Modified Dataframe by applying lambda function on each row:") print(modDfObj) |
Output:
|
1 2 3 4 5 6 7 8 |
Modified Dataframe by applying lambda function on each row: a b c 0 227 39 28 1 338 36 16 2 449 21 26 3 560 37 27 4 671 38 32 5 782 40 16 |
So, basically Dataframe.apply() calls the passed lambda function for each row and passes each row contents as series to this lambda function. Finally it returns a modified copy of dataframe constructed with rows returned by lambda functions, instead of altering original dataframe.
Apply a User Defined function with or without arguments to each row or column of a Dataframe
Suppose we have a user defined function that accepts a series and returns a series by multiplying each value by 2 i.e.
|
1 2 3 |
# Multiply given value by 2 and returns def doubleData(x): return x * 2 |
Now let’s see how to apply this user defined function to each column of our data frame i.e.
|
1 2 3 4 5 |
# Apply a user defined function to each column by doubling each value in each column modDfObj = dfObj.apply(doubleData) print("Modified Dataframe by applying a user defined function to each column in Dataframe :") print(modDfObj) |
Output:
|
1 2 3 4 5 6 7 8 |
Modified Dataframe by applying a user defined function to each column in Dataframe : a b c 0 444 68 46 1 666 62 22 2 888 32 42 3 1110 64 44 4 1332 66 54 5 1554 70 22 |
Similarly we can apply this user defined function to each row instead of column by passing an extra argument i.e.
|
1 2 |
# Apply a user defined function to each row by doubling each value in each column modDfObj = dfObj.apply(doubleData, axis=1) |
Suppose we have a user defined function that accepts other arguments too. For example, this function accepts a series and a number y then
returns a new series by multiplying each value in series by y i.e.
|
1 2 3 |
# Returns x*y def multiplyData(x, y): return x * y |
Now let’s see how to apply this user defined function with argument to each column of our data frame i.e.
|
1 2 3 4 5 |
# Apply a user defined function to each column that will multiply each value in each column by given number modDfObj = dfObj.apply(multiplyData, args=[4]) print("Modified Dataframe by applying a user defined function (with arguments) to each column in Dataframe :") print(modDfObj) |
Output:
|
1 2 3 4 5 6 7 8 |
Modified Dataframe by applying a user defined function (with arguments) to each column in Dataframe : a b c 0 888 136 92 1 1332 124 44 2 1776 64 84 3 2220 128 88 4 2664 132 108 5 3108 140 44 |
Similarly we can apply this user defined function with argument to each row instead of column by passing an extra argument i.e.
|
1 2 |
# Apply a user defined function to each row by doubling each value in each column modDfObj = dfObj.apply(multiplyData, axis=1, args=[3]) |
Apply a numpy functions to a to each row or column of a Dataframe
Generally in practical scenarios we apply already present numpy functions to column and rows in dataframe i.e.
Now let’s see how to apply a numpy function to each column of our data frame i.e.
|
1 2 3 4 5 |
# Apply a numpy function to each column by doubling each value in each column modDfObj = dfObj.apply(np.square) print("Modified Dataframe by applying a numpy function to each column in Dataframe :") print(modDfObj) |
Output:
|
1 2 3 4 5 6 7 8 |
Modified Dataframe by applying a numpy function to each column in Dataframe : a b c 0 49284 1156 529 1 110889 961 121 2 197136 256 441 3 308025 1024 484 4 443556 1089 729 5 603729 1225 121 |
Similarly we can apply a numpy function to each row instead of column by passing an extra argument i.e.
|
1 2 |
# Apply a numpy function to each row by square root each value in each column modDfObj = dfObj.apply(np.sqrt, axis=1) |
Apply a Reducing functions to a to each row or column of a Dataframe
Till now we have applying a kind of function that accepts every column or row as series and returns a series of same size. But we can also call the function that accepts a series and returns a single variable instead of series. For example let’s apply numpy.sum() to each column in dataframe to find out the sum of each values in each column i.e.
|
1 2 3 4 5 |
# Apply a numpy function to get the sum of values in each column modDfObj = dfObj.apply(np.sum) print("Modified Dataframe by applying a numpy function to get sum of values in each column :") print(modDfObj) |
Output:
|
1 2 3 4 5 |
Modified Dataframe by applying a numpy function to get sum of values in each column : a 2997 b 181 c 115 dtype: int64 |
Now let’s apply numpy.sum() to each row in dataframe to find out the sum of each values in each row i.e.
|
1 2 3 4 5 |
# Apply a numpy function to get the sum of values in each row modDfObj = dfObj.apply(np.sum, axis=1) print("Modified Dataframe by applying a numpy function to get sum of values in each row :") print(modDfObj) |
Output:
|
1 2 3 4 5 6 7 8 |
Modified Dataframe by applying a numpy function to get sum of values in each row : 0 279 1 375 2 481 3 609 4 726 5 823 dtype: int64 |
Complete example is as follows:
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 |
import pandas as pd import numpy as np # Returns x*y def multiplyData(x, y): return x * y # Multiply given value by 2 and returns def doubleData(x): return x * 2 def main(): # List of Tuples matrix = [(222, 34, 23), (333, 31, 11), (444, 16, 21), (555, 32, 22), (666, 33, 27), (777, 35, 11) ] # Create a DataFrame object dfObj = pd.DataFrame(matrix, columns=list('abc')) print("Original Dataframe", dfObj, sep='\n') print('************* Apply a lambda function to each row or each column in Dataframe *************') print('*** Apply a lambda function to each column in Dataframe ***') # Apply a lambda function to each column by adding 10 to each value in each column modDfObj = dfObj.apply(lambda x : x + 10) print("Modified Dataframe by applying lambda function on each column:") print(modDfObj) print('*** Apply a lambda function to each row in Dataframe ***') # Apply a lambda function to each row by adding 5 to each value in each column modDfObj = dfObj.apply(lambda x: x + 5, axis=1) print("Modified Dataframe by applying lambda function on each row:") print(modDfObj) print('************* Apply a User Defined function to each row or each column in Dataframe *************') print('*** Apply a user defined function to each column in Dataframe ***') # Apply a user defined function to each column by doubling each value in each column modDfObj = dfObj.apply(doubleData) print("Modified Dataframe by applying a user defined function to each column in Dataframe :") print(modDfObj) print('*** Apply a user defined function to each row in Dataframe ***') # Apply a user defined function to each row by doubling each value in each column modDfObj = dfObj.apply(doubleData, axis=1) print("Modified Dataframe by applying a user defined function to each row in Dataframe :") print(modDfObj) print('************* Apply a User Defined function (with Arguments) to each row or each column in Dataframe *************') print('*** Apply a user defined function ( with arguments ) to each column in Dataframe ***') # Apply a user defined function to each column that will multiply each value in each column by given number modDfObj = dfObj.apply(multiplyData, args=[4]) print("Modified Dataframe by applying a user defined function (with arguments) to each column in Dataframe :") print(modDfObj) print('*** Apply a user defined function ( with arguments ) to each row in Dataframe ***') # Apply a user defined function to each row by doubling each value in each column modDfObj = dfObj.apply(multiplyData, axis=1, args=[3]) print("Modified Dataframe by applying a user defined function (with arguments) to each row in Dataframe :") print(modDfObj) print('************* Apply a numpy function to each row or each column in Dataframe *************') # Apply a numpy function to each column by doubling each value in each column modDfObj = dfObj.apply(np.square) print("Modified Dataframe by applying a numpy function to each column in Dataframe :") print(modDfObj) # Apply a numpy function to each row by square root each value in each column modDfObj = dfObj.apply(np.sqrt, axis=1) print("Modified Dataframe by applying a numpy function to each row in Dataframe :") print(modDfObj) print('************* Apply a reducing function to each column or row in DataFrame *************') # Apply a numpy function to get the sum of values in each column modDfObj = dfObj.apply(np.sum) print("Modified Dataframe by applying a numpy function to get sum of values in each column :") print(modDfObj) # Apply a numpy function to get the sum of values in each row modDfObj = dfObj.apply(np.sum, axis=1) print("Modified Dataframe by applying a numpy function to get sum of values in each row :") print(modDfObj) if __name__ == '__main__': main() |
Output:
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 |
Original Dataframe a b c 0 222 34 23 1 333 31 11 2 444 16 21 3 555 32 22 4 666 33 27 5 777 35 11 ************* Apply a lambda function to each row or each column in Dataframe ************* *** Apply a lambda function to each column in Dataframe *** Modified Dataframe by applying lambda function on each column: a b c 0 232 44 33 1 343 41 21 2 454 26 31 3 565 42 32 4 676 43 37 5 787 45 21 *** Apply a lambda function to each row in Dataframe *** Modified Dataframe by applying lambda function on each row: a b c 0 227 39 28 1 338 36 16 2 449 21 26 3 560 37 27 4 671 38 32 5 782 40 16 ************* Apply a User Defined function to each row or each column in Dataframe ************* *** Apply a user defined function to each column in Dataframe *** Modified Dataframe by applying a user defined function to each column in Dataframe : a b c 0 444 68 46 1 666 62 22 2 888 32 42 3 1110 64 44 4 1332 66 54 5 1554 70 22 *** Apply a user defined function to each row in Dataframe *** Modified Dataframe by applying a user defined function to each row in Dataframe : a b c 0 444 68 46 1 666 62 22 2 888 32 42 3 1110 64 44 4 1332 66 54 5 1554 70 22 ************* Apply a User Defined function (with Arguments) to each row or each column in Dataframe ************* *** Apply a user defined function ( with arguments ) to each column in Dataframe *** Modified Dataframe by applying a user defined function (with arguments) to each column in Dataframe : a b c 0 888 136 92 1 1332 124 44 2 1776 64 84 3 2220 128 88 4 2664 132 108 5 3108 140 44 *** Apply a user defined function ( with arguments ) to each row in Dataframe *** Modified Dataframe by applying a user defined function (with arguments) to each row in Dataframe : a b c 0 666 102 69 1 999 93 33 2 1332 48 63 3 1665 96 66 4 1998 99 81 5 2331 105 33 ************* Apply a numpy function to each row or each column in Dataframe ************* Modified Dataframe by applying a numpy function to each column in Dataframe : a b c 0 49284 1156 529 1 110889 961 121 2 197136 256 441 3 308025 1024 484 4 443556 1089 729 5 603729 1225 121 Modified Dataframe by applying a numpy function to each row in Dataframe : a b c 0 14.899664 5.830952 4.795832 1 18.248288 5.567764 3.316625 2 21.071308 4.000000 4.582576 3 23.558438 5.656854 4.690416 4 25.806976 5.744563 5.196152 5 27.874720 5.916080 3.316625 ************* Apply a reducing function to each column or row in DataFrame ************* Modified Dataframe by applying a numpy function to get sum of values in each column : a 2997 b 181 c 115 dtype: int64 Modified Dataframe by applying a numpy function to get sum of values in each row : 0 279 1 375 2 481 3 609 4 726 5 823 dtype: int64 |
Python Recommendations:
C++ & C++11 Recommendations:
If you didn't find what you were looking, then do suggest us in the comments below. We will be more than happy to add that.
Do Subscribe with us for more Articles / Tutorials like this,
Excellent post: it was very helpful to me!