Pandas Tutorial

Last modified on: October 19, 2024

<h2>Pandas Tutorial - A Comprehensive Guide to Data Manipulation in Python</h2>
<div class="flex-shrink-0 flex flex-col relative items-end">
<div>
<div class="pt-0">
<div class="gizmo-bot-avatar flex h-8 w-8 items-center justify-center overflow-hidden rounded-full">
<div class="relative p-1 rounded-sm flex items-center justify-center bg-token-main-surface-primary text-token-text-primary h-8 w-8">Learn how to use Pandas for data manipulation and analysis in Python. This tutorial covers DataFrames, data importing, exploration, manipulation, and exporting, making it ideal for beginners.</div>
</div>
</div>
</div>
</div>
<div class="group/conversation-turn relative flex w-full min-w-0 flex-col agent-turn">
<div class="flex-col gap-1 md:gap-3">
<div class="flex max-w-full flex-col flex-grow">
<div class="min-h-[20px] text-message flex w-full flex-col items-end gap-2 whitespace-normal break-words [.text-message+&amp;]:mt-5" dir="auto" data-message-author-role="assistant" data-message-id="0314fa4b-1128-4068-890d-0327baff720d">
<div class="flex w-full flex-col gap-1 empty:hidden first:pt-[3px]">
<div class="markdown prose w-full break-words dark:prose-invert light">
<h3>Pandas Tutorial Overview</h3>
<p>Pandas is a powerful and widely-used data manipulation and analysis library in Python. It provides data structures like Series and DataFrames that make it easy to work with structured data. This tutorial will guide you through the basics of Pandas, including data structures, data manipulation, and basic operations.</p>
<h4>1. <strong>Installing Pandas</strong></h4>
<p>To get started with Pandas, you need to install it if you haven't already:</p>
<div class="dark bg-gray-950 contain-inline-size rounded-md border-[0.5px] border-token-border-medium relative">
<div class="flex items-center text-token-text-secondary bg-token-main-surface-secondary px-4 py-2 text-xs font-sans justify-between rounded-t-md h-9">bash</div>
<div class="sticky top-9 md:top-[5.75rem]">
<div class="absolute bottom-0 right-2 flex h-9 items-center">
<div class="flex items-center rounded bg-token-main-surface-secondary px-2 font-sans text-xs text-token-text-secondary">
<pre class="language-python"><code>pip install pandas</code></pre>
</div>
</div>
</div>
</div>
<h4>2. <strong>Importing Pandas</strong></h4>
<p>After installation, you can import Pandas using the following command. It's common to import it as <code>pd</code> for convenience:</p>
<div class="dark bg-gray-950 contain-inline-size rounded-md border-[0.5px] border-token-border-medium relative">
<div class="sticky top-9 md:top-[5.75rem]">
<div class="absolute bottom-0 right-2 flex h-9 items-center">
<div class="flex items-center rounded bg-token-main-surface-secondary px-2 font-sans text-xs text-token-text-secondary">
<pre class="language-python"><code>import pandas as pd</code></pre>
</div>
</div>
</div>
</div>
<h4>3. <strong>Pandas Data Structures</strong></h4>
<p>Pandas has two primary data structures:</p>
<ul>
<li><strong>Series</strong>: A one-dimensional labeled array capable of holding any data type.</li>
<li><strong>DataFrame</strong>: A two-dimensional labeled data structure with columns of potentially different types.</li>
</ul>
<p><strong>Creating a Series</strong>:</p>
<div class="dark bg-gray-950 contain-inline-size rounded-md border-[0.5px] border-token-border-medium relative">
<div class="flex items-center text-token-text-secondary bg-token-main-surface-secondary px-4 py-2 text-xs font-sans justify-between rounded-t-md h-9">
<pre class="language-python"><code>data = pd.Series([1, 2, 3, 4, 5])
print(data)</code></pre>
</div>
</div>
<p><strong>Creating a DataFrame</strong>:</p>
<div class="dark bg-gray-950 contain-inline-size rounded-md border-[0.5px] border-token-border-medium relative">
<div class="flex items-center text-token-text-secondary bg-token-main-surface-secondary px-4 py-2 text-xs font-sans justify-between rounded-t-md h-9">
<pre class="language-python"><code>data = {
    'Name': ['Alice', 'Bob', 'Charlie'],
    'Age': [25, 30, 35],
    'City': ['New York', 'Los Angeles', 'Chicago']
}
df = pd.DataFrame(data)
print(df)</code></pre>
</div>
</div>
<h4>4. <strong>Reading Data</strong></h4>
<p>Pandas makes it easy to read data from various file formats such as CSV, Excel, and JSON.</p>
<p><strong>Reading a CSV file</strong>:</p>
<div class="dark bg-gray-950 contain-inline-size rounded-md border-[0.5px] border-token-border-medium relative">
<div class="flex items-center text-token-text-secondary bg-token-main-surface-secondary px-4 py-2 text-xs font-sans justify-between rounded-t-md h-9">
<pre class="language-python"><code>df = pd.read_csv('data.csv')</code></pre>
</div>
</div>
<p><strong>Reading an Excel file</strong>:</p>
<div class="dark bg-gray-950 contain-inline-size rounded-md border-[0.5px] border-token-border-medium relative">
<div class="flex items-center text-token-text-secondary bg-token-main-surface-secondary px-4 py-2 text-xs font-sans justify-between rounded-t-md h-9">
<pre class="language-python"><code>df = pd.read_excel('data.xlsx')</code></pre>
</div>
</div>
<p><strong>Reading a JSON file</strong>:</p>
<div class="dark bg-gray-950 contain-inline-size rounded-md border-[0.5px] border-token-border-medium relative">
<div class="flex items-center text-token-text-secondary bg-token-main-surface-secondary px-4 py-2 text-xs font-sans justify-between rounded-t-md h-9">
<pre class="language-python"><code>df = pd.read_json('data.json')</code></pre>
</div>
</div>
<h4>5. <strong>Exploring Data</strong></h4>
<p>Once you have your data in a DataFrame, you can explore it using various methods:</p>
<ul>
<li><strong>Viewing the first few rows</strong>:</li>
</ul>
<div class="dark bg-gray-950 contain-inline-size rounded-md border-[0.5px] border-token-border-medium relative">
<div class="flex items-center text-token-text-secondary bg-token-main-surface-secondary px-4 py-2 text-xs font-sans justify-between rounded-t-md h-9">
<pre class="language-python"><code>print(df.head())  # Display the first 5 rows
</code></pre>
</div>
</div>
<ul>
<li><strong>Viewing the last few rows</strong>:</li>
</ul>
<div class="dark bg-gray-950 contain-inline-size rounded-md border-[0.5px] border-token-border-medium relative">
<div class="flex items-center text-token-text-secondary bg-token-main-surface-secondary px-4 py-2 text-xs font-sans justify-between rounded-t-md h-9">
<pre class="language-python"><code>print(df.tail())  # Display the last 5 rows
</code></pre>
</div>
</div>
<ul>
<li><strong>Getting summary statistics</strong>:</li>
</ul>
<div class="dark bg-gray-950 contain-inline-size rounded-md border-[0.5px] border-token-border-medium relative">
<div class="flex items-center text-token-text-secondary bg-token-main-surface-secondary px-4 py-2 text-xs font-sans justify-between rounded-t-md h-9">
<pre class="language-python"><code>print(df.describe())  # Summary statistics for numerical columns
</code></pre>
</div>
</div>
<ul>
<li><strong>Getting the shape of the DataFrame</strong>:</li>
</ul>
<div class="dark bg-gray-950 contain-inline-size rounded-md border-[0.5px] border-token-border-medium relative">
<div class="flex items-center text-token-text-secondary bg-token-main-surface-secondary px-4 py-2 text-xs font-sans justify-between rounded-t-md h-9">
<pre class="language-python"><code>print(df.shape)  # Output: (number of rows, number of columns)
</code></pre>
</div>
</div>
<ul>
<li><strong>Getting column names</strong>:</li>
</ul>
<div class="dark bg-gray-950 contain-inline-size rounded-md border-[0.5px] border-token-border-medium relative">
<div class="flex items-center text-token-text-secondary bg-token-main-surface-secondary px-4 py-2 text-xs font-sans justify-between rounded-t-md h-9">
<pre class="language-python"><code>print(df.columns)
</code></pre>
</div>
</div>
<h4>6. <strong>Selecting Data</strong></h4>
<p>You can select specific data from a DataFrame using indexing and slicing.</p>
<ul>
<li><strong>Selecting a column</strong>:</li>
</ul>
<div class="dark bg-gray-950 contain-inline-size rounded-md border-[0.5px] border-token-border-medium relative">
<div class="flex items-center text-token-text-secondary bg-token-main-surface-secondary px-4 py-2 text-xs font-sans justify-between rounded-t-md h-9">
<pre class="language-python"><code>print(df['Name'])  # Selects the 'Name' column
</code></pre>
</div>
</div>
<ul>
<li><strong>Selecting multiple columns</strong>:</li>
</ul>
<div class="dark bg-gray-950 contain-inline-size rounded-md border-[0.5px] border-token-border-medium relative">
<div class="flex items-center text-token-text-secondary bg-token-main-surface-secondary px-4 py-2 text-xs font-sans justify-between rounded-t-md h-9">
<pre class="language-python"><code>print(df[['Name', 'City']])  # Selects 'Name' and 'City' columns
</code></pre>
</div>
</div>
<ul>
<li><strong>Selecting rows by index</strong>:</li>
</ul>
<div class="dark bg-gray-950 contain-inline-size rounded-md border-[0.5px] border-token-border-medium relative">
<div class="flex items-center text-token-text-secondary bg-token-main-surface-secondary px-4 py-2 text-xs font-sans justify-between rounded-t-md h-9">
<pre class="language-python"><code>print(df.iloc[0])  # Selects the first row
</code></pre>
</div>
</div>
<ul>
<li><strong>Selecting rows by condition</strong>:</li>
</ul>
<div class="dark bg-gray-950 contain-inline-size rounded-md border-[0.5px] border-token-border-medium relative">
<div class="flex items-center text-token-text-secondary bg-token-main-surface-secondary px-4 py-2 text-xs font-sans justify-between rounded-t-md h-9">
<pre class="language-python"><code>print(df[df['Age'] &gt; 30])  # Selects rows where Age is greater than 30
</code></pre>
</div>
</div>
<h4>7. <strong>Data Manipulation</strong></h4>
<p>Pandas allows for powerful data manipulation techniques, including adding, removing, and modifying columns.</p>
<ul>
<li><strong>Adding a new column</strong>:</li>
</ul>
<div class="dark bg-gray-950 contain-inline-size rounded-md border-[0.5px] border-token-border-medium relative">
<div class="flex items-center text-token-text-secondary bg-token-main-surface-secondary px-4 py-2 text-xs font-sans justify-between rounded-t-md h-9">
<pre class="language-python"><code>df['Salary'] = [70000, 80000, 90000]
</code></pre>
</div>
</div>
<ul>
<li><strong>Removing a column</strong>:</li>
</ul>
<div class="dark bg-gray-950 contain-inline-size rounded-md border-[0.5px] border-token-border-medium relative">
<div class="flex items-center text-token-text-secondary bg-token-main-surface-secondary px-4 py-2 text-xs font-sans justify-between rounded-t-md h-9">
<pre class="language-python"><code>df.drop('Salary', axis=1, inplace=True)  # Removes the 'Salary' column
</code></pre>
</div>
</div>
<ul>
<li><strong>Renaming a column</strong>:</li>
</ul>
<div class="dark bg-gray-950 contain-inline-size rounded-md border-[0.5px] border-token-border-medium relative">
<div class="flex items-center text-token-text-secondary bg-token-main-surface-secondary px-4 py-2 text-xs font-sans justify-between rounded-t-md h-9">
<pre class="language-python"><code>df.rename(columns={'City': 'Location'}, inplace=True)
</code></pre>
</div>
</div>
<h4>8. <strong>Handling Missing Data</strong></h4>
<p>Pandas provides methods for handling missing data effectively.</p>
<ul>
<li><strong>Checking for missing values</strong>:</li>
</ul>
<div class="dark bg-gray-950 contain-inline-size rounded-md border-[0.5px] border-token-border-medium relative">
<div class="flex items-center text-token-text-secondary bg-token-main-surface-secondary px-4 py-2 text-xs font-sans justify-between rounded-t-md h-9">
<pre class="language-python"><code>print(df.isnull().sum())  # Returns the number of missing values in each column
</code></pre>
</div>
</div>
<ul>
<li><strong>Filling missing values</strong>:</li>
</ul>
<div class="dark bg-gray-950 contain-inline-size rounded-md border-[0.5px] border-token-border-medium relative">
<div class="flex items-center text-token-text-secondary bg-token-main-surface-secondary px-4 py-2 text-xs font-sans justify-between rounded-t-md h-9">
<pre class="language-python"><code>df.fillna(value=0, inplace=True)  # Replaces missing values with 0
</code></pre>
</div>
</div>
<ul>
<li><strong>Dropping rows with missing values</strong>:</li>
</ul>
<div class="dark bg-gray-950 contain-inline-size rounded-md border-[0.5px] border-token-border-medium relative">
<div class="flex items-center text-token-text-secondary bg-token-main-surface-secondary px-4 py-2 text-xs font-sans justify-between rounded-t-md h-9">
<pre class="language-python"><code>df.dropna(inplace=True)  # Removes rows with any missing values
</code></pre>
</div>
</div>
<h4>9. <strong>Grouping Data</strong></h4>
<p>You can group data in a DataFrame using the <code>groupby()</code> method to perform aggregate operations.</p>
<p><strong>Example</strong>:</p>
<div class="dark bg-gray-950 contain-inline-size rounded-md border-[0.5px] border-token-border-medium relative">
<div class="flex items-center text-token-text-secondary bg-token-main-surface-secondary px-4 py-2 text-xs font-sans justify-between rounded-t-md h-9">
<pre class="language-python"><code>grouped = df.groupby('Location').mean()  # Groups by 'Location' and calculates the mean of numerical columns
print(grouped)
</code></pre>
</div>
</div>
<h4>10. <strong>Exporting Data</strong></h4>
<p>After manipulating your data, you can easily export it to various formats.</p>
<ul>
<li><strong>Exporting to CSV</strong>:</li>
</ul>
<div class="dark bg-gray-950 contain-inline-size rounded-md border-[0.5px] border-token-border-medium relative">
<div class="flex items-center text-token-text-secondary bg-token-main-surface-secondary px-4 py-2 text-xs font-sans justify-between rounded-t-md h-9">
<pre class="language-python"><code>df.to_csv('output.csv', index=False)
</code></pre>
</div>
</div>
<ul>
<li><strong>Exporting to Excel</strong>:</li>
</ul>
<div class="dark bg-gray-950 contain-inline-size rounded-md border-[0.5px] border-token-border-medium relative">
<div class="flex items-center text-token-text-secondary bg-token-main-surface-secondary px-4 py-2 text-xs font-sans justify-between rounded-t-md h-9">
<pre class="language-python"><code>df.to_excel('output.xlsx', index=False)
</code></pre>
</div>
</div>
<ul>
<li><strong>Exporting to JSON</strong>:</li>
</ul>
<div class="dark bg-gray-950 contain-inline-size rounded-md border-[0.5px] border-token-border-medium relative">
<div class="flex items-center text-token-text-secondary bg-token-main-surface-secondary px-4 py-2 text-xs font-sans justify-between rounded-t-md h-9">
<pre class="language-python"><code>df.to_json('output.json')
</code></pre>
</div>
</div>
<h3>Conclusion</h3>
<p>Pandas is an essential library for data analysis in Python, offering powerful tools for data manipulation and analysis. With its easy-to-use data structures, you can efficiently work with and analyze structured data. Mastering Pandas will significantly enhance your ability to handle data in Python.</p>
<h3>&nbsp;</h3>
</div>
</div>
</div>
</div>
</div>
</div>

Web Technology View More

Pandas Tutorial

Learn Ansible

Learn HTML

Learn Angular 3

Learn PHP

Learn Angular 2.0

Learn Python

Learn C# Sharp

Learn CSS

Learn Node Js

Learn PHP 7.1

Learn Angular 3

Learn Angular 2

Learn HTML5

Learn Angular 2

Learn Angular 3.0

Learn Bootstrap 3

Learn Bootstrap 4

Learn Bootstrap 5