Comma Separated Values (CSV) is a widely used file format for storing and exchanging tabular data. Python provides various libraries and modules to work with CSV files, making it easy to read, write, and manipulate data in this format. In this article, we’ll explore the basics of working with CSV files in Python and provide practical examples to help you get started.

1. Introduction to CSV Files

CSV files are simple text files that store tabular data in plain text, where each row represents a record, and columns are separated by a delimiter, typically a comma. They are often used for tasks like data import/export and data exchange between different applications.

Sample CSV data might look like this:

1
2
3
4

Name,Age,Location
Alice,30,New York
Bob,25,Los Angeles
Charlie,40,Chicago

In Python, you can work with CSV files using the built-in csv module or external libraries like pandas.

2. Reading CSV Files

Using csv.reader

The csv.reader class in the csv module provides a straightforward way to read CSV files. Here’s how you can use it:

1
2
3
4
5
6
7
8
9

import csv

# Open the CSV file
with open('data.csv', 'r') as file:
    reader = csv.reader(file)
    
    # Iterate through the rows
    for row in reader:
        print(row)

This code opens the data.csv file, reads its content, and prints each row as a list.

Using pandas

Pandas is a powerful data manipulation library in Python. It provides a high-level way to read CSV files, making data manipulation more convenient:

1
2
3
4
5
6
7

import pandas as pd

# Read CSV into a DataFrame
df = pd.read_csv('data.csv')

# Display the DataFrame
print(df)

Pandas reads the CSV data into a DataFrame, which allows for easy data manipulation, filtering, and analysis.

3. Writing CSV Files

Using csv.writer

To write data to a CSV file using the csv.writer class, follow this example:

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15

import csv

data = [
    ['Name', 'Age', 'Location'],
    ['Alice', 30, 'New York'],
    ['Bob', 25, 'Los Angeles'],
    ['Charlie', 40, 'Chicago']
]

# Open the CSV file for writing
with open('output.csv', 'w', newline='') as file:
    writer = csv.writer(file)
    
    # Write the data
    writer.writerows(data)

This code creates a new CSV file called output.csv and writes the data from the data list.

Using pandas

Pandas also provides a convenient way to write a DataFrame to a CSV file:

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12

import pandas as pd

data = {
    'Name': ['Alice', 'Bob', 'Charlie'],
    'Age': [30, 25, 40],
    'Location': ['New York', 'Los Angeles', 'Chicago']
}

df = pd.DataFrame(data)

# Write the DataFrame to a CSV file
df.to_csv('output.csv', index=False)

The index=False parameter ensures that the DataFrame is written without the index column.

4. Manipulating CSV Data

Filtering Data

With pandas, you can easily filter data based on conditions. For example, to filter individuals older than 30:

1
2
3

# Filter data
filtered_data = df[df['Age'] > 30]
print(filtered_data)

Modifying Data

To modify data in a pandas DataFrame, you can use the .loc property:

1
2
3

# Modify data
df.loc[df['Name'] == 'Alice', 'Age'] = 31
print(df)

This code changes Alice’s age to 31 in the DataFrame.

5. Handling Header Rows

By default, both csv.reader and pandas assume the first row of the CSV file contains headers. To handle CSV files without headers or with custom headers, you can provide the header parameter in pandas:

1
2
3
4
5
6
7
8

# Read CSV with no headers
df = pd.read_csv('data.csv', header=None)
print(df)

# Read CSV with custom headers
custom_headers = ['Person', 'Years', 'City']
df = pd.read_csv('data.csv', names=custom_headers)
print(df)

6. Handling Different Delimiters

While CSV files typically use a comma as the delimiter, you might encounter CSV files with different delimiters such as semicolons or tabs. You can specify the delimiter using the delimiter or sep parameter in pandas:

1
2

# Read a semicolon-separated CSV
df = pd.read_csv('data.csv', sep=';')

7. Handling Errors

When working with CSV files, it’s essential to handle errors. Common issues include missing files, incorrect delimiters, or malformed data. To handle errors, use try and except blocks around your CSV operations.

8. Conclusion

Working with CSV files is a common task in data manipulation and analysis. Python’s csv module and the pandas library provide powerful tools to read, write, and manipulate CSV data efficiently. Whether you’re handling small datasets or large-scale data analysis, these tools will help you manage your data effectively.

By mastering these techniques, you can easily integrate CSV data into your Python workflows and leverage the full potential of Python for data analysis and data manipulation tasks.