How to Split Large CSV Files — By Row Count, File Size, or Condition

Large CSV files often hit Excel's row limits or exceed system upload caps. When this happens, splitting becomes necessary. The approach varies depending on whether you need to split by row count, file size, or by conditions—such as department or region. This article compares four methods across browser, desktop, and command-line tools, showing which to use for each situation.

Note: Third-party tool specs reflect the state at the time of writing (April 2026). Check each tool's official site for the latest features and limits.

CSV Splitting Tools Compared — Browser, Desktop, and Command Line

Splitting a large CSV file typically falls into four categories, each suited to different tasks. The right choice depends on your technical comfort level, the operating system you use, and whether your split criteria are simple (row-based) or complex (conditional).

Each approach has trade-offs. Browser-based tools offer ease of use but may have file size limitations. Desktop GUI tools are familiar to Windows users but lack flexibility. Command-line tools are fastest for large files but require scripting knowledge. Python solutions provide unlimited flexibility but demand programming expertise.

LeapRows — Filter and Export as Conditional Split

LeapRows (disclosure: built by the author) lets you upload a CSV in the browser, apply filter conditions, and export matching rows as separate files. Think of it as Excel filtering with file output—split by department, region, revenue tier, or any other column present in your data.

The advantage of conditional splitting over simple row-based splitting is that data stays meaningful and organized. For example, sales data splits into "Tokyo Branch" and "Osaka Branch" files rather than cutting at an arbitrary row number. Each output file is standalone and self-contained with headers included. This means no downstream cleanup is required—each file can go directly to the relevant team.

The LeapRows workflow is straightforward and quick:

If you need intentional data separation, the GUI makes it far faster than scripting. Setup cost is zero and requires only a browser. The tool preserves data integrity throughout the split, so no rows are lost and all values remain unchanged.

CSV Splitter (Windows GUI, Row/Size Split)

CSV Splitter is a Windows desktop tool that divides a file by row count or total size. The workflow is minimal: select the file, enter a number specifying the row count or file size threshold, and click execute. The application handles the rest automatically.

Its strength is splitting to meet Excel's 1,048,576-row limit, which is the most common use case for non-technical users. If you simply need files no larger than 1 million rows each, this tool handles it in seconds. Headers are automatically added to every split file, so no post-processing is needed. The tool is also fast enough for files up to several hundred megabytes without noticeable lag.

CSV Splitter's typical workflow follows this sequence:

Windows-only support and no conditional logic. If you need "split by department" or "split by year," this tool cannot do it. It also cannot reorder or filter rows before splitting—it only cuts files at fixed intervals. For power users who need anything beyond basic row-count or size-based division, this tool reaches its ceiling quickly.

split Command (Linux/macOS Built-in)

The split command is built into Linux and macOS, so no installation is needed. Run it from the terminal or embed it in shell scripts. This approach is ideal if you are already comfortable with command-line usage or need to automate splitting as part of a larger pipeline.

Example:

split -l 100000 input.csv output_

This divides the file into 100,000-row chunks. On Windows, PowerShell can achieve similar results, but requires writing a custom script—there is no single built-in command equivalent to split.

Command-line tools have distinct characteristics:

Strengths are zero setup on Linux/macOS and exceptional speed. Large files (several GB) often split faster with CLI tools than GUI applications because there is no graphical overhead. The command executes in the background with minimal resource consumption. Headers are not automatically reattached to split files, so you must manually add them afterward using another script or tool. Conditional splitting is not possible with the basic split command alone.

Python Script (Flexible Conditional Split)

Write Python logic to handle any conditional split. Here's an example that divides by department:

import pandas as pd

df = pd.read_csv('input.csv')
for dept in df['department'].unique():
    subset = df[df['department'] == dept]
    subset.to_csv(f'output_{dept}.csv', index=False)

Python offers maximum flexibility—combine multiple conditions, mix row count with conditions, filter for specific date ranges, or run batch operations across hundreds of files. You can split by multiple columns simultaneously, remove unwanted rows during the split, or apply transformations as part of the same process.

Python implementation typically follows these phases:

Initial setup and script development can take 30+ minutes for Python beginners. However, once a script is written, it can be reused and adapted indefinitely, making it worthwhile if you split CSVs regularly. Best for technical users or teams with a dedicated data analyst.

Match the Method to Your Goal

Splitting Below Excel's 1,048,576-Row Limit

Excel cannot open files exceeding 1,048,576 rows. This limit applies to all modern versions of Excel and is a hard boundary. If you try to open a larger CSV, Excel will either truncate it silently or refuse to open it entirely.

For row-based splits to stay under this limit, compare your options:

For simple row-based splits to stay under the Excel limit, CSV Splitter or the CLI split command works fine. Both are fast and reliable. If you need headers in each output file, CSV Splitter is the faster choice because it handles headers automatically. With the CLI tool, you'll need to manually prepend headers to each split file after splitting, adding extra work.

Meeting Upload Caps for Tax Filing or E-Commerce Platforms

Tax filing systems like e-Tax and e-commerce platforms like Rakuten often enforce file size or row limits. Use CSV Splitter or LeapRows (disclosure: built by the author) to match those limits exactly, then upload each split file separately.

Sorting Rows into Separate Files by Department or Region

When you need intentional data segmentation—such as splitting sales data by branch or invoices by department—use LeapRows (disclosure: built by the author) or Python. LeapRows provides an intuitive GUI for condition setup; Python handles arbitrarily complex logic.

Three Pitfalls to Avoid When Splitting CSVs

Handling the Header Row

Should every split file include the original header row, or only the first file? The answer depends on how the downstream system or tool processes the data.

Header strategy depends on your use case:

In most cases, if each file is processed independently, include headers in every file. LeapRows and CSV Splitter do this automatically. Command-line and Python tools often require manual handling.

Encoding Changes After Split

On Windows systems, a Shift-JIS CSV may become UTF-8 after splitting. If the upload destination requires Shift-JIS specifically, this causes corruption.

Encoding handling varies by tool:

Before choosing a splitting tool, confirm whether the input encoding is preserved or converted.

File Naming and Numbering Conventions

Split files get auto-numbered, but naming conventions vary widely by tool.

Naming patterns across tools:

If upload order matters or if a system sorts files by name, check the tool's naming behavior beforehand.

Before You Split — Ask If You Really Need To

Splitting is a response to constraints: Excel row limits, system upload caps, or storage restrictions. But splitting does not always simplify your workflow. It can introduce new problems—file management becomes harder, reconciliation is trickier, and automation becomes more complex.

Pause before splitting and ask: does this file truly need to be split? Consider these alternatives:

• System handles large CSVs natively? → Splitting adds unnecessary steps
• Goal is departmental analysis? → Filter functions in the original CSV may be more efficient
• Splitting solely to fit Excel? → Database or analytics tool might be better

Approach selection by use case:

Remember: splitting is a symptom of constraints, not a business solution. Address the root constraint if possible—upgrade your system, negotiate higher upload limits, or move data to a database platform that handles volume naturally.