New: Advanced Merge Tools and Dynamic Pipelines

Monday, September 30th, 2024

We're excited to announce a significant update to our CSV processing toolkit, introducing powerful new merge operations and dynamic pipeline capabilities. These features are designed to streamline your data workflows and provide more flexibility in handling complex data scenarios.

Advanced CSV Merge Operations

CSV Insert

The new CSV Insert tool allows you to merge CSV files by inserting new rows without modifying existing data.

Example:

Table 1 (Original):

ID	Name	Age
1	Alice	30
2	Bob	25

Table 2 (To Insert):

ID	Name	Age
3	Charlie	35
4	Diana	28

Result (After Insert):

ID	Name	Age
1	Alice	30
2	Bob	25
3	Charlie	35
4	Diana	28

CSV Upsert

With the CSV Upsert feature, you can now update existing rows and insert new ones in a single operation.

Example:

Table 1 (Original):

ID	Name	Age
1	Alice	30
2	Bob	25

Table 2 (To Upsert):

ID	Name	Age
2	Bob	26
3	Charlie	35

Result (After Upsert):

ID	Name	Age
1	Alice	30
2	Bob	26
3	Charlie	35

CSV Update

The CSV Update tool focuses on modifying existing rows only.

Example:

Table 1 (Original):

ID	Name	Age
1	Alice	30
2	Bob	25
3	Charlie	35

Table 2 (Update Data):

ID	Name	Age
2	Bob	26
3	Charlie	36
4	Diana	28

Result (After Update):

ID	Name	Age
1	Alice	30
2	Bob	26
3	Charlie	36

CSV Inner Join

Perform an inner join operation with the CSV Inner Join tool.

CSV Outer Join

The CSV Outer Join feature allows you to combine all data from both files, including non-matching rows. This is equivalent to a full outer join in SQL, ensuring no data is left behind.

Upload and Backup

We've also introduced an Upload and Backup feature, allowing you to securely upload, backup, and save important data. This ensures your critical information is safely stored and easily accessible when needed.

Dynamic Pipeline Steps

Our latest update introduces a more flexible and dynamic pipeline system. Each tool now has its own set of pipeline steps, allowing for more specialized and efficient data processing workflows. This means you can now:

Customize the data processing flow for each specific tool
Combine different operations seamlessly within a single workflow
Enjoy a more intuitive and streamlined user experience tailored to each tool's purpose

Enhanced User Interface

We've also made improvements to our user interface, including:

New icons for each tool, making it easier to identify different operations at a glance
Improved layout and organization of tools in the UI
More intuitive navigation between different CSV processing features

What This Means for You

For data scientists, these new merge operations provide powerful tools for data preparation and analysis. You can now perform complex data integration tasks directly in your browser, saving time and reducing the need for additional software.

Technical engineers will appreciate the flexibility of our new dynamic pipeline system, allowing for more efficient and customizable data processing workflows. This can significantly streamline your data engineering tasks.

Founders and project managers will find value in the expanded toolkit, enabling your teams to handle a wider range of data scenarios without the need for multiple specialized tools. This can lead to improved productivity and reduced software costs.

Get Started

We invite you to explore these new features and see how they can enhance your data processing workflows. As always, we welcome your feedback and suggestions for future improvements.