Salesforce Bulk API Mappings

August 9, 2024in Data

Using Salesforce Bulk API and Bulk API 2.0 in Mappings and Mapping Tasks

The Salesforce Bulk API and Bulk API 2.0 allow you to efficiently process and retrieve large datasets from Salesforce sources with minimal API calls. These APIs are particularly useful for handling extensive data loads in mappings and mapping tasks.

Salesforce Bulk API

The Salesforce Bulk API processes large volumes of data by dividing it into manageable batches. Key limitations to consider:

Each batch is restricted to 10 MB of data or 10,000 records in CSV format.
For instance, reading 10 million records would result in approximately 1,000 batches, each containing up to 10,000 records.
If the batch size exceeds 10 MB, the API adjusts and splits batches based on the file size rather than the record count.

Salesforce Bulk API 2.0

Bulk API 2.0 offers enhanced scalability and automation for even larger datasets:

It supports processing up to 100 million records within a 24-hour period.
Unlike Bulk API, file batching is fully automated on Salesforce’s end, requiring no intervention or manual configuration by the user.

Recommendations for Bulk API 2.0

To take full advantage of Bulk API 2.0:

Use API version 50 or higher for all Bulk API 2.0 operations with the Salesforce connector.
This ensures compatibility and access to the latest features and performance optimizations.

By leveraging these APIs, you can seamlessly manage and process large-scale Salesforce data, optimizing performance and minimizing API call overhead.