Export to JSON, BSON, CSV with large result set won't work

Benny Purelku shared this problem 15 days ago
In Progress

When I try to export a large data set result from a query NoSQLBoost just keeps spinning for hours but it never really extracts anything. When I shrink the result set from the same query then it works. Any suggestions/help would be greatly appreciated.

Thanks,

Benny

Comments (1)

photo
1

When version 5.1.x exports the query result, it reads the entire dataset into memory. If the dataset is large, there will be performance problems, and even cause memory overflow and crash. In the upcoming 5.2 release, We refactored the exported code greatly to improve the efficiency of the export.