SQLite needs the ability to sort data. It does so by comparing two items and determining if one is equal, less than or greater than the other by using a collation function. This is from the official ...
In Ray Data, the collate_fn currently must run on the iterator/consumer side because map_batches does not guarantee that each batch passed to the function has an exact size equal to batch_size. This ...