create_scalar_index fails due to resources exhausted

[wpjgit]

data：https://github.com/cwida/duckdb-data/releases/download/v1.0/lineitemsf1.snappy.parquet
convert to lance

dataset = lance.dataset('D:\\opt\\duckdb\\data\\lineitem.lance')
dataset.create_scalar_index("l_shipdate", "BTREE")

File "D:\code\test-python\langchain-test\lance_test\lance_query.py", line 109, in <module>
   dataset.create_scalar_index("l_shipdate", "BTREE")
 File "D:\python-env\langchain-test\Lib\site-packages\lance\dataset.py", line 1232, in create_scalar_index
   self._ds.create_index([column], index_type, name, replace)
OSError: LanceError(IO): Execution error: LanceError(IO): Resources exhausted: Failed to allocate additional 28952 bytes for ExternalSorterMerge[0] with 104835192 bytes already allocated - maximum available is 22408, D:\a\lance\lance\rust\lance-datafusion\src\chunker.rs:47:46, D:\a\lance\lance\rust\lance-index\src\scalar\btree.rs:1065:29

[westonpace]

#2119 (comment)