You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Currently CSVs are generated by creating each row at a time. This means that all attributes need to be loaded into memory to create the CSV file, along with all prerequisites. If there are a lot of attributes, we can run out of memory.
The idea would be to load an attribute, generate the CSV column for it, and then move on to the next attribute. This will allow attributes to be GC'd (see #12).
The text was updated successfully, but these errors were encountered:
CSV generation by column
Currently CSVs are generated by creating each row at a time. This means that all attributes need to be loaded into memory to create the CSV file, along with all prerequisites. If there are a lot of attributes, we can run out of memory.
The idea would be to load an attribute, generate the CSV column for it, and then move on to the next attribute. This will allow attributes to be GC'd (see #12).
The text was updated successfully, but these errors were encountered: