Code

Add streaming of xlsx file support#144

Code

Merged

qrilka merged 165 commits intoqrilka:masterqrilka/xlsx:masterfrom SupercedeTech:masterSupercedeTech/xlsx:masterCopy head branch name to clipboardDec 19, 2021

+2,317-548

Commits

Commits on Dec 8, 2021

• Change type alias for CellMap

  Show description for 93a5701
  jappeace

  committed
  93a5701

  Copy full SHA for 93a5701

• Try seeing if we can list everything in the test data

  jappeace

  committed
  0e241be

  Copy full SHA for 0e241be

• Loop trough the entire thing

  jappeace

  committed
  d705488

  Copy full SHA for d705488

• Split of go into seperate function

  jappeace

  committed
  d050598

  Copy full SHA for d050598

• Don't print the bytestring

  jappeace

  committed
  5b42e5b

  Copy full SHA for 5b42e5b

• I'm finding out it aint ordered

  jappeace

  committed
  2a50042

  Copy full SHA for 2a50042

• Go a long way towards completion

  jappeace

  committed
  d6a5f50

  Copy full SHA for d6a5f50

• Use coerce for free speed

  jappeace

  committed
  ce7cff8

  Copy full SHA for ce7cff8

• Do some rundimentary parsing

  jappeace

  committed
  fa8df15

  Copy full SHA for fa8df15

• Add styling the binary to see what's going on

  jappeace

  committed
  bc66011

  Copy full SHA for bc66011

• Filter out the formula

  jappeace

  committed
  d596b31

  Copy full SHA for d596b31

• Add string table parsing, cleanup warnings

  jappeace

  committed
  8404ab7

  Copy full SHA for 8404ab7

• THis only get's the last string (lol)

  jappeace

  committed
  b88381b

  Copy full SHA for b88381b

• Fix shared string bug

  jappeace

  committed
  36dca07

  Copy full SHA for 36dca07

• Filter empty rows

  jappeace

  committed
  bdc3779

  Copy full SHA for bdc3779

• Try allow user to use sideffect to lookup string

  Show description for b5ec1e4
  jappeace

  committed
  b5ec1e4

  Copy full SHA for b5ec1e4

• Revert "Try allow user to use sideffect to lookup string"

  Show description for ace6031
  jappeace

  committed
  ace6031

  Copy full SHA for ace6031

• Make a conduit out of shared string instead of use state monad

  jappeace

  committed
  0455509

  Copy full SHA for 0455509

• Try fix tests after that Cellmap change

  Show description for c0d2231
  jappeace

  committed
  c0d2231

  Copy full SHA for c0d2231

• Revert "Try fix tests after that Cellmap change"

  Show description for b55f125
  jappeace

  committed
  b55f125

  Copy full SHA for b55f125

• Revert "Change type alias for CellMap"

  Show description for 63f91b0
  jappeace

  committed
  63f91b0

  Copy full SHA for 63f91b0

• Fix the tests

  jappeace

  committed
  eccf7f8

  Copy full SHA for eccf7f8

• Remove MonadIO constraint, throw errors with monadthrow

  Show description for ddc9ee8
  jappeace

  committed
  ddc9ee8

  Copy full SHA for ddc9ee8

• Remove several redundant constraints

  jappeace

  committed
  0616416

  Copy full SHA for 0616416

• Add haskcallstack, but it's not a good idea after reading the docs

  Show description for 5180ee7
  jappeace

  committed
  5180ee7

  Copy full SHA for 5180ee7

• Revert "Add haskcallstack, but it's not a good idea after reading the docs"

  Show description for db46ca3
  jappeace

  committed
  db46ca3

  Copy full SHA for db46ca3

• Add bool parse support

  jappeace

  committed
  d17dbdc

  Copy full SHA for d17dbdc

• Add some docs

  jappeace

  committed
  9c27047

  Copy full SHA for 9c27047

• Show the issue with a test

  jappeace

  committed
  cd9be9a

  Copy full SHA for cd9be9a

• Fix tests for shared strings

  jappeace

  committed
  87ea6ba

  Copy full SHA for 87ea6ba

• Add nix flake template

  Show description for d94d4b9
  

  awkure

  authored and

  jappeace

  committed
  d94d4b9

  Copy full SHA for d94d4b9

• Add stylish haskell to nix shell and fix shell

  

  awkure

  authored and

  jappeace

  committed
  6329020

  Copy full SHA for 6329020

• Update streaming parser and add docs

  Show description for 000e696
  

  awkure

  authored and

  jappeace

  committed
  000e696

  Copy full SHA for 000e696

• Update tests and benchmarks

  Show description for fca5598
  

  awkure

  authored and

  jappeace

  committed
  fca5598

  Copy full SHA for fca5598

• Enable profiling and collect data for all parsers

  

  awkure

  authored and

  jappeace

  committed
  b07d300

  Copy full SHA for b07d300

• Update docs and fix error with parsing some strings

  

  awkure

  authored and

  jappeace

  committed
  d0e8686

  Copy full SHA for d0e8686

• Add conduit for creating shared string table

  jappeace

  committed
  7e9c4ec

  Copy full SHA for 7e9c4ec

• Add geenration of shared string table

  jappeace

  committed
  15b2d2e

  Copy full SHA for 15b2d2e

• Add support for writing rows

  jappeace

  committed
  01fe7e6

  Copy full SHA for 01fe7e6

• Solve warnings

  jappeace

  committed
  4c087fc

  Copy full SHA for 4c087fc

• Make it produce a file

  jappeace

  committed
  eb11b3b

  Copy full SHA for eb11b3b

• Add test that checks our writing code to the existing implementation

  Show description for 27cf20a
  jappeace

  committed
  27cf20a

  Copy full SHA for 27cf20a

• Cleanup tag soup with more use of the library

  jappeace

  committed
  9d0801d

  Copy full SHA for 9d0801d

• I guess this made the tests pass,

  Show description for f94e958
  jappeace

  committed
  f94e958

  Copy full SHA for f94e958

• Cleanup old test suite

  Show description for a6762d3
  jappeace

  committed
  a6762d3

  Copy full SHA for a6762d3

• Add support for parsing errors

  jappeace

  committed
  929b0b6

  Copy full SHA for 929b0b6

• Add test that compares existing value to the writer

  jappeace

  committed
  9337b60

  Copy full SHA for 9337b60

• Add printing of most boilerplate

  jappeace

  committed
  78429e1

  Copy full SHA for 78429e1

• Fix namespace issue for shared strings

  Show description for 2884eaa
  jappeace

  committed
  2884eaa

  Copy full SHA for 2884eaa

• Add namespaces to pretty much everything

  jappeace

  committed
  1f752a5

  Copy full SHA for 1f752a5

• I think we managed to obtain relationships

  jappeace

  committed
  67db7da

  Copy full SHA for 67db7da

• Workbooks now get loaded

  Show description for 2a6d10e
  jappeace

  committed
  2a6d10e

  Copy full SHA for 2a6d10e

• Simplify the tests

  jappeace

  committed
  418094a

  Copy full SHA for 418094a

• This passes the test of writing and reading

  Show description for 2bdef1b
  jappeace

  committed
  2bdef1b

  Copy full SHA for 2bdef1b

• Add documentation on how to validate and how to use ssts

  jappeace

  committed
  d2bbdb5

  Copy full SHA for d2bbdb5

• Make the result be digestable by excel

  jappeace

  committed
  4eabcea

  Copy full SHA for 4eabcea

• Stop writing in and out

  Show description for b622d43
  jappeace

  committed
  b622d43

  Copy full SHA for b622d43

• Move not api related code to an internal module

  Show description for da72680
  jappeace

  committed
  da72680

  Copy full SHA for da72680

• Add additional notes on arguments

  jappeace

  committed
  4c02079

  Copy full SHA for 4c02079

• Since this realized, no longer need outdated docs

  jappeace

  committed
  b6c8aa5

  Copy full SHA for b6c8aa5

• Remove implementation details from haddock

  Show description for 576a1b2
  jappeace

  committed
  576a1b2

  Copy full SHA for 576a1b2

• Fix bug where writing of larger files got truncated to last result

  Show description for 14cee74
  jappeace

  committed
  14cee74

  Copy full SHA for 14cee74

• Parse every column of the row, not just 1 (set sheet state)

  Show description for 80494eb
  

  timds

  authored and

  jappeace

  committed
  80494eb

  Copy full SHA for 80494eb

• Do not treat excel booleans as indices into the shared strings

  Show description for b6e03d0
  

  timds

  authored and

  jappeace

  committed
  b6e03d0

  Copy full SHA for b6e03d0

• Add some possibly helpful comments to Parser.Stream

  

  timds

  authored and

  jappeace

  committed
  000d83d

  Copy full SHA for 000d83d

• Replace hard-coded path with getTemporaryDirectory in StreamTests

  Show description for 2103b06
  

  timds

  authored and

  jappeace

  committed
  2103b06

  Copy full SHA for 2103b06

• [Draft] Add an alternate Stream API that can stream certain sheets

  Show description for 4fa6cf3
  

  Tim Stapels

  authored and

  jappeace

  committed
  4fa6cf3

  Copy full SHA for 4fa6cf3

• (Streaming via "zip") Include API for both XML events and SheetItem

  Show description for b384c39
  

  Tim Stapels

  authored and

  jappeace

  committed
  b384c39

  Copy full SHA for b384c39

• Stream module: Expose more functions & clarify docs

  

  Tim Stapels

  authored and

  jappeace

  committed
  55932a4

  Copy full SHA for 55932a4

• Stream module via "zip": Add API to count number of rows in a sheet

  Show description for 86e061b
  

  Tim Stapels

  authored and

  jappeace

  committed
  86e061b

  Copy full SHA for 86e061b

• Remove getSheetXmlSource from public API

  Show description for 4549de1
  

  Tim Stapels

  authored and

  jappeace

  committed
  4549de1

  Copy full SHA for 4549de1

• Use a vector instead of a map for storing shared strings

  Show description for 4b69412
  

  Tim Stapels

  authored and

  jappeace

  committed
  4b69412

  Copy full SHA for 4b69412

• [remove me] log time taken to parse shared strings

  

  Tim Stapels

  authored and

  jappeace

  committed
  6d63578

  Copy full SHA for 6d63578

• [remove me?] add many SCC annotations to Parser.Stream module

  

  Tim Stapels

  authored and

  jappeace

  committed
  4fdd845

  Copy full SHA for 4fdd845

• Parser.Stream: replace xml-conduit with xeno (experimental hack)

  Show description for ba72012
  

  Tim Stapels

  authored and

  jappeace

  committed
  ba72012

  Copy full SHA for ba72012

• Parser.Stream: Replace xeno with hexpat as the xml parser

  Show description for 3cba572
  

  Tim Stapels

  authored and

  jappeace

  committed
  3cba572

  Copy full SHA for 3cba572

• Add countrows executable for easier profiling

  

  Tim Stapels

  authored and

  jappeace

  committed
  23f1043

  Copy full SHA for 23f1043

• add to .gitignore

  

  Tim Stapels

  authored and

  jappeace

  committed
  c2544f5

  Copy full SHA for c2544f5

• illustration of incompatible synchronous libxml<->conduit APIs

  

  Tim Stapels

  authored and

  jappeace

  committed
  66f0347

  Copy full SHA for 66f0347

• try using concurrency to yield results of libxml in conduit

  Show description for 1e99e19
  

  Tim Stapels

  authored and

  jappeace

  committed
  1e99e19

  Copy full SHA for 1e99e19

• Modify libxml parser to take a IO callback rather than conduit CB

  Show description for 343632c
  

  Tim Stapels

  authored and

  jappeace

  committed
  343632c

  Copy full SHA for 343632c

• Stream parser: remove xeno parser code

  Show description for 03d73a3
  

  Tim Stapels

  authored and

  jappeace

  committed
  03d73a3

  Copy full SHA for 03d73a3

• Stream parser: Add callback-based expat interface

  Show description for 7b6250b
  

  Tim Stapels

  authored and

  jappeace

  committed
  7b6250b

  Copy full SHA for 7b6250b

• Ignore cabal.project.local

  

  Tim Stapels

  authored and

  jappeace

  committed
  139b5a2

  Copy full SHA for 139b5a2

• Add nix dev setup that doesn't use flakes

  Show description for 29eb326
  

  Tim Stapels

  authored and

  jappeace

  committed
  29eb326

  Copy full SHA for 29eb326

• Remove parser based on zip-archive

  

  Tim Stapels

  authored and

  jappeace

  committed
  dfb37bc

  Copy full SHA for dfb37bc

• Remove -fno-full-laziness

  Show description for 89484de
  

  Tim Stapels

  authored and

  jappeace

  committed
  89484de

  Copy full SHA for 89484de

• Update copyright and haddocks

  

  Tim Stapels

  authored and

  jappeace

  committed
  b0e228a

  Copy full SHA for b0e228a

• Rename sourceSheet to readSheet

  Show description for 92162ba
  

  Tim Stapels

  authored and

  jappeace

  committed
  92162ba

  Copy full SHA for 92162ba

• Fix haddock typo

  

  Tim Stapels

  authored and

  jappeace

  committed
  5c74b85

  Copy full SHA for 5c74b85

• Stream parser: replace Map with IntMap as CellRow type

  Show description for f5e66ec
  

  Tim Stapels

  authored and

  jappeace

  committed
  f5e66ec

  Copy full SHA for f5e66ec

• Parse shared strings with hexpat rather than xml-conduit

  Show description for 3dab49b
  

  Tim Stapels

  authored and

  jappeace

  committed
  3dab49b

  Copy full SHA for 3dab49b

• Stream parser: remove xml-conduit from the API

  

  Tim Stapels

  authored and

  jappeace

  committed
  67ad6e9

  Copy full SHA for 67ad6e9

• stream parser: remove getOrParseSharedStrings from public API

  

  Tim Stapels

  authored and

  jappeace

  committed
  107fd01

  Copy full SHA for 107fd01

• stream parser: Add API to get workbook info (sheet names & numbers)

  

  Tim Stapels

  authored and

  jappeace

  committed
  6ea2835

  Copy full SHA for 6ea2835

• stream benchmark: update to reflect newer callback API

  Show description for 7c4ca8b
  

  Tim Stapels

  authored and

  jappeace

  committed
  7c4ca8b

  Copy full SHA for 7c4ca8b

• stream parsing: remove libxml usage

  

  Tim Stapels

  authored and

  jappeace

  committed
  11b29fd

  Copy full SHA for 11b29fd

• Revert countRowsInSheet to faster version that does minimal parsing

  Show description for 1298e73
  

  Tim Stapels

  authored and

  jappeace

  committed
  1298e73

  Copy full SHA for 1298e73

• This fixes the compile error in the tests.

  Show description for 1c5549d
  jappeace

  committed
  1c5549d

  Copy full SHA for 1c5549d

• Add the SheetView api

  Show description for 3fc300f
  jappeace

  committed
  3fc300f

  Copy full SHA for 3fc300f

• Stream writing: Add column sizing support

  Show description for 7aeab7a
  jappeace

  committed
  7aeab7a

  Copy full SHA for 7aeab7a

• Add row properties

  Show description for b862b3a
  jappeace

  committed
  b862b3a

  Copy full SHA for b862b3a

• Add style parsing and writing

  Show description for c2dfbfe
  jappeace

  committed
  c2dfbfe

  Copy full SHA for c2dfbfe

• Update src/Codec/Xlsx/Parser/Stream.hs

  Show description for afa9aea
  

  jappeace

  and

  jezen

  committed
  afa9aea

  Copy full SHA for afa9aea

• Rename sstable -> sharedStrings'

  jappeace

  committed
  4ef6cb6

  Copy full SHA for 4ef6cb6

• Fix writing of empty sheetview list.

  Show description for 710422c
  jappeace

  committed
  710422c

  Copy full SHA for 710422c

• Fix collect items reversing the row order.

  Show description for 74e83b8
  jappeace

  committed
  74e83b8

  Copy full SHA for 74e83b8

• Add another square test case that's smaller

  Show description for d4b4cf1
  jappeace

  committed
  d4b4cf1

  Copy full SHA for d4b4cf1

• Filter cells or cellvalues if they contain no information

  jappeace

  committed
  c82d3b1

  Copy full SHA for c82d3b1

• Delete profiling files, flake stuff, and count rows binary

  Show description for ba9b652
  jappeace

  committed
  ba9b652

  Copy full SHA for ba9b652

• Fix CI issues

  Show description for f3f97af
  jappeace

  committed
  f3f97af

  Copy full SHA for f3f97af

• Address review comments

  Show description for 0a9c163
  jappeace

  committed
  0a9c163

  Copy full SHA for 0a9c163

• Fix more review comments

  jappeace

  committed
  1d19354

  Copy full SHA for 1d19354

• Selective imports

  jappeace

  committed
  ec5fb40

  Copy full SHA for ec5fb40

• Improve getWorkbookInfo API to include name and r:id attribute

  Show description for 2fb0eaf
  

  Tim Stapels

  authored and

  jappeace

  committed
  2fb0eaf

  Copy full SHA for 2fb0eaf

• Add countRowsInSheetByName function

  

  Tim Stapels

  authored and

  jappeace

  committed
  af0e97a

  Copy full SHA for af0e97a

• Fix confusion between sheet's r:id and sheetId

  Show description for 8d47600
  

  Tim Stapels

  authored and

  jappeace

  committed
  8d47600

  Copy full SHA for 8d47600

• Revert "Fix confusion between sheet's r:id and sheetId"

  Show description for 2f3d3ae
  

  Tim Stapels

  authored and

  jappeace

  committed
  2f3d3ae

  Copy full SHA for 2f3d3ae

• stream parser: Access individual sheets via relationships

  Show description for 91b4291
  

  Tim Stapels

  authored and

  jappeace

  committed
  91b4291

  Copy full SHA for 91b4291

• stream parser: Don't expose getWorkbookRelationships as API

  

  Tim Stapels

  authored and

  jappeace

  committed
  2077ff8

  Copy full SHA for 2077ff8

• Streaming parser: Don't error when a shared string table is absent

  

  Tim Stapels

  authored and

  jappeace

  committed
  da9446e

  Copy full SHA for da9446e

• Streaming parser: add support for inline strings

  

  Tim Stapels

  authored and

  jappeace

  committed
  ea4127a

  Copy full SHA for ea4127a

• Re-enable test suite in nix

  Show description for 17d456a
  

  Tim Stapels

  authored and

  jappeace

  committed
  17d456a

  Copy full SHA for 17d456a

• Add test that inline strings can be parsed

  

  Tim Stapels

  authored and

  jappeace

  committed
  ee518dc

  Copy full SHA for ee518dc

• Fix type in excellvaluetype docs

  Show description for 10fc4dc
  

  jappeace

  and

  qrilka

  committed
  10fc4dc

  Copy full SHA for 10fc4dc

• Fix type in internal stream comment

  Show description for 27283a9
  

  jappeace

  and

  qrilka

  committed
  27283a9

  Copy full SHA for 27283a9

• Fix typo in comment in writer/stream

  Show description for 220de36
  

  jappeace

  and

  qrilka

  committed
  220de36

  Copy full SHA for 220de36

• Fix typo in comment in writer/stream

  Show description for 7d08d86
  

  jappeace

  and

  qrilka

  committed
  7d08d86

  Copy full SHA for 7d08d86

• expose cabal, disable profiling by default.

  jappeace

  committed
  868c467

  Copy full SHA for 868c467

• Add motivation hexpat copy

  jappeace

  committed
  290f0ef

  Copy full SHA for 290f0ef

• Move typeapplications above other language pragmas

  jappeace

  committed
  c288be1

  Copy full SHA for c288be1

• Expose errors, don't use error but exception mechanism.

  jappeace

  committed
  bbcbdb8

  Copy full SHA for bbcbdb8

• Clear typealiases, rename sharedstringstate to sharedstringsstate

  jappeace

  committed
  37e928b

  Copy full SHA for 37e928b

• Fix more review comments

  jappeace

  committed
  8a94064

  Copy full SHA for 8a94064

• Apply indented stylish rules

  jappeace

  committed
  3dd5da7

  Copy full SHA for 3dd5da7

• rename mapFold -> upsertSharedString

  jappeace

  committed
  16c8e32

  Copy full SHA for 16c8e32

• Add single sheetness support to the name of writesettings

  jappeace

  committed
  0f09fed

  Copy full SHA for 0f09fed

• Remove TODO comment

  jappeace

  committed
  b509078

  Copy full SHA for b509078

• Delete inline comment about test idea

  jappeace

  committed
  5a2c8cd

  Copy full SHA for 5a2c8cd

• Split sheetitem into two types, one without sheet index

  Show description for a0d265e
  jappeace

  committed
  a0d265e

  Copy full SHA for a0d265e

• Fix docs

  jappeace

  committed
  06add90

  Copy full SHA for 06add90

• Add warning to zipOpts

  jappeace

  committed
  9fa44b7

  Copy full SHA for 9fa44b7

• replace excell -> Excel

  jappeace

  committed
  86ce3ae

  Copy full SHA for 86ce3ae

• Fix grammar issue in comments

  jappeace

  committed
  3c7bb45

  Copy full SHA for 3c7bb45

• Fix another grammar issue

  jappeace

  committed
  3d09f30

  Copy full SHA for 3d09f30

• Delete commented code

  jappeace

  committed
  7a3500f

  Copy full SHA for 7a3500f

• Add better description of Clark Notation

  Show description for c5d47b7
  jappeace

  committed
  c5d47b7

  Copy full SHA for c5d47b7

• Delete unused rels

  jappeace

  committed
  b905d85

  Copy full SHA for b905d85

• Change comment from tab support to write multiple sheets

  jappeace

  committed
  f1ef1d7

  Copy full SHA for f1ef1d7

• Delete commented out code

  jappeace

  committed
  ccce953

  Copy full SHA for ccce953

• Remove unused pragmas

  jappeace

  committed
  b6b9e71

  Copy full SHA for b6b9e71

• Remove unused dependencies

  jappeace

  committed
  b38d690

  Copy full SHA for b38d690

• Remove Reduncant lock statement from rebase

  jappeace

  committed
  f54af34

  Copy full SHA for f54af34

• Fix lex error

  jappeace

  committed
  d664e04

  Copy full SHA for d664e04

• Add counting bench

  jappeace

  committed
  a963af2

  Copy full SHA for a963af2

• Add minor api changes for figuring out the index.

  Show description for 7b84164
  jappeace

  committed
  7b84164

  Copy full SHA for 7b84164

• Merge pull request #20 from SupercedeTech/minor-api-changes-and-benchmarking

  Show description for 3220c8a
  jappeace

  authored
  3220c8a

  Copy full SHA for 3220c8a

• Add benchmarks for writing with sst and existing lib call

  Show description for d1f09f8
  jappeace

  committed
  d1f09f8

  Copy full SHA for d1f09f8

Commits on Dec 9, 2021

• Rename RowItem -> Row

  jappeace

  committed
  e22df3a

  Copy full SHA for e22df3a

Commits on Dec 14, 2021

• Add memoize functionality

  Show description for 90535dc
  jappeace

  committed
  90535dc

  Copy full SHA for 90535dc

• Merge pull request #21 from SupercedeTech/review-comments-iv

  Show description for b65d523
  jappeace

  authored
  b65d523

  Copy full SHA for b65d523

• Remove blank line

  jappeace

  committed
  6d118b7

  Copy full SHA for 6d118b7

• Remove more blank lines.

  Show description for bb30ade
  jappeace

  committed
  bb30ade

  Copy full SHA for bb30ade

Commits on Dec 15, 2021

• Clean out docs for memoized module

  Show description for 095fa1c
  jappeace

  committed
  095fa1c

  Copy full SHA for 095fa1c

Commits on Dec 19, 2021

• Fix typo readWorkbookRelatinoships -> readWorkbookrelationships

  jappeace

  committed
  e549d1f

  Copy full SHA for e549d1f