- Use uuid for s3 identifiers Update unique id to use uuid derived from file path rather than the filepath itself.
- V2 connectors precheck support All steps in the v2 pipeline support an optional precheck call, which encompasses the previous check connection functionality.
- Filter Step Support dedicated step as part of the pipeline to filter documents.
- Add Milvus destination connector Adds support storing artifacts in Milvus vector database.
- Remove old repo references Any mention of the repo this project came from was removed.
- Initial Migration Create the structure of this repo from the original code in the Unstructured project.