You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Fusio has its own HttpClient abstraction that can integrate with different async runtimes. We can integrate OpenDAL with this HTTP client to avoid relying on reqwest instead.
OpenDAL offers excellent support for buffering and concurrency, making it very easy to upload a large file in 16 parts.
let w = op.writer_with(path).buffer(8*1024*1024).concurreny(16).await?;
w.write(data).await?;// repeat writing data...
w.close().await?;
fusio::Fs doesn't offer such features for opendal to adjust those settings; perhaps we can configure them using OpendalFs instead.
create_dir_all doesn't implement correctly
fusio::Fs::create_dir_all doesn't take &self which makes it's impossible for fusio_opendal to implement it correctly.
Docs and examples
fusio_opendal can serve as an excellent fallback for any services we do not support for now. Perhaps we can include this in our documentation and add corresponding examples.
Unit tests and integration tests
We can implement unit tests using opendal's memory service and possibly add integration tests for other services like S3, GCS, or AzBlob, depending on our users' needs.
The text was updated successfully, but these errors were encountered:
This issue is used to track future work on Fusio OpenDAL Integration.
Tasks
Integrate with fusio's own
HttpClient
Fusio has its own
HttpClient
abstraction that can integrate with different async runtimes. We can integrate OpenDAL with this HTTP client to avoid relying onreqwest
instead.Visit opendal's
HttpFetch
for more information.Integrate better with opendal's buffer/concurreny
OpenDAL offers excellent support for buffering and concurrency, making it very easy to upload a large file in 16 parts.
fusio::Fs
doesn't offer such features for opendal to adjust those settings; perhaps we can configure them usingOpendalFs
instead.create_dir_all
doesn't implement correctlyfusio::Fs::create_dir_all
doesn't take&self
which makes it's impossible forfusio_opendal
to implement it correctly.Docs and examples
fusio_opendal
can serve as an excellent fallback for any services we do not support for now. Perhaps we can include this in our documentation and add corresponding examples.Unit tests and integration tests
We can implement unit tests using opendal's memory service and possibly add integration tests for other services like S3, GCS, or AzBlob, depending on our users' needs.
The text was updated successfully, but these errors were encountered: