[Feature Request]: Improve Documentation for Simple HTTP Calls (Decouple from Python)

[FractalMind]

What needs to be done?

The current codebase is heavily oriented toward Python, making it difficult for developers using other languages to interact with the API. Additionally, there is no documentation covering simple HTTP calls to the Docker container.

Expected Improvement

• Provide a clear and language-agnostic guide for interacting with the API using simple HTTP requests.
• Include examples of HTTP calls (e.g., curl, Postman, or raw HTTP requests in various languages).
• Ensure documentation is accessible without requiring knowledge of the internal (hidden) Python library.

What problem does this solve?

Proposed Solution

• Create a new section in the documentation that explains how to interact with the API using standard HTTP requests.
• Provide example requests and responses in a clear format.
• Ensure that non-Python developers can easily integrate with the system.

Target users/beneficiaries

Additional Context
Currently, all functionality is "hidden" within the Python library, making it difficult for developers who do not use Python to work with the API. A decoupled, well-documented approach would improve usability for a broader audience.

Would love to hear thoughts from the team! 🚀

Love the project btw, you guys are on fire!

Current alternatives/workarounds

No response

Proposed approach

No response

[aravindkarnam]

@FractalMind Thanks a bunch for this suggestion. You are absolutely right. Language agnostic API guide is the need of the hour and the API layer itself needs a lot of overhaul w.r.t the new features we've been releasing in the core library.

We'll try to prioritise this. In the mean time, you can view the docs for API here. @unclecode This is current? I can see that it's not listed anywhere in the main site.

Also I remember your contribution from a few months back, the first official docker image for Crawl4AI! It was so helpful for me, in building my project. Thanks again for your continued support and adoption of this library.