Skip to content

Commit

Permalink
update docs
Browse files Browse the repository at this point in the history
  • Loading branch information
claromes committed Jun 23, 2024
1 parent b3f78fb commit 72d55f0
Show file tree
Hide file tree
Showing 11 changed files with 33 additions and 35 deletions.
Binary file modified assets/preview_image.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added assets/waybacktweets_title.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
5 changes: 5 additions & 0 deletions docs/_static/css/custom.css
Original file line number Diff line number Diff line change
@@ -1,5 +1,10 @@
body {
font-family: Georgia, 'Times New Roman', Times, serif;
background-color: whitesmoke;
}

a:hover {
background-color: whitesmoke !important;
}

#cli #usage #waybacktweets h3,
Expand Down
2 changes: 1 addition & 1 deletion docs/conf.py
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@
project = "Wayback Tweets"
release, version = get_version("waybacktweets")
rst_epilog = f".. |release| replace:: v{release}"
copyright = f"2023 - {datetime.datetime.now().year}, Claromes · Icon by The Doodle Library · Title font by Google, licensed under the Open Font License · Release: v{release}" # noqa: E501
copyright = f"2023 - {datetime.datetime.now().year}, Claromes · Icon by The Doodle Library · Title font by Google, licensed under the Open Font License · Pre-release: v{release}" # noqa: E501
author = "Claromes"

# -- General configuration ---------------------------------------------------
Expand Down
3 changes: 2 additions & 1 deletion docs/contribute.rst
Original file line number Diff line number Diff line change
Expand Up @@ -23,9 +23,10 @@ Install from the source, following the :ref:`installation` instructions.

Brief explanation about the code under the Wayback Tweets directory:

- ``app``: Streamlit app
- ``app``: Streamlit application code
- ``assets``: Title and logo images
- ``docs``: Documentation generated with Sphinx
- ``legacy_app``: Legacy Streamlit application code
- ``waybacktweets/api``: Main package modules
- ``waybacktweets/config``: Global configuration module
- ``waybacktweets/exceptions``: Wayback Tweets Exceptions
Expand Down
22 changes: 13 additions & 9 deletions docs/index.rst
Original file line number Diff line number Diff line change
Expand Up @@ -3,13 +3,18 @@
Wayback Tweets
================

.. image:: ../assets/waybacktweets.png
.. image:: ../assets/waybacktweets_title.png
:alt: Wayback Tweets
:align: center

Release: |release|
Pre-release: |release|

Retrieves archived tweets CDX data from the Wayback Machine, performs necessary parsing (see :ref:`field_options`), and saves the data in CSV, JSON, and HTML formats.

.. image:: ../assets/preview_image.jpg
:alt: Preview image
:align: center

.. note::
Intensive queries can lead to rate limiting, resulting in a temporary ban of a few minutes from web.archive.org.

Expand All @@ -36,23 +41,22 @@ Command-Line Interface

cli


API Reference
---------------
Streamlit Web App
-------------------

.. toctree::
:maxdepth: 2

api
streamlit


Streamlit Web App
-------------------
API Reference
---------------

.. toctree::
:maxdepth: 2

streamlit
api


Additional Information
Expand Down
19 changes: 10 additions & 9 deletions docs/streamlit.rst
Original file line number Diff line number Diff line change
@@ -1,6 +1,3 @@
.. note::
The current version of the Web App is 0.4.3. Version 1.0 has not yet been implemented in the Streamlit Web App, as it is in the review and testing phase.

Web App
=========

Expand All @@ -13,15 +10,13 @@ Filters
----------
- Filtering by date range: Using the ``from`` and ``to`` filters

- Only unavailable tweets: Checks if the archived URL still exists on Twitter (see the :ref:`flowchart`)

- Only unique Wayback Machine URLs: Filtering by the collapse option using the ``urlkey`` field and the URL Match Scope ``prefix``
- Limit: Query result limits.

- Offset: Allows for a simple way to scroll through the results.

Pagination
------------
- Only unavailable tweets: Checks if the archived URL still exists on Twitter (see the :ref:`flowchart`)

Pagination allows viewing up to 25 tweets per page. This helps to avoid rate limiting from the API, for parsing returns with the mimetype ``application/json``.
- Only unique Wayback Machine URLs: Filtering by the collapse option using the ``urlkey`` field and the URL Match Scope ``prefix``


Community Comments
Expand All @@ -48,6 +43,12 @@ Community Comments
<br>
</ul>

Legacy App
-------------

To access the legacy version (v0.4.3) of Wayback Tweets `click here <https://waybacktweets-legacy.streamlit.app>`_.


.. note::

If the application is down, please check the `Streamlit Cloud Status <https://www.streamlitstatus.com/>`_.
Expand Down
2 changes: 0 additions & 2 deletions docs/todo.rst
Original file line number Diff line number Diff line change
Expand Up @@ -5,8 +5,6 @@ TODO

<input type="checkbox">

|uncheck| Review and publish the new version of the Streamlit Web App

|uncheck| Unit Tests

|uncheck| JSON Parser: Create a separate function to handle JSON return, apply JsonParser (``waybacktweets/api/parse.py:111``), and avoid rate limiting
Expand Down
11 changes: 0 additions & 11 deletions legacy_app/.streamlit/config.toml

This file was deleted.

2 changes: 1 addition & 1 deletion pyproject.toml
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
[tool.poetry]
name = "waybacktweets"
version = "1.0a2"
version = "1.0a3"
description = "Retrieves archived tweets CDX data from the Wayback Machine, performs necessary parsing, and saves the data."
authors = ["Claromes <[email protected]>"]
license = "GPLv3"
Expand Down
2 changes: 1 addition & 1 deletion waybacktweets/api/parse.py
Original file line number Diff line number Diff line change
Expand Up @@ -111,7 +111,7 @@ class JsonParser:
"""
This class is responsible for parsing tweets when the mimetype is application/json.
Note: This class is in an experimental phase, but it is currently being used by the Streamlit Web App.
Note: This class is in an experimental phase.
Args:
archived_tweet_url (str): The URL of the archived tweet to be parsed.
Expand Down

0 comments on commit 72d55f0

Please sign in to comment.