Tools: Tool for minimal review of pull request content by LLM

[ktyubeshi]

Overview

This script reviews the contents of pull requests using an LLM.
Ideally, submitted pull requests should be reviewed by native speakers.
However, in the absence of reviewers, this script will minimally ensure there are no issues with the content.

Idea

• Extracts the entries generated by the differences in the pull request.
• Checks each entry with an LLM, such as GPT, for deviations from the original text or any obvious issues, and outputs the responses in a report.

Note

Ideally, it would include consistency checks, but this is not easy due to the volume of information that must be processed at once. It will likely require a combination of techniques such as vector search and a lot of trial and error.

The initial script will perform checks that are able to be completed individually for each entry.