Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Finetune CLI #28

Open
wants to merge 26 commits into
base: main
Choose a base branch
from
Open

Finetune CLI #28

wants to merge 26 commits into from

Conversation

oleander
Copy link
Owner

@oleander oleander commented Feb 8, 2025

No description provided.

oleander and others added 25 commits February 7, 2025 14:37
@oleander
test
7d9843b
@oleander
Add profiling feature with macro for measuring execution time
fe94188
@oleander
Refactor diff processing, optimize token handling and storage
462b75d
@oleander
Update test signatures and add profiling tests
2ea378d
@oleander
Refactor GitFile signatures and commit messages
37e5b2e 
Optimize PatchDiff with parallel processing

Add rayon dependency to Cargo.toml

Remove redundant patch tests

Update Cargo.lock with new dependencies

Remove profiling tests
@oleander
Update Cargo.lock dependencies and checksums
c87b0d2
@oleander
Update dependencies in Cargo.toml and Cargo.lock
7eb1eb7
@oleander
Add StringPool for efficient memory use in PatchDiff
e2df5f4
@oleander
Update dependencies in Cargo.toml and Cargo.lock
bf3110f
@oleander
Add num_cpus crate and parallelize file processing
63a498c
@oleander
Refactor file processing to use parallel chunks and atomic tokens
6a5051b
@oleander
Remove redundant import of bail from anyhow
7ed087b
@oleander
Sort files by token count in PatchDiff implementation.
51f9609
@oleander
Delete test.txt file
5e50a25
@oleander
Improve error handling and path management in config and style modules
d49f534
@oleander
Add tests for StringPool functionality in hook.rs
600e5fd
@oleander
Update default model and add profiling to model and commit functions
450381d
@oleander
Add profiling to filesystem module functions
00faa02
@oleander
Implement token counting and generation for commit messages
4a7d5d8
@oleander
Add documentation for Filesystem, File, and Dir structs in filesystem.rs
a5833c8
@oleander
Refactor commit message generation methods and file handling logic
5384690
@oleander
Implement configuration file management and update functions in App
fa47b5b
@oleander
Implement parallel processing of diff data in PatchDiff trait
c7778e6
```
da74cd4 
feat: Add Finetune functionality and related files

- Introduce finetune.rs to manage fine-tuning workflows with OpenAI.
- Create finetune.md for documenting the finetuning process.
- Update Cargo.toml and Cargo.lock with necessary dependencies for finetuning.
- Add stats.json to track various parameters in the finetuning process.
```
```
7b9aa2f 
delete: remove stats.json file

Based only on the changes visible in the diff, this commit deletes the stats.json file.
```
@oleander oleander changed the base branch from main to feature/speed February 8, 2025 05:07
Base automatically changed from feature/speed to main February 8, 2025 15:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@oleander