0.1.11

Changes

• feat: add openai compatible path @tikikun (#153)

📖 Documentaion

• Update Nitro docs @hahuyhoang411 (#128)

Contributor

@hahuyhoang411, @tikikun and @vuonghoainam

0.1.10

Changes

• Hotfix embedding @tikikun (#149)
• chore: change the typo for model loading @tikikun (#148)

🧰 Maintenance

• [CI] Update nitro options for init and inference @vuonghoainam (#147)

Contributor

@tikikun and @vuonghoainam

0.1.9

Changes

• feat: add warmup model back @tikikun (#146)
• feat: make non stream completion possible to be fully compatible with… @tikikun (#143)

🚀 Features

• Addition of New install.sh for linux, macos and install.bat for windows @hiento09 (#134)

🧰 Maintenance

• Add c/c++ file extension trigger for nitro CI @hiento09 (#144)

Contributor

@hiento09 and @tikikun

0.1.8

Changes

• hotfix: model_loaded status @tikikun (#131)
• Update Nitro docs @hahuyhoang411 (#127)

Contributor

@hahuyhoang411 and @tikikun

0.1.7

Changes

• feat: add model status and information dump @tikikun (#123)
• Unload model stop background @tikikun (#122)

Contributor

@tikikun

0.1.6

Changes

• Update docs on Nitro Github @hahuyhoang411 (#116)
• Refactor params get @tikikun (#114)
• 82 feat add custom user assistant prompt option as a server option for nitro @tikikun (#111)

Contributor

@hahuyhoang411 and @tikikun

0.1.5

Changes

• hotfix: update bug fixes for recent batch inference @tikikun (#109)
• 41 feat batch inference for nitro @tikikun (#101)

🧰 Maintenance

• disable DBUILD_SHARED_LIBS cmake windows cuda @hiento09 (#108)

Contributor

@hiento09, @jan-service-account and @tikikun

0.1.4

Changes

🧰 Maintenance

• Nitron linux allow all cors for cloud-native @hiento09 (#98)

Contributor

@hiento09

0.1.3

Changes

• chore: Amend license from MIT to AGPLv3 @dan-jan (#92)

🚀 Features

• Simple e2e testing for nitro binary file @hiento09 (#95)

🧰 Maintenance

• Simple e2e testing for nitro binary file @hiento09 (#95)

Contributor

@dan-jan, @hiento09 and @tikikun

0.1.2

Changes

• Add Windows DLL for runtime @vuonghoainam (#91)
• 76 massively improve nitro documentation @tikikun (#84)
• 63 feat nitro speed up for 1st inference time after model loaded @tikikun (#83)
• turn off logging for llama cpp @tikikun (#81)
• add extra params @tikikun (#79)
• pump llama cpp latest version @tikikun (#78)
• feat: CI/CD and windows with/ without GPU @vuonghoainam (#64)

🧰 Maintenance

• Correct robocopy command @hiento09 (#87)
• fix(ci): Update packaging step for config.json file @vuonghoainam (#75)

Contributor

@hiento09, @jan-service-account, @tikikun and @vuonghoainam