Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add custom modeling to Language Processing #148

Open
2 tasks
jeffpaul opened this issue Oct 10, 2019 · 2 comments
Open
2 tasks

Add custom modeling to Language Processing #148

jeffpaul opened this issue Oct 10, 2019 · 2 comments
Milestone

Comments

@jeffpaul
Copy link
Member

Is your enhancement related to a problem? Please describe.
We currently utilize Azure's Text Analytics for the Language Processing functionality, but you're forced to accept what the general Text Analytics model has learned to get feedback in the form of tags. A parallel option could be to utilize the Language Understanding service and further train that model to be site-specific. This would seem to provide a more precise set of language processing results unique to a specific site, though a downside could be pricing of Language Understanding compared to Text Analytics.

Describe the solution you'd like

  • setting to enable Language Understanding instead of Text Analytics
  • if user edits tags for a piece of content, send that data back to Language Understanding to further train the model

Designs
n/a

Describe alternatives you've considered
Keep ClassifAI as-is with Text Analytics and instead work to add additional functionality instead of more complex functionality as described here.

Additional context
n/a

@jeffpaul jeffpaul added this to the Future Release milestone Oct 10, 2019
@jeffpaul
Copy link
Member Author

Bah, I quickly created this after creating #147 and completely forgot that it's Watson NLU for the language processing. Still, the idea holds of allowing us to swap Watson NLU out for a custom modeling service that could learn from any edits that a site owner makes to tags. I'll update this issue to be more accurate to ClassifAI's currently service providers in a bit, mea culpa.

@jeffpaul
Copy link
Member Author

jeffpaul commented May 6, 2021

Watson NLU announced custom classifcations now in beta and custom category models as well (which are both part of their broader NLU custom model offerings), so this is something that could begin to be explored should the market/community see value in custom text classifications.

@jeffpaul jeffpaul modified the milestones: Future Release, 2.6.0 Jul 7, 2023
@dkotter dkotter modified the milestones: 3.1.0, 3.2.0 Jul 12, 2024
@dkotter dkotter modified the milestones: 3.2.0, 3.3.0 Dec 11, 2024
@jeffpaul jeffpaul modified the milestones: 3.3.0, 3.4.0 Jan 7, 2025
@jeffpaul jeffpaul moved this from Incoming to Backlog in Open Source Practice Jan 7, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Backlog
Development

No branches or pull requests

2 participants