Improve performance of analysis of all vocabulary terms #327
Assignees
Labels
performance
Performance issue
Comments
|
Given the way text analysis works, my idea is that TermIt would take definitions of all terms in a vocabulary, join them into a single HTML document where for each term there would be an element with id corresponding to the term. After analysis, the document would be split based on these elements and process the results as usual. This would mean there would be just one call to the text analysis service and the results could be processed in a single transaction. <html>
<body>
<div id="http://example.com/termOne">
Term one definition text
</div>
<div id="http://example.com/termTwo">
Term two definition
</div>
</body>
</html> |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
When a term's label or definition changes, it triggers text analysis of all terms in the same vocabulary. This can be quite time consuming when a vocabulary is large. As each term is analyzed separately, we should consider trying to batch the analysis, for example by joining the definitions into a single string that could be analyzed in one go and then separate the parts again in post-processing.
The text was updated successfully, but these errors were encountered: