fix: measure descriptions and code snippets to determine if records are too large to index

fix: measure descriptions and code snippets to determine if records are too large to index #5176