fix bugs on database search

[sgjzfzzf]

PR Category

Model Test

Type of Change

Bug Fix

Description

When reading the cache of the compiled kernel, the read index sometimes could be an error. You can replay this bug with the following script.

import flag_gems
import torch


x = torch.randn((256, 256), device="cuda")
y = torch.randn((256, 256), device="cuda")
with flag_gems.use_gems():
    z0 = torch.matmul(x, y)
    z1 = torch.matmul(x, y)

In the PR, it reads by filter, not index, so it has no relationship with the parameter storage position.

Issue

Progress

• Change is properly reviewed (1 reviewer required, 2 recommended).
• Change is responded to an issue.
• Change is fully covered by a UT.

Performance