You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
i noticed vdc file usually have 16 digits precision. but viperDdc.SetCoeffs only accepts (and processing in) float. which caused some precision lose. is that a expected behavior?
The text was updated successfully, but these errors were encountered:
I'm not sure if we did as part of the RE'ing or was part of ViPER already. Either way, we can easily set to double (will use up more memory and cpu but who cares at this point).
hi
i noticed vdc file usually have 16 digits precision. but
viperDdc.SetCoeffs
only accepts (and processing in) float. which caused some precision lose. is that a expected behavior?The text was updated successfully, but these errors were encountered: