Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

precision for vdc file #28

Open
rhjdvsgsgks opened this issue Jan 14, 2025 · 1 comment
Open

precision for vdc file #28

rhjdvsgsgks opened this issue Jan 14, 2025 · 1 comment

Comments

@rhjdvsgsgks
Copy link

hi

i noticed vdc file usually have 16 digits precision. but viperDdc.SetCoeffs only accepts (and processing in) float. which caused some precision lose. is that a expected behavior?

@iscle
Copy link
Collaborator

iscle commented Jan 14, 2025

I'm not sure if we did as part of the RE'ing or was part of ViPER already. Either way, we can easily set to double (will use up more memory and cpu but who cares at this point).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants