Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

remove int16 but test the float dtypes #33

Merged
merged 2 commits into from
Jul 25, 2024
Merged

Conversation

keewis
Copy link
Member

@keewis keewis commented Jul 25, 2024

This only works by restricting the values the data can have; inf and very high values, as well as subnormals, cause the values to diverge significantly (different numerical operations).

keewis and others added 2 commits July 25, 2024 16:33
@keewis keewis merged commit 6ecb6a0 into IAOCEA:main Jul 25, 2024
6 checks passed
@keewis keewis deleted the convolution-tests branch July 25, 2024 14:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant