Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add guidance and requirement/suggestion for creating feasible computation when full computation is long #30

Open
larsvilhuber opened this issue May 13, 2021 · 1 comment
Assignees

Comments

@larsvilhuber
Copy link
Contributor

Some computations, as presented in the paper, may run for a very long time.

Authors should be encouraged (required?) to provide instructions on how to run "feasible" computations (instead of 1,000 bootstraps, run only 10; instead of full sample, run with a 1% sample) and how it might impact the output.

This is different from creating synthetic data.

@joanllull
Copy link

joanllull commented May 13, 2021

This is actually an interesting point.

We do this indeed (only encountered two examples so far, but I expect to encounter more when I take over at Econometrics Journal). In one of the examples, we required a smaller number of simulations, in the other we only checked the solution code but not the estimation code (it was using pre-specified routines and synthetic data, otherwise, we would have required a small function to test that minimization actually works).

When this happen, in the paper we then certify the following in the paper: "Given the highly demanding nature of the algorithms, the replication checks were run on a simplified version of the code, which is also available at [...]"

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants