Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unable to generate the Output 'tsv' file #5

Open
sidhantwadhwani opened this issue Jul 17, 2020 · 1 comment
Open

Unable to generate the Output 'tsv' file #5

sidhantwadhwani opened this issue Jul 17, 2020 · 1 comment

Comments

@sidhantwadhwani
Copy link

Describe the bug
I have followed the steps to generate the output file in the 'tsv' format. But i am unable to get the output file.
By Following the steps, i follow these steps:

change the 'compile-local.sh', 'run.sh' and 'run-local.sh' file with the relevant spark_path, hadoop_path, master_hostname, and port.
compile the repo code using 'compile-local.sh'
execute the code by running the file './run.sh output -n 20 -m 120 -format tsv -noise 0.1 '

But still in the output i do not get the output file.

To Reproduce
Steps to reproduce the behavior:

  1. Go to 'compile.sh'.
  2. Change the value of 'SPARK' with the installation directory path of the spark.
  3. Start the Spark master this gives you the master node name(IP) and port.
  4. Using the master node IP and port from the previous port, Start the spark worker.
  5. Go to 'run.sh'.
  6. Change the value of 'MASTER' with the master node name (IP) value obtained from step3, and change the value of 'PORT' with the port value obtained from step3.
  7. Go to 'run-local.sh'.
  8. Change the value of 'SPARK_HOME' with the installation directory path of the spark, and change the value of 'HDFS_HOME' with the installation directory path of the hadoop.
  9. Then run the file 'compile.sh' to compile the code.
  10. Then run the file './run.sh output -n 20 -m 120 -format tsv -noise 0.1' to run the code.

Expected behavior
This should generate the output tsv file, i.e the graph output, but it just prints out a few paths, as per the screenshot attached.

Screenshots
trillionG_error
If applicable, add screenshots to help explain your problem.

Desktop (please complete the following information):

  • OS: [e.g. iOS]
  • Browser [e.g. chrome, safari]
  • Version [e.g. 22]

Smartphone (please complete the following information):

  • Device: [e.g. iPhone6]
  • OS: [e.g. iOS8.1]
  • Browser [e.g. stock browser, safari]
  • Version [e.g. 22]

Additional context
Add any other context about the problem here.

@chan150
Copy link
Owner

chan150 commented Jul 17, 2020

In my opinion, you should try to change the path of HDFS since you use Windows OS.
For example, try either "-hdfs ." or "-hdfs pwd"

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants