Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add option to use index first in table scan #116

Closed
wants to merge 6 commits into from
Closed

Conversation

birdstorm
Copy link
Contributor

for this issue
in correspondence to this pull request

README.md Outdated
@@ -58,6 +58,7 @@ Below configurations can be put together with spark-defaults.conf or passed in t
| spark.tispark.meta.reload_period_in_sec | 60 | Metastore reload period in seconds |
| spark.tispark.plan.allow_agg_pushdown | true | If allow aggregation pushdown (in case of busy TiKV nodes) |
| spark.tispark.plan.allow_index_double_read | false | If allow index double read (which might cause heavy pressure on TiKV) |
| spark.tispark.plan.use_index_scan_first | false | Use index prior to table scan (takes effect only when `allow_index_double_read` is set true) |
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is set to

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

done

@@ -3,5 +3,5 @@ tidb.port=4000
tidb.user=root
test.mode=Test
test.ignore=tpch
test.sql=select tp_datetime from full_data_type_table
test.db=tispark_test
test.sql=select sum(c1) from guoshui group by c1
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

May need to remove this file.

@Novemser
Copy link
Contributor

Novemser commented Dec 7, 2017

@birdstorm Please resolve the conflicts.

@@ -58,6 +58,7 @@ Below configurations can be put together with spark-defaults.conf or passed in t
| spark.tispark.meta.reload_period_in_sec | 60 | Metastore reload period in seconds |
| spark.tispark.plan.allow_agg_pushdown | true | If allow aggregation pushdown (in case of busy TiKV nodes) |
| spark.tispark.plan.allow_index_double_read | false | If allow index double read (which might cause heavy pressure on TiKV) |
| spark.tispark.plan.use_index_scan_first | false | Use index prior to table scan (takes effect only when `allow_index_double_read` is set to true) |
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actually what we want is finer grain control over which index to choose. We already has an option to enable/disable index. It will be redundant to have index_first option.

@ilovesoup
Copy link
Contributor

I will close this first.

@ilovesoup ilovesoup closed this Dec 11, 2017
@Novemser Novemser deleted the add_index_hint branch December 25, 2017 08:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants