Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for spark sql #113

Open
wants to merge 18 commits into
base: main
Choose a base branch
from
+1,422 −341
Open

Add support for spark sql #113

Changes from 1 commit
Commits
Show all changes
18 commits
Select commit Hold shift + click to select a range
651fbb0
Add support for Spark SQL
jphalip Oct 31, 2023
3f18362
Updates
jphalip Nov 6, 2023
a405e6d
Multiple fixes
jphalip Nov 17, 2023
3fd7609
Fix Spark for indirect writes
jphalip Nov 22, 2023
26a751b
Add support for insert overwrites to Spark SQL
jphalip Dec 7, 2023
35459f4
Increase cloud build timeout
jphalip Dec 8, 2023
173bc0c
Attempt to fix integration tests
jphalip Dec 8, 2023
aaee23f
Change output file name and directory for Spark SQL
jphalip Dec 8, 2023
396df89
Small updates
jphalip Dec 19, 2023
03ea384
Attempt to fix test failures
jphalip Dec 25, 2023
1a2a4af
One more attempt to fix conflicts
jphalip Dec 27, 2023
0e7c698
Making progress?
jphalip Dec 27, 2023
e24610e
Another try
jphalip Dec 27, 2023
d3bc3a2
One more try
jphalip Dec 27, 2023
9c414eb
pom cleanups
jphalip Dec 27, 2023
0977af8
One more pom fix
jphalip Dec 27, 2023
927ce9b
Simplify management of grpc libs
jphalip Dec 27, 2023
d668cd5
Small tweak to Spark strategy class
jphalip Jan 5, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Attempt to fix test failures
@jphalip
jphalip committed Dec 25, 2023
commit 03ea38424a5dce2e084bf85acedc8644965e82d1
12 changes: 12 additions & 0 deletions hive-2-bigquery-connector/pom.xml
View file
Original file line number Diff line number Diff line change
@@ -18,6 +18,12 @@
<groupId>${project.groupId}</groupId>
<artifactId>hive-bigquery-connector-common</artifactId>
<version>${project.version}</version>
<exclusions>
<exclusion>
<artifactId>grpc-netty-shaded</artifactId>
<groupId>io.grpc</groupId>
</exclusion>
</exclusions>
</dependency>

<dependency>
@@ -34,6 +40,12 @@
<version>${project.version}</version>
<type>test-jar</type>
<scope>test</scope>
<exclusions>
<exclusion>
<artifactId>grpc-netty-shaded</artifactId>
<groupId>io.grpc</groupId>
</exclusion>
</exclusions>
</dependency>

<dependency>