Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

How we can read and write the data to Hive? #446

Open
sunilpandey-de opened this issue Jul 5, 2021 · 3 comments
Open

How we can read and write the data to Hive? #446

sunilpandey-de opened this issue Jul 5, 2021 · 3 comments

Comments

@sunilpandey-de
Copy link

Can someone help me understand using metorikku how we can read and write the data to Hive tables.

Thank You!
@lyogev
Copy link
Contributor

lyogev commented Jul 7, 2021

Can you share your environment details? (yarn/k8s/spark-shell?) which hive you are using? what version of spark?

Thanks

@sunilpandey-de
Copy link
Author

We are running this on our development yarn cluster, Hive version 2.3 and Spark 3.0.

@lyogev
Copy link
Contributor

lyogev commented Jul 11, 2021

So hive is configured correctly in the spark-defaults etc?
If so all you need to save in hive is set tableName in your output

metorikku/config/metric_config_sample.yaml

Line 50 in 7fdd083

tableName: hive_table1

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@lyogev @sunilpandey-de