Jump to content

Client daggara Spark Sahayam kavali.... urgent

powerking

By powerking
in Discussions

 Share

Recommended Posts

kasi Celebrity

kasi

Posted
Posted
On 8/3/2017 at 0:09 AM, powerking said:

Using PySpark ... trying to connect Hive tables and working on querying to get result sets for analysis.... 

My query is, how do we create Hive tables with 100 columns on files which are in hdfs... later I want to query these tables in spark ( preferably Pyspark) for analytics.... 

I know I can do this in Spark SQL but Indexing is something I wanna consider here.... correct me 

I'll be heading to Linkedin anyway.... Thanks for the response 

Please do let me know if anyone worked on the scenario mentioned above...

Peace Out !

check your PM,,,,,

Link to comment
Share on other sites
kasi Celebrity

kasi

Posted
Posted
On 8/3/2017 at 0:09 AM, powerking said:

Using PySpark ... trying to connect Hive tables and working on querying to get result sets for analysis.... 

My query is, how do we create Hive tables with 100 columns on files which are in hdfs... later I want to query these tables in spark ( preferably Pyspark) for analytics.... 

I know I can do this in Spark SQL but Indexing is something I wanna consider here.... correct me 

I'll be heading to Linkedin anyway.... Thanks for the response 

Please do let me know if anyone worked on the scenario mentioned above...

Peace Out !

does you file have a header???

Link to comment
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

×
 Share
Go to topic listing
×
×
  • Create New...