Help - Hadoop/hive admins

[mettastar]

Hive lo at a time only one query run cheyagaluguthunna.. not able to run concurrently .. second query is waiting for first one to finish atleast 70-80% mappers then only starting

[mettastar]

Due to some reasons indulo only MR engine and hive 1.0 version ey vaadali .. fyi..

Anduli em configs chesthe work avuthundo selava ivandi punyam untadi.. google chesthe kuda doriki saavatla

[mettastar]

Ltt

[mettastar]

Calling @xxxmen

[mettastar]

Ltt

[Piscina]

6 hours ago, mettastar said:

Hive lo at a time only one query run cheyagaluguthunna.. not able to run concurrently .. second query is waiting for first one to finish atleast 70-80% mappers then only starting

Ask admins to change # ofsessions in users profile 

[nako_job_kavali]

8 hours ago, mettastar said:

Hive lo at a time only one query run cheyagaluguthunna.. not able to run concurrently .. second query is waiting for first one to finish atleast 70-80% mappers then only starting

Try to increase the container size bhayya....and hive server heap size increase cheyadaniki try chey...

[WeBeliveInTigerman]

What is the cluster size?.. May be there are no more vcores left on the Custer. Check yarn UI

[xxxmen]

8 hours ago, mettastar said:

Calling @xxxmen

nenu Hadoop kadu vayya Ofenstack

[mettastar]

Cluster 5 node .. nothings runs on the cluster.. no admins .. adi EMR cluster.

 

[mettastar]

2 hours ago, Piscina said:

Ask admins to change # ofsessions in users profile 

Bro hive config file lo em param o telsa.. ?

[mettastar]

13 minutes ago, WeBeliveInTigerman said:

What is the cluster size?.. May be there are no more vcores left on the Custer. Check yarn UI

Em run katle cluster paina

[mettastar]

1 hour ago, nako_job_kavali said:

Try to increase the container size bhayya....and hive server heap size increase cheyadaniki try chey...

Im trying to run couple of small jobs .. antha resource use cheyavu.. just want to check if i can run them concurrently..

CLI lo hive commands submit chesthe concurrent run kaava

[nako_job_kavali]

28 minutes ago, mettastar said:

Im trying to run couple of small jobs .. antha resource use cheyavu.. just want to check if i can run them concurrently..

CLI lo hive commands submit chesthe concurrent run kaava

Avuthay....kaani check if the heap size is low...heap size is mainly for the process to start or initialize....so oka query run avutundaga inko query initialize avvadaniki enuf memory ledhu....

[Allarinaresh10]

9 hours ago, mettastar said:

Hive lo at a time only one query run cheyagaluguthunna.. not able to run concurrently .. second query is waiting for first one to finish atleast 70-80% mappers then only starting

 

9 hours ago, mettastar said:

Due to some reasons indulo only MR engine and hive 1.0 version ey vaadali .. fyi..

Anduli em configs chesthe work avuthundo selava ivandi punyam untadi.. google chesthe kuda doriki saavatla

 

config file lo idi set chesi try cheyyi  ...  hive.exec.parallel to true

 

<property>  

<name>hive.exec.parallel</name>  

<value>true</value>

<description>Whether to execute jobs in parallel</description>

</property>

 

<property>  

<name>hive.exec.parallel.thread.number</name>  

<value>8</value>

<description>How many jobs at most can be executed in parallel</description>

</property>