Jump to content

janala mindsets


vendettaa

Recommended Posts

6 minutes ago, vendettaa said:

Office lo work unatte anpistundi munduki potledu proper lead leka

Busy busy untunna

nee yenkamma proper lead leka pani aagi povudu ok ...

nuvve lead cheyochu kada... u have that jeal and talent no

Link to comment
Share on other sites

Prathi vallu ilanti values e cheptharu, intikelli sri reddy debates and big boss 2 lanti ethics leni shows e enjoy chestharu. 

Bitching is in our indian genes. sacche dhaka podhu. 

Link to comment
Share on other sites

Inthaki oka anmayi chaala manditho affairs pettukovadam , adigithe it’s my choice Anadam first category r second ani bul bul fruit adigadu.. naku antha knowledge leka ikkada vesa 

Link to comment
Share on other sites

1 minute ago, kiraak_poradu said:

nee yenkamma proper lead leka pani aagi povudu ok ...

nuvve lead cheyochu kada... u have that jeal and talent no

Antaledu ok chepta

we have 2 clusters

one cluster has Hadoop spark 

another one is spark standalone cluster on ec2 instance 

am supposed to build data pipeline using scala spark and deploy on these clusters 

so I have one of the source and target as Hadoop , so I developed application which gets data from Hadoop and writes to Hadoop and am running this job successfully on cluster which has hadoop 

withins 2 mins cassandra,kafka annitlo data save avtundi with logic implemented when I submit spark jar

ipdu nannu spark standalone lo deploy cheymantunnaru which doesn’t have Hadoop and cannot support hive server 2 ,endukante the spark we r using is 2.4.0

so java driver manager use chesi connecting to remote cluster and writing it adi 3000 records ki 1 hour tiskuntundi ,performance improve cheydam kastam ga undi

actually idi critical project remote cluster lo unna hive Loki data load cheydam feaseable ga ledu,it’s damn slow 

so agipoindi

they are supposed to have everything in one cluster 

ma lead spark standalone cluster manadi,ide use cheddam antadu ,adi processing ki tappa deniki paniki radu

ade vere cluster which is maintained by other team ,it has spark Hadoop on one cluster 

ma lead ki vere team mida depend kadam istam ledu ala ani  deni mida ekuva dependency untundo danike priority ivvali gani

prod lo remote cluster lo unna hive ki millions of records from another cluster write cheydam anta tikkala pani undadu ani na abhiprayam

 

Link to comment
Share on other sites

6 minutes ago, JohnSnow said:

Prathi vallu ilanti values e cheptharu, intikelli sri reddy debates and big boss 2 lanti ethics leni shows e enjoy chestharu. 

Bitching is in our indian genes. sacche dhaka podhu. 

oka saameta undi deeniki.  Cheppedi Sri Ranga neetulu, Dooredi Dommari gudesalu:)

Link to comment
Share on other sites

Just now, vendettaa said:

Antaledu ok chepta

we have 2 clusters

one cluster has Hadoop spark 

another one is spark standalone cluster on ec2 instance 

am supposed to build data pipeline using scala spark and deploy on these clusters 

so I have one of the source and target as Hadoop , so I developed application which gets data from Hadoop and writes to Hadoop and am running this job successfully on cluster which has hadoop 

withins 2 mins cassandra,kafka annitlo data save avtundi with logic implemented when I submit spark jar

ipdu nannu spark standalone lo deploy cheymantunnaru which doesn’t have Hadoop and cannot support hive server 2 ,endukante the spark we r using is 2.4.0

so java driver manager use chesi connecting to remote cluster and writing it adi 3000 records ki 1 hour tiskuntundi ,performance improve cheydam kastam ga undi

actually idi critical project remote cluster lo unna hive Loki data load cheydam feaseable ga ledu,it’s damn slow 

so agipoindi

they are supposed to have everything in one cluster 

ma lead spark standalone cluster manadi,ide use cheddam antadu ,adi processing ki tappa deniki paniki radu

ade vere cluster which is maintained by other team ,it has spark Hadoop on one cluster 

ma lead ki vere team mida depend kadam istam ledu ala ani  deni mida ekuva dependency untundo danike priority ivvali gani

prod lo remote cluster lo unna hive ki millions of records from another cluster write cheydam anta tikkala pani undadu ani na abhiprayam

 

em kadu kaka be cool. 

anni avthayi ... jayeebhava

Link to comment
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

×
×
  • Create New...