help: teradata spark write

[AleAle]

attention seeking ani savagottaddu

stackover flow, teradata forums anni chusesi work out kaka ikda post chestunna , may be solution dorkutadani

genuine doubt stuck since a day

opened shell with the below command:

spark-shell --jars "terajdbc4.jar,tdgssconfig.jar" --conf spark.debug.maxToStringFields=100 --verbose --master yarn  --driver-memory 2g --driver-cores 1 --executor-memory 3g --num-executors 4 --executor-cores 3  -- --output-method internal.fastload

 

data frame is 

df.write.
format("jdbc").
option("url", "jdbc:teradata://abcd.com").
option("dbtable", "dbname.tablename").
option("user", "userid").
option("password", "pwd").
mode("overwrite").
option("driver","com.teradata.jdbc.TeraDriver").
save()                   

trying to write data frame from spark to teradata, its working with less volume of data (10,000 records)

but when i try to load huge volumes like more than million records its failing:  

 

 

evaraina work chesara dini mida? 

chesunte help me out
 

Issue fixed topic close ,thread closed

[AleAle]

@mettastar  @Allarinaresh10 help

[No_body_friends]

Google,stack overflow lantivi thelusa? 

[Scada]

Just now, No_body_friends said:

Google,stack overflow lantivi thelusa? 

11 minutes ago, AleAle said:

stackover flow, teradata forums anni chusesi work out kaka ikda post chestunna , may be solution dorkutadani

 

[DannyArcher]

Support.  

[bostonBOSS]

4 minutes ago, No_body_friends said:

Google,stack overflow lantivi thelusa? 

paina ade kada cheppindi.. ikkada kuda oka stone vestundi 

[AleAle]

Issue solve chesa 

topic closed

endo ikda post chesina ventane am

able to solve myself

[Unityunity2]

Just now, AleAle said:

Issue solve chesa 

topic closed

endo ikda post chesina ventane am

able to solve myself

How did you solved it

Let us know useful for others 

[AleAle]

15 minutes ago, Unityunity2 said:

How did you solved it

Let us know useful for others 

Applied partition by on dataframe

[No_body_friends]

19 minutes ago, AleAle said:

Issue solve chesa 

topic closed

endo ikda post chesina ventane am

able to solve myself

@Android_Halwa

[GucciGang]

are you @Minniee monna same post vesav

[Hydrockers]

3 hours ago, GucciGang said:

are you @Minniee monna same post vesav

+1