Posted inData Science Technology
Scala project under IntelliJ IDEA
Setup of a scala project using IntelliJ IDEA I suppose you have already downloaded and installed the community edition of IntelliJ IDEA from this link, that you have your java,…
Posted inCode Data Science
Spark code snippets
A growing post which gathers short pieces of code Let's suppose spark to be an opened spark session. # Open a spark session spark = SparkSession \ .builder.config(conf=conf) \ .appName("code-test").getOrCreate()…
Posted inCode Data Science kaggle
Spark and XGBoost using Scala
Spark and XGBoost using Scala language Recently XGBoost project released a package on github where it is included interface to scala, java and spark (more info at this link). I…