Apache spark project in Eclipse with Maven

If you are really looking to develop some spark projects, the easiest and best option would be eclipse with Maven which gives all framework tools to do the development easier.There are some tutorial videos in youtube which explain how to install and start with it.

I just started with the 'wordcount' program, once I configured the eclipse&scala IDE in Ubuntu.

My screenshots:

Spark Eclipse Maven Live video record:






Youtube tutorials:

spark streaming

Spark Streaming from local Network and Counting the words in near to real time. This is awesome!!.



Next I like to find some trending news/feeds using apache spark streaming.

Machine Learning

Machine learning , nice word. I know that I was studying about machines/computers from Plus+2. Then what is new in this learning :-).But this is different.Here we makes Machine to learn from its previous experience or outputs/inputs. If you want to give a try on ML, I think this is a best course to start with Free and Open source materials .

apache spark- a software which gives you great learning experience

The beauty of open source projects is that if you try to learn it , it will take you through lot of subject areas that you never heard about. Apache Spark is one of them for me. I started hearing about it when I started to follow big data&hadoop. Ok,I thought , let me install it in my ubuntu machine . I found that it is quite easy and the interesting part is that it took me through interesting subjects like ML(machine learning), Streaming,functional programming (scala) etc..

Apache Spark Machine Learning Tutorial | MapR

Apache Spark Machine Learning Tutorial | MapR

Introduction to Spark Architecture

After seeing the below video , I understood that the importance learning new programming languages. The new languages are coming with some new ideas. More than learning the new languages in the perspective of Jobs opening, those are quite interesting to know how and where the research happens to create new technologies.