Tuesday, December 13, 2016

Apache spark project in Eclipse with Maven

If you are really looking to develop some spark projects, the easiest and best option would be eclipse with Maven which gives all framework tools to do the development easier.There are some tutorial videos in youtube which explain how to install and start with it.

I just started with the 'wordcount' program, once I configured the eclipse&scala IDE in Ubuntu.

My screenshots:






Spark Eclipse Maven Live video record:






Youtube tutorials:



Sunday, December 11, 2016

spark streaming

Spark Streaming from local Network and Counting the words in near to real time. This is awesome!!.



Next I like to find some trending news/feeds using apache spark streaming.



Machine Learning

Machine learning , nice word. I know that I was studying about machines/computers from Plus+2. Then what is new in this learning :-).But this is different.Here we makes Machine to learn from its previous experience or outputs/inputs. If you want to give a try on ML, I think this is a best course to start with Free and Open source materials .