Jun 11, 2014

If you are a software developer, you can be a Data Scientist too!

In the big data era, data science is a vital ability that ought to be prepared by programming specialists. It could be utilized to foresee valuable data on new ventures focused around finished undertakings. Numerous developers, statisticians, analysts and IT experts have some fractional foundation and are looking to make the move into data science.

Thus, how does one go about that? Your choice of methodology will reflect your past experiences. Here are a few point-of-view from designers to business experts-

Java Developers
In case you’re a Java developer, you are acquainted with programming building standards and flourish with creating programming frameworks that perform complex assignments. Data science is about building “information items”, basically programming frameworks that are focused around information and calculations.

A great first step is to comprehend the different calculations in machine realizing: which calculations exist, which issues they fathom and how they are executed. It is additionally helpful to figure out how to utilize a demonstrating modeling tools like R or Matlab. Libraries like WEKA, Vowpal Wabbit, and Opennlp give generally tried executions of numerous basic calculations. In case you’re not officially acquainted with Hadoop — learning Mapreduce, Pig and Hive and Mahout will be important.

Python Developers
In case you’re a Python developer, you are acquainted with programming improvement and scripting.You may have effectively utilized some Python libraries that are regularly utilized within information science, for example, Numpy and Scipy. Python has incredible backing for data science requisitions, particularly with libraries, for example, Numpy/Scipy, Pandas,scikit-learn, Ipython for exploratory investigation, and Matplotlib for visualizations. To bargain with extensive data sets, take in more about Hadoop and its mix with Python through streaming.

Statisticians and connected researchers
In case you’re originating from a facts or machine-learning foundation, its presumable you’ve as of now been utilizing tools like R,matlab or SAS for a long time to perform relapse dissection, grouping investigation, order or comparable machine learning errands.

R, Matlab and SAS are astounding devices for factual investigation and visualization, with mature executions for some machine learning algorithms.However, these tools are regularly utilized for information investigation and model improvement, and infrequently utilized within segregation to fabricate processing evaluation information items. Much of the time, you have to blend in different other programming parts in like Java or Python and coordinate with information stages like Hadoop, when building end-to-end information items.

Regularly, getting acquainted with one or more current programming dialects, for example, Python or Java is your first step. We thought that it was exceptionally useful to work nearly with accomplished data specialists to better comprehend the outlook and tools they use to fabricate generation quality data products.

Business analysts
If your background is SQL, you have been using data for many years already and understand full well how to use data to gain business insights. Using Hive, which gives you access to large datasets on Hadoop with familiar SQL primitives, is likely to be an easy first step for you into the world of big data.

Data science often entails developing data products that utilize machine learning and statistics at a level that SQL cannot describe well or implement efficiently. Therefore, the next important step towards data science is to understand these types of algorithms (such as recommendation engines, decision trees, NLP) at a deeper theoretical level, and become familiar with current implementations by tools such as Mahout, WEKA, or Python’s Scikit-learn.

Hadoop developers
Being a Hadoop developer, you know the complexities of vast datasets and cluster computing. You are likely additionally acquainted with Pig, Hive, and Hbase and accomplished in Java. A great first step is to addition profound understanding of machine learning and detail, and how these calculations might be executed proficiently for substantial datasets. A great in front of the pack to look is Mahout which executes a large number of these calculations over Hadoop.

An alternate zone to research is “data cleanup”. Numerous calculations accept a certain essential structure to the information before demonstrating starts. Sadly, in- genuine data is very “grimy” and making it prepared for displaying has a tendency to take a huge heft of the work in data science. Hadoop is frequently an instrument of decision for huge scale data cleanup and pre-processing, preceding demonstrating.

Last musings
The path to data science is not a walk around the diversion focus. You need to take in a ton of new technologies, programming languages, and most vital – pick up certifiable experience. This requires significant investment, exertion and a particular financing. In any case what you discover at the end of the way is truly rewarding.

About the authorSubhendu Panigrahi@SubhenduPanigrahi
Subhendu Panigrahi is a Guest writer for Startuptimes.in . He is the Co-Founder at Venturesity and passionate about Startups & , Technology, Apps Segment in India.

Leave a Comment and Join the Discussion


Post a Comment

Twitter Delicious Facebook Digg Stumbleupon Favorites More