Candidates About

Srikanth Vanka

PROFESSIONAL SUMMARY:

•        3 years of overall IT experience in a variety of industries, which includes hands on experience in Big Data Analytics and development

•        Expertize with the tools in Hadoop Ecosystem including Pig, Hive, HDFS, MapReduce, Sqoop, Storm, Spark, Kafka, Yarn, Oozie, and Zookeeper. 

•        Excellent knowledge on Hadoop ecosystems such as HDFS, Job Tracker, Task Tracker, Name Node, Data Node and Map Reduce programming paradigm 

•        Experience in designing and developing applications in Spark using python to compare the performance of Spark with Hive and SQL/Oracle.

•        Experience in manipulating/analyzing large datasets and finding patterns and insights within structured and unstructured data. 

•        Strong experience on Hadoop distributions like AWS, MapR and Horton Works.

•        Good understanding of NoSQL databases and hands on work experience in writing applications on NoSQL databases like HBase, Cassandra and MongoDB.

•        Experienced in writing complex MapReduce programs that work with different file formats like Json,Text, Sequence, Xml, parquet and Avro.

•        Experience in Oozie and workflow scheduler to manage Hadoop jobs by Direct Acyclic Graph (DAG) of actions with control flows.

•        Experience in migrating the data using Sqoop from HDFS to Relational Database System and vice-versa according to client's requirement. 

•        Extensive Experience on importing and exporting data using stream processing platforms like Flume. 

•        Very good experience in complete project life cycle (design, development, testing and implementation) of Client Server and Web applications.

•        Experience in Designing, developing, validating and deploying the Talend ETL processes for the DWH team using HADOOP (PIG, HIVE) on Hadoop. 

•        Experience in database design using PL/SQL to write Stored Procedures, Functions, Triggers and strong experience in writing complex queries for Oracle.

•        Strong experience in Object-Oriented Design, Analysis, Development, Testing and Maintenance. 

•        Experienced in using agile approaches, including Extreme Programming, Test-Driven Development and Agile Scrum. 

•        Worked in large and small teams for systems requirement, design & development. 

•        Key participant in all phases of software development life cycle with Analysis, Design, Development, Integration, Implementation, Debugging, and Testing of Software Applications in client server environment, Object Oriented Technology and Web based applications. 

•        Experience in using various IDEs Eclipse, IntelliJ and repositories SVN and Git. 

•        Experience of using build tools Ant, Maven. 

•        Preparation of Standard Code guidelines, analysis and testing documentations. 

 

                                             

 

 

TECHNICAL SKILLS:

BigData/Hadoop Technologies	HDFS, YARN, MapReduce, Hive, Pig, Impala, Sqoop, Flume, Spark, Kafka, Storm, Golden Gate, Zookeeper
NOSQL Databases	HBase, Cassandra, MongoDB
Languages	C, Java, Scala, Python, SQL, PL/SQL, Pig Latin, HiveQL, Java Script, Shell Scripting
Java & J2EE Technologies	Core Java
Application Servers	Web Logic.
Cloud Computing Tools	Amazon AWS.
Databases	Microsoft SQL Server, MySQL, Oracle, DB2
Operating Systems	UNIX, Windows, LINUX
Build Tools	Jenkins, Maven, ANT
Business Intelligence Tools	Tableau, Splunk
Development Tools	Microsoft SQL Studio, Eclipse, NetBeans,UC4,TWS and Oozie
Development Methodologies	Agile/Scrum, Waterfall
Version Control Tools	Git, SVN

 

 

WORK EXPERIENCE:

 

Nordstrom-Seattle, WA                                                                             Oct 17 to till Now                                                                                                                                

Big Data Engineer

Nordstrom is fashion retailer based in US and Canada. This project is to modernize pricing strategy application to improve processing time of jobs which are currently running out of Oracle Retail Price Management. The project is implemented  using  Big Data Framework leveraging batch and real time processing functionalities which come handy in reducing execution time of jobs and also to implement business logic in a effective way.

 

 

 

 

 

Responsibilities:

•        Build and support real-time, high availability ETL and data feed processes, primarily relating to email marketing campaigns.

•        Partnered directly with stakeholders from beginning to the end of their data projects – understand the context and goals, find and collect the data needed, and help them visualize it and tell the story.

•        Responsible for building scalable distributed data solutions using Hadoop. 

•        Installed and configured Spark clusters and eco-system on Kubernetes.

•        Developed automated scripts to install Spark clusters with ansible.

•        Developed Python wrapper scripts to  push the logs to an Amazon S3 bucket.

•        Developed big data ingestion framework to process multi TB data incorporating data quality checks, transformation and stored them in efficient storage formats like Parquet and also loaded them into Amazon S3 using Spark Scala API and Spark.

•        Created the Spark code to take input data from multiple sources like HDFS, S3, Flatfiles and etc.

•        Developed Spark programs using Scala and python, also involved in creating Spark SQL Queries .

•        Explored the advanced utilities like text analytics and processing, using the in-memory computing capabilities of Spark.

•        Implemented ELK (Elastic Search, Log stash, Kibana) stack to collect and analyze the logs produced by the Spark cluster.

•        Involved in creating Hive tables, and loading and analyzing them using hive queries.

•        Implemented schema extraction for Parquet, CSV and Avro file formats in Hive.

•        Extracted the data from Oracle 12c, transformed and load into HDFS using Golden Gate and Kafka. 

•        Automated workflows using Kubernetes via cron and  Control-M jobs to pull data from various databases into Data Lake.

•        Involved in Cluster coordination services through Zookeeper and Adding new nodes to an existing cluster.

•        Worked on a Spark poc to measure its performance in comparison with Oracle in execution time.

•        Set up customer data for complex multivariate tests and analysis.

•        Understand, support, and improve the existing codebase.

•        Provide occasional on-call production support for big data jobs after hours.

•        Document data findings, methodologies and resolution efforts in ticketing systems and internal wikis.

 

 

Environment: Hadoop, HDFS, AWS , S3, Apache Hive, Sqoop, Kafka, Apache Spark, Redshift, Cassandra ,Golden Gate ,Kafka , Shell Scripting, Python, Log stash , Agile, Kubernetes ,Ansible ,Zoo Keeper, Kubekins , MySQL.

 

 

 

 

 

UnitedHealth Group-Cypress, CA                                                                 Jan 17 to Oct 17                                                                                                                                         

Hadoop/spark Developer

Optum was established in 2011, when UnitedHealth Group unified its market-leading services and capabilities into a single, integrated company focused on solving the biggest and most complex challenges facing health care. This project is to build Billing Receivalbles and Management Systems which provides billing information of the patients to the online portal. It is implemented in BigData/Haddop framework.

 

 

Responsibilities:

•        Responsible for building scalable distributed data solutions using Hadoop. 

•        Installed and configured Hadoop clusters and eco-system.

•        Developed automated scripts to install Hadoop clusters.

•        Work with business stakeholders to understand requirements / business use cases.

•        Responsible for creating Hive tables, loading the structured data resulted from Map Reduce jobs into the tables and writing hive queries to further analyze the logs to identify issues and behavioral patterns.

•        Developed Spark scripts using Scala shell commands as per the requirement.

•        Developed Unix shell scripting for invoking Hive scripts.

•        Modified the existing functionalites in SQL/HiveQL as per the latest business requirements.

•        Experienced in performance tuning of Spark Applications for setting right Batch-Interval time.

•        Implemented Splunk tool stack to collect and analyze the logs produced by the spark cluster. 

•        Designed, developed and maintained data integration programs in a Hadoop and RDBMS environment with both traditional and non-traditional source systems such as RDBMS and NoSQL data stores for data access and analysis. 

•        Loading data from large data files into Hive tables and also Hbase NoSQL databases.

•        Worked on a POC to compare processing time of Impala with Apache Hive for batch applications to implement the former in project.

•        Involved in creating Hive tables, and loading and analyzing data using hive queries.

•        Implemented schema extraction for Parquet and Avro file Formats in Hive.

•        Extracted the data from Oracle 12c, transformed and load in HDFS using Talend Studio ETL TOOL. 

•        Good experience with Talend open studio for designing ETL Jobs for Processing of data.

•        Good experience with continuous Integration of application using Jenkins.

•        Did performance tuning of Hadoop clusters and Hadoop MapReduce routines.

•        Used Reporting tools like Tableau to connect with Hive for generating daily reports of data.

•        Collaborated with the infrastructure, network, database, application and BI teams to ensure data quality and availability.

•        Experience in working in Agile methodology to deliver solutions for customers with changing requirements.

 

 

Environment: Hadoop YARN, Spark Streaming, Spark SQL, Scala, Python, Hive, Hbase, Golden Gate,Elastic Search, Talend, Tableau, TWS, Jenkins, MapR 5.2.1, Oracle 12c, Linux.

 

Comcast–Denver, CO                                                                                  Aug 16 to Dec 16                                                                                                                             

Hadoop Developer

Comcast is one of nation's leading providers of entertainment, information & communications products and services. I am Part of The MELD Customer Usage team which provides Comcast users timely access to a scaled fault tolerant Hadoop big data platform. This platform securely houses current and historical enterprise value data. This supports company strategy to reduce duplicate data processing, storage, and systems. This product seeks to unify the enterprise customer interaction-related event/usage data in to a single point of reference and provide APIs for data retrieval.

 

Responsibilities: 

·         Worked on analyzing Hadoop cluster using different big data analytic tools including Pig, Hive and MapReduce.

·         Managed fully distributed Hadoop cluster is an additional responsibility assigned to me.  I was trained to overtake the responsibilities of

a Hadoop Administrator, which includes managing the cluster, Upgrades and installation of tools that uses Hadoop ecosystem.

·         Worked on Installation and configuring of Zoo Keeper to co-ordinate and monitor the cluster resources.

·         Implemented test scripts to support test driven development and continuous integration.

·         Consumed the data from Kafka using Apache spark.

·         Load and transform large sets of structured, semi structured and unstructured data.

·         Involved in loading data from LINUX file system to HDFS.

·         Importing and exporting data into HDFS and Hive using Sqoop.

·         Used Kafka for real time data Ingestion to HDFS.

·         Implemented Partitioning, Dynamic Partitions, Buckets in Hive

·         Worked in creating HBase tables to load large sets of semi structured data coming from various sources.

·         Extending HIVE and PIG core functionality by using custom User Defined Function’s (UDF), User Defined Table-Generating Functions (UDTF) and User Defined Aggregating Functions (UDAF) for Hive and Pig using python.

·         Experienced in running Hadoop streaming jobs to process terabytes of xml format data. 

·         Involved in scheduling UC4 workflow engine to run multiple Hive and pig jobs.

·         Developed workflow in UC4 to automate the tasks of loading the data into HDFS and pre-processing with Pig.

·         Responsible for loading data files from various external sources like ORACLE, MySQL into staging area in MySQL databases. 

·         Executed Hive queries on Parquet tables stored in Hive to perform data analysis to meet the business requirements. 

·         Actively involved in code review and bug fixing for improving the performance.  

·         Good experience in handling data manipulation using python.

·         Involved in developing, building, testing, and deploying to Hadoop cluster in distributed mode. 

·         Created Linux shell Scripts to automate the daily ingestion of IVR data.

·         Processed the raw data using Hive jobs . 

·         Automated the History and Purge Process.

·         Created Pig Latin scripts to sort, group, join and filter the enterprise wise data. 

·         Developed the verification and control process for daily load. 

·         Experience in Daily production support to monitor and trouble shoots Hadoop/Hive jobs.

 

Environment: Hadoop, HDFS, Pig, Apache Hive, Sqoop, Kafka, Apache Spark, Storm, Shell Scripting, Python, Kerberos, Agile, Zoo Keeper, Maven, Ambari, Horton Works, MySQL.

 

 

SCHOOL YEARS IN BETWEEN (Masters)

 

 

InfofacLabs-Pvt.LTD, India                                                                        June 13 to Aug 14                                                                                                                                                 

Hadoop Consultant

Responsibilities:

•        Responsible for building scalable distributed data solutions using Hadoop. 

•        Experience in Job management using Fair scheduler and Developed job processing scripts using Oozie workflow. 

•        Designed and developed automated, complex, and efficient ETL processes to match multiple large-scale datasets together.

•        Involved in Requirement Analysis, Design, Development and Testing of the risk workflow system. 

•        Involved in the implementation of design using vital phases of the Software development life cycle (SDLC) that includes Development, Testing, Implementation and Maintenance Support. 

•        JDBC framework has been used to connect the application with the Database. 

•        Used Eclipse for the Development, Testing and Debugging of the application. 

•        Log4j framework has been used for logging debug, info & error data. 

•        Used Oracle 10g database for data persistence and SQL Developer was used as a database client.  

•        Designed, developed and did maintenance of data integration programs in a Hadoop and RDBMS environment with both traditional and non-traditional source systems as well as RDBMS and NoSQL data stores for data access and analysis. 

•        Developed Map Reduce Programs for data analysis and data cleaning.

•        Troubleshoot cluster and query issues, evaluate query plans, and optimize schemas and queries.

•        Migration of ETL processes from MySQL to Hive to test the ease of data manipulation.

•        Worked extensively with Sqoop for importing metadata from Oracle.

•        Involved in creating Hive tables, and loading and analyzing data using hive queries.

•        Developed Hive queries to process the data and generate the data cubes for visualizing.

•        Implemented Partitioning, Dynamic Partitions, Buckets in HIVE. 

•        Used Reporting tools like Tableau to connect with Hive for generating daily reports of data.

•        Collaborated with the infrastructure, network, database, application and BI teams to ensure data quality and availability.

 

Environment: Agile, Jira, Oracle 10g, Core Java, JSON , Log4J, Junit, Hadoop YARN, Hive, Sqoop, Amazon Aws, Talend, Oozie, Jenkins, Oracle 12c, Linux.

 

PROJECT:

 

Web Programming with HTML5                                                       Jan 13 to Jun 13                                                                                    

 

EDUCATION:

 

Master of Science in Computer Science May 2016                        

New York Institute of Technology, New York, NY

 

Bachelor of Technology in Computer Science 2014

GITAM University, India