Candidates About

 

Siva Vundela

Professional Summary:

• Technically accomplished professional with 16 years of total experience in Hadoop (5 years) and java (11 years) technologies in IT industry.
• Experience in full lifecycle development process which includes planning, design, development, testing and implementation of moderate to advanced complexity systems.
• Experienced in Hadoop cluster using Cloudera manager and Hortonworks distributions.
• Have experience in installing, configuring, performance tuning and administrating Hadoop cluster for major Hadoop distributions.
• In depth knowledge of Hadoop Architecture and various components such as HDFS, Job Tracker, Task Tracker, Name Node, Data Node and MapReduce concepts.
• Extensive working experience on Hadoop eco-system components like MapReduce (MRv1), YARN, Hbase, Hive, Pig, Sqoop, Flume, Oozie.
• Extensive Experience on importing and exporting data using Kafka.
• Expert in working with Hive data warehouse tool-creating tables, data distribution by implementing partitioning and bucketing, writing and optimizing the HiveQL queries.
• Extending Hive and Pig core functionality by writing custom UDFs.
• Good working knowledge on Spark.
• Worked on developing ETL processes to load data from multiple data sources to HDFS using Flume and Sqoop, perform structural modifications using Map-Reduce, HIVE and analyze data using visualization/reporting tools.
• Experience in performing data validation using HIVE dynamic partitioning and bucketing.
• Experienced in Importing and exporting data using Sqoop from RDBMS to Hadoop and troubleshooting issues related to Sqoop jobs.
• Good experience on real time data feeding platform-KAFKA
• Hands on experience in setting up workflow using Apache Oozie workflow engine for managing and scheduling Hadoop jobs.
• Used compression codecs to compress data in the Hadoop cluster.
• Experience in Core Java with strong understanding and working knowledge in Object Oriented Concepts like Collections, Multithreading, Data Structures, Algorithms, Exception Handling and Polymorphism.
• Basic knowledge in application design using Unified Modeling Language (UML)
• Good knowledge of Software Development Life Cycle coupled with excellent communication skills.
• Familiar with Agile and Waterfall.
• Experience in writing test cases and unit testing.
• Committed to excellence, self-motivator, team-player, and a far-sighted developer with strong problem-solving skills and with zeal to learn new technologies.
• Technical and interpersonal skills combined with great commitment towards meeting deadlines.

 

Key Strengths

 

• Very quick learner and excellent team player
• Excellent requirement gathering and system analysis skills
• Continuous education & training in new technologies.
• Passion for work & achieving customer satisfaction with quality deliverables
• Thrive on challenges, even under very tight schedules
• Committed to delivering on time, even under challenging timeframes

 

TECHNICAL SKILLS

Operating Systems	Sun Solaris 9/10/, RHEL 4/5/6, IBM AIX 5.3,5.2, UNIX, Windows 2008
Hadoop EcoSystem:	SPARK, Apache NiFi, IBM SPSS Modeler, Analytics server ,Hadoop, HDFS, Map Reduce ,HBase  Hive , Splunk, PIG,Oozie,HUE,Zookeeper, Cloudera, Ambari, Ranger, Knox, Sqoop ,Java ,Scala, Python and GitStash,GCP
Java Tools	Spring Core/Spring Framework, Spring MVC, Web services(Soap, REST),Java, Elasticsearch ,Map Reduce, J2EE ,CI/CD, AngularJS , FreeMarker Templates ,JSP,JSF, JSON, J2EE, Web Services,  taglibs, CSS , Maven build tool
Databases	Teradata,Greenplum,Oracle , SQL Server, DB2
Frameworks	Struts 1.x/2.x, Spring 3.0/2.5 and Hibernate 3.5/3.0
No SQL Databases	HBase, Cassandra
Development Tools	Eclipse, IntelliJ IDEA,ERWIN, TOAD, MS Project
Application and Web Servers	Web Sphere Application Server, BEA-Web logic Application  Server ,JBOSS Application server and Tomcat
Others	MR Unit, UNIX Shell Scripting, RAD, RSA, Ant Tool and Toad, UML, Rational Rose
Domain Knowledge	Banking ,Telecom Insurance ,Health Care ,Manufacturing, GIS and Mobile
Methodologies	Agile, UML

 

WORK EXPERIENCE:

 

 

JPMORGAN CHASE, Wilmington, DE                                                                                                        Apr 2015 – Till Date  

Project Names   : (CBRF, Credit Bureau Reporting Facility, GPS, EDA)

Role: Application Dev Lead (VP)

Responsibilities:

·         Implemented different applications like CBRF (Credit Bureau Reporting Facility), GPS (Guided Prospects System), Chase pay, EDA (Event Driven Alerts) and Cyber Security in Big Data technologies stack.

·         Reading credit bureau Metro 2 files (Equifax, Experian, Transunion and innovis                ) from landing zone and called Voltage API to encrypt all feeds and stored in HDFS RAW folder.

·         Reading Metro files from HDFS folder and called Voltage API to decrypted API and sent to tmp folder.

·         Worked on MAPREDUCE API is started that runs on every data node in the cluster. It first validates every record and then calls to voltage FPE API and applied PFE (FORMAT PRESERVED ENCRYPTION) for only PII data columns like (SSN, Consumer account number)

·         Reads EDA URL data from HBASE table using EDA Spark driver and sends to EDA processor. EDA processor prepares and saves the doc to solr.

·         Worked on different file formats (ORCFILE, RCFILE, SEQUENCE FILE, TEXT FILE, PARQUET) and different

Compression codecs (GZIP, SNAPPY and  LZO).

·         Leverage Voltage SST & EFPE to protect all our PI & PII data.

·         Implemented Voltage file level encryption and decryption

·         Implemented voltage FOE encryption with column level

·         Implemented Voltage HIVE UDF function for hive PII tables

·         Implemented Voltage encryption library for spark job to encrypt and decrypt the data

·         Implemented pig scripts and Write CB prospect data to HBASE table.

·         Implemented REST API layer and HDFS connector write and read Logs, Events, Audit, config and Metadata to HBASE tables.

·         NiFi is used to process logs for analytics purpose.

·         NiFi is designed to pull data from various sources and push it in HDFS and HBASE

·         Involved in create NiFi data flows for Event Driven Alert application.

·         Created Hbase tables to store various data formats of PII data coming from different portfolios.

·          Hands on experience in in-memory data processing with Apache Spark. 

·         Used Spark-Streaming APIs to perform necessary transformations and actions on the fly for building the common learner data model which gets the data from Kafka in near real time and Persists into HBASE.

·         Created Real time streaming data ingestion using Kafka.

·         Used Spark API over Cloudera Hadoop YARN to perform analytics on data in Hive.

·         Wrote Spark jobs and integrated it with Oozie workflow for batch processing on huge datasets. 

·         Configured Spark streaming to receive real time data from the Kafka and store the stream data to HDFS using java. 

·         Expert in implementing advanced procedures like text analytics and processing using the in-memory computing capabilities like Apache Spark written in Java

·         Handled importing of data from various data sources, performed transformations using Hive, MapReduce, Spark and loaded data into HDFS.

·         Worked on the core and Spark SQL modules of Spark extensively.

·         Diverse experience utilizing Java tools in business, Web, and client-server environments including Java Spring

Platform, J2EE, REST API, Java Servlets and Java GREENPLUM database Connectivity (JDBC) technologies. Experience in designing both time driven and data driven automated workflows using Oozie.

·         Hadoop security and access controls (Kerberos, Active Directory)

·         Implemented advanced procedures like text analytics and processing using the in-memory computing

Capabilities like Spark.

·         Enhanced and optimized product Spark code to aggregate, group and run data mining tasks using the Spark framework.

·          Used Spark API over Hortonworks Hadoop YARN to perform analytics on data in Hive.

·         Exploring with the Spark improving the performance and optimization of the existing algorithms in Hadoop using Spark Context, Spark-SQL, Data Frame, Pair RDD's, Spark YARN.

·         Developed Spark code using Java and Spark-SQL/Streaming for faster testing and processing of data.

·         Import the data from different sources like HDFS/Hbase into Spark RDD Developed a data pipeline using Kafka to store data into HDFS.

·         Implemented EPV-AIM with Kerberos keytab.

 

Environment:  HDOOP ,RHEL,Spark ,HBase,Hive ,Pig ,Tez ,Oozie ,Sqoop , Hortonworks NiFi  DataFlow 1.2.0.0,Ambari ,Linux ,Java,Scala, J2EE, Eclipse IDE ,IntelliJ IDEA  ,GIT STASH 3.2.0,Bigbucket,Jenkins 2.0 ,confluence 5.8 ,Jira 6.3,Spring framework 4.0, REST API, Voltage Encryption API,SonarQube 5.0,Maven, Putty 0.6.3,FileZilla 3.6.0.2,  J2EE , SQL, TERADATA,GREENPLUM , XML, Spark, Tableau Desktop, Tableau Server ,UNIX Shell Scripting

 

Verizon Wireless, Warren, NJ                                                                                                                        Mar 2014 – March 2015

Role: Sr. Hadoop Developer

Responsibilities:

·         Project structure created in hadoop environment

·         Created design documentation for Handset device Analytics report and diagnostic report.

·         Log files are transferred from web application servers to Hadoop system using cron job.

·         Implemented Ingestion scripts.

·         Developed Map Reduce job based on Handset device Battery life usage, Net work data, Uploaded information,Product information and signals data and Device information

·         Report generated with most  installed application on Handset device model using PIG,HBASE , Hive and Sqoop

·         Designed , created and loaded data into hive tables for handset device Battery life reports and diagnostic reports

·         Added Mapreduce program jobs, Hive, pig scripts and sqoop flow into an oozie workflow and scheduled with daily oozie coordinator.

·         Moving data from HDFS to RDBMS and vice-versa using SQOOP.

·         Extracted the data from Teradata into HDFS using Sqoop.

·         Extensive experience in writing Pig scripts to transform raw data from several data sources into forming baseline data.

·         Developed Hive scripts for end user / analyst requirements to perform ad hoc analysis

·         Very good understanding of Partitions, Bucketing concepts in Hive and designed both Managed and External tables in Hive to optimize performance

·         Solved performance issues in Hive and Pig scripts with understanding of Joins, Group and aggregation and how does it translate to MapReduce jobs.

·         Developed UDFs in Java as and when necessary to use in PIG and HIVE queries

·         Experience in using Sequence files, ORC, RCFile, AVRO and HAR file formats.

·         Implemented authentication using Kerberos and authentication using Apache Sentry.

·         Very good experience with both MapReduce 1 (Job Tracker) and MapReduce 2 (YARN) setups

·         Very good experience in monitoring and managing the Hadoop cluster using Ambari.

·         Good Working knowledge of Tableau

·          Predictive modeling Analytics and diagnostic reports generated using IBM SPSS Modeler and Analytics server.

 

Environment: IBM SPSS Modeler 16.0, Analytics server, Horton works  Hadoop 1.2.0 ,MapReduce, Hive 0.11, HBASE 0.94,PIG 0.11, Sqoop 1.4.3, ,HBASE 0.94, Oozie 3.3.2 ,Linux ,Java, J2EE, Eclipse,SVN, JSON Loader ,Maven, Putty, WinSCP,  J2EE , SQL, SQL Developer , XML, Oracle JSON & web services API

 

 

Legg Mason, Inc, Baltimore, MD                                                                                                                               Mar 2013 – Feb 2014

Role: Sr. Hadoop developer

Responsibilities:

 

·         Dumped the data using Sqoop into HDFS for analyzing.

·         Written Map Reduce java programs to analyze the log data for large-scale data sets.

·         Involved in using HBase Java API on Java application.

·         Automated all the jobs for extracting the data from different Data Sources like MySQL to pushing the result set data to Hadoop Distributed File System.

·         Customize parser loader application of Data migration to HBase.

·         Developed Pig Latin scripts to extract the data from the output files to load into HDFS.

·         implemented  Map Reduce jobs using Java API and PIG Latin as well HIVEQL

·         Hands on design and development of an application using Hive (UDF).

·         Creates a Solr schema from the Indexer settings

• Experience in writing SOLR queries for various search documents
• Responsible for defining the data flow within Hadoop eco system and direct the team in implement them.

·         Developed HIVE queries for the analysts.

 

Environment: Big Data Apache Hadoop, Hive,  Hue Tool ,Zookeeper, Map Reduce, Sqoop, crunch API, Pig 0.10 and 0.11,HCatalog,  Linux (Red Hat 5.1), Git Hub, Java,JSP,JSF, Eclipse, Maven, Python, Solr / Lucene ,J2EE ,PHP, SQL, HTML, XML,REST API, XSLT, XQuery, DHTML, Oracle, MS SQL Server, MYSQL, Ajax/JavaScript, JSON & web services API

 

IBM, PA                                                                                                                                                                Mar 2010 – Feb 2013

Project Name   : Unemployment Compensation Modernization System (UCMS)(Department of Labor ,PA)

Sr Java Developer and Administrator

Responsibilities:

 

·         Coded Map Reduce program in Java to extract information from huge volume of files, load it into Hive and then HQL to create the report on top of them

·         Identified and analyzed the user requirements and design, development, testing and deployment.

·         Responsible for creating artifacts like class diagrams, sequence diagrams, use case diagrams for all the use cases.

·         Involved in Lifecycle development on business tier of large scale complex SOA based application         

·         Used IBM RAD in developing UCMS components.

·         Importing and exporting data into HDFS and Hive using Sqoop

·         Responsible to manage data coming from different sources

·         Installed and configured Hive and also written Hive UDFs

·         Involved in creating Hive tables, loading with data and writing hive queries

·         Implemented nine nodes CDH3 Hadoop cluster on Red hat LINUX.

·         Implemented best income logic using Pig scripts.

·         Analyzed data using Pig Latin, HiveQL, HBase and custom MapReduce programs in Java

·         Wrote SOLR queries for various search documents

·         Used Hibernate mappings to persist.

·         Worked closely with deployment teams during testing and production deployments of the application.

 

Environment: IBM RAD 7.0, Big Data Apache Hadoop, Hive,,Zookeeper, HBase,Map Reduce ,Spring DI, Hibernate 3.0, Web sphere Process Server,WebServices, WebSphere Application Server 6.0

 

NiSource, Inc, Merrillville, IN (IBM)                                                                                                  Aug 2008 – Feb 2010

Sr.Java Developer and Administrator

Responsibilities:

 

·         Completed up gradation of Plumtree portal 5.0.5 to Oracle Webcenter User Interaction 10grR3

·         Created SQL script for quick resolution  to the date issue  as a utility useful for upgrade to  Oracle Webcenter User interaction

·         Configured Search index and automation server, Tomcat and Weblogic application server , performance tuning and  load balancing servers

·         Developed Admin utilities and Tested performance testing using Load Runner

·         Maintain Portal content and its search index and documentum crawlers

·         Implemented Portal best practices

 

Environment:  Oracle Webcenter Interaction 10gR3,IDK 10gR3, Eclipse SDK 3.1.1, ,RAD,RSA, Tomcat 6.1 ,Windows Server 2003 SP2, MS SQLServer 2000, Apache-ant-1.6.1

 

XL Global Services Inc, Stamford, CT                                                                                                     Feb 2007 - Jul 2008                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            

Role: Sr. Java Developer  

Responsibilities:

 

·         Upgraded custom Navigation  5.0.5 to 6.1 MP1 using Customization installer

·         Developed  adaptive  portlets using IDK in .NET Framework  

·         Configured Web Services. AD Authentication Web Service  and User Profile Web Service  and Crawler to allow access to external content through the Portal 

·         Created Crawler to allow access to external content through the Portal 

·         Developed Portal Jobs Failed Notification script using Portal API

·         ALUI  Portal  Setup user permissions to portal development services

 

Environment: AquaLogic Interaction 6.1 MP1, Eclipse SDK 3.1.1,  AquaLogic Interaction Studio 2.2 MP1, IIS 6.0 (.NET 1.1 SP1,2.0), Windows Server 2003 SP2, MS SQLServer 2000, 2005,Visual Studio 2003,2005,C# ,ASP,ASP.NET,ADO.NET, Apache-ant-1.6.1

 

 

Unilever, CT                                                                                                                                           Dec 2004 - Jan 2007                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        

Role: Java Developer

Responsibilities:

 

·         Plumtree Content Server Administration

·         All the pages like A