Candidates About

 

Narsi Jillella

Big Data Architect/Sr. Hadoop Consultant      

Sr. Java Lead Consultant

CERTIFICATION

Ø  Cloudera Certified Admistrator for Apache Hadoop (CCA-410).

Summary

Ø  IT professional over 15 years of experience in Analysis, Design, Design Patterns, Development, Integration, Testing and maintenance of mission critical object oriented Java, J2EE applications.

Ø  Around 5 years of experience in Big Data, Hadoop, HDFS, Map Reduce and Hadoop ecosystem related technologies.

Ø  Hands on experience in installing, configuring  HDFS and Hadoop ecosystem components like HBase, Spark, scala, Impala, nifi, Phoenix, solR, Hive, Tez, Sqoop, Pig, Flume, Oozie, coordinator, Zookeeper and etc.

Ø  Experience in multiple distributions i.e. Horton works, cloudera etc.

Ø  Experience in writing Map Reduce programs and using Apache Hadoop API for analyzing the history data.

Ø  Experience in writing Sqoop, Hive Query Language and Pig scripts.

Ø  Experience in Oozi and workflow scheduler to manage hadoop jobs by Direct Acyclic Graph (DAG) of actions with control flows.

Ø  Experience in performance tuning the Hadoop cluster by gathering and analyzing the existing infrastructure.

Ø  Experience of Hadoop Administration/Architecture and various components such as HDFS, Name Node, YARN and Map Reduce.

Ø  Experience in developing applications using Java/J2EE/EJB/JSP/JSF/Servlets/JMS/Java Mail/JDBC/Struts/Java Script/HTML/ DHTML/ XML, Tiles, spring, Toplink, Hibernate, JSP Custom Tags and Unix Shell Scripting.

Ø  Expertise in developing numerous multi-tier components including Business Components (EJB), Presentation tier components (Servlets and JSP), Database programming PL/SQL and JDBC.

Ø  Extensive working experience on MVC Framework using Struts, spring (dependency injection/IOC), JDO, JPA and Hibernate.

Ø  Working experience in databases such as Oracle, SQL Server, Sybase and DB2 in the areas of Object-Relational DBMS Architecture, physical and logical structure of database, Application Tuning and Query optimization.

Ø  Experience with installation and configuration of Web sphere 4.0/5.x/6.x,Web Logic 8.1/9.3/10.3, JBOSS, Tomcat 6 and deployment of 3-tier applications.

Ø  Proficient in SQL and PL/SQL using Oracle, DB2, Sybase and SQL Server.

Ø  Experience in development using ETL/Informatica9.X/8.X and Performance tuning. Experience in data extraction from heterogeneous sources like Flat Files, Oracle and UDB DB2 using Informatica Power center

Ø  Excellent communication and people management skills. Ability to contribute individually and in a team. Organized highly motivated and detail-directed problem solver

Education

Masters in Computer Applications at Nagarjuna University, Andhra Pradesh, India.

Bachelors of Science at Nagarjuna University, Andhra Pradesh, India.

Computer Skills

Skills
Languages	JAVA, C++, C, PL/SQL and SQL
J2EE Technologies	J2EE (EJB 2.0/3.0, JSP2.0 and SERVLETS 2.3) J2EE Design Patterns, UML, JMS and JDBC
Frameworks	Spring REST, Struts 2/1.2, TILES ,Hibernate, Toplink, Spring, JQuery, Ext JS and Nitobi
Web/App Server	Web sphere 6.1/5.0/4.0, BEA Web logic 10.3/9.2/8.1, JBOSS 4.0, Tomcat 6/4.0.4.
Hadoop/Big Data	Hadoop, HDFS, Map Reduce, Hive, Tez, Impala, Pig, Sqoop, nifi, Kafka, Storm, HBase, Scala, Spark, Spark SQL, Impala, Solar, Flume, Oozie, Hcatalog, Kerberos, Avro, JSON, yarn, Cassandra, HAWQ, Tableau, GreenPlum and Zookeeper
ETL	Informatica 9.x/8.X (Integration Service / Power Center/ Power Mart)
Version Tools	GIT, SVN, VSS, and CVS
Web Languages	XML, XSL, XSLT, XSQL, XSL-FO, HTML, HTML5 DHTML, DOM, JavaScript, AJAX, ExtJs, JQuery, JSON, CSS and CSS3.
Messaging Systems	JMS, Kafka and IBM MQ Series
IDE (Integrated Development Environment).	RAD, Weblogic Workshop 8.1/10.3, IBM Web sphere Studio 4/5/5.1, Visual Cafe 3.0/4.0, JBuilder 3.0/4.0, JDeveloper, Eclipse, Log4j, TOAD, SQL Navigator, XML SPY, Aqua Data Studio 9.0 and Webking.
RDBMS	Oracle8i/9i /10g/11g(SQL, PL/SQL), DB2,MS-SQL Server , TeraData, Greenplum, Informix and Sybase
Operating System	HP-Unix, Linux and MS Windows NT /2008/XP.
Reporting Tools	Crystal Reports 2008, tableau and Crystal Report launcher
Others	Unix Shell Scripts, PERL, Rational Rose, Clear Trust 6.1, MS-Visio, WinSCP, putty, SecureCRT6.5, Maven and ANT

 

 

 

 

Project Experience

 

JPMIS, CHASE, NY                                                                          May 2015 – Till Date

Big Data Architect/Sr. Hadoop Consultant

JPMorgan Chase is one of the nation's leading financial services firms, offering commercial and consumer banking and credit services, securities brokerage and financial consulting. Implemented different applications like GPS (Guided Prospects System), VD (Vendor disengagement), Chase-pay, Intelli-Trak, EDA (Event Driven Alerts), CBRF (Credit Bureau Reporting Facility) and IFM (Intraday Facility Monitor) in Big Data technologies stack.

Responsibilities:

Ø  Involved in analyze/architect/design requirements in big data technologies.

Ø  Involved in create TSD’s and implement different Big Data projects.

Ø  Involved in evaluate technologies for the big data applications.

Ø  Involved in create tasks and given estimates for the projects.

Ø  Developed oozie workflows to load data data into Hive/Hbase.

Ø  Developed shell scripts to ingest data files into HDFS.

Ø  Developed map reduce to clean up and prepare structured data.

Ø  Developed pig scripts/UDF’s to load data into HBase tables.

Ø  Developed oozie workflows to automate using coordinator.

Ø  Developed data ingestion flows into HDFS for different projects.

Ø  Developed map reduce jobs to load data into Hbase/Hive.

Ø  Developed fields masking using Voltage security application.

Ø  Involved in create nifi data flows for Event Driven Alert application.

Ø  Involved in create nifi data flows for data ingestion and data processing.

Ø  Developed SQL’s to run on MPP data base like greenplum.

Ø  Designed logical and physical tables in Greenplum database for ITRAK application.

Ø  Developed REST API to render data for ITRAK UI application.

Ø  Used spark API to perform analytics on data in Hive.

Ø  Developed Scala spark jobs for the IFM application and load data into hbase.

Ø  Developed iterative data processing in Scala/spark.

Ø  Developed spark code using scala and spark-SQL for faster processing of data.

Ø  Developed Scala/Spark to process data in memory.

Ø  Developed hbase connector service to put and to get the data from hbase tables.

Ø  Designed and Architect Spring REST Back end application.

Ø  Developed Spring REST API to expose hbase table’s data for UI applications.

Ø  Developed Generic Rest Client to pull the data based on parameters from REST API.

Ø  Developed exports excel service to generate xls files using apache poi.

Ø  Developed Jenkin pipeline jobs to deploy applications in different environments.

Ø  Created branching and release version mechanism for different projects.

Ø  Involved in QA, UAT and Production support for different projects.

Ø  Developed POC’s in Big Data new Technologies like falcon, Nifi, Solr and Phoenix

 

Environment: Java, JDK1.7/1.8, Horton works 2.24, Cloudera 5.4, Hadoop, HDFS, HBase, Hive, Tez, Pig, Sqoop, Ambari, Solr, spark, scala, Oozi, Impala,Coordinator, yarn, Nifi, Map Reduce, HCatalog, Kerberos, Spring, REST, JSP, Greenplum, Voltage, SQL, Log4J, Jenkins, ARM, Apache, Tomcat,  Eclipse, Free Marker, AJAX, JavaScript, JQuery, GIT stash, Confluence, Maven, JIRA, WinScp, Putty, FTP, Linux and Shell Script.

 

Mobile Analytics/Diagnostics/SmartApp, Verizon Wireless, Warren, NJ    Jan 14– Apr 2015

Big Data Architect/Sr. Hadoop Consultant

Mobile analytics/diagnostics/SmartApp data is used Verizon support team to analyze/diagnose the customer’s data. Implemented different workflows to produce results on large data sets and display on UI dashboards using Tableau. The process is automated to move files to external servers to hadoop regions and then load data into HDFS/HIVE/HBase by Oozie workflows.

Responsibilities:

Ø  Involved in analyze functional requirements and design big data implementations.

Ø  Involved in design and setup environment for different Big Data projects.

Ø  Responsible to ingest data into HDFS using shell scripts for different projects.

Ø  Written Map Reduce jobs to ingest data into Hive or Hbase tables.

Ø  Written Map Reduce programs to analyze the large data sets.

Ø  Dumped the data using Sqoop into HDFS/Hive for analyzing.

Ø  Developed map reduce to parse JSON data and store into HBase and Hive.

Ø   Developed Pig Latin Scripts to extract the data and load into HDFS/Hive/HBase.

Ø  Developed spark jobs to generate aggregations on analytics data.

Ø  Developed iterative data processing in Scala/spark.

Ø  Import the data from different sources like HDFS/HBase into Spark RDD for further processing.

Ø  Developed custom UDFS and implemented pig scripts.

Ø  Developed Hive Query Language (HQL) scripts to load map reduce output into Hive data warehouse.

Ø  Involved in design and create tables, dropping and altered at run time without blocking updates using Cassandra.

Ø  Involved in working on node tools which offers serval commands to return Cassandra metrics pertaining disk usage.

Ø  Developed Oozie workflows to Sqoop Teradata into Hive Tables.

Ø  Written Pig scripts to analyze and generate summary data for ad-hoc reports.

Ø  Written shell scripts to move external log data into HDFS for processing.

Ø  Written Oozi workflow to automate the workflow and map reduce jobs.

Ø  Developed HQL scripts to extract data from hive and Sqoop out to RDBMS.

Ø  Developed tableau reports for diagnostics and smart apps.

Ø  Importing and exporting data from oracle to HDFS/Hive using Sqoop.

Ø  Developed Hive Scripts to create Hive Database and tables for the different projects.

Ø  Created HBase column family tables and developed MR jobs to load data into HBase.

Ø  Created IBM SPSS data modeler streams for predictive analytics.

Ø  Configured IBM SPSS modeler to connect Hive HCatlog for modeler streams.

Ø  Scheduling / Monitoring Oozi coordinator and workflow controls task.

Ø  Support other teams to setup project environments.

Ø  Involved in migrating applications and support applications in production environment.

Environment: Java, JDK1.6, Horton works, Hadoop, HDFS, Hive, Tez, Pig, Sqoop, Hue, HBase, Spark, Scala, Solr/Lucene, Kafka, Storm, Oozi, Zookeeper, yarn Map Reduce, HCatalog, Tableau, JSP, Oracle, Teradata, SQL, Log4J, RAD, Web sphere, Eclipse, AJAX, JavaScript, JQuery, CSS3, SVN, WinScp, Putty, FTP, Linux, Cronjob, Shell Script and SQL Developer.

 

Index Benchmark, SP Dow Jones Indices, New York, NY                        Jul 12– Dec 13

Sr. Lead Java/Hadoop Consultant

T3 Spice is the combination of three different applications FAME, EMDB (Emerging Markets Database) and SPICE. SPICE source is used only for the legacy data and inactive for the present data. Each application has their own set of companies and stocks and all of them were combined into a single application T3Spice. T3 spice has the functionalities like Indices, company, stock, stock events creation/modification, reporting, operations (reference data, setting up reports and uploads) and index calculations. Worked on Big Data POC's.

Responsibilities:

Ø  Understanding the functional requirements and Involving in functional and Technical Design document of the Project

Ø  Involved in impacts, analysis and design of the project.

Ø  Implemented single sign on to the application using oracle web access and web gate.

Ø  Involved in install oracle access manager and web gate in Linux.

Ø  Implemented stock correction dividend module using JSF.

Ø  Developed JSF pages and rich faces pages for announcements modules.

Ø  Developed commodities upload and report modules.

Ø  Developed Rights Offerings Event module.

Ø  Written stored procedures for upload and reports modules.

Ø  Written stored procedures for commodities and correction dividend modules.

Ø  Developed JSF beans, JSP’s, BD’s, SF’s, EJB’s and DAO’s.

Ø  Implemented risk control methodologies for risk control indices.

Ø  Developed packages, stored procedures and functions based on requirements.

Ø  Implemented stock drop comments module both UI and upload using JSF.

Ø  Oracle Toplink used as the persistence mechanism OR- Mapping.

Ø  Configured/developed Calc Engine, flux and market data java multi-threaded process applications in Linux.

Ø  Installed web logic server 10.3.5 in Linux environment for production and DR.

Ø  Configured T3 Spice application on new Linux servers.

Ø  Created managed servers in cluster environment.

Ø  Configured apache load balance for web logic managed servers.

Ø  Written WLS script to create JMS servers, queues and topics for the application.

Ø  Installed and configured Hadoop, Hive, Pig, Sqoop and Oozie on the Hadoop Cluster.

Ø  Developed complex Map Reduce Jobs using MRv1, Hive and Pig.

Ø  Responsible for building scalable distributed data solutions using Hadoop.

Ø  Written Oozi control workflows and scheduled using coordinator.

Ø  Exported analyzed data to the relational databases using Sqoop for the reports.

Ø  Configured Hadoop Pseudo Distributed environment for QA Team.

Ø  Configured web logic server in lower environments (Dev, QA, UAT and Prod support) for T3 spice application.

Ø  Created shall script to archive logs (application logs and server logs) and backup.

Ø  Involved in QA, UAT and Production support.

Environment: Java, JDK1.6, Clodera CDH4, Hadoop, HDFS, Hive, Pig, Sqoop, Map Reduce, Oozi, JSP, EJB’s, Servlets, JSF, My Faces 1.1, Rich Faces 1.3, tomahawk 1.1, HTML5,  Struts, JDBC, Spring, JMS(Queue’s and Topic’s), Oracle Top Link, Oracle, SQL, PL/SQL, Log4J, Tiles, Web logic Server 10.3, Eclipse, AJAX, JavaScript, JQuery, CSS3, CVS, WinScp, Putty, FTP, Linux, Cronjob, Flux Schedulers, Shell Script, ANT, UML,  Firebug and TOAD.

 

Workflow Reports and Alerts, B & H Photo Video, New York, NY                    Jan 12– Jun 13

Sr. Lead Consultant/Hadoop Developer

To consolidate all the reports and email alerts that buyers are currently receiving from a few different sources into one place. To give management the ability to monitor the buyers if/when they took care of their reports and alerts.

Responsibilities:

Ø  Understanding the functional requirements and Involving in functional and Technical Design document of the Project

Ø  Involved in impacts, analysis and design of the project.

Ø  Developed Java standalone application to process Reports and alerts automatically with scheduler. Scheduler runs every 10 min to process reports and alerts. The reports are generated by Cogno’s and alerts are generated by UNIX systems.

Ø  Involved in loading data into HDFS from Informix, Oracle database using Sqoop.

Ø  Created Hive tables and load data to produce analytical data output for management.

Ø  Developed Map Reduce programs to analyze buyer’s history data on different sources.

Ø  Involved in setting up QA environment and updating configuration for implementing scripts with Hive, Pig and Sqoop.

Ø  Used spring for Dependency Injunction.

Ø  Developed Java Standalone application to generate the automatic alerts based on the alerts occurrence settings.

Ø  Developed direct web request classes to make AJAX calls.

Ø  Developed JSP, Servlets, Actions, HTML, JavaScript, CSS, and DTO’s, DAO’s for Workflow Reports and alerts.

Ø  Developing shell scripts.

Ø  Involving in database logical tables design for Reports and Alerts. Involving in creating physical database tables.

Ø  Implemented custom widgets like Dialog, ToolTips, grid table sorter, Calculations, Selectable and Tabs using JQuery.

Ø  Involved in supporting QA and Production Parallel environments.

Environment: Java, Core Java, JDK1.6, , Apache Hadoop(HDFS), Map Reduce v1, Hive, Sqoop, Pig, Oozie, JSP, Servlets, Struts2.0, JDBC, Spring Ioc, Spring JDBC, Log4J,  Web logic Server 10.3, DWR, Eclipse, AJAX, JavaScript, JQuery, HTML5, CSS3, CVS, Putty, FTP, Unix, Shell Script, ANT, UML, Firebug, Informix, Oracle 11g, SQL, PL/SQL and TOAD.

 

DVP (Delivery Vs Payments: DTCC), New York, NY                                                       July 10 – Dec 11

FICC – Fixed Income Clearing Corporation

Technology Lead

The DVP (Delivery vs. Payments)-rewrite project is comprised of the 4 projects. 1. DVP Admin and Reports 2. DVP baseline 3. DVP RTTM and 4. DVP Netting & Settlement based on the major functionality of existing system. All the projects will be executed in parallel and each project will follow its own SDLC from the functional Specification phase.

Responsibilities:

Ø  Understanding the functional requirements and Involved in functional and Technical Design document of the Project.

Ø  Developing Multithreading Java Batch applications (MRO Recon, SWIFT Recon) using Java1.5, spring, DTO’s and DAO’s for DVP Baseline.

Ø  Developed Views on XML tables for Batch applications processing.

Ø  Developed procedures and functions for Reconciliation process for Batch applications.

Ø  Developing JSP, Servlets, session beans, DTO’s, DAO’s, Hibernate O/R Mappings, and DTO’s for DVP Admin, Trade and Trade substitution screens in DVP Rewrite project.

Ø  Hibernate used as the persistence mechanism OR- Mapping  along with advanced features such as Criteria based querying

Ø  Involving in database design for all DVP projects using existing application.

Ø  Involving in writing complex Views, Materialized Views, synonyms, sequences, indexes and DB links to all DVP Rewrite projects.

Ø  Developing procedures, Functions to generate Journal tables and Triggers for all DVP Admin database tables.

Ø  Designed object model and created diagrams (Use case diagrams, Class diagrams, Sequence Diagrams) using UML.

Ø  Integrated struts application with spring framework.

Ø  Used spring for Dependency Injunction.

Ø  Designing History database tables for all DVP projects and developing views on tables.

Ø  Developing procedures, Functions and packages to copy data from active tables to history tables.

Ø  Developing functions and procedures to all DVP Rewrite projects based on the requirements.

Ø  Writing DBA scripts and co-ordinate DBA to run the scripts in all environments.

Ø  Coordinated with DBA team for planning regular database objects upgrade in INT, QA and UAT environments.

Ø  Coordinated with infrastructure team for planning regular code implementation /upgrade in higher (INT, QA and UAT) environments.

Ø  Involving in doing testing in DEV, INT and QA Parallel environments.

Ø  Involved in writing java script validations.

Ø  Support production environments.

Ø  Involved in Java Code Review and preparing code review matrix documentation.

Ø