Candidates About

 

                                                         

                            Nitin Misra                                                    

Career Objective

Seeking for an interesting and challenging role in the field of data engineering where I can utilize my skills to play a role in the progress of that organization.

 

PROFESSIONAL PROFILE

 

 

Data Engineer with over 9+ years of experience in design, architecture, development and data modeling of complex database systems.

 

SKILL SET

• Datawarehouse Development
• Big data(SQL and No SQL based)
• Data Warehousing & Integration
• Data Modelling, Data ingestion, ETL, Data Presesentation.
• Object & Dimensional Modeling
• OLAP & OLTP Data Modeling
• Scripting, Coding & Documentation
• Experience with BI tools

 

FUNCTIONAL SKILLS

Project Execution:-

 

·         Interfacing with clients and BA’s to understand the requirement.

·         Adhering to plans & schedules, attending team meetings for individual projects.

·         Interacting with team members to ensure smooth progress of project work.

         
Technical Skills:-

 

·         Worked in designing, coding and implementation of datwarehouse projects using MPP Datawarehouse Vertica and Netezza platforms.

·         Data Modelling using ERWIN.

·         Big data(No SQL based), HDFS, using hive.

·         Big data(SQL based) using Vertica, Netezza.

·         Scripting using Python, Shell.

·         Worked on performance tuning for present applications hosted on Vertica, Netezza platforms.

·         Well versed in PL/SQL programming (Oracle 11i).

·         Worked on BI tools like Qlikview, Tableau.

·         Experience in Analysis, Design, Maintenance, Support and Coding using Oracle, PL/SQL, Shell scripting and worked on various kinds of projects including development, enhancement, maintenance and support on Client / Server with hands-on experience in tools like TOAD, Informatica 8.6.0, Autosys, HP Quality Center 10.0, Squirrel for Netezza,Netezza Performance Server (NPS),Python, Vertica DB etc.

 

Programming Languages : PL/SQL, SQL Server, UNIX shell scripting,Python.
Databases : Oracle 10g, Netezza, Vertica
Operating Systems : Windows, Unix
Tools : Informatica 8.6.0, Sql Loader, TOAD, Autosys,Actuate, Quality Center 10.0,JIRA,Actuate 9,Squirrel for Netezza, Netezza Performance Server (NPS)

BI Tools : Qlik view, Tableau

 

 

 

 

Academic Credentials

§  MBA :- Persued 3 year Post Graduate Programme in Management from IMT Center for Distance learning(Ghaziabad), India in Marketing and Finance in 2011

§  B.E – Electronics and communication Engineering from MDU Rohtak in 2008

 

 

 

Professional Experience

Ingestion of Big data(100 TB+) using Hadoop, Vertica solutions:-

 

§ Technology :- HDFS, Hive, Vertica, Python

§ Duration :– Jun 2017 till date

§ Client: AT&T

§ Brief (Scope): As part of this initiative 100 PB+ was ingested in the Hadoop, Vertica framework.

The data was critical for compliance purposes and required quick turnaround of user queries.

 

 

Responsibilities:-

·         Liasing with the Data Analyst to understand the data being sourced.

·         Coming up with high level design of the proposed model.

·         Do data profiling to setup the data ingestion rules.

·         Model the architecture for data flow.

·         Lias with the BI reporting team to make data suitable for reporting.

 

Technical Skills:-

·         Use Python for automation.

·         Worked on HDFS(Hive) for huge ingestion of data(100+ PB).

·         Use Vertica to ingest huge data for faster performance.

·         Data modelling using ERWIN.

 

 

Ingestion of data into ECDW(Enterprise Datawarehouse) platform:

 

§ Database :- Vertica, Teradata, SQL Server

§ Duration :– Feb 2017 till date

§ Client: AT&T

§ Brief (Scope): As part of this initiative data from new sources is being ingested into the ECDW platfrom which can be used by downstreams or for reporting purposes.

 

Responsibilities:-

·         Coming up with high level design of the proposed model.

·         Do data profiling to setup the data ingestion rules.

·         Participate in the ETL design.

·         Lias with the BI reporting team to make data suitable for reporting.

 

Technical Skills:-

·         Use Python for automation.

·         Tune Vertica queries for faster performance.

·         Data modelling using ERWIN.

·         Migrate legacy database platforms to Vertica platform.

·         Design logical model using Erwin Data modeller tool to create the desired physical models.

·         Use bteq, mload, tpt utilities in Teradata to support, maintain and enhance the existing applications.

·         Design underlying projections for Vertica tables for best query, load performance.

·         Optimize Copy utility in Vertica for faster loads.

·         Worked on building Hybird solutions using Datalake, Datawarehouse for use in BI applications.

·         Write shell scripts to create wrappers for batch execution and interaction with Vertica/Teradata Databases.

·         Optimize internal configuration parameters in Vertica for best performance.

·         Contribution in automating software development process using python

·         Use IBM Tivoli to schedule jobs.

·         Support database for BI reporting tools like Microstrategy, Tableau.

 

 

 

Migrating from Teradata to Vertica:

 

§ Database :- Vertica, Teradata

§ Duration :– Aug 2016 till date

§ Client: AT&T

§ Brief (Scope): This initiative is to migrate the database from teradata to vertica

 

Responsibilities:-

·         Understanding the data model of the existing Teradata based application.

·         Coming up with high level design of the proposed model.

·         Coordinating with the other teams to run the queries on the existing vertica infrastructure and gauging the impact.

 

Technical Skills:-

·         Passing critical and longer running queries through DBD as part of the incremental design.

·         Gauging the query specific projections for their performance and deploying the same for performance tuning.

·         Creating partitions for the big tables as a performance tuning measure.

·         Creating query specific projections based on query predicates for longer running complex queries.

·         Checking query plans for performance improvement.

 

 

 

 

Performance tuning and BAU tasks :

 

§ Database :- Vertica, Oracle

§ Duration :– May 2015 – Jul 2016

§ Client: Bank of America

§ Brief (Scope): This initiative is to do performance tuning of the existing queries running on the vertica and oracle.

 

Responsibilities:-

·         Understanding the existing queries and running on the vertica datawarehouse from online and batch perspective and coming up with performance tuning measures

 

 

Technical Skills:-

·         Passing critical and longer running queries through DBD as part of the incremental design.

·         Gauging the query specific projections for their performance and deploying the same for performance tuning.

·         Creating query specific projections based on query predicates for longer running complex queries.

·         Checking query plans for performance improvement.

 

 

 

 

 

 

 

 

Design of Revenue Attribution Engine and sunsetting the existing model:

 

§ Technology:  Big Data

§ Database :- Vertica

§ Duration :– Nov 2014 – Apr 2015

§ Client: Bank of America

§ Brief (Scope): This initiative was to setup a revenue attribution engine

 

Responsibilities:-

·         Work with the UI team to design the data model for the UI-DB interaction.

·         Write the PLSQL code to support the UI.

·         Design the loading technique to populate data from oracle to vertica.

·         Come up with the unit and integration test plan for the project.

·         Generating recons to access the impact of the new attribution engine.

·         Writing sql scripts to compare various existing systems and come up with a cleaning up approach.

 

Technical skills:-

·         Worked on the pipes in linux to load and unload the data from oracle to vertica.

·         Used VSQL and shell scripting to apply the revenue attribution rules to the trades.

·         Used projections on tables to improve the query performance.

·         Used segmentation on the tables for faster retrieval of data.

·         Worked with query plans to improve query performance.

 

 

 

 

Project Name – Migration from Netezza Mustang to Vertica

 

§ Technology:  Big Data

§ Database :- Netezza

§ Duration – Jan 2014 – Aug 2014  

§ Client: Bank of America

§ Brief (Scope): This initiative is to migrate from the ageing mustang to new datawarehouse.

            Responsibilities:

·         Designed test queries to be run on various datawarehouse platforms to compare the performances

·         To ensure seemless transition from Mustang to Vertica server.

·         Working with the team to resolve any challenges in the migration.

·         Worked on tuning the existing scripts using proper distribution keys, better explain plan, rewriting optimized joins etc.

·         Guided the team to improve the performance of the system on the whole.

·         Worked on designing the optimized model for the project.

 

Technical Skills:-

·         Worked on vsql to access vertica db from linux environment

·         Worked on projections to improve the performance of the queries.

·         To come up with the right segmentation approach for tables created as part of the design.

·         Query specific design for long running and complex queries

·         Setting up separate resource pool for BI tools as part of performance optimal resource utilization.

·         Checking query plans for performance improvement.

 

 

 

Project – Handling database part of a .net based reporting tool

 

§ Technology:  PL/SQL, Autosys, Netezza

§ Duration –Nov 2012 – Dec 2013

§ Database :- Netezza

§ Tools:- Squirrel for Netezza,  HP Quality center v9.2,Autosys, Qlikview BI

§ Client: Bank of America

§ Brief (Scope): This dot net based tool works as a desktop application for the user.It is a one-stop application for the salespeople to review the summary/details of trades executed.

                       

            Team Size: 6

            Role: Onsite Coordinator

Responsibilities:

·         Coordinating with the UI team to come with a data model supporting UI DB handshake.

·         Designing the aggregate tables and creating the scripts to populate them.

·         Used Shell scripting as well as sql scripts to get the aggregated data.

·         Used autosys to run multiple queries in parallel to ensure resources are utitlized properly.

·         Guide the offshore team with writing optimized code.

·         Optimizing the code to make sure pass through queries are efficient.

 

Technical skills involved:

·         Used NZSQL to load run run queries on the netezza platform from shell as well as sql scripts.

·         Used NZLOAD to copy data from one db to another.

·         Used NZLOAD to load the data from external sources.

·         Worked on NPS to check/gauge the health of the netezza platform.

·         Worked on the query plan to improve the performance of the existing queries.

·         Created distribution keys to improve the query performance.

 

 

 

 

Project Name – Creating Qlik view dashboards

 

§ Technology:  Business Intelligence

§ Database :- Netezza</