Candidates About
Manikumar Vellaisamy
Summary:
- IT experience with 15 years dedicated into data warehousing & business intelligence technologies using Informatica, Business Objects, Oracle, Teradata, DB2 and Unix.
- 2 years in Hadoop Development working with Big Data and Hadoop File System (HDFS).
- Hands on experience in working with ecosystems like Hive, Pig, Sqoop, MapReduce, Flume, Oozie.
- Strong Knowledge of Hive’s analytical functions and HBase.
- Capturing data from existing databases that provide SQL interfaces using Sqoop.
- Efficient in building Hive, Pig and MapReduce Scripts.
- Loaded the dataset into Hive and Pig for ETL Operation.
- Good Knowledge of Hadoop Cluster architecture and monitoring the Cluster.
- Experience in using Zoo Keeper and Cloudera Manager.
- 4 Years in Master Data Management (MDM) using Informatica MDM/Siperian tool.
- Expert in Data Warehousing / Business Intelligence technology, Data Warehouse lifecycle, Kimball / Inmon methodologies, standards and best practices of ETL, exposed to the challenges of today’s BI projects such as data Integration, data cleansing, and performance bottlenecks.
- Knowledge in Master Data Management (MDM) using Siperian tool.
- Experience in leading and managing teams in the capacity of technical lead, module lead, developer and tester.
- Designed and developed logical and physical Data Models, design straight and alternate hierarchies for the STAR, Snowflake, Hybrid schemas. Understand the emphasis of Confirmed Dimensions, Slowly changing dimensions.
- Knowledge in Planning, Designing, Developing and Deploying Data warehouse / Data Marts with experience in both relational & multidimensional database.
- Strong experience in Data Warehousing based on Windows and UNIX platforms.
- Experience in Using Repository Server/Manager, Designer and Workflow Manager /Server Manager Tools in Informatica Power Center 9x/8x
- Experience in extraction, transformation and Loading and Implementation, Strong Database skills, Unix Shell Programming, Report Designing and development knowledge.
- Executed software projects for Pharmaceutical, Banking and Financial Services industry processes.
- Proficient in analyzing and translating business requirements to technical requirements and architecture
- Good experience in ETL processes and OLAP tools, Oracle, DB2 & Teradata.
- Working in Pharmaceutical Vendor tool called TrackWise for Complaint Management
- Experience in creating and using Stored Procedures, Functions, Triggers, Views, Synonyms and Packages in Different databases.
- Experience in source systems analysis like TrackWise, Cegedim and data extraction from various sources like Flat files, Oracle8i/9i.
- Extensive experience and knowledge of the project lifecycle, including requirements gathering, and test plans development and execution.
- Clear understanding of business procedures and ability to work as an individual and as a part of a team.
- Possess excellent communication with Clients. Worked in Singapore for 18 months.
- Technical Lead & Good team player with excellent inter-personal, written and oral communication skills.
- Certified in Informatica 8 Designer from Informatica Corporation.
Skill Set:
ETL Tool : Informatica 9x/8x/7x/6x
Databases (RDBMS) : Oracle 11g/10g/9i/8i
Languages/APIs : SQL, and PL/SQL, Shell Scripting, Windows Scripting
Big Data Ecosystems : Hadoop, MapReduce, HDFS, Hive, Pig, Flume, HBase, Sqoop, Zookeeper, Oozie
Reporting Tools : Business Objects 4.0/XI R3/6x/5x
Environment : Windows 9X/NT/2000 Server, UNIX
Other Software : TOAD 8.5.3, PL/SQL Developer 7.1, Putty
Other Application : HP Quality Center 9/10, TrackWise 6/8, Remedy, TFS (Team Foundation Server), Clear case, IBM RPM (Rational Portfolio management)
Trained Knowledge’s:
- Hadoop, HDFS, MapReduce, Python, Spark, Scala, Pig, Hive, Sqoop, Flume, HBase, Cloudera, Hortonworks
- Siperian MDM 9.0.1
- Informatica Data Director (IDD) 9.0.1, Informatica Data Transformation
- Informatica Data Quality, Informatica Data Console
Education:
- Bachelor’s in Computer Science Engineering - 2002, Bharathidasan University India.
Professional Experience:
Client : First Republic Bank, San Francisco
Role : ETL Lead
Duration : Aug 15 to Till Date
Company : Horizonsoft Solutions, Texas
Environment : Hadoop, MapReduce, HDFS, Hive, Pig, Sqoop, Flume, Oozie, Zookeeper, Informatica 9.6.1, SQL Server 2012, Oracle 11g, Linux, TFS, Control-m Scheduler
Eagle Invest is an online investment product being offered by First Republic Bank. First Republic Investment Management (FRIM) will act in the capacity as the primary advisor; Future Advisor will act in the capacity of Sub-Advisor and Technology Provider for this product. All accounts will be custodied at Fidelity. Eagle Invest is an opportunity for PWM to more effectively and profitably serve smaller relationships and have a competitive offering for clients of all sizes who want a more online based low fee solution. Eagle Invest Product insightful daily analyses of 30 to 50 GB of data collected by external sources. Processed the bank Streamline business process by developing into Hadoop ecosystem components that moved data from individual servers into HDFS.
- As an ETL lead responsible for analysis, design, development, testing and implementation. Involved in providing technical and architectural solution to the business requirement for and manage it through to the implementation phase.
- Understand the Business Requirements and translate into Mapping design document and assign the work to team members.
- Responsible for leading the project team in Deliver new and highly complex solutions to clients in response to varying business requirements.
- Developed MapReduce programs to parse raw data, populate staging tables and stored the refined data in partitioned tables in the PWM environment.
- Created Hive Queries that helped market analysis spot emerging trends by comparing fresh data with Eagle Invest reference tables and historical metrics.
- Enable speedy reviews by using Oozie to automate data loading into Hadoop Distributed File system and PIG to pre-process the data.
- Design, Development and Testing of Mappings using Informatica.
- Working on Source Analyzer, Mapping Designer, Mapplet and Transformations.
- Involving in creation Mappings by using Business rules to load data into PWM. Several types of transformations such as Source Qualifier, Expression, Aggregator, Filter, Look up (File and Database), Union, Joiner, Transaction Control, SQL, Sequence, Rank and Router were used.
- Created reusable transformations, User Defined Functions and Mapplets and used them in various mappings.
- Implemented different methods of Lookup Cache’s (Persistent, Non-Persistent, Static and dynamic).
- Involving in creation of Procedures, Triggers, Synonyms and Materialized Views in SQL Server 2012.
- Involving in creation of Parameter files & ETL Scripts.
- Working with Linux shell scripts to run the workflows from PMCMD commands, Send mail to Portfolio Manager, Archive source system files and Scheduling the Informatica Workflow through Unix Crontab in Production and Control-m Scheduler.
- Involving in Migration of Oracle Scripts, ETL Scripts and UNIX scripts to SIT, UAT & PROD Environments through TFS Tool.
- Involving in ETL Mapping Specifications.
- Preparing Technical Specification Documents.
Client : Kaiser Permanente, Portland
Role : Technical Informatica Lead
Duration : Feb 15 to Aug 15
Company : Horizonsoft Solutions, Texas
Environment : Informatica 9.5.1, Oracle 11g, Business Objects.
Common Extracts Data is to create the data marts for the downstream applications to support Accums and EPIC applications. The solution will generate the reports in business objects for the customer system revenue data for several regions are North West, SCAL, NCAL & HI.
- As a Technical ETL Consultant for Common Extracts, responsible for analysis, design, development, testing and implementation. Involved in providing technical and architectural solution to the business requirement for and manage it through to the implementation phase.
- Understand the Business Requirements and translate into Mapping design document and assign the work to team members.
- Responsible for leading the project team in Deliver new and highly complex solutions to clients in response to varying business requirements.
- Design, Development and Testing of Mappings using Informatica.
- Working on Source Analyzer, Mapping Designer, Mapplet and Transformations.
- Involving in creation Mappings by using Business rules to load data into Common Extracts . Several types of transformations such as Source Qualifier, Expression, Aggregator, Filter, Look up (File and Database), Union, Joiner, Transaction Control, SQL, Sequence, Rank and Router were used.
- Created reusable transformations, User Defined Functions and Mapplets and used them in various mappings.
- Implemented different methods of Lookup Cache’s (Persistent, Non-Persistent, Static and dynamic).
- Involving in creation of Procedures, Triggers, Synonyms and Materialized Views in Oracle 11g.
- Involving in creation of Parameter files & ETL Scripts.
- Working with Unix shell scripts to run the workflows from PMCMD commands and Scheduling the Informatica Workflow and Oracle Procedure through Unix Crontab in Production.
- Involving in Migration of Oracle Scripts, ETL Scripts and UNIX scripts to SIT, UAT & PROD Environments through RTC Tool.
- Involving in ETL Mapping Specifications.
- Involving in HP Quality Center to execute the test scripts for system testing.
- Preparing Technical Specification Documents.
Client : McKesson Specialty Health, Houston
Role : Senior Informatica Developer & MDM Developer
Duration : Jun 13 to Jan 15
Company : Horizonsoft Solutions, Texas
Environment : Informatica 9.5.1, Informatica MDM, Informatica IDQ, Oracle 11g.
Health Informatics Project (HI) is to create Global Master Data Management from various source systems to support the Physicians and Patient data. The HI MDM has been designed to provide the master data for the physicians and patients to the downstream applications.
• As a Senior ETL/MDM Consultant for HIDM applications for McKesson Specialty Health, responsible for analysis, design, development, testing and implementation.
Involved in providing technical and architectural solution to the business requirement for and manage it through to the implementation phase.
• Understand the Business Requirements and translate into Mapping design document.
• Responsible for leading the project team in Deliver new and highly complex solutions to clients in response to varying business requirements.
• Involved in data cleansing and standardization in the Informatica Data Quality.
• Analyzed the source systems for integrity issues to the data resided in various source systems and defined the same in Systems and Trust.
• Involved in implementing the Land Process of loading the physician/patient data set into Informatica MDM from various source systems.
• Designed the Base Objects, Staging tables, Landing Tables, foreign key relationships, queries, packages and query groups.
• Worked on Data Cleansing and Standardization using the cleanse functions in Informatica MDM.
• Defined the Trust and Validation rules and setting up the match/merge rule sets to get the right master records.
• Configured match rule set property by enabling search by rules in MDM according to Business Rules.
• Performed match/merge and ran match rules to check the effectiveness of MDM process of data.
• Design, Development and Testing of Mappings using Informatica.
• Working on Source Analyzer, Mapping Designer, Mapplet and Transformations.
• Involving in creation Mappings by using Business rules to load data into HI. Several types of transformations such as UDT (Unstructured Data Transformation),HTTP, Web Consumer,Source Qualifier, Expression, Aggregator, Filter, Look up (File and Database), Union, Joiner, Transaction Control,SQL, Sequence, Rank and Router were used.
• Used Target Load Plan to load the target tables as per the business needs.
• Created reusable transformations, User Defined Functions and Mapplets and used them in various mappings.
• Implemented different methods of Lookup Cache’s (Persistent, Non-Persistent, Static and dynamic).
• Involving in creation of Procedures, Triggers, Synonyms and Materialized Views in Oracle 11g.
• Involving in creation of Parameter files & ETL Scripts.
• Involving in Migration of Oracle Scripts, ETL Scripts to TST & PROD Environment.
• Involving in ETL Mapping Specifications.
• Involving in designing of new reports and enhancements of the existing reports.
• Preparing Technical Specification Documents and report documentation.
• Responsible for providing the system architecture and delivering solution to customer.
• Involving in the change control and release management aspect of the project.
• Interact with users.
Client : Eli Lilly (Manufacture and Quality)
Role : Technical Lead
Duration : Jul 12 – Jun 13
Company : IBM, Indianapolis
Environment : Informatica 9.1.0, Oracle 11g, Business Objects XI R3, TrackWise, Unix, Remedy, HP Quality Center, Toad, TFS (Team Foundation Server), Clear case
Complaint Data Warehouse (CDW) interface consists of three material/batch data sources that pulls data from the TrackWise Complaint Management System source, Adverse event and Counterfeit data source. CDW is being developed for integrating various systems. Compliants and Investigations informations are from Systems and Applications. The Informatica/Oracle PL SQL tools will be used for this Extraction, Transformation and Loading (ETL) process. Complaints Integrated Reporting Environment (CIRE) is a collection of reporting tools that will be used for information delivery of product compliant and adverse event information (AE/PC).
- As a technical lead for CDW applications for Eli Lilly, responsible for analysis, design, development, testing and implementation. Involved in providing technical and architectural solution to the business requirement for and manage it through to the implementation phase.
- Understand the Business Requirements and translate into Mapping design document and assign the work to team members.
- Responsible for leading the project team in Deliver new and highly complex solutions to clients in response to varying business requirements.
- Coordinate with Offshore effectively and make them understand system better by giving more inputs on technical side.
- Design, Development and Testing of Mappings using Informatica.
- Working on Source Analyzer, Mapping Designer, Mapplet and Transformations.
- Involving in creation Mappings by using Business rules to load data into CDW. Several types of transformations such as Source Qualifier, Expression, Aggregator, Filter, Look up (File and Database), Union, Joiner, Transaction Control, SQL, Sequence, Rank and Router were used.
- Experience in creation, backup, and restoring of Repository.
- Used Target Load Plan to load the target tables as per the business needs.
- Created reusable transformations, User Defined Functions and Mapplets and used them in various mappings.
- Implemented different methods of Lookup Cache’s (Persistent, Non-Persistent, Static and dynamic).
- Responsible to handle TT’s /CR’s alone, meeting the severity levels on time.
- Involving in creation of Procedures, Triggers, Synonyms and Materialized Views in Oracle 11g.
- Involving in creation of Parameter files & ETL Scripts.
- Working with Unix shell scripts to run the workflows from PMCMD commands and Scheduling the Informatica Workflow and Oracle Procedure through Unix Crontab in Production.
- Involving in Migration of Oracle Scripts, ETL Scripts and UNIX scripts to TST & PROD Environment through TFS Tool.
- Involving in ETL Mapping Specifications.
- Involving in HP Quality Center to execute the test scripts for system testing.
- Involving in designing of new reports and enhancements of the existing reports.
- Preparing Technical Specification Documents and report documentation.
- Responsible for providing the system architecture and delivering solution to customer.
- Involving in the change control and release management aspect of the project.
- Involving in creation of Mapplets, Complex business logic mappings, loading Dimension and Fact tables.
- Interact with users.
Client : Eli Lilly (Master Data Management)
Role : Senior Informatica Developer
Duration : Dec 09 - Jul 12
Company : IBM, Chennai
Environment : Informatica 8.1.1, Oracle 10g, Siperian, Remedy, HP Quality Center, Toad, IBM RPM (Rational Portfolio Management)
The implementation of a robust and scalable Customer Master solution is a key component of the Global Master Data Management initiative that will link together information about Lilly’s customers across the globe and provide a trusted, comprehensive view of customers to the organization in support of CRM and other activities.
The MIDAS Customer Master solution has been designed to provide a “single version of truth’ for Lilly customer information and has been architected to manage information for ongoing value.
The Customer Master enables business and data stewardship capabilities to ensure information quality through updatable business rules and data quality management and reporting. Governance controls provide a n interface for stewards to modify the Master system to accommodate changes in business requirements and needs.
- Trained & Involved in understanding the functionality of MDM process & implementation procedure
- Understand the requirements and convert them to high level technical specifications.
- Prepared initial requirement documents like integration field level mapping document and Mandatory field level mapping doc
- Co-ordinate with Informatica admin to understand the admin console set up
- Experience in creation, backup, and restoring of Repository
- Prepared Mapping Documents and reviewed by on-site team
- Involving in creation of mappings by using Business rules to load data into Siperian from Flat Files (Cegedim), Oracle based on requirements and load it into Target Tables in Oracle.
- Used Repository manager to copy the development folder across test environment and production to maintain consistency and used repository manager to validate multiple mappings and sessions at once
- Created/Scheduled workflows based on demand, run on time, run only once using Informatica Workflow Manager.
- Implemented complex functionality in PL/SQL and called through Informatica.
- Developed Stored Procedures, Functions and Triggers as per the requirement which is used in Informatica.
- Used and developed some of the Windows scripts to handle flat files.
- Implemented Siperian Mapping, Cleansing list, Match and Merge Strategy/Rules and Hierarchal Process. Created Trust and Validation rules.
- Worked closely with Production support team to resolve the run time issues in production.
- Extensive experience in tuning queries using hints.
- Involved in preparing Unit test document, Test data and testing the developments.
- Handle the flat files through Windows scripting.
Client : Eli Lilly (Master Data Management)
Role : Senior Informatica Developer
Duration : Sep 09 - Dec 09
Company : Dynpro India Private Limited, Chennai
Environment : Informatica 8.1.1, Oracle 10g, Siperian, Remedy, HP Quality Center, Toad, IBM RPM (Rational Portfolio management)
The implementation of a robust and scalable Customer Master solution is a key component of the Global Master Data Management initiative that will link together information about Lilly’s customers across the globe and provide a trusted, comprehensive view of customers to the organization in support of CRM and other activities.
The MIDAS Customer Master solution has been designed to provide a “single version of truth’ for Lilly customer information and has been architected to manage information for ongoing value.
The Customer Master enables business and data stewardship capabilities to ensure information quality through updatable business rules and data quality management and reporting. Governance controls provide a n interface for stewards to modify the Master system to accommodate changes in business requirements and needs.
- Trained & Involved in understanding the functionality of MDM process & implementation procedure
- Understand the requirements and convert them to high level technical specifications.
- Prepared initial requirement documents like integration field level mapping document and Mandatory field level mapping doc
- Co-ordinate with Informatica admin to understand the admin console set up
- Experience in creation, backup, and restoring of Repository
- Prepared Mapping Documents and reviewed by on-site team
- Involving in creation of mappings by using Business rules to load data into Siperian from Flat Files (Cegedim), Oracle based on requirements and load it into Target Tables in Oracle.
- Used Repository manager to copy the development folder across test environment and production to maintain consistency and used repository manager to validate multiple mappings and sessions at once
- Created/Scheduled workflows based on demand, run on time, run only once using Informatica Workflow Manager.
- Implemented complex functionality in PL/SQL and called through Informatica.
- Developed Stored Procedures, Functions and Triggers as per the requirement which is used in Informatica.
- Used and developed some of the Windows scripts to handle flat files.
- Implemented Siperian Mapping, Cleansing list, Match and Merge Strategy/Rules and Hierarchal Process. Created Trust an Validation rules.
- Worked closely with Production support team to resolve the run time issues in production.
- Extensive experience in tuning queries using hints.
- Involved in preparing Unit test document, Test data and testing the developments.
- Handle the flat files through Windows scripting.
Client : UOB
Role : System Analyst
Duration : Oct 08 – Aug 09
Company : Helius Technologies PTE LTD, Singapore
Environment : Informatica 8.1, Oracle 9i, PL/SQL, UNIX, Visio, Clear Case, Clear Quest
GDW is the central repository of data for the entire bank. It will also be a source of information to feed to other downstream data marts. GDW will push the data out of GDW via ETL to a staging or interface area, where other applications can pull information from that staging or interface area.
Source data’s from all the data sources via Connect Direct to load into AS400 Staging area. Different country data will be kept under different library. Informatica will pull data from AS400 source staging area and load into Oracle database for data transformation process.
End users will be using Showcase to access the information from this GDW. Proper security control mechanism has been set up to make sure only authenticated users can access to authorized information.
GDW is building the reports for various products like Customer information, Account information, Deposits, Loans and Trading to provide better analysis and control flexibility on customer contacts. This Project deals with building a data warehouse and creating reports which will help in Decision-making.
- Design, Development and Testing of Mappings using Informatica.
- Working on Source Analyzer, Mapping Designer, Mapplet and Transformations.
- Involving in creation Mappings by using Business rules to load data into GDW. Several types of transformations such as Source Qualifier, Expression, Aggregator, Filter, Look up, Sequence, Rank and Router were used.
- Involving in creation of procedures in Oracle 9i.
- Involving in creation of Parameter files.
- Involving in creation of Target reset library script in UAT & PROD Environment.
- Involving in creation of Job Flow Diagram in Visio & Run Sheet to set up in Ctrl-M Scheduler.
- Involving in creation of ETL Scripts.
- Execute the Workflows through UNIX.
- Involving in Migration of Oracle Scripts, ETL Scripts and UNIX scripts to UAT & PROD Environment through CLEAR CASE & CLEAR QUEST Tool.
- Involving in ETL Mapping Specifications.
- Interact with users.
Client : DBS
Role : Senior Software Engineer
Duration : Mar 08 – Oct 08
Company : APAR Technologies PTE LTD, Singapore
Environment : Informatica 7.1, DB2, Teradata, UNIX, Clear Case
Risk Management Group (“RMG”) data mart was created and continually enhanced with data from various transactional systems. The purpose of the data mart was to provide a dashboard for credit risk so as to gain adequate control of risk profiles and exposure, to manage portfolios, to simulate portfolios, and to allocate economic and regulatory capital.
From the staging area, a set of loading jobs will pick up the files and load them into the tables in RMG data mart. After all the data files have been a loaded, a set of ETL jobs will further process the data and generate a set of reports.
There are 2 databases in RMG Data Mart: Pre-production (“PPRISKMG”) and production (“RISKMG”). Data is first loaded into PPRISKMG at the beginning of every month. This database is only accessible internally to RMG users (“RMT”). RMT will then provide their inputs to enrich the data. A set of batch jobs then extract and transform the data in PPRISKMG based on the set of rules. On 15th calendar day, the data in PPRISKMG is ported into RISKMG which is then accessible by all users.
- Design, Development and Testing of Mappings using Informatica.
- Involving in Extraction and Loading of data from Data warehouse system to RMG Data mart.
- Working on Source Analyzer, Mapping Designer, Mapplet and Transformations.
- Involving in creation Mappings by using Business rules to load data. Several types of transformations such as Source Qualifier, Expression, Aggregator, Filter, Look up, Sequence, Rank and Router were used.
- Involving in creation of Parameter files and Batch List
- Execute the Workflows through UNIX.
- Involving in creation of Views and Work Tables.
- Involving Artifacts Promotion and Packaging from Development Env, UAT Env to BAU BETA.
Client : Charles Schwab
Role : Senior Software Engineer
Duration : Apr 06 – Feb 08
Company : Dallinsoft, Bangalore
Environment : Informatica 7 Power Center, Oracle 9i, Windows 2000
Enterprise Reporting Warehouse solution is to build the initial framework for an extensible enterprise reporting warehouse that ultimately provides integrated, verified & historical views of information clients, accounts, products, geographical locations, and relationships.
The solution will support three key functional areas are Bank Assets Under Management, Client Asset Reporting, Fee/Revenue General Ledger reporting. The purpose of this project is to define, collect, report and have the ability to analyze balance and revenue data from an integrated data warehouse. The warehouse will be designed as an extensible foundation to integrate new data subject areas in the future and support new business model.
- Design, Development and Testing of Mappings using Informatica.
- Involved in Extraction and Loading of data from Data warehouse system to Data mart.
- Working on Source Analyzer, Mapping Designer, Mapplet and Transformations.
- Created Mappings by using Business rules to load data. Several types of transformations such as Source Qualifier, Expression, Aggregator, Filter, Look up, Sequence, Rank and Router were used.
- Created and Executed Load Sessions.