Vijay Data Architect

  • Sr. Data Architect / Modeler
  • Houston, TX
  • Member Since Jun 02, 2023

Candidates About

 

Vijay

Sr. Data Architect / Modeler

Summary:

·         Over 9+ years of IT industry experience in Application Design, Development, and Data Management - Data Governance, Data Architecture, Data Modeling, Data Warehousing and BI, Data Integration, Meta-data, Reference Data and MDM.

·         Experience in Dimensional Data Modeling, Star/Snowflake schema, FACT & Dimension tables.

·         Experience with emerging technologies such Big Data, Hadoop, and NoSQL.

·         Experience in working on Distributed storage for analysis and processing of large data sets using Apache Hadoop .

·         Working knowledge of Big data, NewSql, NoSQL, Vertica.

·         Experience in importing and exporting data from different relational databases like MySQL6.x, Netezza, Oracle into HDFS and Hive using Sqoop.

·         Excellent Analytical skills to understand the Business Process and Functionality. Developing Functional Specifications for business process refinement and automation, Data Modeling, system architecture, and conducting feasibility studies.

·         Highly Efficient in Data Mart Design and creation of cubes using dimensional data modeling - identifying Facts and Dimensions, Star Schema and Snowflake Schema.

·         Solid hands on experience in creating and implementation of Conceptual, Logical and Physical Models for Online Transaction Processing and Online Analytical Processing.Efficient in developing Logical and Physical Data model and organizing data as per the business requirements using Sybase Power Designer, Erwin, ER Studio in both OLTP and OLAP applications.

·         Strong experience in analyzing/ Data Transformation of large amounts of data sets writing Pig scripts and Hive queriesin AWS EMR, AWS RDS. Extensive knowledge in Hadoop stack components viz. Apache Hive, Pig Scripting,etc.

·         Hands-on experience in architecting and data modeling for AWS Redshift, AWS Oracle RDS, AWS PostgreSQL and AWS Aurora.

·         Expertise lies in Data Modeling, Database design and implementation of Oracle, AWS Redshift databases and Administration, Performance tuning etc.

·         Excellent experience in troubleshooting SQL queries, ETL jobs, data warehouse/data mart/data store models.

·         Practical understanding of the Data modeling (Dimensional & Relational) concepts like Star-Schema Modeling, Snowflake Schema Modeling, Fact and Dimension tables. Worked on data modeling using ERWIN tool to build logical and physical models.

·         Skillful in Data Analysis using SQL on Oracle, MS SQL Server, DB2 & Teradata.

·         Experienced in Data Extraction/Transformation/Loading (ETL), Data Conversion and Data Migration by using SQL Server Integration Services (SSIS) and PL/SQL Scripts. 

·         Good exposure on usage of NoSQL database column-oriented, HBase. 

·         Experienced in Technical consulting and end-to-end delivery with architecture, data modeling, data governance and design - development - implementation of solutions.

·         Experienced in writing SQL queries and optimizing the queries in Teradata, Netezza, Oracle and SQL Server.

·         Creating data models (ERD, logical) including robust data definitions, which may be entity-relationship-attribute models, star, and snowflake models.

·         Good experienced in Normalization for OLTP and De-normalization of Entities for Enterprise Data Warehouse. 

·         Experience using MapReduce, and "Big data" work on Hadoop and other NOSQL platforms.

·         In depth understanding of data modeling concepts and techniques as applied in OLTP, ODS and Data Warehouse applications including normalization (3NF), de-normalization, dimensional modeling, OLAP.

·         Excellent Software Development Life Cycle (SDLC) with good working knowledge of testing methodologies, disciplines, tasks, resources and scheduling.

·         Strong experience with architecting highly performance databases using PostgreSQL, PostGIS, MYSQL and Cassandra. 

 

Technical Skills:

Data Modeling Tools:   Erwin R6/R9, Rational System Architect, IBM Info sphere Data Architect, ER Studio and Oracle Designer

Database Tools:           Microsoft SQL Server12.0, Teradata 15.0, Oracle 12c/11G/9i, and MS Access

BI Tools:                      Tableau 7.0/8.2, Tableau server 8.2, Tableau Reader 8.1, SAP Business Objects, Crystal Reports.

Big Data:                       Hadoop, HDFS, Hive, Pig, HBase, Sqoop, Flume, Kafka

Packages:                    Microsoft Office 2010, Microsoft Project 2010, SAP and Microsoft Visio, Share point Operating Systems:     Windows, Centos, Sun Solaris, UNIX, Ubuntu Linux 

AWS:                            Redshift, EMR, EC2, S3, RDS, Cloud Search, Data Pipeline

Version Tool:               VSS, SVN, CVS.

Tools & Utilities:          TOAD 9.6, Microsoft Visio 2010.

Methodologies:            RAD, JAD, RUP, UML, System Development Life Cycle (SDLC), Waterfall Model.

 

 

Work Experience:

 

Direct Energy, Houston, TX                                                                                                     Feb 2017- Present

Sr. Data Architect/ Data Modeler

·         Responsible for the data architecture design delivery, data model development, review, approval and Data warehouse implementation. 

·         Designed and developed architecture for data services ecosystem spanning Relational, NoSQL, and Big Data technologies.

·         Collected large amounts of log data using Apache Flume and aggregating using PIG/HIVE in HDFS for further analysis.

·         Created Logical and Physical Data Model using IBM Data Architect tool.

·         Develop and maintain data architecture, including master data and data quality, using Toad Data Modeler and Microsoft Master Data Manager (MDS), as well as Oracle Data Integrator.

·         Design and develop Business Intelligence architecture using Microsoft, Oracle, and Tableau products.

·         Designed the Logical Data Model using ERWIN 9.64 with the entities and attributes for each subject areas.

·         Used Tableau for BI Reporting and Data Analysis. 

·         Specifies overall Data Architecture for all areas and domains of the enterprise, including Data Acquisition, ODS, MDM, Data Warehouse, Data Provisioning, ETL, and BI.

·         Loaded data into Hive Tables from Hadoop Distributed File System (HDFS) to provide SQL-like access on Hadoop data.

·         Developed and implemented data cleansing, data security, data profiling and data monitoring processes.

·         Developed Map Reduce programs to cleanse the data in HDFS obtained from heterogeneous data sources to make it suitable for ingestion into Hive schema for analysis

·         Applied data analysis, data mining and data engineering to present data clearly.

·         Converting existing hive queries to Spark SQL queries to reduce execution time.

·         Demonstrated expertise utilizing ETL tools, including SQL Server Integration Services (SSIS), Data Transformation Services (DTS), and Data Stage and ETL package design, and RDBM systems like SQL Servers, Oracle, and DB2.

·         Review and Patch of Netezza and Oracle environments including DB2, OS and Server firmware.

·         Configured Hunk to read customer transaction data from Hadoop Ecosystems such as HDFS and Hive

·         Selecting the appropriate AWS service based on data, compute, database, or security requirements.

·         Used Flume extensively in gathering and moving log data files from Application Servers to a central location in Hadoop Distributed File System (HDFS) for data science.

·         Working on Amazon Redshift and AWS and architecting a solution to load data, create data models and run BI on it.

·         Extensively used Crystal Reports SAP SE 14.2 for Data Reporting

·         Experience with AWS ecosystem (EC2, S3, RDS, and Redshift).

·         Gathered and analyzed existing physical data models for in scope applications and proposed the changes to the data models according to the requirements.

·         Developed and implemented data cleansing, data security, data profiling and data monitoring processes.

·         Used Teradata Administrator and Teradata Manager Tools for monitoring and control the system.

·         Developed and configured on Informatica MDM hub supports the Master Data Management (MDM), Business Intelligence (BI) and Data Warehousing platforms to meet business needs.

·         Developed PL/SQL scripts to validate and load data into interface tables

·         Participated in maintaining data integrity between Oracle and SQL databases.

·         Participated in OLAP model based on Dimension and FACTS for efficient loads of data based on Star Schema structure on levels of reports using multi-dimensional models such as Star Schemas and Snowflake Schema.

Environment: Oracle 12c, MS-Office, SQL Architect, Spark, TOAD Benchmark Factory, Teradatav15, Hadoop, SQL Loader, SharePoint, ERwin r 9.64, DB2, MS-Office, SQL Server 2008/2012, AWS, HBase, Hive.

 

Molina Healthcare, Long beach, CA                                                                                      Sep 2015 – Jan 2017

Sr. Data Modeler/ Data Architect

·         Analyze functional and non-functional business requirements and translate into technical data requirements and create or update existing logical and physical data models.

·         Massively involved in Data Architect role to review business requirement and compose source to target data mapping documents.

·         Installed and Configured Open Source Software like Pig, Hive, HBase, Flume and Sqoop.

·         Designed and developed architecture for data services ecosystem spanning Relational, NoSQL, and Big Data technologies.  

·         Designed semantic layer data model. Conducted performance optimization for BI infrastructure.

·         Actively involved in the Design and development of the Star schema data model.

·         Implemented slowly changing and rapidly changing dimension methodologies; created aggregate fact tables for the creation of ad-hoc reports.

·         Involved in the creation, maintenance of Data Warehouse and repositories containing Metadata.

·         Performed Hive programming for applications that were migrated to big data using Hadoop.

·         As an Architect implement MDM hub to provide clean, consistent data for a SOA implementation.

·         Installing and configuring the a 3-node Cluster in AWS EC2 Linux Servers

·         Designed different type of STAR schemas like detailed data marts and Plan data marts, Monthly Summary data marts using ER studio with various Dimensions Like Time, Services, Customers and various FACT Tables.

·         Created and maintained surrogate keys on the master tables to handle SCD type 2 changes effectively.

·         Worked with the developers in deciding the application architecture.

·         Responsible for Dimensional Data Modeling and Modeling Diagrams using ERWIN.

·         Designed and implemented a Data Lake to consolidate data from multiple sources, using Hadoop stack technologies like SQOOP, HIVE/HQL.

·         Designed the data marts using the Ralph Kimball's Dimensional Data Mart modeling methodology using ER Studio 9.7.

·         Created DDL scripts using ER Studio and source to target mappings to bring the data from source to the warehouse.  

·         Developed and maintained data dictionary to create metadata reports for technical and business purpose.

·         ETL processing using Pig & Hive in AWS EMR, S3

·         Developed strategies for data warehouse implementations, data acquisitions, provided technical and strategic advice and guidance to senior managers and technical resources in the creation and implementation for data architecture and data modelling.

·         Extensive Data validation by writing several complex SQL queries and Involved in back-end testing and worked with data quality issues.

·         Data Profiling, Mapping and Integration from multiple sources to AWS S3/RDS/Redshift.

·         Design and development of ETL routines to extract data from heterogeneous sources and loading to Actuarial Data Warehouse.

·         Participated in preparing Logical Data Models/Physical Data Models.

·         Identify source systems, their connectivity, related tables and fields and ensure data suitably for mapping.

·         Worked with BTEQ to submit SQL statements, import and export data, and generate reports in Teradata.

·         Worked on HL7 2.x file format (ADT and clinical messages) on MEDIFAX and a thorough understanding of how interface development projects work.

·         Developed company-wide data standards, data policies and data warehouse/business intelligence architectures.

·         Designed and documented Use Cases, Activity Diagrams, Sequence Diagrams, OOD (Object Oriented Design) using UML and Visio.

·         Performed data cleaning and data manipulation activities using NZSQL utility.

·         Designed and Developed Oracle PL/SQL Procedures and UNIX Shell Scripts for Data Import/Export and Data Conversions. 

·         Written complex SQL queries for validating the data against different kinds of reports generated by Business Objects XIR2.

·         Designing Logical data models and Physical Data Models using Erwin.

·         Developing the Conceptual Data Models, Logical data models and transformed them to creating schema using ERWIN.

Environment: DB2, CA Erwin 7.0, Oracle 11g, MS-Office, SQL Architect, Hadoop, Hive, Pig, TOAD Benchmark Factory, Sqoop, SQL Loader, AWS Redshift, AWS S3, PL/SQL, SharePoint, ERwin r8.0 and Erwin r9.0, MS-Office, SQL Server 2008/2012,

 

Fifth Third Bank, Cincinnati, OH                                                                                          May 2013 – Aug 2015

Sr. Data Modeler/ Data Analyst

·         Understood source business process and data model and do Data Analysis and map the requirement to source system.

·         Generated comprehensive analytical reports by running SQL queries against current databases to conduct Data Analysis. 

·         Performed Data Analysis, Data Migration and data profiling using complex SQL on various sources systems including Oracle and Teradata.

·         Develop Logical and Physical data models that capture current state/future state data elements and data flows using Erwin.        

·         Experienced in Designing Database with prominent activities like maintaining sequences, index, primary key, foreign key, manipulating columns and tables.

·         Translated business requirements into working logical and physical data models for Data warehouse, Data marts and OLAP applications.

·         Involved in preparing modeling estimates, DFD, Volumetric, defining enterprise standards for best practices.

·         Data architect for large-scale pharmacy data management (PBM) data migration project from SAS to Teradata for the Enterprise Information Management (EIM) program. Redesigned database schemas and created conceptual, logical and physical data models. 

·         Implemented dimension model (logical and physical data modeling) in the existing architecture using ER Studio.

·         Worked with Amazon Redshift and AWS

·         Performed Data modeling using Erwin Data Modeler. Identified objects and relationships and how those all fit together as logical entities, these are then translated into physical design using forward engineering

·         Identified the entities and relationship between the entities to develop Conceptual Model using ERWIN.

·         Worked with Hadoop eco system covering HDFS, HBase, YARN and Map Reduce

·         Enforced referential integrity in the OLTP data model for consistent relationship between tables and efficient database design.

·         Excellent experience and knowledge on data warehouse concepts and dimensional data modeling using Ralph Kimball methodology.

·         Worked with BTEQ to submit SQL statements, import and export data, and generate reports in Teradata.

·         Gathering the business requirements from the respective application team (Data Architect's / Application Owner's).

·         Worked with data compliance teams, Data governance team to maintain data models, Metadata, Data Dictionaries; define source fields and its definitions.

Environment: ERWIN 9.0.0, Windows 2010, UNIX, Oracle 12c, SQL SERVER 12.0,  PL/SQL, DB2, Teradata SQL assistant, DQ analyzer, HDFS, HBase, YARN, IBM Optim Tool, IBM Rational Clear Case and Clear Quest, Toad 9.7,

 

 

Southwest Airlines, Dallas, TX                                                                                                Mar 2011- Apr 2013

Sr. Data Modeler/Analyst

·         Participated in all phases of project including Requirement gathering, Analysis, Design, Coding, Testing, Documentation and warranty period.

·         Develop Logical and Physical data models that capture current state/future state data elements and data flows using Erwin.

·         Used forward engineering to generate DDL from the Physical Data Model and handed it to the DBA.

·         Developed dimensional model for Data Warehouse/OLAP applications by identifying required facts and dimensions.

·         Analyzed the business requirements by dividing them into subject areas and understood the dataflow within the organization

·         Created a Data Mapping document after each assignment and wrote the transformation rules for each field as applicable

·         Created a list of domains in Erwin and worked on building up the data dictionary for the company

·         Created DDL scripts for implementing Data Modeling changes. Created ERWIN reports in HTML, RTF format depending upon the requirement, Published Data model in model mart, created naming convention files, co-coordinated with DBAs' to apply the data model changes.

·         Extensively used Normalization techniques (up to 3NF).

·         Writing complex queries using Teradata SQL.

·         Worked with the ETL team to document the transformation rules for data migration from source to target systems.

·         Developed source to target mapping documents to support ETL design.

·         Developed the logical data models and physical data models that capture current state/future state data elements and data flows using ERwin.

·         Created Physical Data Model from the Logical Data Model using Compare and Merge Utility in ERwin and worked with the naming standards utility.

·         Responsible for migrating the data and data models from SQL server environment to Oracle 10g environment.

·         Designed the physical model for implementing the model into oracle 10g physical data base.

·         Used ER Studio to create logical and physical data models for enterprise wide OLAP system.

·         Generated comprehensive analytical reports by running SQL queries against current databases to conduct data analysis.

·         Supported QA/ETL teams in ensuring proper implementation of the requirements and developed and executed test plans and test scripts for testing and UAT (User Acceptance Testing).

Environment: Erwin, SQL, SQL Server 2000/2010, Rational Rose, Crystal Reports 9, PL/SQL, Business Objects XIR2, ETL Tools Informatica9.5/8.6/9.1 Oracle 10g, Teradata V2R13/R14.10, Teradata SQL Assistant 12.0, Netezza, Power Designer

 

Valuelabs, Hyderabad, India                                                                                                     Apr 2008-Feb 2011           

Data Modeler/Analyst

·         Developed Data Mapping, Data Governance, Transformation and Cleansing rules for the Master Data Management Architecture involving OLTP, ODS and OLAP.

·         Created logical data model from the conceptual model and it's conversion into the physical database design using Erwin.

·         Analyzed the data and provide resolution by writing analytical/complex SQL in case of data discrepancies.

·         Tuning and code optimization using different techniques like dynamic SQL, dynamic cursors, and tuning SQL queries, writing generic procedures, functions and packages.

·         Responsible for Relational data modeling (OLTP) using MS Visio (Logical, Physical and Conceptual).

·         Designed, developed and implemented solutions with data warehouse, ETL, data analysis, and BI reporting technologies.

·         Design and development of ETL processes using Informatica ETL tool for dimension and fact file creation

·         Create and execute test scripts, cases, and scenarios that will determine optimal system performance according to specifications.

·         Performed Data Modeling, Database Design, and Data Analysis with the extensive use of Erwin.

·         Proficient in GUI, Relational Database Model (RDBMS), designing of OLAP system environment as well as Report Development.

·         Extensively used SQL, Transact SQL and PL/SQL to write stored procedures, functions, packages and triggers.

·         Deployed naming standard to the Data Model and followed company standard for Project Documentation.

·         Resolved the data type inconsistencies between the source systems and the target system using the mapping documents and analyzing the database using SQL queries.

·         Reverse Engineered DB2 databases and then forward engineered them to Teradata using ER Studio.

·         Tested the database to check field size validation, check constraints, stored procedures and cross verifying the field size defined within the application with metadata.

·         Extensively worked on development of mappings with BODS Transformations like Map Operation, Table Comparison, History Preserving, Key Generation, Pivot, Reverse Pivot etc.

·         Responsible for design of logical and physical Data model for client's investment management ODS using dimensional modeling.

Environment: Erwin, Oracle 8i, Developer 2000 with Forms 5.0 and Reports 3.0, O, Windows XP, PL/SQL, MS-Access, Sql Server, MS Office, MS Visio, Informatica Power center 5.1, Teradata