
Mohammad R Hasan
- Big Data Admin/Architect
- Franklin, TN
- Member Since Jun 01, 2023
Mohammad R Hasan (Rakybul)
PROFILE:
· Over 20+ years of IT experience with 4+ years as Hadoop Administrator/Big Data Administrator/Developer Lead/Big Data Architect and Management using many different products such as: Cloudera Hadoop Big Data HDFS, SPARK, SOLR, YARN, OOZIE, Hive, Impala, Hue, Teradata, MS SQL Server, Oracle, PostgreSQL, Git and DB2 Databases.
· Expert in writing T-SQL and PL/SQL queries. Knowledge in tuning T-SQL (DDL and DML) queries to improve the database performance and availability.
· Experience in RDBMS Concepts, Database Management Systems, and Database Physical and Logical design, Data Modeling, Data Warehouses.
· Familiar with Data Warehousing designs in Star and Snow flake Schemas.
· Expert in building various DTS packages with Script Task for file path and file validation.
TECHNICAL SKILLS:
Languages :Java, Scala, Spark, Python, Pig, Hive.hql, T-SQL, PL/SQL, .Net 2003, Visual Basic 6.0, C# and C++
Operating Systems : Red Hat Enterprise Linux Server release 6.7, Windows 2012/7/2003/2000/XP/NT, UNIX, Sun Solaris
Networking: DNS, DHCP, TCP/IP, HTTP, web security mechanisms, proxies, firewalls, load balancers
Open Source: Apache, Redis, Rails
Databases : Big Data, Teradata, MS SQL Server, Oracle, MS Access
Database Tools :Cloudera Hadoop Big Data, Teradata, Db2, SQL Profiler, MongoDB, Query Analyzer, ODI, DTS, SSIS, SSRS, SSAS, Erwin, Visio, Toad, Embarcadero, ERStudio Data Architect 9.0
Reporting Services: IBM Cognos 10.2, Crystal Reporting, MS Reporting Services.
Web Technologies : HTML, XML, VB Script, ASP.net
UI : CRM ON Demand, Oracle JDE Edwards Enterprise one
Web Servers : IIS, Apache Web Server, Embarcadero Team Server.
EXPERIENCE
Admin/Architect, Big Data
Company Name: Community Health Systems, Information Services
Dates Employed: Sep 2013 – Present
Employment Duration: 4yr 2 months
Location Franklin, TN
I am currently the Admin/Architect for Big Data, leading our BIG/FAST Data transformation engagements and assisting our team in building a solid and sound easy manageable EDW for CHS.
Big data Architect:
· Manage 70 production data node Cloudera Hadoop clusters
· Developed Shell scrips for deployment.
· Monitoring and troubleshooting of hardware and software Cloudera services
· Install Packages and Parcels for Cloudera Cluster releases, system upgrades, patches, and evaluation of stability
· Linux/Red Hat administration and troubleshooting skills
· Strong Python, Shell, Hive, Impala, PostgreSQL, Oracle and SQL Programing and Performance tuning skills.
EDW (Enterprise Data Warehouse) implementation:
Cloudera Hadoop Eco Systems - CDH 5.7.X (70 node-1 petabyte space- 3 racks-20TB Ram/memory)
Work with TCS (Tata consulting services) resources: Allocation of development work.
Cloudera Manager, HDFS, Flume, Spark, Oozie, Zookeeper, Map Reduce, Hadoop, Hue, Hive, Impala, Solr code development and code review. Manage Code for Development and Production for 206 facilities.
Manage 100s’ of Oozie jobs.
Developed HDFS process to get daily load then delta through Oozie and Informatica BDE.
RaymondCorp/Toyota USA January 2012- September 2013
Greene, NY
SQL Server Developer/SQL DB Production Support/Data Analyst:
Raymond Corporation manufactures a broad line of electric powered material handling equipment such as lift trucks, reach trucks, narrow aisle and hydrogen fuel cells equipment.
Project Details:
Product Selection Tool:
Raymond Market Research & Intelligence group developed “Product Selection Tool” for GKA (Global Key Account/dealers) for Toyota, Raymond and BT trucks.
Responsibilities:
Design Product Selection database
Developed schema for Product selection database
Developed complex SQL to generate reports
Crete database objects
Create User Interface
Generate reports based on user selection
TMHU (Toyota material handling USA)/DHL Claim and Lease Processing:
TMHU generates csv files for their dealer’s service/Leasing provided to DHL Trucks. Raymond Corporation processes those files into E1 (SQL Server/AS 400) system to generate Raymond Invoice number and date to pay TMHU claims for National and Warranty Accounts. Raymond Corp creates Credit Memos’ to pay TMHU and other customers.
Responsibilities:
Load weekly TMHU provided SAP .csv files into SQL Server Tables through SSIS pkg.
Developed Primary key based on source files Analysis.
Developed Clustered Indexes based upon complex queries analysis.
Developed complex SQL Server stored procedures to generate weekly and monthly reports for Raymond National Account.
Developed SQL jobs to generate reports and send reports through mail to designated persons.
Wall-Mart Claim/Leasing process:
Raymond Corp dealers submit their claims through CRM/JDE Interface to generate invoices for their services/Lease provided to Wall-Marts Trucks.
Home Depot Claim process:
Dealers submit their claims through CRM/JDE Interface to generate invoice for their services provided to Home Depot Trucks. Raymond corps generates Credit memos to paid dealers for their services.
NCM (Non Confirming Material):
Raymond Engineering groups use NCM Database (ASP) interface to manage their defect parts after quality Testing.
Responsibilities: Create user groups to provide permission to NCM interfaces. Add, modify NCM user interfaces based on IT work Order submissions. Generate reports based on user requirements.
ORACLE JD EDWARDS ENTERPRISEONE: Dealers submit Claims for their Services through CRM/JDE menu to generate claims to Raymond, Raymond creates claims and invoices to their dealers.
Responsibilities: Run jobs to do validate Accounting Department bills vs. Marketing Department bills.
Visual Basic Scripts:
VB Scripts developed to load csv files into SQL Server Tables.
SQL Jobs: Create SQL Jobs, Procedures, functions, complex sql queries, reports based on different department’s request.
ORACLE CRM on Demand:
ORACLE CRM on Demand used by end user to determined Dealer’s provided services to a Truck with Accounts information.
Responsibilities: Developed SSIS pkg to load SQL Table from xml files send by Active dealers to determine services provided to a Truck.
WebSphere Cast Iron:
IBM WebSphere Cast Iron Studio used to developed competitive trucks, dealers and Dealer Customer Accounts.
Responsibilities:
Developed generic SQL Script to validate Raymond Dealers, Services provided by dealers; Dealers associated with Competitive Trucks and Accounts. Validation Cast Iron mapping between SQL Server to CRM On Demand.
Environment: Windows Server 2008 R2, Windows Server 2003 R2, SQL Server 2008R2(X64)/2000,DTS/SSIS, Lease+, MS Access 2000/2010, MS Visual Studio 2008, Visual Basic Scripts, IBM iSeries AS 400, JDE World, MS Office, Numara Track-It!
T-Mobile, Bellevue, WA March 2011-January 2012
SCMS (Sales Commission Management System)
T-Mobile implements a hosted Sales Performance Management (SPM) solution to support sales performance management and the sales compensation administration process. The new system will replace the current homegrown sales compensation functionality built into ACS, ICS and Excel workbooks across T-Mobile’s five sales channels. The purpose of this project is to deliver the technology needed to replace the current systems’ functionality with an easy-to-maintain, end-to-end SPM solution for 38 million Subscribers.
Oracle Developer:
ABC (Audit, Balance, Control): Developed ABC Schema, Packages and procedures for ABC module to support other modules to control errors tracking.
SAMSON SYSTEM (Prepaid Subscriber and Feature Data):
Developed Oracle Procedures, Packages to load Prepaid Subscriber and Feature data into new Oracle Adapter.
PAG (Postpaid Subscriber and Feature Data): Developed Oracle Procedures, Packages to load Prepaid Subscriber and Feature data into new Oracle Adapter.
TCM (T-Mobile Contract Management): Developed Oracle Procedures, Packages to load CM Subscribers and Features data into new Oracle Adapter.
CP (Customer Profiling Data): Developed Oracle Procedures, Packages to load CP Subscribers and Features data into new Oracle Adapter.
SQL Server Development:
ACS(Automatic Commission System)
Validate Active, Cancel and Suspended commissionable Transactions through Complex SQL query.
ICS(Indirect Commission Systems)
Validate Active, Cancel and Suspended commissionable Transactions through Complex SQL query.
ETL Development:
Install Informatica 9.1.0 Serer into UNIX AIX.
Developed ETL process through Informatica PowerCenter.
Design and developed 100’s of Mapping and WorkFlows for Source to Target. Run 100’s of WorkFlows through WorkFlow Manager.
Monitor WorkFlows through Informatica PowerCenter Monitor.
Environment: Windows 7, SQL Server 2008 R2, MS Visual Studio 2008, SQL Oracle 11gR2, Oracle Data Integrator 11g, Embarcadero ERStudio Data Architect 9.0, Toad for Oracle, AIX Unix, Informatica 9.1.0, Oracle - OraDb11g_home1, SQL Developer
Bank of America( Merrill Lynch) August 2010 - March 2011
SQL Server Developer: WMBS (Wealth Management Banking Services)
Organization Group: Global Wealth Management Ops and Broadcort Tech
Project: Merrill Lynch has developed a user-friendly web-based tool for creating client letter on the fly. This tool automates and improves the way that client letters are created and managed. Client Service Representatives are able to login into the system and choose a group of letters relevant to their particular business unit. When a letter is chosen and account number is entered, Client and Financial Advisor information is retrieved from the database along with name and address fields are automatically populated. Moreover, the Client Service Representatives are able to customize the letter by entering values for variables that are unique to the letter.
Technical Environment: MS SQL Server 2000/2005, T-SQL, SSIS, SSRS, redgate, Windows Server 2003, MS .Net 2003, MS Excel, MS Visual Studio 2008, C#, IBM I Series, AS400, Query Tool For DB2, DB2I (TSO, Spufi), Oracle 10g/9i, BIDS, AutoSys and JIL (Job Information Language)
Responsibilities:
· Created database design.
· Wrote complex T-SQL Stored Procedures.
· Created user defined functions.
· Implemented NBK’s (unique) ID into COL.
· Developed letters variables.
· Developed HLD and LLD Documentations.
· Developed MIDAS (Management Information Decision Analysis Support).
· Query to generate reports for WMBS group.
As an Oracle Developer: Managed HR database in RDR (Oracle Based Data Warehouse) for all of their employees.
· Developed scripts for Oracle 10g/9i HR Database (Reference Data Repository (RDR)) to update new implemented NBK on Oracle Packages and Procedures.
As a DB2 Developer:
· Merrill Lynch keeps all of their client’s correspondence records into MIDAS.
· Developed complex query to generate reports from MIDAS Data Warehouse for WMBS Client Representatives.
· Member of: 08005R Client Rept and Info Systems.
· Completed Web Training: 2010 Information Protection and Privacy, 2010 Anti Money Laundering.
NTSP (North Texas Specialty Physicians January 2010 – July 2010
SQL Server Developer-NTPS Data Warehouse (SSIS/SSRS/SSAS Developer)
NTSP is a group of physicians developed a product to manage their monthly claims information as well patients, Diagnosis provider, Pharmacy and Insurance payment information. HCFA (Health Care Funded Administration) provide raw file to NTPS to process claims information. NTSP receives Lab Data from LabCorp and Quest. There are three more vendors also use this Data Warehouse to get their specific members performance reports based on their performance, registered members and provider. Their existing systems migrated into sql server 2008. CCD (community care data) provided by SandLot and Care and Care Pacific Health Care and Health Vision to NTSP. HL7 is their standard to generate message based on Warehouse provided data.
Responsibilities:
· Gather requirements for new Data warehouse schema.
· Developed report design specification documents.
· Write MDX queries
· Design Cubes
· SSAS,SSRS,SSIS
· Developed complex reports employing expressions, global collections, and conditional formatting using SQL Server Reporting Services
· Interact with business users to determine report specifications
· Capture changes to map new data warehouse.
· Converts 150+ rpt file into rdl files.
· Developed and Format Tablix with group expression and generate Template for rdl files.
· Developed rdl file based on condition and expression.
· Developed Data source view, cubes for Data Mart by SSAS.
· Developed data sets, data sources to generate reports.
· Deployed SSRS reports into Client server.
· Configured SSRS report into client Server.
· Upload manage users on Reports Manager.
· Developed strategy to map raw data into sql server 2008 Database warehouse.
· Developed sql scripts to generate new reports.
· Modified stored procedures for new SSRS reports.
· Developed SSIS for new warehouse load.
· Developed Stored Procedures to map new data warehouse.
· Deployed rdl files to Report Manager Server.
· Configuration SSRS to NTSP Server.
· SSRS Server configuration.
· Deployed rpt Files to Microsoft Office SharePoint Server Templates(MOSS)
· SSRS Deployment to Production Server.
· Developed SSIS (ETL) to load Stage to Production.
· Developed Configuration and Log files dynamic to run rdl, dtsx file to multiple environments.
Environment: Windows Server 2008 R2, Crystal Reports, MS Excel, MS VISIO, MS Visual Studio 2008, C#, SQL Server 2005,2008,BIDS.
Bank of America (Merrill Lynch), Hopewell, NJ October 2009 –Jan 2010
Organization Group: WEALTH MANAGEMENT TECHNOLOGY
SQL Server Developer
Project:DTSConversion(ML-Products/Bond/CustomizedInvestment/HR-Hierarchy/Flexi Cash/Profiles/Accounts/Event Tracker)
Merrill Lynch upgrading their SQL Server 2000 database to 2005 and also adding new business rules for their new Database Server. Merrill Lynch has many different Investment strategies and DTS (Data Transformation Services) have been using to manipulate data and produce many different business and Investment values. Global Investment Risk Management department is a part of managing all DTS packages. Because of upgrading new Database Server 2008, they need to convert all of their 2000 DTS packages to SSIS (SQL Server Integration Services) 2008.
Responsibilities:
· Convert 100’s of DTS packages to SSIS packages.
· Work with .Net 2003 .cuss Files to Execute SSIS Package Name and Global variables.
· Independently open .Net 2003 Solutions to Test Business Functionality of DTS/SSIS Packages.
· Developed and Configuration ASP.Net Solutions to verify and validate packages Functionality on Product Based Applications.
· Developed Stored Procedures for new Business Rules.
· Developed User Defined Functions
· SSIS Control Flow to Control SSIS packages.
· SSIS Data Flow to produces data Transformation for new Business Rules.
· SSIS Script Task for ActiveX task conversions.
· SSIS Execute SQL Task
· Developed Event log and check point with pipeline for better performance.
· Developed Merger Join to load multiple Tables into destination.
· SSIS Bulk Inset Task
· SSIS File System Task
· SSIS For Each Loop Container
· End to End Testing
· Windows shell/batch scripting
· Developed Data base Objects
· Developed Bank of America stored Procedures code standard
· Developed XML Configuration File for SSIS
· Developed Log Files for SSIS
· Deployed new build SSIS packages to AustoSys/JIL UNIX Platform.
Environment: Windows Server 2003, MS .Net 2003, MS Excel, MS Visual Studio 2008, C#, SQL Server 2000,2005, IBM I Series, AS400, Query Tool For DB2, Oracle 9i/10g, BIDS, AutoSys and JIL (Job Information Language).
Insurity-Hartford, CT June 2007 – September 2009
SQL Server Developer
Project: CityFile Migration
Insurity is an insurance company. It has many different lines of business to provide insurance code for their clients. Insurity has developed a product to search insurance code for USA, CA and Mexico’s clients based on City locations, Zips, Territories and ISO Mitigation information to provide commercial line insurance quotes.
Responsibilities:
· Create Database design.
· Create Insurity Global Data warehouse design and documentations.
· Create SSAS project for their GDW.
· Developed ASP.Net UI with C# to accept user input.
· Developed ETL process to capture data changes by slowly changing data Flow Task tool.
· Developed SSRS standard and Ad hoc report from GDW.
· Write complex T-SQL Stored Procedures.
· Create User Defined Functions.
· Performance tuning of SQL queries and stored procedures using SQL Profiler and Index Tuning Wizard.
· Created Database Maintenance Planner for the Performance of SQL Server, which covers Database Integrity Checks, Update Database Statistics and Re-indexing.
· Convert DTS to SSIS.
· Create XML and Log file for SSIS.
· Run SSIS in command line.
· Create User defined variables to make dynamic SSIS.
· BCP to Export and Import.
· Create Batch Files for Client Requirements.
· Create dynamic variables for Database Instance, Database name, User Name and PW.
· Create XML Files to deploy Packages to Clients.
· Data Validation and Verification.
· Deploy Stored Procedures from Development to Production.
· Generated Scripts to Deploy Production Server.
· Create Documentations, Code review.
· End to End Product Presentation to Client.
Environment: MS Visual Studio 2005, C#, SQL Server 2005, MS VSS, ERWIN, MS Excel, MS Access, CSV, MS Visio, MS Visual Basic 2005.
Alticor - Ada, MI January 2006 –June 2007
SQL Server Developer
Project: DTS Conversion and Global Data warehouse
Alticor Business Intelligence Group developed a Global Data warehouse. There are 300 million rows, 120 tables and 2TB data involved in this data warehouse. GDW will be used by Department of DSS to make future business decisions.
Responsibilities:
· Interacted with users to gather new added requirements.
· Created development environment for BI group of Alticor.
· Create documentation for Star Schema model.
· Modified and Edit OLAP Cubes using Star Schema.
·