Robin Dong

  • Big Data Architect / Hadoop Administrator
  • Jersey City, NJ
  • Member Since Jun 02, 2023

Candidates About

 

Robin Dong

Summary

    Certified Cloudera Hadoop Admin and Developer having over 15 years of experience in IT- Software Engineering with current expertise being in Big Data/Hadoop ecosystems and NoSQL (Cassandra, Mongo DB, and Hive, Hbase)

    Hands on experience in Hadoop Ecosystem components such as Hive, Pig, Sqoop, Flume, Zookeeper/Kafka and Hbase and MapReduce

    Hands on experience in HDFS, Big Data, ETL for data warehouse projects

    Strong SQL programing, Hiveql for Hive, Pig and Hbase 

    Strong programming skills in Spark/Scala, python

    Strong knowledge of Hadoop Architecture and all its ecosystem tools.

    Solo designed and implementation in Kafka multiple nodes cluster to extract data from Teradata, Oracle database into Hadoop cluster databases.

    Implemented Sqoop for large dataset transfer between Hadoop and RDBMS

    Experience in working with Cloudera, Hortonworks Hadoop Distributions and Datastax Cassandra 

    Hands on experience on AWS infrastructure services Amazon Simple Storage Service (Amazon S3) and Amazon Elastic Compute Cloud (Amazon EC2)

    Worked with Zookeeper/Kafka to manage the flow of jobs and coordination in the cluster

    Experience in performance tuning, monitoring the Hadoop cluster by gathering and analyzing the existing infrastructure using Cloudera manager, Ambari, and Opscenter

    Strong Red Hat, Linux Admin skills, working with Unix/Linux for last 14 years

    Oracle DBA: including Erwin database design, development, testing, implementation and data warehousing

    Data Architect:  system design, data model design, backup/recovery strategies, OLAP WH project

    Strong database admin and data performance tuning skills

 

Education

M.S. in Management Information Systems- Strayer University, Washington, DC

B.S. in Computer Engineering- Zhengzhou University, Henan China

 

Certifications

Apache Hadoop/Cloudera Administrator

Apache Hadoop/Cloudera Developer 

Apache Cassandra V2.1 Administrator

Oracle Database Administrator -- OCP

Oracle 11gR2 RAC

Golden Gate 10 

UNIX Solaris 8 System Admin

 

Technical Skills

 

Languages: Spark / Scala, Python, Spark/SQL, Shell script

OS: AWS/EC2, Red Hat, IBM AIX, Linux – RHE7, Centos 7

Networks: TCP/IP, Windows NT 4.0 Server

Software: Cloudera/Hadoop manager 4.5, Hortonworks/Ambari, Kafka streaming, MongoDB, Enterprise Manager Grid Control (OEM) 12c, GoldenGate 12c, CA Erwin R7

Hardware/software: ASM for Oracle RAC, NFS, AWS/EBS

 

 

 

Work Experience         

IntellectDesign --Jersey City, NJ                                                                                                4/2016 - present

 

Big Data Architect / Hadoop Administrator

 

      Installed, configured Cloudera Hadoop and Hortonworks HDP 2.x clusters 5.x on AWS/EC2

      Setup kafka cluster with multiple brokers, partitions and producer, consumer groups

      Installed and configured mongodb multiple nodes sharding, integrated with Hadoop cluster system

      Setup data streaming from kafka to mongodb by Spark Scala program and big data load testing with elastic search team.

      Write complex queries by Spark Scala and Python on NoSql databases and RDBMS for data analysis.

      Provided detailed instruction on installation, configuration and workflow to the team 

      Involved in data science/algorithm research for the project.

      Performance tuning and troubleshooting on clusters and recommended solutions

 

General Electric- Cincinnati, OH                                                                                10/2015 - 4/2016

                                                                                                      

Big Data Architect / Hadoop Administrator & Lead Developer

 

    Installed, configured Cloudera Hadoop components and Hortonworks HDP 2.x

    Installed, configured Cassandra cluster by Opscenter on AWS/EC2/S3

    Worked on analytics as lead Big Data/Scala developer

    Provided procedure definition and design of solution

    Evaluated performance on different Big Data platforms

    Performance tuning on peak time processes on Hadoop cluster

    Worked on CDH, Ambri and configured ecosystem tools like Hive/hiveql, Hbase, Sqoop, spark SQL/Scala, Kafka

    Configured ETL from Teradata database, data lake for data warehouse

    Worked on data models and ingested DWH data to Hadoop cluster

    Monitoring and troubleshooting on production cluster.

    Installed and configure machine learning tool -- Alpine data lab and data models

    Worked on a datapipeline project using flume, kafka, spark/scala/RDD/dataframes and store in hive.

    Generated BI report by Tableau

 

T-Mobile/Ericsson- Seattle, WA                                                                              04/2014 – 09/2015

 

Data Architect / Hadoop Administrator & Developer

 

    Actively involved in design, review, implementing and optimizing data transformation processes

In the Hadoop ecosystems.

    Lead several Hadoop data extraction, warehousing and analytics tasks

    Coordinated with offshore team on development task and troubleshooting 

    Install, manage and support Linux operating systems, ex. RHEL, CentOS, Ubuntu.

    Installed configured Hadoop Cloudera CDH5, setup Hadoop Cloudera distribution system and monitor by Hadoop Cloudera manager.

    Hands on experience with Amazon web services, created EC2 (Elastic Compute Cloud) cluster instances, setup data buckets on S3 (Simple Storage Service), set EMR (Elastic MapReduce) with Hive scripts to process big data.

    Worked on Pig and Hiveql. Involved in data warehouse, schemas creation and management.

    Involved in writing Shell Scripts.

    Setup and optimize the development and production environment.

 

Apple/TCS consulting- Sunnyvale, CA                                               02/2013- 04/2014

 

Hadoop Administrator / Developer and Oracle DBA support.

Ecosystem: Hadoop/Hive, Hbase, Pig, Sqoop, MapReduce and zookeeper etc.

 

    Installed and configured Red Hat/CentOS and Ubuntu/Cloudera manager with Hadoop multiple nodes

    Collected data from different databases (i.e. Teradata, Oracle, MySQL) to Hadoop

     Installed, configured and created Hbase, Hive, Pig and MapReduce scripts

     Worked on Hive/Hbase vs RDBMS, imported data to Hive, created tables, partitions, indexes, views, queries and reports for BI data analysis

     Involved in writing Shell Scripts

     Conducted introductory classes on Hadoop admin and Hadoop developer

     Troubleshooting and performance tuning on Hadoop system

     Installed, refreshed, upgraded 11g databases

     Production Support for any OLTP database issue

     Work closely with Application teams to resolve performance issues

     Installed Oracle 11gr2 RAC on EMC/ASM storage, installed Data guard

     Installed and configured Oracle 12c and GoldenGate 12c

     Installed and setup Oracle 12c Enterprise Manager and Mongo database

 

Dow Corning Corp. - Midland, MI                                                        08/2012- 02/2013

 

Oracle RAC Admin and OEM 12C Admin

Oracle 11gr2 RAC system with SAP application

EMC/Vplex, VMware, Red Hat 6.2 with 24 cluster nodes and 10TB SAP application data.

 

     Installed and configured 11gr2 RAC and Oracle Enterprise Manager 12c (OEM) to monitor all 24 nodes 24/7 on cluster, ASM, listeners, databases, agents and performance tuning

     Setup notifications, admin groups, monitor templates, incidents rules, scheduled jobs for backups, database clone, SQL performance, AWR reports

     Production Support for RAC/SAP system

     Documented troubleshooting procedures

 

LandsEnd.com- Dodgeville, WI                                                                     09/2011- 07/2012

Oracle Architect/DBA, Real Application Cluster 11g R2

 

     Performance tune production database: Solaris 10 kernel and Java application

     Created performance health check report using OEM Grid control to analyze data in conjunction with AWR analysis by ADDM

     Heavy user interface with marketing team to reorg data warehouse to support the Business Intelligence model, also completed many SQL store procedures for analysis and market trending and cleaned up, refreshed all images for company online sale.

     Installed and configured Oracle Golden Gate for bi-directional replication

     Production Support for all Erwin data models for company databases. Managed requirements and releases for all international marketing work tracks

     Designed new production databases merge strategies

     Configured Nagios for system-wide monitoring

     Re-designed company development architecture and refresh procedures on VMware

 

Department of Defense Manpower Data Center/SRA- Seaside, CA                                      03/2009 - 08/2011

Senior Oracle DBA             

     Installed and configured OEM (Grid Control) for security system

     Designed and maintained relational database model, with many sub models

     Monitored and performed troubleshooting for all US Air Force Base PIPS databases

     Performed SQL tuning for system statistics reports

     Worked on Data warehouse project, ETL scripts and implemented.

     Setup policy for database security, such as audit vault, FGA and encryption

     Optimized system configuration related to daily performance and maintenance

     Provided solutions for data guard performance on network issues

     Installed Oracle 11g RAC on Linux RH, ASM

     Installed and configured Golden Gate to replicate Oracle 11g databases

 

 

 

 

Citi Group Bank/Banamex- Mexico City, Mexico                                                            05/2008 - 03/2009

Senior Oracle DBA/HP-UX Administrator

     Provided architectural design for implementation of data warehouse to support massive credit card data repository

     Designed data ware house model, transformed it to a physical database and configured the system/database

     Worked closely with the development team to tune ETL scripts. Performed verification on all database stored procedures, functions and triggers

     Created baselines for Unix servers

     Production Support for OLTP databases

 

Hewlett Packard- Mountain View, CA                                                              01/2004 - 05/2008

Senior Oracle DBA

     Production and Development Support for PPM, worked with 70 java developers

     Installed Sun Solaris 9 and Linux Red Hat 4.1 operating system

     System admin for UNIX Solaris, Linux, HP-UX, IBM IAX, Windows NT, 2003, XP

     Installed OEM Grid Control to monitor production Real Application Cluster (RAC)

     Completed Sql package, procedures and functions for upgrade software