
Shawn Xu
- Lead SSIS/SSRS Developer
- Jersey City, NJ – 07097
- Member Since Mar 15, 2023
Shawn Xu
BI DEVELOPER/DATA SCIENTIST
(1) Over 10 years IT working experience, 8+ years’ solid working experience in SQL Server database development and administration performed with DBA duties all in enterprise environment.
(2) Working knowledge and experiences of software development life cycle (SDLC) and project methodologies, Agile methodologies as well as tools and techniques within each phase (e.g., requirement elicitation, data dictionaries, data diagram, ERD, programming languages, technical platforms, standards and procedures).
(3) Hands on working experience with SQL Server and T-SQL in maintaining system security (e.g., manage user logins, grant access roles and create services account), constructing triggers, tables, user functions, views, indexes, stored procedures, user profiles, relational database models, and data integrity.
(4) Expert experience with the MS BI stack including Analysis Services (SSAS), Integration Services (SSAS), Reporting Services (SSRS), SharePoint Dashboard, performance point.
(5) Experience as a MS SQL Server database architect/designer/developer/administrator on large scale software development projects.
(6) Report/dashboard visualization through SSRS/Power BI / MicroStrategy / Tableau / QlikView /Crystal. Installation and configuration of web server. Maintenance of metadata, updating, security, troubleshooting. Created reports/dashboards. Released to end users, or published to SharePoint/web portals.
(7) Solid knowledge and working experience in the following areas (in details):
· Installing, configuring and managing SQL 2008/2012/2014 servers, migrating existing applications to SQL 2008/2012/2014. Transferring/Rewriting DTS packages to SSIS packages; Setting up SQL 2012 Database mirroring.
· SQL database design, architecture, data modeling (conceptual, logical and physical) using Erwin.
· Data warehousing and analysis skills: ETL tools, OLTP, OLAP (MOLAP, HOLAP, and ROLAP), Data Mining, MDX, Transactional and Multi-Dimensional modeling skills (star schema and snowflake schema, Kimball).
· Expertise in OLAP Cube designing and construction, SQL Reports development, Ad Hoc Report Model designing, Tableau Reporting, Excel pivot reports, and SSIS package development.
· Performance Point, SharePoint Dashboard, Score Card development, Microsoft InfoPath design, SharePoint list/view design.
· SQL Management Studio, Visual Studio, Enterprise Manager and Query Analyzer, Analysis Services, Profiler, Source control tools.
· Data transferring: SSIS packages, replication, log shipping, SQL jobs calling query.
· Hands on experience and outstanding knowledge of performance measurement, KPI design, development and implementation with reporting dashboard.
· Proficient in creating Use Cases, Sequence Diagrams, Component Diagrams, Collaboration Diagrams, Activity Diagrams, and Class Diagrams.
· Solid background in Finance, banking and marketing services field.
(8) Strong troubleshooting and problem solving skills. Strong ability to prioritize multiple tasks. Excellent communication skills, proactive, self-managing and teamwork spirits.
AREAS OF EXPERTISE
|
Category |
Technology |
|
Database |
SQL Server 2008/2012/2014 Enterprise/Management Studio |
|
SQL, T-SQL, PL/SQL, SQL/PLUS, NoSQL, MongoDB, MySQL, MS Access, etc. |
|
|
Performance Tuning, Capacity Planning |
|
|
Installation, Upgrade, & Migration |
|
|
ODBC, OLE DB, DTS, SSIS, SSRS, SSAS |
|
|
Operating Systems |
Windows Enterprise 2008, Advanced Server /Windows 7/NT 4.0 Server, Azure, AWS |
|
Applications |
Erwin R8, ER Studio |
|
UML |
|
|
Visual Studio 6.0/.NET, Performance Point Server2007, SharePoint 2013, Git, Jumpy/Pandas/SciPy, Talend ETL |
|
|
Client / Server |
|
|
Reporting Tools |
Tableau, SSRS, SAP Crystal Report, MS Excel, PowerBL, etc. |
|
Language |
.NET, C#, HTML, XML, ASP, JSP, JavaScript, Python |
|
Protocols |
HTTP, TCP/IP, FTP |
WORKING EXPERIENCE
Yootech Investment Management Co., LTD.
03/2015– Present
Technical Lead
Yootech is a hedge fund company focusing on program trading in financial market. It has an office in Princeton NJ and a license registered with the Securities and Futures Commission of China. It specializes in short term trading to capitalize on market movements and inefficiencies. My job was to lead the technical team to develop IT solutions to management, traders and other stakeholders.
· Collected business rules and requirements. Multiple source system identification. Data cleansing. data mapping, data dictionary, data modeling (conceptual, logical, physical), dimensional modeling. Staging, ODS, NDS, DW, DM, ETL. Master Data Management design and development. Cube creation. Data analysis. Data mining. Data sourcing including Excel, Flat file, SQL Server, Oracle, Teradata, Sybase, MySQL, PostgreSQL, Hadoop (Kafka, Hive, Pig, Impala, Spark), NoSQL, MongoDB, Azure, AWS.
· Maintenance and ad-hoc development related to servers, databases, tables, views, index, cursors, triggers, user defined functions, stored procedures, SQL jobs, batch jobs, SSIS packages, OLAP cubes, reports, dashboards. Database backup & restoration strategy, disaster recovery, mirroring, replication
· Identified requirements from stakeholders, provided leadership in designing, implementing and maintaining blueprints, life-cycle plans, and roadmaps of data warehouse, ETL solutions and data visualization applications for Consumer Lending, Compliance and Risk Management.
· Performed applied research and development, and prototype activities, either directly or in an oversight capacity; provided technical leadership for data platform technologies and solutions, once rolled out into production.
· Designed and reviewed conceptual, logical and physical multidimensional EDW model and solution to ensure the standards for data architecture and business processes are consistently maintained and followed
· Collaborated with project managers to set up data management conventions to ensure quality control, promote best practices, and methodologies of development and testing.
· Staying abreast of industry changes related to BI, analytics, and big data, and seek and capitalize on the opportunities to improve productivity, improving time-to-market, improving solutions quality, and improving cost effectiveness
· Conducted data analysis and visualization using python Beautiful Soup, NumPy, SciPy, Pandas, Matplotlib, tkinter, scrapy and other libraries.
· Worked on Machine Learning, statistics modeling and prediction; Created Deep Learning solutions includes LSTM, RNN, CNN for pattern recognition of stock patterns & other high-dimensional data, risk management. Other models and algorithms includes Regression, SVM, Bayesian Networks, HMM, KNN, K-means, Decision Tree. The statistics model and data-mining were used to do trend discovery and analysis, text mining, correlation and pattern discovery, optimization.
· Designed programs to trade equities, FX spots, index futures options, and Fixed Income markets/products such as bonds, swaps etc.
JP Morgan Chase, Jersey City, NJ
03/2014– 05/2015
Lead SSIS/SSRS Developer
The Oversight & Control department needs a platform that can provide an enterprise-level consolidated reporting solution that leverages data from various finance management applications. The first phase was to develop a Dimensional Data Warehouse. SSIS packages were created to bring data from different source systems. SSRS reports were also created to allow project managers view and produce consistent and standardized status reports with ability to create executive boardroom decks and ad-hoc reports. The future state of Consolidated Reporting Platform will explore the expansion of the enhanced and standardized reporting capabilities to other pillars throughout the organization.
· Worked with project managers and financial analyst to gather requirements and business rules from different departments and organizations.
· Designed and created a snowflake-schema Data Warehouse in SQL Server 2012 with ErWin r8.
· Created SSIS packages to load the staging tables, dimensional data warehouse, and to run jobs. Configured SSIS to dynamically deploy to different environments;
· Created Views, stored procedures, and functions to provide the reporting solutions.
· Deployed and supported SSIS packages to production server using environmental variables, and jobs were scheduled to run the packages.
· Scheduled and monitored all maintenance activities including database consistency check, data backup & restore strategy, index defragmentation, statistics updates.
KPMG, Montvale, NJ
07/2011–03/2014
Lead BI Developer/SharePoint Developer/Application DBA
KPMG KTech leadership had formed a committee that will be responsible for measuring the overall performance of KTech based on a broad range of statistics. The work includes developing a combined Data Warehouse and presentation/reporting/analytics layer solution for Performance Measurement. Leverage Extract-Transform-Load (ETL SSIS) methods to map data elements for extraction from KPMG-US transactional systems and other sources. Financial data from SAP and other different legacy systems were also migrated and integrated into the Data Warehouse. SharePoint Dashboards were created to present the data to the leadership.
· Collected requirement directly from different groups across KTech, including internal employees and external data servicers. Documented the business requirements and technical specifications and designed the business/functional requirements.
· Designed and created a snowflake-schema Data Warehouse in SQL Server 2008 R2 with ErWin r8.
· Created SSIS packages to load the staging tables, Data Warehouse, and to run jobs. Data sources include flat files, spreadsheet, access, SAP Oracle database, SQL database, SharePoint list, HTML files; and other third party sources.
· Created Reports to validate the Data before and after the migration/integration.
· Created Views and Table-valued Functions to provide the reporting solutions. Stored procedures were created to load data and to log errors in ETL.
· Created SSAS cubes for business users to do self-service analysis; Designed SSRS Reports to present important financial/operational data.
· Deployed and supported SSIS packages to production server, and jobs were scheduled to run the packages.
· Designed approaches the measure performances for different business lines. Wrote stored procedure to calculate the performance on a monthly basis.
· Developed SharePoint 2007 Dashboard using the SSRS and Performance Point as the bridge. Developed SharePoint 2010 Dashboard using SSRS directly.
· Designed SharePoint list and InfoPath form to gather data from business users. Extracted data from SharePoint list and loaded it to SQL Server Database.
· Helped business users to reconcile reports generated from Data Warehouse with reports from legacy systems.
· Scheduled and monitored all maintenance activities including database consistency check, data backup & restore strategy, index defragmentation, statistics updates.
AMBAC Financials, New York, NY
01/2011– 07/2011
SQL Server BI Developer
AMBAC Financials provides financial guarantee products, such as bond insurance and other financial services to clients in both the public and private sectors around the world. The Portfolio Risk Management (“PRM”) and Legal departments developed a MBS remediation strategy focused on the identification of loans that breach representations and warranties made by Sponsors in AMBAC insured MBS securitizations and demands that these loans be repurchased. As the number of loans involved in the Repurchase Strategy is large, their status transitions through multiple stages of analysis is complicated, a data mart was created from scratch to enable tracking, managing and reporting on this critical remediation strategy. SSIS packages were created to load data into the data mare from different sources. SSAS cube and reports were created to do the proof of concepts.
· Collected requirement directly from risk group members, internal employees and external data servicers. Documented the business requirements and technical specifications.
· Designed and created a snowflake-schema Data Mart in SQL Server 2008 with ErWin r7.
· Created SSIS packages to load the staging tables, data marts, and to run jobs.
· Wrote Macros in Excel to parse raw data in excel files so that they can be used in ETL.
· Created Views and Table-valued Functions to provide the reporting solutions. Stored procedures were created to load data and to log errors in ETL.
· Created SSAS cubes and SSRS Reports to demonstrate how they work and what reports they can provide.
· Assisted DBA to deploy all the data mart objects and SSIS packages to production server, and jobs were scheduled run the packages.
· Helped business users to reconcile reports generated from data mart with in-house reports.
· Scheduled and monitored all maintenance activities including database consistency check, data backup & restore strategy, index defragmentation, statistics updates.
Coastal Trade Securities, Montclair, NJ
09/2010– 12/2010
SQL Server BI Developer
Coastal Trade Securities is a broker-dealer that provides proprietary trading services to the active trading community. A trading group in CTS developed an algorithm for trading equities. The project was to back test and forward test the trading data with different settings to find the most profitable one. A dimensional Database based on SQL server 2008 was designed and developed. Historical and current data are loaded to the data mart using SSIS packages. OLAP cubes were designed to analyze the impacts on the performance of different parameters like spread, volatility, timeframe, news release, style, correlation with the markets, methods, etc.
· Designed and implemented a star-schema Data Mart in SQL Server 2008.
· Created SSIS packages to load the staging tables, data marts, to refresh cubes, and to run jobs.
· Deployed the package to server and jobs were scheduled run the packages.
· Created OLAP cubes for the traders to analyze the performance of the algorithm from different perspectives.
· Scheduled and monitored all maintenance activities to meet business requirements activities including database consistency check, data backup & restore strategy, index defragmentation.
· Modeled and forecasted database and platform resource utilization to meet user needs and respond to anticipate technological innovations.
GMAC Financials, Omaha, NE
05/2009– 08/2010
Application DBA/SQL Server Developer
GMAC Financial Services was a financial company that provides a suite of financial programs including automotive financing, life insurance and mortgage operations in approximately 40 countries around the world. The project was initiated to provide more robot reporting and analysis tools for the risk management group. The scope expanded to include reporting needs within other areas. A new data warehouse was designed to support ‘reporting’ vs existing data warehouse which is a copy of the operational system optimized for data entry. SSIS packages were designed to move and transform the data from Oracle database to the new data warehouse built in SQL. Enterprise reports were created upon requests. Jobs were scheduled to run the SSIS packages and reports on a daily & monthly basis. We also created report models for users to write their own reports. A solid enterprise level reporting server with delivery through notification services was established.
· Designed and implemented a snowflake -schema Data Warehouse in SQL Server based on the existing data warehouse & SCS auto operational database.
· Created SSIS packages with which data from different resources were loaded daily in order to create and maintain a centralized data warehouse. Made the package dynamic so it fit the environment.
· Managed and developed existing and new ETL processes for SQL Server reports. Refreshed staging tables with ETL. Scaled SSIS to make it work more reliable.
· Wrote enterprise reports and stored procedures upon requests. Designed report models to meet business requirements and allowed users to perform fast queries.
· Developed schemas for business applications with providing full-life cycle architectural guidance and ensured quality technical deliverables.
· Scheduled and monitored all maintenance activities of SQL Server 2000/2005 to meet business requirements activities including database consistency check, data backup & restore strategy, index defragmentation.
· Modeled and forecasted database and platform resource utilization to meet user needs and respond to anticipate technological innovations.
· Ran month end processes. Troubleshot issues in jobs, reports, SSIS packages and so on. Trained the business users to create Ad hoc reports of their own.
University of Virginia Medical Center, Charlottesville, VA
04/2008– 05/2009
Application DBA
UVMC developed a roadmap for an Enterprise Data Warehouse solution that would address its
information delivery and decision making needs. With the help of Teradata, a scalable
Enterprise Data Warehouse platform was designed, developed and deployed. Data from different
sources are being loaded to the Data Warehouse on a daily basis to refresh the Analysis
and Reporting Solutions. SQL Server jobs are scheduled to run the ETL packages and to process
the cubes. SharePoint dashboards containing SSRS, KPI lists, Excel sheet PDF files were created
to demonstrate key metrics in the Medical Center. ProClarity and Excel are also being used to
analyze the data by decision makers. As the application DBA, my main task is to maintain all the
jobs, ETL packages, Cubes, SQL Server Reports, databases on the production and development
servers. I also developed SQL Server Reports, SharePoint web Pages, KPI lists for the dashboard
and SSIS packages to load table for reporting solutions.
· Scheduled and monitored maintenance activities of SQL Server 2000/2005 to meet business requirements activities including database consistency check, data backup & restore strategy, index defragmentation.
· Managed the production, development, and test database including access controlling, high availability, performance monitoring and tuning, capacity planning.
· Maintained SQL Jobs which refresh Data Warehouse, process cubes, and backup databases.
· Modified and tuned SSIS packages, and changed cube designs to accommodate business changes.
· Migrated the databases, cubes, DTS packages from SQL 2000 to SQL 2005 based on the business requirements.
· Created new SSIS packages, standard tables and scheduled jobs to support reporting needs.
· Created, managed and delivered interactive web-based reports for SharePoint Dashboard to support daily operations.
· Created and customized SharePoint KPI lists and WebPages for key business metrics using SharePoint designer.
· Monitored the status of all databases and servers including CPU, memory, I/O, space management, block, and dead lock.
· Tuned performance, optimized databases, managed system securities, tracked logs and issues.
MBIA Inc., Armonk, New York (Microsoft Consulting Service)
09/2007– 04/2008
SQL Server Developer
MBIA Inc. is a Fortune 500 financial guarantor and a leading provider of fixed-income investment management services. The Company’s core business is credit enhancement of municipal bonds and structured finance. The current project is to provide a reporting solution on the Microsoft platform to their internal user community based on existing and future data sources. With these data sources, a suite of Reporting Services report models that enable users to analyze and manipulate large datasets. Report models using Oracle data source views were built and tested. Report models based Star & Virtual Star (named query) Schema with ROLAP, HOLAP and MOLAP storage options were built for concept testing. Cubes were created based on a data warehouse designed in SQL Server and Oracle. SSIS packages were developed to transfer, transform, load data and refresh the Cubes. Ad Hoc reporting models were constructed based on this UDM model.
· Analyzed business requirements and built logical data models that describe all the data and relationships between the data.
· Generated database Schema through reverse engineer Oracle databases into ERwin.
· Designed and implemented a snow-flake schema Data Warehouse in SQL Server based on the existing Oracle instances.
· Developed new ETL processes to populate the Data Warehouse, and process cubes. Tuned and optimized these SSIS packages.
· Created OLAP Cubes with Star Schema, Virtual Star Schema (named query) data warehouse based on data from more than one Oracle instance.
· Designed and implemented Ad hoc report models based on all kinds of data sources, set up and implemented Standards for SSRS environments.
· Monitored and tuned the performance of certain report generation process.
· Created, managed, and delivered interactive web-based reports to support daily operations and drive decisions.
· Used SQL Profiler for troubleshooting, monitoring, optimizing SQL Server and T-SQL statement from developers and testers.
People’s Bancorp Inc, Columbus, OH
08/2005– 09/2007
SQL Server Developer/DBA
Peoples Bancorp Inc. Company operates about 50 branch offices in non-urban markets in Ohio, Kentucky, and West Virginia; it also has two loan production offices, one of which is in the Columbus, Ohio metro area. The bank's lending activities are focused on commercial loans (some 60% of the portfolio) and real estate loans (about 30%). It also provides checking and savings accounts, NOW and money market accounts, and certificates of deposit. The project was to install SQL Servers for newly created or updated branch. It includes database development to test through production, providing both development and production support including security management, availability maintaining, performance monitoring and optimization, as well as to synchronize the data with its main office through replication.
· Database planning in relation to physical and logical data architecture.
· Created data-related documentation (e.g., file descriptions and definitions, entity relationships and attributes, etc.).
· Developed and maintained data methodologies, procedures, and standards. Performed data impact analysis. Properly maintained core or control application tables.
· Modified database structures as directed by developers for test/develop environments and assisted with coding, design and performance tuning.
· Designed a database cluster to handle more than one million OLTP transactions
· Deploy, monitor, and maintain SSAS services and databases.
· Modeled and forecasted database and platform resource utilization to meet user needs and respond to anticipate technological innovations.
· Assisted with various ad hoc query requests.
EDUCATION
MS, Computer Information System, Ohio University, 08/2002
CERTIFICATE
Microsoft Certified Database Administrator (MCDBA)
E-Commerce Certificate from Ohio University