Post Job Free
Sign in

Big Data Machine Learning

Location:
Hotel de ville Lafayette, Pas-de-Calais, 62100, France
Posted:
February 07, 2024

Contact this candidate

Resume:

HW

HENRY WANG

ad3f25@r.postjobfree.com 626-***-**** Rowland Heights, CA 91748 WWW: Bold Profile

Deep understanding of the characteristics of users in various industries and have experience in integrating, implementing, and maintaining large-scale national projects. My experience spans multiple industries including aviation, government, finance, e-commerce, internet, big data, and GIS. I have led the bidding, demand analysis, architectural design, work arrangement, and delivery implementation of ultra-large projects [10 million to 1 billion] in areas like aviation backend, big data, machine learning, e-commerce platforms, and financial payments; the following work experience provides detailed descriptions.

Possess extensive knowledge in large enterprise development and management, having led over 70+ large technical teams. I have worked on projects handling up to 170 trillion data entries per day and have led and developed teams in PB-level big data and machine learning algorithms. Participated in formulating corporate development strategies, business plans, and budget schemes, possessing a robust technical reserve and deep industry breadth and depth. I understand and master the trends of advanced technology and am looking for a company and position where I can fully utilize my abilities. During my entrepreneurial period, I offered services including technical consultation,desktop application development, web development, and VR development. Industry depth includes: Big Data, AI (Artificial Intelligence), image recognition, embedded systems, IoT (Internet of Things), distributed high-concurrency architecture and development, backend game development, secondary development of GIS, full stack, and development styles like MVC, MVP, MVVM. Business systems include: financial systems, e-commerce systems, educational systems, medical systems, etc. Experienced in optimizing and solving problems in various system aspects, such as JVM tuning, HTTP layer optimization, TCP/UDP layer optimization (OSI 7 layer tuning), H.264 optimization, machine learning algorithm optimization, Elasticsearch optimization, Linux optimization.

Technologies I have used include: Easy Language, C, C++, C#, Unity3D, Java, Python, Kotlin, Swift, EMAC6/7 Script, PHP, PLSQL, SQL (DLL, DML, DBA), NoSQL (Hypertable, MongoDB, HBase, Memcache, Redis, CouchDB, Cassandra), Pascal,

.Net, R, Matlab, Lua, Scala, etc.

Common technologies I use: Microservices (Spring Cloud, Dubbo, Tars K8s), front-end and back-end separation, message queues, distributed caching, data warehouse, TensorFlow, PyTorch, Unity3D, Apache/Nginx/Lighttpd, Mycat, VueJs, React-Native, Uni-app, OpenCV, OpenGL, WebVR, Flutter, AntD, Matlab, QT, MFC, and so on. Windows Operating System

Proficient in using various monitoring middlewarelike ELK, Grafana, SQLAlchemy, Prometheus, Zabbix for

monitoring cloud computing, servers, databases, caching, applications, MQ interfaces, JVM memory, threads,

network IO, throughput.

Used protocols like Thrift, Protobuf, gRPC, webservice, restapi.

Developed using technologies like Flink, Storm, Spark Streaming, Hadoop, Presto, Hive, ZooKeeper, Etcd,

Elasticsearch, Kylin, and wrote 4 books for living expenses.

Used C++ 99, 11, 14, 17 for development on Windows and Linux.

Worked with various heterogeneous systems, IBM,

Solaris, Unix, ARM, 386, 586, Windows 09 13 server, etc. Development of Flutter, Android, iOS projects, reverse engineering development.

Rich experience in leading teams, familiar with the pros and cons of KPI and OKR management methods and

their rational application, customer interaction, and project proposal design.

Proficient in data mining algorithms, familiar with python tensorflow, scikit-learn, java weka libsvm,

pytorch, paddlepaddle, modeling and architectural

design, system performance optimization, and leading successful large-scale aviation backend operations. Deep understanding of ORM mapping, OOP, and AOP

aspect programming, basic knowledge of procedural

programming, SOA ESB, and microservice architectures like SpringCloud, Dubbo, Tencent TARS.

Proficient in using GIT, SVN, PowerDesigner, Tomcat, Summary

Skills

Used JDK 1.5, 1.6, 1.7, 1.8, 11, 13, and various custom versions of JDK from different manufacturers.

Experience with openstack, kvm cloud virtualization, docker swarm, k8s secondary development.

Experience with xss, sql injection, cc attack, ddos attack, csrf attack, 0day vulnerability attack, arp attack for "paid scientific research learning".

WebLogic, IVY, Maven, Jenkins + Sonar, Jira, Confluence, and other project and team management tools.

Proficient in SQL, NoSQL, and NewSQL databases as

well as business development operations. Experienced with middleware including MYSQL & MYSQL Cluster

(or MariaDB), Oracle, MSSQL, MongoDB, Hadoop,

ClickHouse, Db2, Memcached, HBase, Redis, Geode,

Amazon RDS, TiDB, Redis Cluster, PostgreSQL, Cube, Vertica, Alluxio DB, ELK stack, SQLite, EMC, Sybase, etc. Proficient in using mainstream frameworks such as

ServletJDBC, SSI, SSH, SpringMVC+Ibatis,Spirng boot, and visual frameworks like FastUnit, Spx designer. Common technologies I use: Microservices (Spring

Cloud, Dubbo, Tars), front-end and back-end separation, message queues, distributed caching, data warehouse, TensorFlow, PyTorch, Unity3D, Apache/Nginx/Lighttpd, Mycat, VueJs, React-Native, Uni-app, OpenCV, OpenGL, WebVR, Flutter, AntD, Matlab, QT, MFC, and so on.

Syncunit Inc. Austin, TX

DevOps Engineer

01/2023 - 11/2023

Recommended strategies to maximize performance and lifespan of equipment involved in software installations.

Coordinated testing and validation procedures through software development lifecycle.

Coordinated system installations, testing and code corrections. Employed integrated development environments (IDEs). Designed system for the distributed deployment of 6,000+ mining machine nodes.

Development and implementation of the backend architecture for Jiuhengxing N6 Capital Management System.

Basic module design, project framework construction, progress allocation and adjustment according to schedule, assisting team members in problem- solving and training, documentation standards, architectural design, code review, communication with other teams for project integration, and problem-solving assistance.

he company's architecture uses distributed systems, clustering for high-pressure areas, REST for communication services, and functional modularization, including SSO login authentication, payment platform, backend management, static page generation, purchasing, system log collection, seasonal load distribution, system security monitoring, etc. Custom development of a distributed transaction system using open-source Kafka was undertaken, and the registration center, configuration center, and messaging service were each bound to the security center for heartbeats. The project used a front-end and back-end separation + RESTful technology implementation. The team consisted of front-end developers (JQuery, Vue), back-end developers (C++, Java), testers (performance testing, unit testing, regression testing), operations

(system operations, automated operations), product managers, code inspection teams, tender specialists, and delivery managers. Electron, Uni-app, jQuery, Layui, Bootstrap, Vue, Website Cloning Technology, WeChat SDK, Payment SDK Development Tools: Hbuilder, WebStorm, Teleport Ultra, WeChat Developer Tool, SecureCRT, A-Frame

(WEBVR framework), Inno Setup.

Experience

58COIN INC. Austin, TX

Architect, Project Director & Backend

Lead

01/2019 - 01/2023

Provided comprehensive services for the 58coin exchange, including software development, iteration, and launch.

Scheduled ongoing performance quality assurance checks for software applications and automated performance test scripts. The user base reached 100,000, with an online concurrency of up to 10,000 TPS distribution system.

upgraded from a spring cloud + geode central architecture to an Alibaba Nacos + MySQL cluster iteration.

Successful delivery, 1.0 upgrade completed, supporting a customer scale of 100W+ and TPS of 10,000+.

Spring cloud + K8s + Cloud compute distribution system design. design 70+ system nodes distribution working.

Project reporting, progress tracking, problem-solving, architectural design, performance management, research on new technologies, task allocation, responsible for Hadoop development, distributed issue troubleshooting, performance optimization, Spark real-time computing, Kafka development, Hive, and providing multi-tenant project development. Use different Programming languages: Java, Python (mainly), R, SCALA, Shell, EMAC6 (Nodejs, AngularJs, VueJs, jQuery, Js, Electron, nwJs, D3JS), SQL (stored procedures, functions, DDL, DML, Oracle9g, 10g, 10c, 11g, 11c, Mysql, PostgreSQL), NoSQL (ElasticSearch, Hbase, Redis), H5 (JqueryUI, Bootstrap, frontend architectural design, frontend framework extraction), Go fix project issue.

The Seven Technology INC. Los Angeles,

CA

Architectural Designer,Founder

01/2016 - 01/2019

Monitored electrical engineers, mechanical engineers or interior designers to provide optimal structural designs.

Specified materials, finishes, fixtures, furnishings, equipment, systems and components necessary for the completion of a project. Prepared cost estimates for proposed construction projects. Reviewed contractors' schedules and submission of shop drawings and samples.

Received projects from peers and direct clients. We undertook the project development while also outsourcing some tasks to other clients for additional revenue.

Organized data and modeled information for use in key decision-making. Performed site due diligence and site selection for clients. Collaborated with the owner of a piano store to develop an educational app. The owner had resources of primary school customers in Beijing, and the goal was to integrate online and offline services through the app. Collaborated with Tencent and won the bid for three civil aviation businesses, supporting an architecture with a daily data volume of 170 trillion. The project included three modules: a registration center, a configuration center, and a messaging service. Custom development of a distributed transaction system using open-source Kafka was undertaken, and the registration center, configuration center, and messaging service were each bound to the security center for heartbeats. The project used a front-end and back-end separation + RESTful technology implementation. The team consisted of front-end developers (JQuery, Vue), back-end developers (C++, Java), testers (performance testing, unit testing, regression testing), operations (system operations, automated operations), product managers, code inspection teams, tender specialists, and delivery managers. I was responsible for overall progress, coordinating with Tencent and civil aviation clients, and resolving conflicts. Reverse engineering of the "Ask Tao" mobile game, analyzing data packets and simulating the backend. Development and numerical simulation were conducted for modules such as the pet module, battle system, equipment system, chat system, and recharge system.

Collaborated with secondary contractors and other companies on projects involving the development of hybrid apps, mini-programs, PC clients, and virtual reality visualization projects. PyQt is one of the GUI programming solutions for the Python language, used as an alternative to Python's built-in Tkinter. Other alternatives include PyGTK, wxPython, etc. Like Qt, PyQt is free software and forms the basis of PyKDE. General-Purpose 3D Real-Time Vision Sensing Technology Based on a unique parallel optical axis four-camera array hardware structure, a general-purpose matching algorithm was developed. It's an optical inspection technology capable of passive imaging in any visible light condition, rapidly generating edge feature points and three-dimensional digital line images of objects within the camera's field of view in seconds. This includes spatial coordinates and texture data for each pixel. For humans, general-purpose visual capability is a decisive gateway in cognitive formation, and it is the same for artificial intelligence. [General- Purpose 3D Real-Time Vision Sensing Technology] As a fundamental technology in the field of machine vision, its applications span across trillion-dollar market sectors like artificial intelligence, the Internet of Things, and big data, offering an extremely broad commercial prospect. By analyzing characteristic data from the ticketing system and using the machine learning SVM algorithm, it identified malicious IP behaviors and specifically handled these IPs.

Responsible for building the real-time data prediction backend system, providing data for analysts for statistical analysis through predicted results, high concurrency, high load design, architectural design, guiding and reviewing the overall technical plan for the project within the company, coordinating work between development departments, project reviews, task complexity, and processing time coordination, reporting progress to the leader.

Supported up to 100,000 tps data concurrency. Transferred data to the backend through algorithms and post-production assessed the project for potential application in other projects, then promoted it to other departments.

China TravelSky Holding Company.

Beijing, China

Senior Software Engineer

01/2009 - 01/2013

Conducted full lifecycle software development from planning to deployment and maintenance.

Performed estimates of work hours and tracked progress using Agile and Scrum methodology.

Recommended strategies to maximize performance and lifespan of equipment involved in software installations.

Worked closely with systems analysts, engineers and programmers to understand limitations, develop capabilities and resolve software problems.

Successfully built a 50-machine cluster, with each machine supporting up to 2000 tps concurrency. Deployed TB-level daily data inflow into production, providing multi-tenant and permission-related secondary development.

In collaboration with Jiaotong University, this project used algorithmic methods to solve feature issues. Feature selection was based on expert experience, input time, season, and other 35-dimensional feature data to predict the query value of objects (office + appname + time). Since there is a correlation between query values and session lifecycle, the linear formula provided by Jiaotong University was used to input parameters and data to predict approximate time ranges.

Project reporting, progress tracking, problem-solving, architectural design, performance management, research on new technologies, task allocation, responsible for Hadoop development, distributed issue troubleshooting, performance optimization, Spark real-time computing, Kafka development, Hive, and providing multi-tenant project development. Hadoop deployment followed the initial plan, with an 800-node Hadoop cluster deployment (2 namenodes, 2 secondary nodes, 4 datanodes), integrating with CDH and CLOUDMANAGE in collaboration with the other two groups within IM. A single machine could reach up to 1500 tps, and overall 800,000 tps. After initial testing, it supported 0.3-0.5PB of high-availability data with elastic scalability.

set up the basic layer of Hadoop, while the other two groups handled CDH and CLOUDMANAGE for data management, HBASE, data warehouse, HA, etc., and technical R&D.

The plan aimed to support data storage, analysis, and display for China Aviation Information Network in the later stages. Currently using 500

(physical and virtual) machines, 1500 nodes, averaging 32 cores, 40G RAM, 1-2T hard disk, Redhat 6 operating system.

Designed a fast and efficient web log analysis system based on business development requirements. The system involved Java remote access to servers for downloading and parsing logs. It located log addresses based on tid and appname, then, by identifying data characteristics, it inserted data points to statistically analyze concentrated problem causes and directions.

Beijing Institute of Technology Beijing

Bachelor of Science in Computer Science

06/2009

English:

Professional

Chinese (Mandarin):

Native/ Bilingual

https://www.linkedin.com/in/sevnoilem

https://github.com/sevnoilem

Aliyun ACP Certifications

Education and Training

Languages

Websites, Portfolios, Profiles

Certifications



Contact this candidate