hadoop developer or java developer
Beaverton, OR email@example.com 097********
•Overall 7 years of IT experience in J2EE development, big data development and analysis with hadoop ecosystem, ELK(graylog) log analysis.
•Solid fundamentals of Computer Science in data structure,algorithm(surf in Leetcode ever),database and so forth.
•Good understanding/knowledge of Hadoop Architecture and various components such as Hdfs, Yarn, Hive, Impala, Kylin, Spark.
•Experience in maintenance and optimization of the hadoop cluster via Cloudera Manager platform(HA configuration, security control with Sentry).
•Proficient in importing and exporting data using Sqoop from Relational Databse Systems to HDFS and vice-versa.
•Excellent knowledge and experience of object-oriented programming, design-pattern and related concept.
•Experience in writting complex Hive SQL, Impala SQl along with the optimization.
•Experience in using and understanding various J2ee components like spring,hibernate,ibatis,jsf.
•Proficient in log analysis via ELK,kafka and Graylog(app log, hardware log or whatever log).
Big Data Engineer JiangDuoDuo LTD - Suzhou - Suzhou September 2017 to October 2018
JiangDuoDuo is an online lottery company which mainly involve in sports of football basketball
together with some welfare lotteries.
•Installed, configured, maintained and monitored 5-node enterprise Hadoop cluster with Cloudera Manager on centos 7.
•Built data warehouse with sqoop from mysql to hive via shell script (collect data on daily basis and hourly basis using crontab).
•Set up fine-grained security control for hive and impala according to business group via sentry.Finished related configuration and optimization.
•Developed and checked data accuracy of project anti-flood which support function of getting rid off malicious and massive rush of ordering(use spark 2.1 for implement).
•Developed quick-responsed BI report for huge amount of data (.e.g over years) with Kylin.
Software Engineer(java and bigdata)
BeeCloud(Suzhou) LTD - Suzhou May 2015 to July 2017
BeeCloud mainly serve its client with the third party payment integration, moreover, it provide custom financial service and data analysis service.
•Integrated the new channel to existing ones(YEE, BAIDU) including development with JAVA, Lucence,Cassandra and so on.
•Designed and implemented Log Analysis system using ELK and Graylog.
•Designed and implemented User Visit Session system using Spark.
•Performed the operation and maintenance of back-end system.
Infinity Solution(Suzhou) LTD - Suzhou April 2012 to March 2015
•Manually assessed project changes from clients with Application Security perspective via manual audit and Webinspect.
•Reviewed the code changes for projects from clients with Application Security perspective manually and by Fortify scan.
•Reviewed the documents for projects changes from clients with Application Security perspective.
Java Software Engineer RDPS-China(Suzhou) LTD - Suzhou September 2008 to February 2012
•Analyzed business requirement for projects from clients.
•Communicated with clients on business requirement.
•Performed the design of the projects according to the business requirement.
•Developed projects from clients with the technology PHP, J2EE framework(spring, hibernate, ibatis) as the back-end implement and Jquery, JSF as the front-end implement.
•Developed some side projects with Android.
•Deployed and tested the application Using Apache Tomcat
•Performed the quality assurance effort for projects from clients.
BS in Computer Science
Chengdu University of Technology - Chengdu September 2002 to July 2006
Bachelor's in Computer Science
University of Electronic Science and Technology(second degree) - chengdu October 2003 to June 2006
J2EE(struts, hibernate, spring mvc and so forth) (4 years), J2SE(java basis, object oriented, design pattern...) (8 years), hadoop(sqoop, hive, impala, spark, kylin) (2 years), ELK(and graylog) (2 years), nosql(lucense, cassandra, elasticsearch) (2 years), linux shell (4 years), Script languages(scala, python) (2 years)