Engineer/Senior Engineer, Data
Job Description
- Responsible for the maintenance of the company's big data business clusters/components, providing stable and efficient cluster services.
- Responsible for cluster capacity planning, expansion, and performance optimization.
- Design and implement operations/monitoring/management platforms for large-scale distributed clusters, improving work efficiency through automated operations tools.
- Participate in/lead infrastructure design, providing suggestions/solutions during the design phase.
- Stay updated with big data technology trends, research open-source technologies, continuously optimize the cluster's foundational service architecture, apply new technologies to the big data platform/cluster, and drive team development.
Job Requirements
- Bachelor's degree or above in Computer Science, Computer Engineering, Information Systems, Business Analytics, Statistics, Mathematics or related field
- Proficient in at least one programming language in Python/Java/Scala, with solid programming fundamentals.
- Familiar with the Hadoop ecosystem, and well-versed in open-source projects such as Hadoop/HBase/Hive/Kafka/Zookeeper/Spark/Flink/ClickHouse.
- Knowledgeable about Kafka-based log streaming systems, and familiar with high-availability log systems like Filebeat and Logstash.
- Familiar with the configuration, management, and optimization of the Linux operating system, capable of independently troubleshooting and resolving OS-level issues. Strong learning ability with a keen interest in new technologies.
- Strong analytical and problem-solving skills, at critical situations under pressure as well as day-to-day operations.
- Team players with positive and eager-to-learn attitude
- Adaptable, open-minded, and comfortable to work with ambiguity and change in a fast-paced environment
- Candidates must have at least 2 years of relevant work experience for the Engineer position or 3 years for the Senior Engineer position.