Job Overview

I. Department & Position Orientation This position belongs to the Digitalization Team of the company's core Business Unit (BU). The team focuses on the digital transformation of BU business scenarios and in-depth exploration of data value, undertaking end-to-end empowerment responsibilities from data architecture design to data application implementation. As the technical core of the team, this position needs to lead data architecture planning, technical solution design and implementation based on the Databricks lakehouse architecture, support the data-driven needs of BU's core businesses, and promote the in-depth integration of technical architecture and business scenarios. It is a key technical support role for BU's digital transformation.

II. Core Job Responsibilities
1.    Databricks Architecture Planning & Design: Lead BU-level data architecture planning. Based on the core capabilities of the Databricks lakehouse (Delta Lake, Unity Catalog, Workspace Collaboration, Cluster Elastic Scheduling, etc.), design data storage, computing, integration and governance architectures that adapt to BU business scenarios (such as production process optimization, supply chain intelligent analysis, quality traceability, etc.). Ensure the architecture has high availability, scalability and security to meet the long-term digital development needs of the BU.
2.    Technical Solution Implementation & Optimization: Address BU business pain points (such as data silos, low processing efficiency, difficult data value excavation, etc.), design customized technical solutions (such as real-time data link construction, offline data warehouse building, AI model training data support, etc.) based on the Databricks platform, and lead the implementation of the solutions. Continuously monitor the operation status of the architecture, analyze performance bottlenecks, promote iterative optimization of the architecture, and improve data processing efficiency and resource utilization.
3.    Cross-Team Technical Collaboration & Empowerment: Connect with the company's global IT team, BU business teams and external technical partners, synchronize Databricks architecture standards and technical specifications, and coordinate resources to solve cross-team collaboration problems in architecture implementation. Provide Databricks technical training and guidance for members of the BU Digitalization Team, improve the overall technical capabilities of the team, and promote the promotion of technical best practices within the team.
4.    Business & Technology Integration Empowerment: Deeply understand the core business logic of the BU (such as production technology, order management, customer service, etc.), tap the value of business data based on the Databricks architecture capabilities, provide data architecture-level solution support for BU business decisions (such as capacity forecasting, cost optimization, quality improvement), and promote data technology to become the core driving force for BU business growth.

What your background should look like:

III. Job Requirements
(I) Education & Professional Background
•    Bachelor's degree or above in Computer Science and Technology, Software Engineering, Data Science, Information Systems or related majors;
•    At least 5 years of work experience in data architecture design or big data technology, including at least 2 years of in-depth experience in using or designing architectures for the Databricks platform. Experience working in a Business Unit (BU) Digitalization Team or having data architecture experience in a manufacturing BU is preferred.
(II) Core Technical Competence
1.    In-depth Databricks Technical Mastery: Proficient in the core components of the Databricks lakehouse architecture (Delta Lake Data Lake, Unity Catalog Data Governance, MLflow Model Management, Jobs Scheduling and Monitoring, etc.). Capable of independently completing architecture design and technical selection in complex scenarios, and having experience in solving complex technical problems such as high concurrency and large data volume processing on the Databricks platform;
2.    Data Architecture Design Capability: Familiar with data architecture design methodologies (such as data layering models, data integration architectures, data governance architectures). Having experience in designing and implementing BU-level data warehouses, data lakes or lakehouse architectures, and able to balance the advancement and practicality of the architecture in combination with business needs;
3.    Breadth and Depth of Technology Stack: Master the Spark ecosystem (Spark SQL, Spark Streaming, Structured Streaming), proficient in using at least one programming language (Scala/Python); Understanding of cloud service architectures (AWS/Azure/Alibaba Cloud), and familiarity with data integration tools or data governance tools is preferred;
4.    Technical Solution Implementation Capability: Possess the ability to decompose complex architecture solutions into executable technical tasks, capable of leading the full-process implementation of solutions from design to testing and launch. Experience in cross-team promotion of the launch of large-scale data architecture projects is preferred.

(III) Business & Collaboration Skills
1.    BU Business Understanding Ability: Able to quickly and deeply understand the BU's business model and core pain points, have the ability to convert business needs into data architecture solutions, and have experience in optimizing data architecture and enhancing data value from a business perspective;
2.    Cross-Team Collaboration Ability: Possess excellent communication and collaboration skills across departments (headquarters IT, BU business, external suppliers), able to coordinate multiple resources to promote architecture implementation and resolve technical differences and resource conflicts in collaboration;
3.    Technical Output & Empowerment Ability: Have clear technical expression skills, able to write high-quality architecture design documents and technical solution specifications, and able to provide Databricks technical training and guidance for team members to promote the precipitation of technical knowledge and the improvement of team capabilities.

(IV) Other Requirements
•    Holding advanced Databricks certifications (such as Databricks Certified Professional Data Engineer, Databricks Certified Architect) is preferred;
•    Possess strong problem analysis and solving abilities; when facing complex cross-cutting business and technical issues, able to quickly identify core contradictions and propose effective solutions;
•    Responsible, able to work under pressure, adapt to the fast business iteration rhythm of the BU, and have a strong passion for promoting the digital transformation of the BU.

Competencies