๐ง Tech Level: Middle
๐ฃ๏ธ Language Proficiency: Upper-Intermediate
๐งพ Employment type: Full time
๐ Candidate Location: Poland, Kazakhstan, EU, Georgia, Armenia, Serbia.
๐ Working Time Zone: CET
๐ Start: ASAP
๐งญ Planned Work Duration: by the end of the year
๐ฅ Customer Description:
The customer is a global mobility platform providing on-demand transportation services.
โ๏ธ Project Phase:ongoing
๐ค Soft Skills:
โข Strong analytical and problem-solving skills with the ability to make decisions based on technical evidence and logical reasoning.
โข Excellent communication, active listening, collaboration, and consensus-building skills.
๐ก Hard Skills / Must Have:
โข 3+ years of experience in Data Engineering
โข Strong proficiency in Python
โข Experience with Spark/PySpark for streaming, batch, and asynchronous data processing
โข Data modeling
โข Distributed data processing
โข SQL
โข Data warehouse/lakehouse architecture
โข Hands-on experience with Databricks, GCP, or AWS
โข Terraform
โข Designing data access and governance solutions
โข Understanding of data products and governance controls
โจ Hard Skills / Nice to Have:
โข Willingness to learn new technologies for integration purposes
๐ Responsibilities and Tasks:
โข Develop, deploy, and maintain data pipelines and data governance systems on Databricks (Unity Catalog, Delta Lake, Workflows)
โข Conduct in-depth data analysis, profiling, and processing to classify data by domain and detect personal data (PII)
โข Contribute to the design of data access systems, focusing on data contracts, catalog access, and grant/rollback automation managed as Infrastructure-as-Code with Terraform
โข Review access architectures and contracts to ensure flexibility and reusability
โข Ensure that data products and access controls are deployed according to contracts and operate without unintended side effects
โข Maintain documentation for data contracts, access models, and governance processes
โข Monitor and support deployed pipelines and quality checks to ensure they meet data quality and performance expectations
โข Actively seek out information and internal solutions to ensure reusability and adoption of common data platform technologies
๐งช Technology Stack:Python for streaming, batch, and asynchronous data, MLOps tools
๐ Additional notes:
The work will be carried out either on client's equipment or via a virtual workstation.
๐ฉ Ready to Join?
We look forward to receiving your application and welcoming you to our team!