Job Description
Job description:
- Plan, build and implement data solutions based on DataBricks
- Design and build Modern Data Pipelines and Data Streams
- Develop and Maintain Data Warehouse
- Design and create ETL processes supplying Data Warehouse
- Implement effective metrics and monitoring process
- Pre-process of structured and unstructured data, create queries in databases
- Experience working with Azure Databricks
- Familiarity with PySpark
- Fluent Polish and English, both verbal and written
- Mastery of SQL (T-SQL or PL SQL preferred)
- Knowledge of at least one component: Azure Data Factory, Azure Data Lake, Azure SQL DW, Azure SQL
- Experience with any programming language used for data engineering purpose: Python, Scala, R, Java etc
- Ability to conduct data profiling, cataloging, and mapping for technical design and construction of technical data flows Will be considered as an advantage but are not required.
- Microsoft Certified: Azure Data Engineer Associate
Knowledge of the following components of Azure Analytics: Azure HDInsight with Spark, Azure Stream Analytics.
Qualifications:
- Bachelors OR master’s degree in computer science, Information Systems, or other related field. Or equivalent work experience.