Data Engineer
- Hybrid
- Prague, Praha, Hlavní město, Czechia
Job description
We are seeking a highly skilled Data Engineer to join our client's team in the energy trading sector. The ideal candidate will design, develop, and maintain scalable and efficient data pipelines to support market data processing. This role requires collaboration with trading teams and data scientists to deliver solutions that meet the performance and reliability standards critical to the energy trading industry.
- Design and develop scalable, efficient, and reliable data pipelines for collecting and processing market data from diverse sources, ensuring data integrity and accuracy.
- Collaborate with trading teams and data scientists to understand requirements and translate them into scalable data engineering solutions.
- Develop and maintain data integration processes with various market platforms, optimizing ETL (Extraction, Transformation, Loading) workflows to meet performance benchmarks.
- Conduct performance tuning and optimization of data processing workflows to ensure reliable and efficient operation.
- Stay up-to-date with industry trends and emerging technologies in data engineering, streaming, and energy market systems.
- Design robust and high-performing implementations for data systems, ensuring scalability and efficiency in handling large-scale market data.
Requirements:
- Extensive experience in data engineering roles, preferably in the energy or trading industry
- Expertise in building scalable, fault-tolerant data pipelines using modern frameworks such as Dagster
- Proficiency in Python and experience with data processing libraries such as PyArrow, Polars, Pandas, or similar
- In-depth understanding of ETL principles, data integration, and data warehousing concepts, with hands-on experience implementing ETL workflows
- 2-3 days per week in the client’s modern office in Prague
As an advantage would be:
- Experience with stream processing, including knowledge of frameworks like Apache Spark Streaming
- Familiarity with market systems, energy trading platforms, and financial data feeds (e.g., M7 interface) is a plus
We offer:
- A hybrid work
- A very competitive salary in Euro or CZK
- Cooperation with Czech LLC via Individual entrepreneur
- No strict control. Freedom of action
- Education Package
- Careful and reliable management
or
All done!
Your application has been successfully submitted!