Data Architect /Senior Data Engineer - Freelance
Pixie · Vitoria-Gasteiz, Basque Country, Spain
About this role
A strategic project focused on designing and evolving modern, scalable data platforms for advanced analytics is seeking both Data Architect and Senior Data Engineer profiles. The work involves modern Data Lakehouse architectures and distributed processing in an advanced, highly collaborative technical environment. Required experience includes Apache Spark/PySpark, Apache Airflow (DAGs, scheduling, dependencies, best practices), Apache Iceberg, Python for pipeline development and processing logic, designing and building scalable data platforms, Spark SQL optimization and tuning, data modeling and modern architectures (Data Lake, Lakehouse, Medallion), and SQL and NoSQL databases. The Data Architect profile needs end-to-end vision, the ability to define modern data architectures, and technical leadership, while the Senior Data Engineer profile needs hands-on experience building pipelines, distributed processing, and scalable data platforms. Experience in observability and data quality, streaming with Kafka or Spark Structured Streaming, data security and governance (RBAC, GDPR), and cloud enterprise environments is highly valued.
Skills & technologies
Must have
- Apache Spark
- PySpark
- Airflow
- Apache Iceberg
- Python
- Data Modeling
- Lakehouse
- SQL
Nice to have
- Kafka
- Spark Structured Streaming
- Data Quality
