Senior Data Engineer - Python, Spark, Scala

Senior Data Engineer - Python, Spark, Scala

Schibsted is a growing and diverse family of over 50 brands whose mission is to empower people in their daily lives and each brand contributes to it in its own way. Amongst our brands you can find leading Nordic marketplaces like Finn and Blocket, world-class media houses like VG and Aftonbladet (we are the largest media group in Scandinavia) and other rapidly developing digital companies like Prisjakt, Lendo and many others.

Data Foundations is a central department within Schibsted that is responsible for the data platform and is working on data fueled products with emphasis on volume, velocity and privacy. We are building products at scale, serving the whole of Schibsted and its brands.

Our team within Data Foundations is responsible for development and maintenance of the segmentation platform, which supports online advertising, personalization and analytics use-cases across the whole company.

Whom are we looking for?

We are looking for an experienced Data Engineer, who is independent, goal oriented and loves working with Big Data. We practice a product-oriented mindset, so engineers work together with the product management team to find the best solutions to meet our customers' needs. You also will be responsible for designing and building platform functionality as a part of a team within Data Foundations.

Good examples of such functionality would be:
  • Implementation of new segmentation criteria
  • Ensure compliance with data governance, security policies and privacy laws in all parts of the processing pipeline
  • Monitoring and optimisation of processing pipelines
  • Adding new ways to integrate with consumers and carrying out a migration
What is our technology stack?
  • Python and Spark for data processing, Luigi for data orchestration
  • Scala and Finatra for backend services
  • Docker and Kubernetes as a main platform for both processing and services
  • AWS for storage and other infrastructure (S3, RDS, SQS, Cloudformation,...)
Requirements
  • A Bachelor's degree in Computer Science, Informatics or relevant work experience
  • Knowledge and hands-on experience with Python and Spark
  • Experience with Scala or other JVM languages , ability to get up to speed with Scala is expected
  • Familiarity with Kubernetes, orchestration frameworks (Airflow / Luigi), DevOps, CI/CD, cloud solutions (AWS / Azure / Google Cloud), container-based workflows or distributed systems are all regarded as positive.
As a part of Schibsted, you will also have the opportunity to share knowledge and learn from other data engineers across the organisation. We encourage a diverse, collaborative and creative work environment, where you will develop and push for state-of-the-art solutions in big data processing as well as building reliable and highly scalable services.
Mer info
Område Stockholms stad
Yrkesroll Data & IT, Utvecklare
Typ av anställning Heltid
Sista ansökningsdag Löpande (59 dagar kvar)

Om arbetsgivaren

Schibsted is a family of digital brands with a strong Nordic position, and more than 5,000 employees. Millions of people interact with our companies every day through our leading online marketplaces, world-class media houses. We also help new promising businesses grow. Our joint mission of empowering people in their daily lives is rooted in the values of our media heritage and a legacy of bold change. At our best, we are a fearless force for change in a society built on trust and transparency.

Data & Tech is a central product and tech unit that serves all of Schibsted. We are about 300+ people in Oslo, Stockholm and Krakow, and collaborate closely with other product and tech teams in all units in Schibsted. Areas of responsibilities include data & technology strategy, privacy/data trends/responsible data & machine learning, information security and internal IT.