Software Engineer Ii (Backend + Data Pipelines)

Role OverviewWe're seeking a Software Engineer II with strong back‐end development experience and a passion for solving complex data challenges at scale.In this role, you'll design, build, and optimise distributed systems that extract, enrich, and process metadata for a wide range of content.You'll work closely with ML engineers, product managers, and cross‐functional partners to integrate machine learning models and LLM‐based services into production pipelines and deliver impactful, high‐performance solutions.This role offers the opportunity to work on cutting‐edge generative AI and metadata enrichment problems at a truly global scale.Tech StackPython, Scala, Ruby on Rails, Airflow, Databricks, Spark, HTTP APIs, AWS (Lambda, ECS, SQS, ElastiCache, SageMaker, CloudWatch, Datadog) and Terraform.Key ResponsibilitiesDesign and build scalable systems to extract, enrich, and process metadata from millions of documents, images, and audio content.Leverage LLMs to integrate capabilities lik...