Platform Engineer – Data & ML Generative Systems

We’re looking for a Platform Engineer (Data & ML Generative Systems) to build out an enterprise-grade data and ML platform supporting developers and applied scientists building real-world custom ML powered applications. The product will provide robust ML use -case experimentation, model training, tuning, serving and analytics capabilities to streamline the development processes of Applied Scientists, Data/ML Engineers, and Application Engineers who are building their own domain-specific Gen-AI powered solutions to fit many use cases within their companies.

Responsibilities
Design and implement scalable control plane, data plane, and microservices in a distributed systems environment
Develop and maintain robust ML data infra for data pipelines for ingesting and processing data of diverse modalities (text, tabular, audio, video, multimodal) from diverse sources.
Define and create data models for diverse entities and workflows orchestrated by the platform
Develop and enhance the platform’s “Search AI” capabilities by creating and visualizing knowledge graphs and recommendations.
Collaborate with cross-functional teams (e.g UX, Software Engineers, Data Scientist, PM, Domain Experts) to design and develop APIs and services that integrate custom machine learning models and analytics tools into end-user journeys through the front-end applications
Ensure high performance and reliability of the platform using Kubernetes and DevOps best practices.
Deploy and manage applications across multiple cloud environments including AWS, Azure, and GCP.

Required Skills
High proficiency in Kubernetes and DevOps methodologies
Experience designing modern, robust, secure, API interfaces with gRPC/protobuf
Strong programming skills in (in order of preference) Rust, C++, go, and Python
Experient with Search platforms (e.g ElasticSearch, OpenSearch) and recommender systems
Experience building reliable data connectors, ingestion, and processing pipelines
Demonstrated ability in building data models for visualizing graphs
Proven track record of developing microservices for distributed systems
Solid experience in cloud technologies such as AWS, Azure, and GCP
Great communication and ability to document work and decisions (e.g design docs)

Qualifications
Bachelor’s degree in Computer Science, Engineering, or a related field
5-8 years of experience in a similar role
Ideally experience within the finance sector