Platform Engineer – Azure/DataBricks
Are you a seasoned platform engineer with expertise in Azure and DataBricks? Apply Now!
Working with one of our top financial clients, this role calls for a Platform Engineer – Azure/DataBricks. This position offers an exciting opportunity to design, develop, and support scalable cloud platform capabilities, focusing on infrastructure automation, Kubernetes, CI/CD modernization, and supporting emerging AI and GenAI use cases. The ideal candidate will contribute to building enterprise-scale cloud solutions, collaborating across diverse teams to enable secure, resilient, and automated cloud-native applications.
Responsibilities
- Design, build, and support reusable cloud platform capabilities on Azure.
- Develop infrastructure automation solutions using Terraform and scripting languages such as Python and Bash.
- Manage container orchestration platforms including Kubernetes and Docker.
- Optimize CI/CD pipelines for deployment automation and process efficiency.
- Support cloud-native application enablement, including APIs, microservices, and AI workloads.
- Implement security, authentication, and access control across cloud platform environments.
- Enhance observability, monitoring, logging, and troubleshooting for cloud workloads.
- Partner with architecture, security, and engineering teams to ensure best practices and operational excellence.
- Support emerging AI, GenAI, and RAG platform initiatives.
Desired Skill-Set
- 8+ years of experience in platform, cloud, DevOps, or infrastructure engineering.
- Proven expertise with Azure cloud environments.
- Extensive experience with Infrastructure-as-Code using Terraform.
- Strong knowledge of Kubernetes, Docker, and container platforms.
- Proficiency in CI/CD pipeline development and automation scripting in Python.
- Experience with cloud platform operations, scalability, resiliency, and security.
- Familiarity with observability and logging solutions.
- Knowledge of authentication, authorization, and access control mechanisms.
Nice to Have
- Experience supporting GenAI, AI/ML, or RAG platforms.
- Knowledge of Azure API Management (APIM).
- Bash scripting skills.
- Experience with Databricks.
- Proven ability to develop reusable enterprise platform services.
- Financial services or banking sector experience.
- Strong soft skills in stakeholder management, communication, and collaboration.
- Problem-solving mindset and ability to work independently in a fast-paced environment.
BeachHead is an equal opportunity agency and employer. We advocate for our candidates and welcome applicants regardless of race, color, religion, national origin, sex, age, or physical or mental disability. BeachHead or our clients may use technology-enabled tools, including automation and artificial intelligence (AI), to support parts of the recruitment process such as resume screening, application management, and candidate matching. These tools assist our recruiters and our clients, and do not replace human decision-making. This job posting represents a current or anticipated vacancy. The position may be filled at any time, and the posting may be removed without notice once the role has been filled.