Allied Consultants, Inc is a proudly Austin based firm with over 34 years of experience delivering top-tier technical and business professionals within Texas State Agencies. We are currently seeking an experience Databricks Administrator to play a key role within a high-impact technical services team.
At Allied Consultants, we value our consultants and are committed to providing an exceptional experience including:
Candidates selected for interviews will be subject to a criminal background check and may be required to pass a drug screening, in compliance with federal and state regulations. All offers of employment are contingent upon successful completion of these checks.
Allied Consultants is a proud to be an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.
Level Description
8 or more years of experience, relies on experience and judgment to plan and accomplish goals, independently performs a variety of complicated tasks, a wide degree of creativity and latitude is expected.
Job Description
Understands business objectives and problems, identifies alternative solutions, performs studies and cost/benefit analysis of alternatives. Analyzes user requirements, procedures, and problems to automate processing or to improve existing computer system: Confers with personnel of organizational units involved to analyze current operational procedures, identify problems, and learn specific input and output requirements, such as forms of data input, how data is to be; summarized, and formats for reports. Writes detailed description of user needs, program functions, and steps required to develop or modify computer program. Reviews computer system capabilities, specifications, and scheduling limitations to determine if requested program or program change is possible within existing system.
Additional job details and special considerations
The Databricks Administrator is responsible for administering, configuring, and supporting the Databricks platform to enable scalable data engineering, analytics, and AI/ML workloads. This role ensures platform reliability, security, cost optimization, and compliance while supporting data engineers, analysts, and data scientists across the organization.
The administrator will manage workspace configuration, cluster policies, user access, integrations with cloud services, and ongoing platform monitoring to support enterprise data and analytics initiatives.
**Location of job: Onsite/Hybrid. Candidates must be local to Ausitn, TX**
Minimum Requirements: | ||
Years | Required/Preferred | Experience |
8 | Required | Experience administering Databricks workspaces in a cloud environment - AWS |
8 | Required | Strong understanding of Databricks cluster configuration, job scheduling, and workspace management. |
8 | Required | Experience managing user access, roles, and permissions using IAM, SCIM, and role-based access control (RBAC). |
8 | Required | Proficiency with Apache Spark concepts, including performance tuning and troubleshooting. |
8 | Required | Experience integrating Databricks with cloud storage services (e.g., S3,) |
8 | Required | Experience implementing and enforcing cluster policies and workspace governance standards. |
8 | Required | Familiarity with Databricks SQL, notebooks, and job orchestration. |
8 | Required | Experience monitoring platform health, performance, and availability. |
8 | Required | Understanding of data security, encryption, and compliance requirements. |
8 | Required | Experience with DevOps or automation tools (Terraform, CI/CD pipelines, scripting). |
4 | Preferred | Experience administering Databricks in an enterprise or government environment. |
4 | Preferred | Experience with Databricks Unity Catalog for data governance and access control. |
4 | Preferred | Knowledge of cost management and optimization for Databricks workloads. |
4 | Preferred | Experience supporting AI/ML workloads using Databricks ML and MLflow. |
4 | Preferred | Familiarity with data lake and lakehouse architectures. |
4 | Preferred | Knowledge of Python, SQL, or Scala for administration and troubleshooting. |
Software Powered by iCIMS
www.icims.com