Azure Data Engineer with Databricks Expertise Job at Group Nine LLC, Iselin, NJ

Y2hRNjJ2NktxV0creDljNWdkYU5rb2Y5dlE9PQ==
  • Group Nine LLC
  • Iselin, NJ

Job Description

Title : Azure Data Engineer with Databricks Expertise Location : NYC, NY/Iselin, NJ [Hybrid] Type : Long term contract Job Description: We are seeking highly skilled Azure Data Engineer with strong expertise in Databricks to join our data team. The ideal candidate will design, implement, and optimize large-scale data pipeline, ensuring scalability, reliability, and performance. This role involves working closely with multiple teams and business stakeholders to deliver cutting-edge data solutions. Key Responsibilities: Data Pipeline Development: Build and maintain scalable ETL/ELT pipelines using Databricks. Leverage PySpark/Spark and SQL to transform and process large datasets. Integrate data from multiple sources including Azure Blob Storage, ADLS and other relational/non-relational systems. Collaboration & Analysis: Work Closely with multiple teams to prepare data for dashboard and BI Tools. Collaborate with cross-functional teams to understand business requirements and deliver tailored data solutions. Performance & Optimization: Optimize Databricks workloads for cost efficiency and performance. Monitor and troubleshoot data pipelines to ensure reliability and accuracy. Governance & Security: Implement and manage data security, access controls and governance standards using Unity Catalog. Ensure compliance with organizational and regulatory data policies. Deployment: Leverage Databricks Asset Bundles for seamless deployment of Databricks jobs, notebooks, and configurations across environments. Manage version control for Databricks artifacts and collaborate with team to maintain development best practices. Group Nine LLC

Job Tags

Contract work,

Similar Jobs

Integrated Visiting Physician Solutions

Practice Manager Job at Integrated Visiting Physician Solutions

 ...individual who is willing to put in hard work and maintain a successful practice. As we continue to find success in our core markets, we need...  ...to services, complaints, etc. # Needs to have a minimum of a Medical Assistant certificate # MUST BE A TEAM PLAYER EEO/ AA... 

Kane Partners LLC

Safety Manager Job at Kane Partners LLC

 ...Step Up & Lead Safety in a Fast-Paced Industrial Setting Are you a boots-on-the-ground safety leader who thrives in high-impact industrial...  ...environments? Were looking for a proactive, hands-on Safety Manager to take charge of workplace safety in our large-scale pulp mill... 

Patch Collection

Social Media Marketing Specialist Job at Patch Collection

 ...We are currently offering a full-time Entry Level opportunity to add to our team in support of our Social Media and Marketing efforts. We are looking to add a candidate with social media marketing experience and an analytical approach. Experience in Graphic Design,... 

Seven Healthcare

Travel Nurse RN - Wound Care - $2,060 per week Job at Seven Healthcare

 ...enthusiasts will find plenty of options for hiking, biking, and nature walks. Food and Entertainment Lawrenceville features a charming downtown area with local restaurants, cafes, and shops, plus proximity to all of Atlanta's entertainment, dining, and cultural attractions.... 

BAYADA Home Health Care

Staff - Registered Nurse (RN) - Home Health - $45+ per visit Job at BAYADA Home Health Care

 ...BAYADA Home Health Care is seeking a Registered Nurse (RN) Home Health for a nursing job in Fayetteville, North Carolina. Job Description & Requirements...  ...identities or who are members of other marginalized communities. Bayada Job ID #7820205002_rxr-1. Posted job title:...