Job ID-247084

  • 2 days ago
  • Job Applicants : 3

Azure Databricks Lead

Databricks

Experience 6-9 Years

Chennai/Mumbai/Bangalore/Pune, Multicity, India

Apply Now

HIR ING

Job Skills

Cloud–Databricks, Databricks, BI/BA

Description

Responsibilities: 
  • Design, Implementing Data Ingestion and Data lakes-based solutions using Big Data Technologies. 
  • The Tech Lead should be highly proficient in the use of Big Data, Open-Source Technologies, standard techniques of Data Integration and Data Manipulation. 
  • Should be able to design and develop cost-efficient and performant data pipelines in the cloud platform. 
  • Create a data environment to support our data analytics, reporting and data science teams. 
  • Experience with integration of data from multiple data sources. 
  • Must work on various data pipeline techniques and frameworks. 
  • Need to monitor the complete process and apply necessary infrastructure changes to speed up the query execution. 
  • Discover patterns in data sets with data mining techniques using different data ingestion APIs and injecting data into the data lake as needed. 


The Role offers: 
  • Great opportunity to learn various tools and technologies used in a sophisticated data architecture within the Business Intelligence and Analytics Data Services. 
  • Gives an opportunity to showcase the candidate's strong analytical skills and problem-solving ability. 
  • An outstanding opportunity to re-imagine, redesign and apply technology to add value to the business and operations. 
  • Gives an opportunity to grow into a Technical architect role over a period. 

 
Essential Skills: 
  • 4+ Years of hands-on knowledge of SQL and NoSQL databases. 
  • Must have knowledge in Databricks with Pyspark, Python and ADF.
  • Working knowledge and experience in Big data services in one of the Cloud Providers will be good (AWS, Azure or GCP).  
  • 4+ years of experience with detailed knowledge of data warehouse technical architectures, ETL, ELT, reporting and analytic tools.
  • 4+ years of work experience with a very large data warehousing environment.
  • 4+ years of work experience in Databricks, Pyspark and Python project development work.
  • Expertise in Big data ecosystems like HDFS and Spark.   
  • Strong hands-on experience in Python or Scala.
  • Hands-on experience in Azure Data Factory.
  • Must have experience in converting the SQL stored procedures to Python code in the PySpark framework using Dataframes.    
  • Design and develop SQL Server stored procedures, functions, views and triggers to be used during the ETL process.   
  • Development of Stored Procedures for transformations in the ETL pipeline.   
  • Should have work experience in Agile projects.   
  • Expertise in the documentation of the ETL processes via process flow diagrams.   
  • Collaborate with business users. Support team members and other developers throughout the organization to help everyone understand issues that affect the data warehouse.    
  • Good experience in customer interaction is required.    
  • Proficient in programming languages such as Python, PySpark, Scala and Java. 
  • Working knowledge of XML, ETL, API and Web Services. 
  • Experience with integration of data from multiple data sources. 
  • Experience with NoSQL databases such as HBase, Cassandra and MongoDB. 
  • Knowledge of various ETL techniques and frameworks such as Flume. 
  • Experience with various messaging systems such as Kafka or RabbitMQ. 
  • Experience with building stream-processing systems using solutions such as Storm or Spark-Streaming. 


Essential Qualification: 
  • BE/BTech in Computer Science, Engineering or relevant field. 

 

 

Why you should join Hexaware’s Big Data community Practice

360 Degree Career Growth – Opportunity to work in Delivery, Presales, Solutioning, Competency Management etc.​

Know More

Delivery Locations Across the World India - Noida, Mumbai, Chennai, Pune, & Bengaluru Global - Atlanta, Mexico, Romania, New Jersey, Virginia, Boston,Sweden, London, Amsterdam​

Know More

Constant Guidance: Get help from Senior technical consultants

Know More

Free & Continuous BI tools and cloud platform (AWS, Azure, GCP etc) Trainings & Certifications

Know More

24*7*365 Access to Cloud Labs

Know More

3X growth for BI&A at Hexaware in the past 4 years​

Know More
equal opportunity employer

Hexaware is an equal opportunity employer, and makes hiring decisions on the basis of merit and business needs.

Hexaware complies with applicable federal, state, and local laws governing nondiscrimination in employment at every facility and location. Hexaware does not unlawfully discriminate on the basis of race, color, religion, sex (which includes sexual harassment, gender harassment and harassment based on pregnancy, childbirth, or related medical conditions), sexual orientation, creed, citizenship, marital status, age, national origin, ancestry, disability, veteran status, or any other characteristics protected by applicable laws. In addition, the Company prohibits the harassment of any individual on any basis. 


Reasonable accommodation will be made to the physical and mental limitations of qualified applicants, within the constraints imposed by business necessity and reasonable financial costs.


For any reasonable accommodation request or challenges in filling up the job application, please reach-out to careersupport@hexaware.com

Apply for
Azure Databricks Lead

APPLY NOW

01

My Information

02

My Skills

03

My Experience

04

Review

Accepted file types: DOC, DOCX, PDF, TXT Max file size: 5MB

Our Employee Value Proposition

At Hexaware, you are encouraged to challenge yourself to achieve your potential and propel your growth.

We trust and empower you to disrupt the status quo and innovate for a better future. You will experience an open and inspiring culture that fosters learning and brings talented, passionate, and caring people together

Our Purpose Statement

Creating Smiles through great people and technology

Hexaware Wins 3 Awards at the Brandon Hall Group Awards 2022