Job Duties and Responsibilities:

• Design, build, and maintain scalable and efficient data pipelines using Azure-native services and Databricks.
• Integrate and transform structured and semi-structured data from various source systems into Snowflake.
• Implement data quality, governance, and cataloging standards in line with organizational data architecture.
• Collaborate closely with business analysts, power users, and executive stakeholders to understand reporting and analytics needs.
• Develop reusable data models and datasets optimized for interactive dashboards and executive level reporting.
• Work with BI teams to deliver end-to-end data visualization solutions in Tableau & Power BI.
• Participate in daily stand-ups, sprint planning, and review meetings to provide updates and support delivery timelines.
• Proactively identify and resolve data-related technical issues or inconsistencies.

Work experience / Technologies required for the position:

• Experience building and optimizing Big Data, Data pipelines, architectures and data sets.
• Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
• Strong analytic skills related to working with unstructured datasets.
• Build processes supporting data transformation, data structures, meta data, dependency and workload management.
• A successful history of manipulating, processing and extracting value from large disconnected data sets.
• Working knowledge of message queuing, stream processing, and highly scalable Big Data, data stores.
• Expertise in translating the existing procedures, packages into business documents and migrating them into the latest tech stack.
• Experience supporting and working with cross-functional teams in a dynamic environment.
• Experience with relational SQL and NoSQL databases, including AzureSQL and Snowflake.
• Experience with Azure cloud services: ADLS, AzureSynapse, Azure Databricks, Delta Lake.
• Experience with stream-processing systems: Spark-Streaming, etc.
• Experience with object-oriented/object function scripting languages: Python, TensorFlow, PyTorch, NLTK, NumPy, Java, C++, Scala, etc.

Skills and Technologies:

• Azure Data Factory, Azure Data Lake, Azure Synapse (optional).
• Databricks (Spark, Python/SQL/Scala).
• Snowflake (data modeling, security, performance tuning).
• Tableau, Power BI, or other enterprise-grade BI tools.
• Git, CI/CD pipelines for data solutions (nice to have).
• Strong SQL and data wrangling skills.