Technology Consulting - Data Engineering

Share job

Date posted

Jul 31, 2024

Job number

1746187

Work site

Up to 50% work from home

Travel

0-25 %

Role type

Individual Contributor

Profession

Consulting Services

Discipline

Technology Consulting

Employment type

Full-Time

Microsoft Industry Solution - India Global Delivery Center (IGDC) delivers end-to-end solutions by enabling accelerated adoption and productive use of Microsoft technologies. An organization of well over 2000+ exceptional people, IGDC presents a great opportunity for highly skilled services professionals to make a foray into consulting, solution development and delivery roles. The ideal consultant is passionate for technology, has the breadth rather than specific product depth, and has the drive and courage to articulate and stand up for a
great solution delivering true value for the client.

As a Microsoft consultant, you will deliver quality engagements with your expertise, either as an advisor, reviewer, contributor, or resource in high profile projects to ensure customer value. The ideal candidate must have the ability to combine their technical skills, leadership skills, creativity, and customer focus to deliver great
solutions to the customers and ensure they get the best out of our technologies and solutions. Consulting Delivery professionals bring subject matter and solution expertise to architectural teams, customers, and partners. They apply deep technical and business knowledge to accelerate the adoption of Microsoft devices and services by ensuring strategic, architectural, and operational alignment to customer and partner objectives.

• Works as Individual contributor the engineering team and provides accurate time estimates, sets work priorities, and makes project changes and trade-offs necessary for a successful release.
• Applies technical experience and industry-specific knowledge to develop solutions, based on an analysis of how the proposed approach affects the business objectives of customers and partners.
• Works to accelerate the value proposition of customer or partner engagements by helping to design, develop, and deploy solutions, based on Microsoft technologies and methodologies.
• Applies information-compliance and assurance policies to ensure stakeholder confidence.
• Responsible for the overall efficacy and quality of a project team’s technical delivery within his or her engagements.
• Defines dependencies and risks that go beyond the immediate scope and timeframe for a complex project. Develops contingency plans, risk-mitigation implementation criteria, and alternative strategies to manage short- and long-term risks and manages technical escalations.
• Identifies the best practice approach for a project, across a wide scope of technical issues, and develops or reuses intellectual capital with customers, world-wide, and for programs and initiatives across Microsoft.
• Drives opportunities to expand or accelerate the adoption and consumption of the cloud and Microsoft technologies.
• Drives innovation and digital transformation. Ensures the use of the existing intellectual property (IP) and improves predictability.
• Defines the technology strategy for large and complex engagements, so that customers or partners realize the full value of investment. Responsible for implementing the technology strategy.
• Drives new ways of thinking, across the division and subsidiary, to improve quality, engineering productivity, and responsiveness to feedback and changing priorities.

Areas of Expertise

• 6+ years of Data Engineering experience
• Must-have skills:

• 6+ Experience in designing and driving Data Warehouse solutions (ex: Azure Synapse Analytics, Snowflake, Teradata) and building analytical solutions.
• Strong Experience in large database solutions, on premises, cloud, and hybrid implementations
• Strong experience in Data Engineering:

• One or more technologies in Big Data stack: Spark, Spark Streaming, Databricks, Kafka, Hadoop, Hive, HDInsight, Hbase, Oozie
• Lambda/Kappa architecture, Time series data
• Azure Stream Analytics, Azure Analysis Service, Must have experience in one or more relational DBMS (Microsoft SQL, Azure Synapse and/or Oracle, Teradata, Netezza)
• Ability to design and drive large Data Migrations using necessary ETL technologies with one or more technologies: ADF, SSIS, Talend, Pentaho, Informatica.
• Drive multi-tenant database designs, security hardening of the data platform.
• Expertise in implementation of Data governance practices using either open source or proprietary tools.
• Expertise in Data Ops

• Database Stack: Strong database experience with OLTP/OLAP, data storage mechanism and architecture with any one or more of the following technologies:

• Columnar (RedShift or Vertica)
• Anyone or more of these OSS (MySQL, PostgreSQL and MariaDB)
• Anyone or more of CosmosDB technologies (MongoDB, Redis, Cassandra - key-value stores, Graph databases, RDF triple stores)

• Familiarity with the technology stack available in the industry for metadata management: Data Quality, MDM, Lineage, Data Catalogue, Data Mesh and Data Modelling.

• Strong experience of full application life cycle design tools and methodologies

• Good experience in Agile Methodology & Expertise in Azure DevOps and Setting examples for good engineering practices and coding along the way through automation where possible.
• Industry experience in one or more of the following industries: automotive, energy, travel and transportation, financial services, government, health, manufacturing, media & communications, or retail/supply chain.